Nov 04 10:04:39 devstack cinder-volume[75989]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Nov 04 10:04:39 devstack cinder-volume[75989]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 04 10:04:39 devstack cinder-volume[75989]: we strongly recommend against using it for new projects. Nov 04 10:04:39 devstack cinder-volume[75989]: If you are already using Eventlet, we recommend migrating to a different Nov 04 10:04:39 devstack cinder-volume[75989]: framework. For more detail see Nov 04 10:04:39 devstack cinder-volume[75989]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 04 10:04:39 devstack cinder-volume[75989]: import eventlet # noqa Nov 04 10:04:41 devstack cinder-volume[75989]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75989) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 04 10:04:41 devstack cinder-volume[75989]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75989) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 04 10:04:41 devstack cinder-volume[75989]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75989) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 04 10:04:42 devstack cinder-volume[75989]: INFO dbcounter [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] Registered counter for database cinder Nov 04 10:04:42 devstack cinder-volume[75989]: DEBUG oslo_db.sqlalchemy.engines [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75989) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 04 10:04:43 devstack cinder-volume[75989]: DEBUG dbcounter [-] [75989] Writer thread running {{(pid=75989) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 04 10:04:43 devstack cinder-volume[75989]: INFO cinder.rpc [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Nov 04 10:04:43 devstack cinder-volume[75989]: INFO cinder.rpc [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Nov 04 10:04:43 devstack cinder-volume[75989]: DEBUG oslo_db.sqlalchemy.engines [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75989) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 04 10:04:43 devstack cinder-volume[75989]: INFO cinder.volume.manager [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] Determined volume DB was empty at startup. Nov 04 10:04:43 devstack cinder-volume[75989]: DEBUG cinder.volume.manager [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75989) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Nov 04 10:04:43 devstack cinder-volume[75989]: INFO cinder.volume.manager [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] Service not found for updating active_backend_id, assuming default for driver init. Nov 04 10:04:43 devstack cinder-volume[75989]: WARNING stevedore.named [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 04 10:04:43 devstack cinder-volume[75989]: WARNING castellan.key_manager [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 04 10:04:43 devstack cinder-volume[75989]: WARNING cinder.keymgr.conf_key_mgr [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 04 10:04:43 devstack cinder-volume[75989]: DEBUG cinder.volume.drivers.lvm [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75989) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Nov 04 10:04:43 devstack cinder-volume[75989]: DEBUG oslo_concurrency.processutils [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75989) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:04:43 devstack cinder-volume[75989]: DEBUG oslo_concurrency.processutils [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] CMD "cinder-rtstool verify" returned: 0 in 0.450s {{(pid=75989) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:04:43 devstack cinder-volume[75989]: DEBUG oslo_db.sqlalchemy.engines [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75989) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 04 10:04:43 devstack cinder-volume[75989]: INFO cinder.rpc [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Nov 04 10:04:43 devstack cinder-volume[75989]: INFO cinder.rpc [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Nov 04 10:04:43 devstack cinder-volume[75989]: WARNING stevedore.named [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 04 10:04:43 devstack cinder-volume[75989]: WARNING castellan.key_manager [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 04 10:04:43 devstack cinder-volume[75989]: INFO cinder.volume.manager [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Nov 04 10:04:43 devstack cinder-volume[75989]: DEBUG oslo_db.sqlalchemy.engines [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75989) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 04 10:04:44 devstack cinder-volume[75989]: INFO oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] Starting 1 workers Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] Started child 76145 {{(pid=75989) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] Full set of CONF: {{(pid=75989) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] ******************************************************************************** {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] Configuration options gathered from: {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] ================================================================================ {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] allow_availability_zone_fallback = False {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] allow_compression_on_image_upload = False {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] allowed_direct_url_schemes = [] {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] api_rate_limit = True {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] auth_strategy = keystone {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] az_cache_duration = 3600 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] backend_availability_zone = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] backend_host = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] backend_name = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] backend_stats_polling_interval = 60 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] backup_api_class = cinder.backup.api.API {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] backup_name_template = backup-%s {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] backup_use_same_host = False {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] backup_use_temp_snapshot = False {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] chap_password = **** {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] chap_username = {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] cinder_internal_tenant_project_id = a85b313ab0e944f99d892b171ef94c6d {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] cinder_internal_tenant_user_id = 80fa15addae64e0d8d4ebc40243ac754 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] cloned_volume_same_az = True {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] cluster = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] compression_format = gzip {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] compute_api_class = cinder.compute.nova.API {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] config_dir = [] {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:04:44 devstack cinder-volume[76145]: INFO cinder.service [-] Starting cinder-volume node (version 29.0.1) Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] config_source = [] {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] control_exchange = openstack {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] debug = True {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] default_availability_zone = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] default_group_type = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] default_volume_type = lvmdriver-1 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] disk_geometry = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] driver_client_cert = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] driver_client_cert_key = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] driver_data_namespace = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] driver_ssl_cert_path = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] driver_ssl_cert_verify = False {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] driver_use_ssl = False {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] enable_force_upload = False {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] enable_new_services = True {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] enable_unsupported_driver = False {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] enabled_backends = ['lvmdriver-1'] {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] enforce_multipath_for_image_xfer = False {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] filter_function = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] glance_api_insecure = False {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] glance_api_servers = ['http://192.168.122.176/image'] {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] glance_api_ssl_compression = False {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] glance_ca_certificates_file = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] glance_catalog_info = image:glance:publicURL {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] glance_certfile = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] glance_keyfile = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] glance_num_retries = 3 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] glance_request_timeout = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] goodness_function = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] graceful_shutdown_timeout = 5 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] group_api_class = cinder.group.api.API {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] host = devstack {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] image_compress_on_upload = True {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] image_conversion_address_space_limit = 1 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] image_conversion_cpu_limit = 60 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] image_conversion_disable = False {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] image_introspection_address_space_limit = 1 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] image_introspection_cpu_limit = 60 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] image_upload_use_cinder_backend = False {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] image_upload_use_internal_tenant = False {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] image_volume_cache_enabled = False {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] image_volume_cache_max_count = 0 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] image_volume_cache_max_size_gb = 0 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] init_host_max_objects_retrieval = 0 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] instance_format = [instance: %(uuid)s] {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] iscsi_target_flags = {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] iscsi_write_cache = on {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] iser_helper = tgtadm {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] iser_ip_address = 192.168.122.176 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] iser_port = 3260 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] log_color = False {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] log_config_append = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] log_dir = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] log_file = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] log_options = True {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] log_rotate_interval = 1 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] log_rotate_interval_type = days {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] log_rotation_type = none {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] max_age = 0 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] max_logfile_count = 30 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] max_logfile_size_mb = 200 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] max_over_subscription_ratio = 20.0 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] message_reap_interval = 86400 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] message_ttl = 2592000 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] migration_create_volume_timeout_secs = 300 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] monkey_patch = False {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] monkey_patch_modules = [] {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] my_ip = 192.168.122.176 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] no_snapshot_gb_quota = False {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] num_iser_scan_tries = 3 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] num_shell_tries = 3 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] num_volume_device_scan_tries = 3 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] nvmeof_conn_info_version = 1 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] nvmet_ns_id = 10 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] nvmet_port_id = 1 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] osapi_max_limit = 1000 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] osapi_volume_ext_list = [] {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] osapi_volume_listen = 0.0.0.0 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] osapi_volume_listen_port = 8776 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] osapi_volume_use_ssl = False {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] osapi_volume_workers = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] per_volume_size_limit = -1 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] periodic_fuzzy_delay = 60 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] periodic_interval = 60 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] project_id_regex = [0-9a-f\-]+ {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] public_endpoint = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] publish_errors = False {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] quota_backup_gigabytes = 1000 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] quota_backups = 10 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] quota_gigabytes = 1000 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] quota_groups = 10 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] quota_snapshots = 10 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] quota_volumes = 10 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] rate_limit_burst = 0 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] rate_limit_except_level = CRITICAL {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] rate_limit_interval = 0 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] reinit_driver_count = 3 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] replication_device = **** {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] report_discard_supported = False {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] report_interval = 120 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] reservation_clean_interval = 86400 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] reservation_expire = 86400 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] reserved_image_namespaces = [] {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] reserved_percentage = 0 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] rpc_response_timeout = 120 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] run_external_periodic_tasks = True {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] scst_target_driver = iscsi {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] scst_target_iqn_name = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] service_down_time = 720 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] shell_completion = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] snapshot_name_template = snapshot-%s {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] snapshot_same_host = True {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] split_loggers = False {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] state_path = /opt/stack/data/cinder {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] storage_availability_zone = nova {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] storage_protocol = iSCSI {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] syslog_log_facility = LOG_USER {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] target_helper = lioadm {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] target_ip_address = 192.168.122.176 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] target_port = 3260 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] target_protocol = iscsi {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] target_secondary_ip_addresses = [] {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] trace_flags = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] transfer_api_class = cinder.transfer.api.API {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] transport_url = **** {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] until_refresh = 0 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] use_chap_auth = False {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] use_default_quota_class = True {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] use_journal = False {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] use_json = False {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] use_multipath_for_image_xfer = False {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] use_stderr = False {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] use_syslog = False {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] verify_glance_signatures = enabled {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] volume_api_class = cinder.volume.api.API {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] volume_backend_name = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] volume_clear = zero {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] volume_clear_ionice = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] volume_clear_size = 0 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] volume_copy_bps_limit = 0 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] volume_dd_blocksize = 1M {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] volume_name_template = volume-%s {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] volume_service_inithost_offload = False {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] volume_usage_audit_period = month {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] zoning_mode = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] oslo_concurrency.disable_process_locking = False {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] keystone_authtoken.auth_section = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] keystone_authtoken.auth_type = password {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] keystone_authtoken.auth_version = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] keystone_authtoken.cache = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] keystone_authtoken.certfile = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] keystone_authtoken.delay_auth_decision = False {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] keystone_authtoken.http_connect_timeout = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] keystone_authtoken.include_service_catalog = True {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] keystone_authtoken.insecure = False {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] keystone_authtoken.interface = public {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] keystone_authtoken.keyfile = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] keystone_authtoken.memcache_password = **** {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[76145]: INFO cinder.volume.manager [None req-6239a86e-dd8b-4742-a6ed-7f0ec06e340f None None] Starting volume driver LVMVolumeDriver (3.0.0) Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-6239a86e-dd8b-4742-a6ed-7f0ec06e340f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] keystone_authtoken.memcache_username = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] keystone_authtoken.region_name = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] keystone_authtoken.service_token_roles_required = True {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] keystone_authtoken.service_type = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] keystone_authtoken.token_cache_time = 300 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.176/identity {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] cache.backend = dogpile.cache.null {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] cache.backend_argument = **** {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] cache.backend_expiration_time = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] cache.config_prefix = cache.oslo {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] cache.debug_cache_backend = False {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] cache.enable_retry_client = False {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] cache.enable_socket_keepalive = False {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] cache.enabled = False {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] cache.expiration_time = 600 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] cache.hashclient_retry_attempts = 2 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] cache.memcache_dead_retry = 300 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] cache.memcache_pool_maxsize = 10 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] cache.memcache_sasl_enabled = False {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] cache.password = **** {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] cache.proxies = [] {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] cache.redis_db = 0 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] cache.redis_sentinel_service_name = mymaster {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] cache.redis_server = localhost:6379 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] cache.retry_attempts = 2 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] cache.retry_delay = 0.0 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] cache.socket_keepalive_count = 1 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] cache.socket_keepalive_idle = 1 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] cache.socket_keepalive_interval = 1 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] cache.socket_timeout = 1.0 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] cache.tls_allowed_ciphers = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] cache.tls_cafile = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] cache.tls_certfile = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] cache.tls_enabled = False {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] cache.tls_keyfile = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] cache.username = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] coordination.backend_url = **** {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] database.asyncio_connection = **** {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] database.asyncio_slave_connection = **** {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] database.backend = sqlalchemy {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] database.connection = **** {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] database.connection_debug = 0 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] database.connection_parameters = {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] database.connection_recycle_time = 3600 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] database.connection_trace = False {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] database.db_inc_retry_interval = True {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] database.db_max_retries = 20 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] database.db_max_retry_interval = 10 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] database.db_retry_interval = 1 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] database.max_overflow = 50 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] database.max_pool_size = 5 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] database.max_retries = 10 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] database.mysql_wsrep_sync_wait = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] database.pool_timeout = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] database.retry_interval = 10 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] database.slave_connection = **** {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] database.sqlite_synchronous = True {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] database.synchronous_reader = True {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] database.use_db_reconnect = False {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] oslo_messaging_tracing.insecure = False {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] profiler.connection_string = messaging:// {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] profiler.enabled = False {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] profiler.es_doc_type = notification {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] profiler.es_scroll_size = 10000 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] profiler.es_scroll_time = 2m {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] profiler.filter_error_trace = False {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] profiler.hmac_keys = **** {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] profiler.sentinel_service_name = mymaster {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] profiler.socket_timeout = 0.1 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] profiler.trace_requests = False {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] profiler.trace_sqlalchemy = False {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] profiler_jaeger.process_tags = {} {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] profiler_jaeger.service_name_prefix = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] profiler_otlp.service_name_prefix = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] oslo_policy.enforce_new_defaults = True {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] oslo_policy.policy_default_rule = default {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] oslo_policy.policy_file = policy.yaml {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] oslo_policy.remote_timeout = 60.0 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] privsep_osbrick.group = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] privsep_osbrick.helper_command = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] privsep_osbrick.user = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] cinder_sys_admin.group = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] cinder_sys_admin.helper_command = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] cinder_sys_admin.user = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] service_user.auth_section = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] service_user.auth_type = password {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] service_user.cafile = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] service_user.certfile = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] service_user.collect_timing = False {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] service_user.insecure = False {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] service_user.keyfile = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] service_user.send_service_user_token = True {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] service_user.split_loggers = False {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] service_user.timeout = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] service_user.tls_ciphers = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] service_user.tls_min_version = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] glance.auth_section = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] glance.auth_type = password {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] glance.certfile = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] glance.collect_timing = False {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] glance.insecure = False {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] glance.keyfile = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] glance.region_name = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] glance.split_loggers = False {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] glance.timeout = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] glance.tls_ciphers = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] glance.tls_min_version = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] backend_defaults.backend_availability_zone = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] backend_defaults.chap_password = **** {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] backend_defaults.chap_username = {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] backend_defaults.disk_geometry = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] backend_defaults.driver_client_cert = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] backend_defaults.driver_client_cert_key = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] backend_defaults.driver_data_namespace = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] backend_defaults.driver_use_ssl = False {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] backend_defaults.enable_unsupported_driver = False {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] backend_defaults.extra_capabilities = {} {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] backend_defaults.filter_function = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] backend_defaults.goodness_function = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] backend_defaults.iscsi_target_flags = {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] backend_defaults.iscsi_write_cache = on {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] backend_defaults.iser_helper = tgtadm {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] backend_defaults.iser_ip_address = 192.168.122.176 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] backend_defaults.iser_port = 3260 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] backend_defaults.lvm_mirrors = 0 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] backend_defaults.lvm_share_target = False {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] backend_defaults.lvm_type = auto {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] backend_defaults.num_shell_tries = 3 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] backend_defaults.nvmet_port_id = 1 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] backend_defaults.replication_device = **** {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] backend_defaults.report_discard_supported = False {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] backend_defaults.reserved_percentage = 0 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] backend_defaults.scst_target_driver = iscsi {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] backend_defaults.scst_target_iqn_name = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] backend_defaults.storage_protocol = iSCSI {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] backend_defaults.target_helper = tgtadm {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] backend_defaults.target_ip_address = 192.168.122.176 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] backend_defaults.target_port = 3260 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] backend_defaults.target_protocol = iscsi {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] backend_defaults.trace_flags = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] backend_defaults.unique_fqdn_network = True {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] backend_defaults.use_chap_auth = False {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] backend_defaults.volume_backend_name = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] backend_defaults.volume_clear = zero {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] backend_defaults.volume_clear_ionice = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] backend_defaults.volume_clear_size = 0 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-6239a86e-dd8b-4742-a6ed-7f0ec06e340f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.086s {{(pid=76145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] backend_defaults.volume_group = cinder-volumes {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] oslo_reports.file_event_handler = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] oslo_reports.log_dir = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] lvmdriver-1.backend_availability_zone = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] lvmdriver-1.backend_host = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-6239a86e-dd8b-4742-a6ed-7f0ec06e340f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] lvmdriver-1.chap_password = **** {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] lvmdriver-1.chap_username = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] lvmdriver-1.chiscsi_conf = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] lvmdriver-1.disk_geometry = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] lvmdriver-1.driver_client_cert = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] lvmdriver-1.driver_data_namespace = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] lvmdriver-1.driver_use_ssl = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] lvmdriver-1.extra_capabilities = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] lvmdriver-1.filter_function = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] lvmdriver-1.goodness_function = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] lvmdriver-1.iser_helper = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] lvmdriver-1.iser_ip_address = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] lvmdriver-1.iser_port = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] lvmdriver-1.iser_target_prefix = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] lvmdriver-1.lvm_conf_file = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] lvmdriver-1.lvm_mirrors = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] lvmdriver-1.lvm_share_target = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] lvmdriver-1.lvm_type = auto {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] lvmdriver-1.num_shell_tries = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] lvmdriver-1.nvmet_port_id = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] lvmdriver-1.replication_device = **** {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] lvmdriver-1.report_discard_supported = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] lvmdriver-1.reserved_percentage = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] lvmdriver-1.scst_target_driver = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] lvmdriver-1.storage_protocol = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] lvmdriver-1.target_helper = lioadm {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] lvmdriver-1.target_ip_address = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] lvmdriver-1.target_port = 3260 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] lvmdriver-1.target_protocol = iscsi {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] lvmdriver-1.trace_flags = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] lvmdriver-1.use_chap_auth = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] lvmdriver-1.volume_clear = zero {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] lvmdriver-1.volume_clear_size = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] lvmdriver-1.volumes_dir = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] oslo_messaging_rabbit.ssl = False {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] oslo_messaging_rabbit.ssl_version = {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] oslo_messaging_notifications.driver = [] {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] oslo_messaging_notifications.retry = -1 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] key_manager.fixed_key = **** {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] barbican.barbican_api_version = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] barbican.barbican_endpoint = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] barbican.barbican_endpoint_type = public {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] barbican.barbican_region_name = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] barbican.cafile = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] barbican.certfile = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] barbican.collect_timing = False {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] barbican.insecure = False {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] barbican.keyfile = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] barbican.number_of_retries = 60 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] barbican.retry_delay = 1 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] barbican.send_service_user_token = False {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] barbican.split_loggers = False {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] barbican.timeout = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] barbican.tls_ciphers = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] barbican.tls_min_version = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] barbican.verify_ssl = True {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] barbican.verify_ssl_path = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] barbican_service_user.auth_section = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] barbican_service_user.auth_type = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] barbican_service_user.cafile = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] barbican_service_user.certfile = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] barbican_service_user.collect_timing = False {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] barbican_service_user.insecure = False {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] barbican_service_user.keyfile = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] barbican_service_user.split_loggers = False {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-6239a86e-dd8b-4742-a6ed-7f0ec06e340f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.058s {{(pid=76145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] barbican_service_user.timeout = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] barbican_service_user.tls_ciphers = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-6239a86e-dd8b-4742-a6ed-7f0ec06e340f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] barbican_service_user.tls_min_version = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] vault.approle_role_id = **** {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] vault.approle_secret_id = **** {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] vault.auth_method = approle {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] vault.auth_path = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] vault.kv_mountpoint = secret {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] vault.kv_path = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] vault.kv_version = 2 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] vault.namespace = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] vault.root_token_id = **** {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] vault.ssl_ca_crt_file = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] vault.timeout = 60.0 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] vault.token_file = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] vault.token_role = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] vault.use_ssl = False {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:04:44 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] ******************************************************************************** {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Nov 04 10:04:44 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-6239a86e-dd8b-4742-a6ed-7f0ec06e340f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.044s {{(pid=76145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:04:44 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-6239a86e-dd8b-4742-a6ed-7f0ec06e340f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:04:44 devstack sudo[76153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Nov 04 10:04:44 devstack sudo[76153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:04:44 devstack sudo[76153]: pam_unix(sudo:session): session closed for user root Nov 04 10:04:44 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-6239a86e-dd8b-4742-a6ed-7f0ec06e340f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.341s {{(pid=76145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:04:44 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-6239a86e-dd8b-4742-a6ed-7f0ec06e340f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:04:44 devstack sudo[76169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 04 10:04:44 devstack sudo[76169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:04:44 devstack sudo[76169]: pam_unix(sudo:session): session closed for user root Nov 04 10:04:44 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-6239a86e-dd8b-4742-a6ed-7f0ec06e340f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.293s {{(pid=76145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:04:44 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-6239a86e-dd8b-4742-a6ed-7f0ec06e340f None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 04 10:04:44 devstack cinder-volume[76145]: INFO cinder.brick.local_dev.lvm [None req-6239a86e-dd8b-4742-a6ed-7f0ec06e340f None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Nov 04 10:04:44 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-6239a86e-dd8b-4742-a6ed-7f0ec06e340f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:04:44 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-6239a86e-dd8b-4742-a6ed-7f0ec06e340f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=76145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:04:44 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-6239a86e-dd8b-4742-a6ed-7f0ec06e340f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:04:45 devstack sudo[76309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 04 10:04:45 devstack sudo[76309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:04:45 devstack sudo[76309]: pam_unix(sudo:session): session closed for user root Nov 04 10:04:45 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-6239a86e-dd8b-4742-a6ed-7f0ec06e340f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.256s {{(pid=76145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:04:45 devstack cinder-volume[76145]: DEBUG cinder.brick.local_dev.lvm [None req-6239a86e-dd8b-4742-a6ed-7f0ec06e340f None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76145) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Nov 04 10:04:45 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-6239a86e-dd8b-4742-a6ed-7f0ec06e340f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:04:45 devstack sudo[76386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 04 10:04:45 devstack sudo[76386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:04:45 devstack sudo[76386]: pam_unix(sudo:session): session closed for user root Nov 04 10:04:45 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-6239a86e-dd8b-4742-a6ed-7f0ec06e340f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.507s {{(pid=76145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:04:45 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-6239a86e-dd8b-4742-a6ed-7f0ec06e340f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:04:45 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-6239a86e-dd8b-4742-a6ed-7f0ec06e340f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=76145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:04:45 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-6239a86e-dd8b-4742-a6ed-7f0ec06e340f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:04:45 devstack sudo[76574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 04 10:04:45 devstack sudo[76574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:04:46 devstack sudo[76574]: pam_unix(sudo:session): session closed for user root Nov 04 10:04:46 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-6239a86e-dd8b-4742-a6ed-7f0ec06e340f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.274s {{(pid=76145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:04:46 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-6239a86e-dd8b-4742-a6ed-7f0ec06e340f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:04:46 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-6239a86e-dd8b-4742-a6ed-7f0ec06e340f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=76145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:04:46 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-6239a86e-dd8b-4742-a6ed-7f0ec06e340f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:04:46 devstack sudo[76668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Nov 04 10:04:46 devstack sudo[76668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:04:46 devstack sudo[76668]: pam_unix(sudo:session): session closed for user root Nov 04 10:04:46 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-6239a86e-dd8b-4742-a6ed-7f0ec06e340f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.296s {{(pid=76145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:04:46 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-6239a86e-dd8b-4742-a6ed-7f0ec06e340f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:04:46 devstack sudo[76771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 04 10:04:46 devstack sudo[76771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:04:46 devstack sudo[76771]: pam_unix(sudo:session): session closed for user root Nov 04 10:04:46 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-6239a86e-dd8b-4742-a6ed-7f0ec06e340f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.247s {{(pid=76145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:04:46 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-6239a86e-dd8b-4742-a6ed-7f0ec06e340f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:04:46 devstack sudo[76774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 04 10:04:46 devstack sudo[76774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:04:46 devstack sudo[76774]: pam_unix(sudo:session): session closed for user root Nov 04 10:04:46 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-6239a86e-dd8b-4742-a6ed-7f0ec06e340f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.316s {{(pid=76145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:04:46 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-6239a86e-dd8b-4742-a6ed-7f0ec06e340f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:04:46 devstack sudo[76858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 04 10:04:46 devstack sudo[76858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:04:47 devstack sudo[76858]: pam_unix(sudo:session): session closed for user root Nov 04 10:04:47 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-6239a86e-dd8b-4742-a6ed-7f0ec06e340f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.270s {{(pid=76145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:04:47 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-6239a86e-dd8b-4742-a6ed-7f0ec06e340f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:04:47 devstack sudo[76862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 04 10:04:47 devstack sudo[76862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:04:47 devstack sudo[76862]: pam_unix(sudo:session): session closed for user root Nov 04 10:04:47 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-6239a86e-dd8b-4742-a6ed-7f0ec06e340f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.287s {{(pid=76145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:04:47 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-6239a86e-dd8b-4742-a6ed-7f0ec06e340f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:04:47 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-6239a86e-dd8b-4742-a6ed-7f0ec06e340f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=76145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:04:47 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-6239a86e-dd8b-4742-a6ed-7f0ec06e340f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:04:47 devstack sudo[76882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 04 10:04:47 devstack sudo[76882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:04:47 devstack sudo[76882]: pam_unix(sudo:session): session closed for user root Nov 04 10:04:47 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-6239a86e-dd8b-4742-a6ed-7f0ec06e340f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.285s {{(pid=76145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:04:47 devstack cinder-volume[76145]: INFO cinder.volume.drivers.lvm [None req-6239a86e-dd8b-4742-a6ed-7f0ec06e340f None None] Enabling LVM thin provisioning by default because a thin pool exists. Nov 04 10:04:47 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-6239a86e-dd8b-4742-a6ed-7f0ec06e340f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:04:47 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-6239a86e-dd8b-4742-a6ed-7f0ec06e340f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=76145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:04:47 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-6239a86e-dd8b-4742-a6ed-7f0ec06e340f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:04:47 devstack sudo[76962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 04 10:04:47 devstack sudo[76962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:04:48 devstack sudo[76962]: pam_unix(sudo:session): session closed for user root Nov 04 10:04:48 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-6239a86e-dd8b-4742-a6ed-7f0ec06e340f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.264s {{(pid=76145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:04:48 devstack cinder-volume[76145]: DEBUG cinder.volume.drivers.lvm [None req-6239a86e-dd8b-4742-a6ed-7f0ec06e340f None None] Updating volume stats {{(pid=76145) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 04 10:04:48 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-6239a86e-dd8b-4742-a6ed-7f0ec06e340f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:04:48 devstack sudo[76965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 04 10:04:48 devstack sudo[76965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:04:48 devstack sudo[76965]: pam_unix(sudo:session): session closed for user root Nov 04 10:04:48 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-6239a86e-dd8b-4742-a6ed-7f0ec06e340f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.268s {{(pid=76145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:04:48 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-6239a86e-dd8b-4742-a6ed-7f0ec06e340f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:04:48 devstack sudo[76968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 04 10:04:48 devstack sudo[76968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:04:48 devstack sudo[76968]: pam_unix(sudo:session): session closed for user root Nov 04 10:04:48 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-6239a86e-dd8b-4742-a6ed-7f0ec06e340f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.242s {{(pid=76145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:04:48 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-6239a86e-dd8b-4742-a6ed-7f0ec06e340f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:04:48 devstack sudo[76971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 04 10:04:48 devstack sudo[76971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:04:48 devstack sudo[76971]: pam_unix(sudo:session): session closed for user root Nov 04 10:04:48 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-6239a86e-dd8b-4742-a6ed-7f0ec06e340f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.268s {{(pid=76145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:04:48 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-6239a86e-dd8b-4742-a6ed-7f0ec06e340f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:04:48 devstack sudo[76974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 04 10:04:48 devstack sudo[76974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:04:49 devstack sudo[76974]: pam_unix(sudo:session): session closed for user root Nov 04 10:04:49 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-6239a86e-dd8b-4742-a6ed-7f0ec06e340f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.243s {{(pid=76145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:04:49 devstack cinder-volume[76145]: INFO cinder.volume.driver [None req-6239a86e-dd8b-4742-a6ed-7f0ec06e340f None None] Driver hasn't implemented _init_vendor_properties() Nov 04 10:04:49 devstack cinder-volume[76145]: DEBUG cinder.volume.driver [None req-6239a86e-dd8b-4742-a6ed-7f0ec06e340f None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76145) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Nov 04 10:04:49 devstack cinder-volume[76145]: DEBUG oslo_db.sqlalchemy.engines [None req-6239a86e-dd8b-4742-a6ed-7f0ec06e340f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76145) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 04 10:04:49 devstack cinder-volume[76145]: DEBUG dbcounter [-] [76145] Writer thread running {{(pid=76145) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 04 10:04:49 devstack cinder-volume[76145]: DEBUG cinder.db.api [None req-6239a86e-dd8b-4742-a6ed-7f0ec06e340f None None] Building query based on filter {{(pid=76145) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Nov 04 10:04:49 devstack cinder-volume[76145]: DEBUG cinder.image.image_utils [None req-6239a86e-dd8b-4742-a6ed-7f0ec06e340f None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76145) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Nov 04 10:04:49 devstack cinder-volume[76145]: INFO cinder.keymgr.migration [None req-ad96dc08-30d2-4489-a43d-84951fd07d53 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Nov 04 10:04:49 devstack cinder-volume[76145]: DEBUG cinder.volume.drivers.lvm [None req-6239a86e-dd8b-4742-a6ed-7f0ec06e340f None None] Updating volume stats {{(pid=76145) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 04 10:04:49 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-6239a86e-dd8b-4742-a6ed-7f0ec06e340f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:04:49 devstack sudo[76977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 04 10:04:49 devstack sudo[76977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:04:49 devstack sudo[76977]: pam_unix(sudo:session): session closed for user root Nov 04 10:04:49 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-6239a86e-dd8b-4742-a6ed-7f0ec06e340f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.265s {{(pid=76145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:04:49 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-6239a86e-dd8b-4742-a6ed-7f0ec06e340f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:04:49 devstack sudo[76980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 04 10:04:49 devstack sudo[76980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:04:49 devstack sudo[76980]: pam_unix(sudo:session): session closed for user root Nov 04 10:04:49 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-6239a86e-dd8b-4742-a6ed-7f0ec06e340f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=76145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:04:49 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-6239a86e-dd8b-4742-a6ed-7f0ec06e340f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:04:49 devstack sudo[76984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 04 10:04:49 devstack sudo[76984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:04:50 devstack sudo[76984]: pam_unix(sudo:session): session closed for user root Nov 04 10:04:50 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-6239a86e-dd8b-4742-a6ed-7f0ec06e340f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.263s {{(pid=76145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:04:50 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-6239a86e-dd8b-4742-a6ed-7f0ec06e340f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:04:50 devstack sudo[76989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 04 10:04:50 devstack sudo[76989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:04:50 devstack sudo[76989]: pam_unix(sudo:session): session closed for user root Nov 04 10:04:50 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-6239a86e-dd8b-4742-a6ed-7f0ec06e340f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.304s {{(pid=76145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:04:50 devstack cinder-volume[76145]: DEBUG cinder.manager [None req-6239a86e-dd8b-4742-a6ed-7f0ec06e340f None None] Notifying Schedulers of capabilities ... {{(pid=76145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:04:50 devstack cinder-volume[76145]: INFO cinder.volume.manager [None req-6239a86e-dd8b-4742-a6ed-7f0ec06e340f None None] Driver initialization completed successfully. Nov 04 10:04:50 devstack cinder-volume[76145]: INFO cinder.manager [None req-6239a86e-dd8b-4742-a6ed-7f0ec06e340f None None] Initiating service 2 cleanup Nov 04 10:04:50 devstack cinder-volume[76145]: INFO cinder.manager [None req-6239a86e-dd8b-4742-a6ed-7f0ec06e340f None None] Service 2 cleanup completed. Nov 04 10:04:50 devstack cinder-volume[76145]: DEBUG cinder.service [None req-6239a86e-dd8b-4742-a6ed-7f0ec06e340f None None] Creating RPC server for service cinder-volume {{(pid=76145) start /opt/stack/cinder/cinder/service.py:231}} Nov 04 10:04:50 devstack cinder-volume[76145]: DEBUG cinder.service [None req-6239a86e-dd8b-4742-a6ed-7f0ec06e340f None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76145) start /opt/stack/cinder/cinder/service.py:237}} Nov 04 10:04:50 devstack cinder-volume[76145]: INFO cinder.volume.manager [None req-6239a86e-dd8b-4742-a6ed-7f0ec06e340f None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Nov 04 10:04:50 devstack cinder-volume[76145]: DEBUG cinder.volume.drivers.lvm [None req-6239a86e-dd8b-4742-a6ed-7f0ec06e340f None None] Updating volume stats {{(pid=76145) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 04 10:04:50 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-6239a86e-dd8b-4742-a6ed-7f0ec06e340f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:04:50 devstack sudo[76992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 04 10:04:50 devstack sudo[76992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:04:50 devstack sudo[76992]: pam_unix(sudo:session): session closed for user root Nov 04 10:04:50 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-6239a86e-dd8b-4742-a6ed-7f0ec06e340f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.260s {{(pid=76145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:04:50 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-6239a86e-dd8b-4742-a6ed-7f0ec06e340f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:04:50 devstack sudo[76998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 04 10:04:50 devstack sudo[76998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:04:51 devstack sudo[76998]: pam_unix(sudo:session): session closed for user root Nov 04 10:04:51 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-6239a86e-dd8b-4742-a6ed-7f0ec06e340f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.258s {{(pid=76145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:04:51 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-6239a86e-dd8b-4742-a6ed-7f0ec06e340f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:04:51 devstack sudo[77003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 04 10:04:51 devstack sudo[77003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:04:51 devstack sudo[77003]: pam_unix(sudo:session): session closed for user root Nov 04 10:04:51 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-6239a86e-dd8b-4742-a6ed-7f0ec06e340f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.241s {{(pid=76145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:04:51 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-6239a86e-dd8b-4742-a6ed-7f0ec06e340f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:04:51 devstack sudo[77006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 04 10:04:51 devstack sudo[77006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:04:51 devstack sudo[77006]: pam_unix(sudo:session): session closed for user root Nov 04 10:04:51 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-6239a86e-dd8b-4742-a6ed-7f0ec06e340f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.262s {{(pid=76145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:04:51 devstack cinder-volume[76145]: INFO cinder.volume.manager [None req-6239a86e-dd8b-4742-a6ed-7f0ec06e340f None None] Driver post RPC initialization completed successfully. Nov 04 10:04:54 devstack cinder-volume[75989]: DEBUG dbcounter [-] [75989] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75989) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 10:05:01 devstack cinder-volume[76145]: DEBUG dbcounter [-] [76145] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76145) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 10:05:01 devstack cinder-volume[76145]: DEBUG dbcounter [-] [76145] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=76145) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 10:05:34 devstack cinder-volume[76145]: DEBUG oslo_service.periodic_task [None req-7c7d79d9-b931-4be1-81c4-2df990fa6c8c None None] Running periodic task VolumeManager._thread_info {{(pid=76145) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 10:05:34 devstack cinder-volume[76145]: DEBUG cinder.volume.manager [None req-7c7d79d9-b931-4be1-81c4-2df990fa6c8c None None] thread count: 6 {{(pid=76145) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 04 10:05:34 devstack cinder-volume[76145]: DEBUG cinder.volume.manager [None req-7c7d79d9-b931-4be1-81c4-2df990fa6c8c None None] thread info: [<_MainThread(MainThread, started 139525287317632)>, , , , , ] {{(pid=76145) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 04 10:06:34 devstack cinder-volume[76145]: DEBUG oslo_service.periodic_task [None req-7c7d79d9-b931-4be1-81c4-2df990fa6c8c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76145) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 10:06:34 devstack cinder-volume[76145]: DEBUG cinder.volume.drivers.lvm [None req-7c7d79d9-b931-4be1-81c4-2df990fa6c8c None None] Updating volume stats {{(pid=76145) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 04 10:06:34 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-7c7d79d9-b931-4be1-81c4-2df990fa6c8c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:06:34 devstack sudo[82129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 04 10:06:34 devstack sudo[82129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:06:34 devstack sudo[82129]: pam_unix(sudo:session): session closed for user root Nov 04 10:06:34 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-7c7d79d9-b931-4be1-81c4-2df990fa6c8c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.241s {{(pid=76145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:06:34 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-7c7d79d9-b931-4be1-81c4-2df990fa6c8c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:06:34 devstack sudo[82132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 04 10:06:34 devstack sudo[82132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:06:35 devstack sudo[82132]: pam_unix(sudo:session): session closed for user root Nov 04 10:06:35 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-7c7d79d9-b931-4be1-81c4-2df990fa6c8c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.269s {{(pid=76145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:06:35 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-7c7d79d9-b931-4be1-81c4-2df990fa6c8c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:06:35 devstack sudo[82135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 04 10:06:35 devstack sudo[82135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:06:35 devstack sudo[82135]: pam_unix(sudo:session): session closed for user root Nov 04 10:06:35 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-7c7d79d9-b931-4be1-81c4-2df990fa6c8c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.242s {{(pid=76145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:06:35 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-7c7d79d9-b931-4be1-81c4-2df990fa6c8c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:06:35 devstack sudo[82138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 04 10:06:35 devstack sudo[82138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:06:35 devstack sudo[82138]: pam_unix(sudo:session): session closed for user root Nov 04 10:06:35 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-7c7d79d9-b931-4be1-81c4-2df990fa6c8c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=76145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:06:35 devstack cinder-volume[76145]: DEBUG cinder.manager [None req-7c7d79d9-b931-4be1-81c4-2df990fa6c8c None None] Notifying Schedulers of capabilities ... {{(pid=76145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:06:35 devstack cinder-volume[76145]: DEBUG oslo_service.periodic_task [None req-7c7d79d9-b931-4be1-81c4-2df990fa6c8c None None] Running periodic task VolumeManager._thread_info {{(pid=76145) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 10:06:35 devstack cinder-volume[76145]: DEBUG cinder.volume.manager [None req-7c7d79d9-b931-4be1-81c4-2df990fa6c8c None None] thread count: 6 {{(pid=76145) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 04 10:06:35 devstack cinder-volume[76145]: DEBUG cinder.volume.manager [None req-7c7d79d9-b931-4be1-81c4-2df990fa6c8c None None] thread info: [<_MainThread(MainThread, started 139525287317632)>, , , , , ] {{(pid=76145) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 04 10:07:01 devstack cinder-volume[76145]: DEBUG dbcounter [-] [76145] Writing DB stats cinder:SELECT=1 {{(pid=76145) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 10:07:01 devstack cinder-volume[76145]: DEBUG dbcounter [-] [76145] Writing DB stats cinder:UPDATE=1 {{(pid=76145) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 10:07:34 devstack cinder-volume[76145]: DEBUG oslo_service.periodic_task [None req-7c7d79d9-b931-4be1-81c4-2df990fa6c8c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76145) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 10:07:34 devstack cinder-volume[76145]: DEBUG cinder.volume.drivers.lvm [None req-7c7d79d9-b931-4be1-81c4-2df990fa6c8c None None] Updating volume stats {{(pid=76145) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 04 10:07:34 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-7c7d79d9-b931-4be1-81c4-2df990fa6c8c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:07:34 devstack sudo[84028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 04 10:07:34 devstack sudo[84028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:07:34 devstack sudo[84028]: pam_unix(sudo:session): session closed for user root Nov 04 10:07:34 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-7c7d79d9-b931-4be1-81c4-2df990fa6c8c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.267s {{(pid=76145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:07:34 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-7c7d79d9-b931-4be1-81c4-2df990fa6c8c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:07:34 devstack sudo[84033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 04 10:07:34 devstack sudo[84033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:07:35 devstack sudo[84033]: pam_unix(sudo:session): session closed for user root Nov 04 10:07:35 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-7c7d79d9-b931-4be1-81c4-2df990fa6c8c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.250s {{(pid=76145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:07:35 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-7c7d79d9-b931-4be1-81c4-2df990fa6c8c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:07:35 devstack sudo[84036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 04 10:07:35 devstack sudo[84036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:07:35 devstack sudo[84036]: pam_unix(sudo:session): session closed for user root Nov 04 10:07:35 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-7c7d79d9-b931-4be1-81c4-2df990fa6c8c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.251s {{(pid=76145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:07:35 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-7c7d79d9-b931-4be1-81c4-2df990fa6c8c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:07:35 devstack sudo[84048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 04 10:07:35 devstack sudo[84048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:07:35 devstack sudo[84048]: pam_unix(sudo:session): session closed for user root Nov 04 10:07:35 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-7c7d79d9-b931-4be1-81c4-2df990fa6c8c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.268s {{(pid=76145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:07:35 devstack cinder-volume[76145]: DEBUG cinder.manager [None req-7c7d79d9-b931-4be1-81c4-2df990fa6c8c None None] Notifying Schedulers of capabilities ... {{(pid=76145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:07:35 devstack cinder-volume[76145]: DEBUG oslo_service.periodic_task [None req-7c7d79d9-b931-4be1-81c4-2df990fa6c8c None None] Running periodic task VolumeManager._thread_info {{(pid=76145) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 10:07:35 devstack cinder-volume[76145]: DEBUG cinder.volume.manager [None req-7c7d79d9-b931-4be1-81c4-2df990fa6c8c None None] thread count: 6 {{(pid=76145) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 04 10:07:35 devstack cinder-volume[76145]: DEBUG cinder.volume.manager [None req-7c7d79d9-b931-4be1-81c4-2df990fa6c8c None None] thread info: [<_MainThread(MainThread, started 139525287317632)>, , , , , ] {{(pid=76145) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 04 10:08:34 devstack cinder-volume[76145]: DEBUG oslo_service.periodic_task [None req-7c7d79d9-b931-4be1-81c4-2df990fa6c8c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76145) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 10:08:34 devstack cinder-volume[76145]: DEBUG cinder.volume.drivers.lvm [None req-7c7d79d9-b931-4be1-81c4-2df990fa6c8c None None] Updating volume stats {{(pid=76145) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 04 10:08:34 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-7c7d79d9-b931-4be1-81c4-2df990fa6c8c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:08:34 devstack sudo[85413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 04 10:08:34 devstack sudo[85413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:08:34 devstack sudo[85413]: pam_unix(sudo:session): session closed for user root Nov 04 10:08:34 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-7c7d79d9-b931-4be1-81c4-2df990fa6c8c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.258s {{(pid=76145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:08:34 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-7c7d79d9-b931-4be1-81c4-2df990fa6c8c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:08:34 devstack sudo[85419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 04 10:08:34 devstack sudo[85419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:08:35 devstack sudo[85419]: pam_unix(sudo:session): session closed for user root Nov 04 10:08:35 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-7c7d79d9-b931-4be1-81c4-2df990fa6c8c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.255s {{(pid=76145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:08:35 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-7c7d79d9-b931-4be1-81c4-2df990fa6c8c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:08:35 devstack sudo[85422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 04 10:08:35 devstack sudo[85422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:08:35 devstack sudo[85422]: pam_unix(sudo:session): session closed for user root Nov 04 10:08:35 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-7c7d79d9-b931-4be1-81c4-2df990fa6c8c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.258s {{(pid=76145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:08:35 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-7c7d79d9-b931-4be1-81c4-2df990fa6c8c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:08:35 devstack sudo[85426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 04 10:08:35 devstack sudo[85426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:08:35 devstack sudo[85426]: pam_unix(sudo:session): session closed for user root Nov 04 10:08:35 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-7c7d79d9-b931-4be1-81c4-2df990fa6c8c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=76145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:08:35 devstack cinder-volume[76145]: DEBUG cinder.manager [None req-7c7d79d9-b931-4be1-81c4-2df990fa6c8c None None] Notifying Schedulers of capabilities ... {{(pid=76145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:09:01 devstack cinder-volume[76145]: DEBUG dbcounter [-] [76145] Writing DB stats cinder:SELECT=1 {{(pid=76145) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 10:09:01 devstack cinder-volume[76145]: DEBUG dbcounter [-] [76145] Writing DB stats cinder:UPDATE=1 {{(pid=76145) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 10:09:11 devstack cinder-volume[75989]: INFO oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] Caught SIGTERM, stopping children Nov 04 10:09:11 devstack cinder-volume[75989]: DEBUG oslo_concurrency.lockutils [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] Acquiring lock "singleton_lock" {{(pid=75989) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 04 10:09:11 devstack cinder-volume[75989]: DEBUG oslo_concurrency.lockutils [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] Acquired lock "singleton_lock" {{(pid=75989) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 04 10:09:11 devstack cinder-volume[75989]: DEBUG oslo_concurrency.lockutils [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] Releasing lock "singleton_lock" {{(pid=75989) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 04 10:09:11 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] Stop services. {{(pid=75989) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Nov 04 10:09:11 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] Killing children. {{(pid=75989) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Nov 04 10:09:11 devstack cinder-volume[75989]: INFO oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] Waiting on 1 children to exit Nov 04 10:09:15 devstack cinder-volume[76145]: DEBUG oslo_concurrency.lockutils [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] Acquiring lock "singleton_lock" {{(pid=76145) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 04 10:09:15 devstack cinder-volume[76145]: DEBUG oslo_concurrency.lockutils [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] Acquired lock "singleton_lock" {{(pid=76145) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 04 10:09:15 devstack cinder-volume[76145]: DEBUG oslo_concurrency.lockutils [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] Releasing lock "singleton_lock" {{(pid=76145) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 04 10:09:15 devstack cinder-volume[76145]: WARNING amqp [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 04 10:09:15 devstack cinder-volume[76145]: WARNING amqp [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 04 10:09:15 devstack cinder-volume[75989]: INFO oslo_service.backend._eventlet.service [None req-e7911878-0a69-4c76-9353-f678fcecea30 None None] Child 76145 exited with status 0 Nov 04 10:09:15 devstack cinder-volume[86188]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Nov 04 10:09:15 devstack cinder-volume[86188]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 04 10:09:15 devstack cinder-volume[86188]: we strongly recommend against using it for new projects. Nov 04 10:09:15 devstack cinder-volume[86188]: If you are already using Eventlet, we recommend migrating to a different Nov 04 10:09:15 devstack cinder-volume[86188]: framework. For more detail see Nov 04 10:09:15 devstack cinder-volume[86188]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 04 10:09:15 devstack cinder-volume[86188]: import eventlet # noqa Nov 04 10:09:17 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86188) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 04 10:09:17 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86188) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 04 10:09:17 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86188) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 04 10:09:18 devstack cinder-volume[86188]: INFO dbcounter [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] Registered counter for database cinder Nov 04 10:09:18 devstack cinder-volume[86188]: DEBUG oslo_db.sqlalchemy.engines [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86188) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG dbcounter [-] [86188] Writer thread running {{(pid=86188) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 04 10:09:19 devstack cinder-volume[86188]: INFO cinder.rpc [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Nov 04 10:09:19 devstack cinder-volume[86188]: INFO cinder.rpc [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_db.sqlalchemy.engines [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86188) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 04 10:09:19 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] Determined volume DB was empty at startup. Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG cinder.volume.manager [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86188) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Nov 04 10:09:19 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] Service not found for updating active_backend_id, assuming default for driver init. Nov 04 10:09:19 devstack cinder-volume[86188]: WARNING stevedore.named [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 04 10:09:19 devstack cinder-volume[86188]: WARNING castellan.key_manager [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 04 10:09:19 devstack cinder-volume[86188]: WARNING cinder.keymgr.conf_key_mgr [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 04 10:09:19 devstack cinder-volume[86188]: INFO cinder.volume.manager [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] Image-volume cache disabled for host devstack@QuobyteHD. Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_db.sqlalchemy.engines [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86188) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 04 10:09:19 devstack cinder-volume[86188]: INFO oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] Starting 1 workers Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] Started child 86407 {{(pid=86188) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] Full set of CONF: {{(pid=86188) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] ******************************************************************************** {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] Configuration options gathered from: {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] ================================================================================ {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] allow_availability_zone_fallback = False {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] allow_compression_on_image_upload = False {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] allowed_direct_url_schemes = [] {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] api_rate_limit = True {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] auth_strategy = keystone {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] backend_availability_zone = None {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] backend_host = None {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] backend_name = None {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] backend_stats_polling_interval = 60 {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] backup_api_class = cinder.backup.api.API {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] backup_name_template = backup-%s {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] backup_use_same_host = False {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] backup_use_temp_snapshot = False {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] chap_password = **** {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] chap_username = {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] cinder_internal_tenant_project_id = a85b313ab0e944f99d892b171ef94c6d {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:19 devstack cinder-volume[86407]: INFO cinder.service [-] Starting cinder-volume node (version 29.0.1) Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] cinder_internal_tenant_user_id = 80fa15addae64e0d8d4ebc40243ac754 {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] cluster = None {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] compression_format = gzip {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] compute_api_class = cinder.compute.nova.API {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] config_dir = [] {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] config_source = [] {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] control_exchange = openstack {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] debug = True {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] default_availability_zone = None {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] default_group_type = None {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] default_volume_type = QuobyteHD {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] disk_geometry = None {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] driver_client_cert = None {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] driver_client_cert_key = None {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] driver_data_namespace = None {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] driver_ssl_cert_path = None {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] driver_ssl_cert_verify = False {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] driver_use_ssl = False {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] enable_new_services = True {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] enable_unsupported_driver = False {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] enabled_backends = ['QuobyteHD'] {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] enforce_multipath_for_image_xfer = False {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] filter_function = None {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] glance_api_insecure = False {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] glance_api_servers = ['http://192.168.122.176/image'] {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] glance_api_ssl_compression = False {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] glance_ca_certificates_file = None {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] glance_catalog_info = image:glance:publicURL {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] glance_certfile = None {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] glance_keyfile = None {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] glance_num_retries = 3 {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] glance_request_timeout = None {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] goodness_function = None {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] graceful_shutdown_timeout = 5 {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] group_api_class = cinder.group.api.API {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] host = devstack {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] image_compress_on_upload = True {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] image_conversion_address_space_limit = 1 {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] image_conversion_cpu_limit = 60 {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] image_conversion_disable = False {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] image_introspection_address_space_limit = 1 {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] image_introspection_cpu_limit = 60 {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] image_upload_use_cinder_backend = False {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] image_upload_use_internal_tenant = False {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] image_volume_cache_enabled = False {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] image_volume_cache_max_count = 0 {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] image_volume_cache_max_size_gb = 0 {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] init_host_max_objects_retrieval = 0 {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] instance_format = [instance: %(uuid)s] {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] iscsi_target_flags = {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] iscsi_write_cache = on {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] iser_helper = tgtadm {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] iser_ip_address = 192.168.122.176 {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] iser_port = 3260 {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] log_color = False {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] log_config_append = None {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] log_dir = None {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] log_file = None {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] log_options = True {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] log_rotate_interval = 1 {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] log_rotate_interval_type = days {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] log_rotation_type = none {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] max_age = 0 {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] max_logfile_count = 30 {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] max_logfile_size_mb = 200 {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:19 devstack cinder-volume[86407]: INFO cinder.volume.manager [None req-a2c9faa3-24a9-483e-ad1f-ab2faaf3b9b6 None None] Starting volume driver QuobyteDriver (1.2.1) Nov 04 10:09:19 devstack cinder-volume[86407]: DEBUG cinder.volume.drivers.remotefs [None req-a2c9faa3-24a9-483e-ad1f-ab2faaf3b9b6 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86407) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] max_over_subscription_ratio = 20.0 {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] message_reap_interval = 86400 {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] message_ttl = 2592000 {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] migration_create_volume_timeout_secs = 300 {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] monkey_patch = False {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] monkey_patch_modules = [] {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] my_ip = 192.168.122.176 {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] no_snapshot_gb_quota = False {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] num_iser_scan_tries = 3 {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] num_shell_tries = 3 {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] num_volume_device_scan_tries = 3 {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] nvmeof_conn_info_version = 1 {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] nvmet_ns_id = 10 {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] nvmet_port_id = 1 {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] osapi_max_limit = 1000 {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] osapi_volume_ext_list = [] {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] osapi_volume_listen = 0.0.0.0 {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] osapi_volume_listen_port = 8776 {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] osapi_volume_use_ssl = False {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] osapi_volume_workers = None {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] per_volume_size_limit = -1 {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] periodic_fuzzy_delay = 60 {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] periodic_interval = 60 {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] project_id_regex = [0-9a-f\-]+ {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] public_endpoint = None {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] publish_errors = False {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] quota_backup_gigabytes = 1000 {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] quota_backups = 10 {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] quota_gigabytes = 1000 {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] quota_groups = 10 {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] quota_snapshots = 10 {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] quota_volumes = 10 {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] rate_limit_burst = 0 {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] rate_limit_except_level = CRITICAL {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] rate_limit_interval = 0 {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] reinit_driver_count = 3 {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] replication_device = **** {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] report_discard_supported = False {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] report_interval = 120 {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] reservation_clean_interval = 86400 {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] reservation_expire = 86400 {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] reserved_image_namespaces = [] {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] reserved_percentage = 0 {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] rpc_response_timeout = 120 {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] run_external_periodic_tasks = True {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] scst_target_driver = iscsi {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] scst_target_iqn_name = None {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] service_down_time = 720 {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] shell_completion = None {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] snapshot_name_template = snapshot-%s {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] split_loggers = False {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] state_path = /opt/stack/data/cinder {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] storage_availability_zone = nova {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] storage_protocol = iSCSI {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] syslog_log_facility = LOG_USER {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] target_helper = lioadm {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] target_ip_address = 192.168.122.176 {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] target_port = 3260 {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] target_protocol = iscsi {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] target_secondary_ip_addresses = [] {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] trace_flags = None {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] transfer_api_class = cinder.transfer.api.API {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] transport_url = **** {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] until_refresh = 0 {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] use_chap_auth = False {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] use_default_quota_class = True {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] use_journal = False {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] use_json = False {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] use_multipath_for_image_xfer = False {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] use_stderr = False {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] use_syslog = False {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] verify_glance_signatures = enabled {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] volume_api_class = cinder.volume.api.API {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] volume_backend_name = None {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] volume_clear = zero {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] volume_clear_ionice = None {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] volume_clear_size = 0 {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] volume_copy_bps_limit = 0 {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] volume_dd_blocksize = 1M {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] volume_name_template = volume-%s {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] volume_service_inithost_offload = False {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] volume_usage_audit_period = month {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] zoning_mode = None {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] oslo_concurrency.disable_process_locking = False {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] keystone_authtoken.auth_section = None {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] keystone_authtoken.auth_type = password {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] keystone_authtoken.auth_version = None {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] keystone_authtoken.cache = None {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] keystone_authtoken.certfile = None {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] keystone_authtoken.delay_auth_decision = False {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] keystone_authtoken.http_connect_timeout = None {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] keystone_authtoken.include_service_catalog = True {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] keystone_authtoken.insecure = False {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] keystone_authtoken.interface = public {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] keystone_authtoken.keyfile = None {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] keystone_authtoken.memcache_password = **** {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] keystone_authtoken.memcache_username = None {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] keystone_authtoken.region_name = None {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] keystone_authtoken.service_token_roles_required = True {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] keystone_authtoken.service_type = None {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] keystone_authtoken.token_cache_time = 300 {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.176/identity {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] cache.backend = dogpile.cache.null {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] cache.backend_argument = **** {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] cache.backend_expiration_time = None {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] cache.config_prefix = cache.oslo {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] cache.debug_cache_backend = False {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] cache.enable_retry_client = False {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] cache.enable_socket_keepalive = False {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86407]: DEBUG cinder.volume.drivers.quobyte [None req-a2c9faa3-24a9-483e-ad1f-ab2faaf3b9b6 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86407) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Nov 04 10:09:19 devstack cinder-volume[86407]: WARNING cinder.volume.drivers.quobyte [None req-a2c9faa3-24a9-483e-ad1f-ab2faaf3b9b6 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Nov 04 10:09:19 devstack cinder-volume[86407]: WARNING cinder.volume.drivers.quobyte [None req-a2c9faa3-24a9-483e-ad1f-ab2faaf3b9b6 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Nov 04 10:09:19 devstack cinder-volume[86407]: DEBUG oslo_concurrency.processutils [None req-a2c9faa3-24a9-483e-ad1f-ab2faaf3b9b6 None None] Running cmd (subprocess): mount.quobyte {{(pid=86407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] cache.enabled = False {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] cache.expiration_time = 600 {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] cache.hashclient_retry_attempts = 2 {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] cache.memcache_dead_retry = 300 {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] cache.memcache_pool_maxsize = 10 {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] cache.memcache_sasl_enabled = False {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] cache.password = **** {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] cache.proxies = [] {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] cache.redis_db = 0 {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] cache.redis_sentinel_service_name = mymaster {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] cache.redis_server = localhost:6379 {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] cache.retry_attempts = 2 {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] cache.retry_delay = 0.0 {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] cache.socket_keepalive_count = 1 {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] cache.socket_keepalive_idle = 1 {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] cache.socket_keepalive_interval = 1 {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] cache.socket_timeout = 1.0 {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] cache.tls_allowed_ciphers = None {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] cache.tls_cafile = None {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] cache.tls_certfile = None {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] cache.tls_enabled = False {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] cache.tls_keyfile = None {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] cache.username = None {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] coordination.backend_url = **** {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] database.asyncio_connection = **** {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] database.asyncio_slave_connection = **** {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] database.backend = sqlalchemy {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] database.connection = **** {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] database.connection_debug = 0 {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] database.connection_parameters = {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] database.connection_recycle_time = 3600 {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] database.connection_trace = False {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] database.db_inc_retry_interval = True {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] database.db_max_retries = 20 {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] database.db_max_retry_interval = 10 {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] database.db_retry_interval = 1 {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] database.max_overflow = 50 {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] database.max_pool_size = 5 {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] database.max_retries = 10 {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] database.mysql_wsrep_sync_wait = None {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] database.pool_timeout = None {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] database.retry_interval = 10 {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] database.slave_connection = **** {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] database.sqlite_synchronous = True {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] database.synchronous_reader = True {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] database.use_db_reconnect = False {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] oslo_messaging_tracing.insecure = False {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] profiler.connection_string = messaging:// {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] profiler.enabled = False {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] profiler.es_doc_type = notification {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] profiler.es_scroll_size = 10000 {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] profiler.es_scroll_time = 2m {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] profiler.filter_error_trace = False {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] profiler.hmac_keys = **** {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] profiler.sentinel_service_name = mymaster {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] profiler.socket_timeout = 0.1 {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] profiler.trace_requests = False {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] profiler.trace_sqlalchemy = False {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] profiler_jaeger.process_tags = {} {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] profiler_jaeger.service_name_prefix = None {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] profiler_otlp.service_name_prefix = None {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] oslo_policy.enforce_new_defaults = True {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] oslo_policy.policy_default_rule = default {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] oslo_policy.policy_file = policy.yaml {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] oslo_policy.remote_timeout = 60.0 {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] privsep_osbrick.group = None {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] privsep_osbrick.helper_command = None {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] privsep_osbrick.user = None {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] cinder_sys_admin.group = None {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] cinder_sys_admin.helper_command = None {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] cinder_sys_admin.user = None {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] service_user.auth_section = None {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] service_user.auth_type = password {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] service_user.cafile = None {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] service_user.certfile = None {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] service_user.collect_timing = False {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] service_user.insecure = False {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] service_user.keyfile = None {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] service_user.send_service_user_token = True {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] service_user.split_loggers = False {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] service_user.timeout = None {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] service_user.tls_ciphers = None {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] service_user.tls_min_version = None {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] glance.auth_section = None {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] glance.auth_type = password {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] glance.certfile = None {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] glance.collect_timing = False {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] glance.insecure = False {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] glance.keyfile = None {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] glance.region_name = None {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] glance.split_loggers = False {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] glance.timeout = None {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] glance.tls_ciphers = None {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] glance.tls_min_version = None {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] backend_defaults.backend_availability_zone = None {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] backend_defaults.chap_password = **** {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] backend_defaults.chap_username = {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] backend_defaults.disk_geometry = None {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] backend_defaults.driver_client_cert = None {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] backend_defaults.driver_client_cert_key = None {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] backend_defaults.driver_data_namespace = None {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] backend_defaults.driver_use_ssl = False {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] backend_defaults.enable_unsupported_driver = False {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] backend_defaults.extra_capabilities = {} {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] backend_defaults.filter_function = None {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] backend_defaults.goodness_function = None {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] backend_defaults.iscsi_target_flags = {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] backend_defaults.iscsi_write_cache = on {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] backend_defaults.iser_helper = tgtadm {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] backend_defaults.iser_ip_address = 192.168.122.176 {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] backend_defaults.iser_port = 3260 {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] backend_defaults.nas_host = {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] backend_defaults.nas_login = admin {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] backend_defaults.nas_mount_options = None {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] backend_defaults.nas_password = **** {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] backend_defaults.nas_private_key = {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] backend_defaults.nas_share_path = {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] backend_defaults.nas_ssh_port = 22 {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] backend_defaults.num_shell_tries = 3 {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] backend_defaults.nvmet_port_id = 1 {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] backend_defaults.quobyte_client_cfg = None {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] backend_defaults.quobyte_volume_url = None {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] backend_defaults.replication_device = **** {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] backend_defaults.report_discard_supported = False {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] backend_defaults.reserved_percentage = 0 {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] backend_defaults.scst_target_driver = iscsi {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] backend_defaults.scst_target_iqn_name = None {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] backend_defaults.storage_protocol = iSCSI {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] backend_defaults.target_helper = tgtadm {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] backend_defaults.target_ip_address = 192.168.122.176 {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] backend_defaults.target_port = 3260 {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] backend_defaults.target_protocol = iscsi {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] backend_defaults.trace_flags = None {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] backend_defaults.unique_fqdn_network = True {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] backend_defaults.use_chap_auth = False {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] backend_defaults.volume_backend_name = None {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] backend_defaults.volume_clear = zero {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] backend_defaults.volume_clear_ionice = None {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] backend_defaults.volume_clear_size = 0 {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] oslo_reports.file_event_handler = None {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] oslo_reports.log_dir = None {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] QuobyteHD.backend_availability_zone = None {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] QuobyteHD.backend_host = None {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] QuobyteHD.chap_password = **** {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] QuobyteHD.chap_username = None {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] QuobyteHD.chiscsi_conf = None {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] QuobyteHD.disk_geometry = None {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] QuobyteHD.driver_client_cert = None {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] QuobyteHD.driver_client_cert_key = None {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] QuobyteHD.driver_data_namespace = None {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] QuobyteHD.driver_use_ssl = None {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] QuobyteHD.extra_capabilities = None {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] QuobyteHD.filter_function = None {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] QuobyteHD.goodness_function = None {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] QuobyteHD.iscsi_target_flags = None {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] QuobyteHD.iscsi_write_cache = None {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] QuobyteHD.iser_helper = None {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] QuobyteHD.iser_ip_address = None {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] QuobyteHD.iser_port = None {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] QuobyteHD.iser_target_prefix = None {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] QuobyteHD.nas_host = None {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] QuobyteHD.nas_login = None {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] QuobyteHD.nas_mount_options = None {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] QuobyteHD.nas_password = **** {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] QuobyteHD.nas_private_key = None {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] QuobyteHD.nas_share_path = None {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] QuobyteHD.nas_ssh_port = None {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] QuobyteHD.num_shell_tries = None {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] QuobyteHD.nvmet_ns_id = None {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] QuobyteHD.nvmet_port_id = None {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] QuobyteHD.replication_device = **** {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] QuobyteHD.report_discard_supported = None {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] QuobyteHD.reserved_percentage = None {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] QuobyteHD.scst_target_driver = None {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] QuobyteHD.storage_protocol = None {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] QuobyteHD.target_helper = None {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] QuobyteHD.target_ip_address = None {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] QuobyteHD.target_port = None {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] QuobyteHD.target_prefix = None {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] QuobyteHD.target_protocol = None {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] QuobyteHD.trace_flags = None {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] QuobyteHD.unique_fqdn_network = None {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] QuobyteHD.use_chap_auth = None {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] QuobyteHD.volume_clear = None {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] QuobyteHD.volume_clear_ionice = None {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] QuobyteHD.volume_clear_size = None {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] QuobyteHD.volumes_dir = None {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack quobyte-client[86408]: Reading configuration file: /etc/quobyte/client.cfg Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack quobyte-client[86408]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] oslo_messaging_rabbit.ssl = False {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] oslo_messaging_rabbit.ssl_version = {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] oslo_messaging_notifications.driver = [] {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] oslo_messaging_notifications.retry = -1 {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] oslo_messaging_notifications.transport_url = **** {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] key_manager.fixed_key = **** {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] barbican.barbican_api_version = None {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] barbican.barbican_endpoint = None {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] barbican.barbican_endpoint_type = public {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] barbican.barbican_region_name = None {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] barbican.cafile = None {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] barbican.certfile = None {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] barbican.collect_timing = False {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] barbican.insecure = False {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] barbican.keyfile = None {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] barbican.number_of_retries = 60 {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] barbican.retry_delay = 1 {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] barbican.send_service_user_token = False {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] barbican.split_loggers = False {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] barbican.timeout = None {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] barbican.tls_ciphers = None {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] barbican.tls_min_version = None {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] barbican.verify_ssl = True {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] barbican.verify_ssl_path = None {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] barbican_service_user.auth_section = None {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] barbican_service_user.auth_type = None {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] barbican_service_user.cafile = None {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] barbican_service_user.certfile = None {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] barbican_service_user.collect_timing = False {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] barbican_service_user.insecure = False {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] barbican_service_user.keyfile = None {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] barbican_service_user.split_loggers = False {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] barbican_service_user.timeout = None {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] barbican_service_user.tls_ciphers = None {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] barbican_service_user.tls_min_version = None {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] vault.approle_role_id = **** {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] vault.approle_secret_id = **** {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] vault.auth_method = approle {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] vault.auth_path = None {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] vault.kv_mountpoint = secret {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] vault.kv_path = None {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] vault.kv_version = 2 {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] vault.namespace = None {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] vault.root_token_id = **** {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] vault.ssl_ca_crt_file = None {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] vault.timeout = 60.0 {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] vault.token_file = None {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] vault.token_role = None {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] vault.use_ssl = False {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:19 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] ******************************************************************************** {{(pid=86188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Nov 04 10:09:19 devstack cinder-volume[86407]: DEBUG oslo_concurrency.processutils [None req-a2c9faa3-24a9-483e-ad1f-ab2faaf3b9b6 None None] CMD "mount.quobyte" returned: 1 in 0.161s {{(pid=86407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:09:19 devstack cinder-volume[86407]: DEBUG oslo_concurrency.lockutils [None req-a2c9faa3-24a9-483e-ad1f-ab2faaf3b9b6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:09:19 devstack cinder-volume[86407]: DEBUG oslo_concurrency.lockutils [None req-a2c9faa3-24a9-483e-ad1f-ab2faaf3b9b6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:09:19 devstack cinder-volume[86407]: DEBUG cinder.volume.drivers.quobyte [None req-a2c9faa3-24a9-483e-ad1f-ab2faaf3b9b6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=86407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:09:19 devstack cinder-volume[86407]: INFO cinder.volume.drivers.quobyte [None req-a2c9faa3-24a9-483e-ad1f-ab2faaf3b9b6 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 ... Nov 04 10:09:19 devstack cinder-volume[86407]: DEBUG oslo_concurrency.processutils [None req-a2c9faa3-24a9-483e-ad1f-ab2faaf3b9b6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 -c /etc/quobyte/client-cinder.cfg {{(pid=86407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:09:19 devstack sudo[86413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 -c /etc/quobyte/client-cinder.cfg Nov 04 10:09:19 devstack sudo[86413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:09:20 devstack sudo[86413]: pam_unix(sudo:session): session closed for user root Nov 04 10:09:20 devstack cinder-volume[86407]: DEBUG oslo_concurrency.processutils [None req-a2c9faa3-24a9-483e-ad1f-ab2faaf3b9b6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.410s {{(pid=86407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:09:20 devstack cinder-volume[86407]: INFO cinder.volume.drivers.quobyte [None req-a2c9faa3-24a9-483e-ad1f-ab2faaf3b9b6 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 succeeded Nov 04 10:09:20 devstack cinder-volume[86407]: DEBUG cinder.volume.drivers.quobyte [None req-a2c9faa3-24a9-483e-ad1f-ab2faaf3b9b6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=86407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:09:20 devstack cinder-volume[86407]: DEBUG oslo_concurrency.lockutils [None req-a2c9faa3-24a9-483e-ad1f-ab2faaf3b9b6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.424s {{(pid=86407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:09:20 devstack cinder-volume[86407]: DEBUG oslo_concurrency.processutils [None req-a2c9faa3-24a9-483e-ad1f-ab2faaf3b9b6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=86407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:09:20 devstack sudo[86515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:09:20 devstack sudo[86515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:09:20 devstack sudo[86515]: pam_unix(sudo:session): session closed for user root Nov 04 10:09:20 devstack cinder-volume[86407]: DEBUG oslo_concurrency.processutils [None req-a2c9faa3-24a9-483e-ad1f-ab2faaf3b9b6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.231s {{(pid=86407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:09:20 devstack cinder-volume[86407]: INFO cinder.volume.driver [None req-a2c9faa3-24a9-483e-ad1f-ab2faaf3b9b6 None None] Driver hasn't implemented _init_vendor_properties() Nov 04 10:09:20 devstack cinder-volume[86407]: DEBUG cinder.volume.driver [None req-a2c9faa3-24a9-483e-ad1f-ab2faaf3b9b6 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.62748336792, 'free_capacity_gb': 1773.62748336792, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86407) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Nov 04 10:09:20 devstack cinder-volume[86407]: DEBUG oslo_db.sqlalchemy.engines [None req-a2c9faa3-24a9-483e-ad1f-ab2faaf3b9b6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86407) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 04 10:09:20 devstack cinder-volume[86407]: DEBUG dbcounter [-] [86407] Writer thread running {{(pid=86407) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 04 10:09:20 devstack cinder-volume[86407]: DEBUG cinder.db.api [None req-a2c9faa3-24a9-483e-ad1f-ab2faaf3b9b6 None None] Building query based on filter {{(pid=86407) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Nov 04 10:09:20 devstack cinder-volume[86407]: DEBUG cinder.image.image_utils [None req-a2c9faa3-24a9-483e-ad1f-ab2faaf3b9b6 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86407) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Nov 04 10:09:20 devstack cinder-volume[86407]: INFO cinder.keymgr.migration [None req-ab602a66-25b6-4934-ace7-d73df6fa84c7 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Nov 04 10:09:20 devstack cinder-volume[86407]: DEBUG oslo_concurrency.lockutils [None req-a2c9faa3-24a9-483e-ad1f-ab2faaf3b9b6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:09:20 devstack cinder-volume[86407]: DEBUG oslo_concurrency.lockutils [None req-a2c9faa3-24a9-483e-ad1f-ab2faaf3b9b6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:09:20 devstack cinder-volume[86407]: DEBUG cinder.volume.drivers.quobyte [None req-a2c9faa3-24a9-483e-ad1f-ab2faaf3b9b6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=86407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:09:20 devstack cinder-volume[86407]: DEBUG cinder.volume.drivers.quobyte [None req-a2c9faa3-24a9-483e-ad1f-ab2faaf3b9b6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=86407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:09:20 devstack cinder-volume[86407]: DEBUG oslo_concurrency.lockutils [None req-a2c9faa3-24a9-483e-ad1f-ab2faaf3b9b6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:09:20 devstack cinder-volume[86407]: DEBUG oslo_concurrency.processutils [None req-a2c9faa3-24a9-483e-ad1f-ab2faaf3b9b6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=86407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:09:20 devstack sudo[86518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:09:20 devstack sudo[86518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:09:20 devstack sudo[86518]: pam_unix(sudo:session): session closed for user root Nov 04 10:09:20 devstack cinder-volume[86407]: DEBUG oslo_concurrency.processutils [None req-a2c9faa3-24a9-483e-ad1f-ab2faaf3b9b6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.233s {{(pid=86407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:09:20 devstack cinder-volume[86407]: DEBUG cinder.manager [None req-a2c9faa3-24a9-483e-ad1f-ab2faaf3b9b6 None None] Notifying Schedulers of capabilities ... {{(pid=86407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:09:20 devstack cinder-volume[86407]: INFO cinder.volume.manager [None req-a2c9faa3-24a9-483e-ad1f-ab2faaf3b9b6 None None] Driver initialization completed successfully. Nov 04 10:09:20 devstack cinder-volume[86407]: INFO cinder.manager [None req-a2c9faa3-24a9-483e-ad1f-ab2faaf3b9b6 None None] Initiating service 3 cleanup Nov 04 10:09:20 devstack cinder-volume[86407]: INFO cinder.manager [None req-a2c9faa3-24a9-483e-ad1f-ab2faaf3b9b6 None None] Service 3 cleanup completed. Nov 04 10:09:20 devstack cinder-volume[86407]: DEBUG cinder.service [None req-a2c9faa3-24a9-483e-ad1f-ab2faaf3b9b6 None None] Creating RPC server for service cinder-volume {{(pid=86407) start /opt/stack/cinder/cinder/service.py:231}} Nov 04 10:09:20 devstack cinder-volume[86407]: DEBUG cinder.service [None req-a2c9faa3-24a9-483e-ad1f-ab2faaf3b9b6 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86407) start /opt/stack/cinder/cinder/service.py:237}} Nov 04 10:09:20 devstack cinder-volume[86407]: INFO cinder.volume.manager [None req-a2c9faa3-24a9-483e-ad1f-ab2faaf3b9b6 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Nov 04 10:09:20 devstack cinder-volume[86407]: DEBUG oslo_concurrency.lockutils [None req-a2c9faa3-24a9-483e-ad1f-ab2faaf3b9b6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:09:20 devstack cinder-volume[86407]: DEBUG oslo_concurrency.lockutils [None req-a2c9faa3-24a9-483e-ad1f-ab2faaf3b9b6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:09:20 devstack cinder-volume[86407]: DEBUG cinder.volume.drivers.quobyte [None req-a2c9faa3-24a9-483e-ad1f-ab2faaf3b9b6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=86407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:09:20 devstack cinder-volume[86407]: DEBUG cinder.volume.drivers.quobyte [None req-a2c9faa3-24a9-483e-ad1f-ab2faaf3b9b6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=86407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:09:20 devstack cinder-volume[86407]: DEBUG oslo_concurrency.lockutils [None req-a2c9faa3-24a9-483e-ad1f-ab2faaf3b9b6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:09:20 devstack cinder-volume[86407]: DEBUG oslo_concurrency.processutils [None req-a2c9faa3-24a9-483e-ad1f-ab2faaf3b9b6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=86407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:09:20 devstack sudo[86521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:09:20 devstack sudo[86521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:09:21 devstack sudo[86521]: pam_unix(sudo:session): session closed for user root Nov 04 10:09:21 devstack cinder-volume[86407]: DEBUG oslo_concurrency.processutils [None req-a2c9faa3-24a9-483e-ad1f-ab2faaf3b9b6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.260s {{(pid=86407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:09:21 devstack cinder-volume[86407]: INFO cinder.volume.manager [None req-a2c9faa3-24a9-483e-ad1f-ab2faaf3b9b6 None None] Driver post RPC initialization completed successfully. Nov 04 10:09:26 devstack cinder-volume[86407]: DEBUG oslo_concurrency.lockutils [None req-e1694dd7-5681-4212-9ff3-f1d789dc4194 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:09:26 devstack cinder-volume[86407]: DEBUG oslo_concurrency.lockutils [None req-e1694dd7-5681-4212-9ff3-f1d789dc4194 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:09:26 devstack cinder-volume[86407]: DEBUG cinder.volume.drivers.quobyte [None req-e1694dd7-5681-4212-9ff3-f1d789dc4194 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=86407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:09:26 devstack cinder-volume[86407]: DEBUG cinder.volume.drivers.quobyte [None req-e1694dd7-5681-4212-9ff3-f1d789dc4194 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=86407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:09:26 devstack cinder-volume[86407]: DEBUG oslo_concurrency.lockutils [None req-e1694dd7-5681-4212-9ff3-f1d789dc4194 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:09:26 devstack cinder-volume[86407]: DEBUG oslo_concurrency.processutils [None req-e1694dd7-5681-4212-9ff3-f1d789dc4194 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=86407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:09:26 devstack sudo[86674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:09:26 devstack sudo[86674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:09:26 devstack cinder-volume[86188]: INFO oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] Caught SIGTERM, stopping children Nov 04 10:09:26 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] Acquiring lock "singleton_lock" {{(pid=86188) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 04 10:09:26 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] Acquired lock "singleton_lock" {{(pid=86188) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 04 10:09:26 devstack cinder-volume[86188]: DEBUG oslo_concurrency.lockutils [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] Releasing lock "singleton_lock" {{(pid=86188) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 04 10:09:26 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] Stop services. {{(pid=86188) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Nov 04 10:09:26 devstack cinder-volume[86188]: DEBUG oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] Killing children. {{(pid=86188) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Nov 04 10:09:26 devstack cinder-volume[86188]: INFO oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] Waiting on 1 children to exit Nov 04 10:09:26 devstack sudo[86674]: pam_unix(sudo:session): session closed for user root Nov 04 10:09:26 devstack cinder-volume[86407]: DEBUG oslo_concurrency.processutils [None req-e1694dd7-5681-4212-9ff3-f1d789dc4194 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.261s {{(pid=86407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:09:26 devstack cinder-volume[86407]: DEBUG cinder.manager [None req-e1694dd7-5681-4212-9ff3-f1d789dc4194 None None] Notifying Schedulers of capabilities ... {{(pid=86407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:09:26 devstack cinder-volume[86407]: ERROR oslo.messaging._drivers.impl_rabbit [None req-e1694dd7-5681-4212-9ff3-f1d789dc4194 None None] Failed to publish message to topic 'cinder-scheduler_fanout': Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/': amqp.exceptions.NotFound: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/' Nov 04 10:09:26 devstack cinder-volume[86407]: ERROR oslo.messaging._drivers.impl_rabbit [None req-e1694dd7-5681-4212-9ff3-f1d789dc4194 None None] Unable to connect to AMQP server on 192.168.122.176:5672 after inf tries: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/': amqp.exceptions.NotFound: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/' Nov 04 10:09:26 devstack cinder-volume[86407]: ERROR oslo_messaging.rpc.server [None req-e1694dd7-5681-4212-9ff3-f1d789dc4194 None None] Exception during message handling: oslo_messaging.exceptions.MessageDeliveryFailure: Unable to connect to AMQP server on 192.168.122.176:5672 after inf tries: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/' Nov 04 10:09:26 devstack cinder-volume[86407]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 04 10:09:26 devstack cinder-volume[86407]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1109, in ensure Nov 04 10:09:26 devstack cinder-volume[86407]: ERROR oslo_messaging.rpc.server ret, channel = autoretry_method() Nov 04 10:09:26 devstack cinder-volume[86407]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^ Nov 04 10:09:26 devstack cinder-volume[86407]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/kombu/connection.py", line 558, in _ensured Nov 04 10:09:26 devstack cinder-volume[86407]: ERROR oslo_messaging.rpc.server return fun(*args, **kwargs) Nov 04 10:09:26 devstack cinder-volume[86407]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^ Nov 04 10:09:26 devstack cinder-volume[86407]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/kombu/connection.py", line 641, in __call__ Nov 04 10:09:26 devstack cinder-volume[86407]: ERROR oslo_messaging.rpc.server return fun(*args, channel=channels[0], **kwargs), channels[0] Nov 04 10:09:26 devstack cinder-volume[86407]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 04 10:09:26 devstack cinder-volume[86407]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1098, in execute_method Nov 04 10:09:26 devstack cinder-volume[86407]: ERROR oslo_messaging.rpc.server method() Nov 04 10:09:26 devstack cinder-volume[86407]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1575, in _publish Nov 04 10:09:26 devstack cinder-volume[86407]: ERROR oslo_messaging.rpc.server self._producer.publish( Nov 04 10:09:26 devstack cinder-volume[86407]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/kombu/messaging.py", line 190, in publish Nov 04 10:09:26 devstack cinder-volume[86407]: ERROR oslo_messaging.rpc.server return _publish( Nov 04 10:09:26 devstack cinder-volume[86407]: ERROR oslo_messaging.rpc.server ^^^^^^^^^ Nov 04 10:09:26 devstack cinder-volume[86407]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/kombu/messaging.py", line 214, in _publish Nov 04 10:09:26 devstack cinder-volume[86407]: ERROR oslo_messaging.rpc.server return channel.basic_publish( Nov 04 10:09:26 devstack cinder-volume[86407]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^ Nov 04 10:09:26 devstack cinder-volume[86407]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/channel.py", line 1820, in basic_publish_confirm Nov 04 10:09:26 devstack cinder-volume[86407]: ERROR oslo_messaging.rpc.server self.wait([spec.Basic.Ack, spec.Basic.Nack], Nov 04 10:09:26 devstack cinder-volume[86407]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/abstract_channel.py", line 99, in wait Nov 04 10:09:26 devstack cinder-volume[86407]: ERROR oslo_messaging.rpc.server self.connection.drain_events(timeout=timeout) Nov 04 10:09:26 devstack cinder-volume[86407]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/connection.py", line 526, in drain_events Nov 04 10:09:26 devstack cinder-volume[86407]: ERROR oslo_messaging.rpc.server while not self.blocking_read(timeout): Nov 04 10:09:26 devstack cinder-volume[86407]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 04 10:09:26 devstack cinder-volume[86407]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/connection.py", line 532, in blocking_read Nov 04 10:09:26 devstack cinder-volume[86407]: ERROR oslo_messaging.rpc.server return self.on_inbound_frame(frame) Nov 04 10:09:26 devstack cinder-volume[86407]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 04 10:09:26 devstack cinder-volume[86407]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/method_framing.py", line 53, in on_frame Nov 04 10:09:26 devstack cinder-volume[86407]: ERROR oslo_messaging.rpc.server callback(channel, method_sig, buf, None) Nov 04 10:09:26 devstack cinder-volume[86407]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/connection.py", line 538, in on_inbound_method Nov 04 10:09:26 devstack cinder-volume[86407]: ERROR oslo_messaging.rpc.server return self.channels[channel_id].dispatch_method( Nov 04 10:09:26 devstack cinder-volume[86407]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 04 10:09:26 devstack cinder-volume[86407]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/abstract_channel.py", line 156, in dispatch_method Nov 04 10:09:26 devstack cinder-volume[86407]: ERROR oslo_messaging.rpc.server listener(*args) Nov 04 10:09:26 devstack cinder-volume[86407]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/channel.py", line 293, in _on_close Nov 04 10:09:26 devstack cinder-volume[86407]: ERROR oslo_messaging.rpc.server raise error_for_code( Nov 04 10:09:26 devstack cinder-volume[86407]: ERROR oslo_messaging.rpc.server amqp.exceptions.NotFound: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/' Nov 04 10:09:26 devstack cinder-volume[86407]: ERROR oslo_messaging.rpc.server Nov 04 10:09:26 devstack cinder-volume[86407]: ERROR oslo_messaging.rpc.server During handling of the above exception, another exception occurred: Nov 04 10:09:26 devstack cinder-volume[86407]: ERROR oslo_messaging.rpc.server Nov 04 10:09:26 devstack cinder-volume[86407]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 04 10:09:26 devstack cinder-volume[86407]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/server.py", line 176, in _process_incoming Nov 04 10:09:26 devstack cinder-volume[86407]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 04 10:09:26 devstack cinder-volume[86407]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 04 10:09:26 devstack cinder-volume[86407]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 04 10:09:26 devstack cinder-volume[86407]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 04 10:09:26 devstack cinder-volume[86407]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 04 10:09:26 devstack cinder-volume[86407]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 04 10:09:26 devstack cinder-volume[86407]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 04 10:09:26 devstack cinder-volume[86407]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^ Nov 04 10:09:26 devstack cinder-volume[86407]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/manager.py", line 2906, in publish_service_capabilities Nov 04 10:09:26 devstack cinder-volume[86407]: ERROR oslo_messaging.rpc.server self._publish_service_capabilities(context) Nov 04 10:09:26 devstack cinder-volume[86407]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/manager.py", line 220, in _publish_service_capabilities Nov 04 10:09:26 devstack cinder-volume[86407]: ERROR oslo_messaging.rpc.server self.scheduler_rpcapi.update_service_capabilities( Nov 04 10:09:26 devstack cinder-volume[86407]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/scheduler/rpcapi.py", line 222, in update_service_capabilities Nov 04 10:09:26 devstack cinder-volume[86407]: ERROR oslo_messaging.rpc.server cctxt.cast(ctxt, 'update_service_capabilities', **msg_args) Nov 04 10:09:26 devstack cinder-volume[86407]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/client.py", line 161, in cast Nov 04 10:09:26 devstack cinder-volume[86407]: ERROR oslo_messaging.rpc.server self.transport._send( Nov 04 10:09:26 devstack cinder-volume[86407]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/transport.py", line 123, in _send Nov 04 10:09:26 devstack cinder-volume[86407]: ERROR oslo_messaging.rpc.server return self._driver.send(target, ctxt, message, Nov 04 10:09:26 devstack cinder-volume[86407]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 04 10:09:26 devstack cinder-volume[86407]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 824, in send Nov 04 10:09:26 devstack cinder-volume[86407]: ERROR oslo_messaging.rpc.server return self._send(target, ctxt, message, wait_for_reply, timeout, Nov 04 10:09:26 devstack cinder-volume[86407]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 04 10:09:26 devstack cinder-volume[86407]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 799, in _send Nov 04 10:09:26 devstack cinder-volume[86407]: ERROR oslo_messaging.rpc.server conn.fanout_send(target.topic, msg, retry=retry) Nov 04 10:09:26 devstack cinder-volume[86407]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1694, in fanout_send Nov 04 10:09:26 devstack cinder-volume[86407]: ERROR oslo_messaging.rpc.server self._ensure_publishing(self._publish, exchange, msg, retry=retry) Nov 04 10:09:26 devstack cinder-volume[86407]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1524, in _ensure_publishing Nov 04 10:09:26 devstack cinder-volume[86407]: ERROR oslo_messaging.rpc.server self.ensure(method, retry=retry, error_callback=_error_callback) Nov 04 10:09:26 devstack cinder-volume[86407]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1135, in ensure Nov 04 10:09:26 devstack cinder-volume[86407]: ERROR oslo_messaging.rpc.server raise exceptions.MessageDeliveryFailure(msg) Nov 04 10:09:26 devstack cinder-volume[86407]: ERROR oslo_messaging.rpc.server oslo_messaging.exceptions.MessageDeliveryFailure: Unable to connect to AMQP server on 192.168.122.176:5672 after inf tries: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/' Nov 04 10:09:26 devstack cinder-volume[86407]: ERROR oslo_messaging.rpc.server Nov 04 10:09:29 devstack cinder-volume[86407]: DEBUG oslo_concurrency.lockutils [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] Acquiring lock "singleton_lock" {{(pid=86407) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 04 10:09:29 devstack cinder-volume[86407]: DEBUG oslo_concurrency.lockutils [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] Acquired lock "singleton_lock" {{(pid=86407) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 04 10:09:29 devstack cinder-volume[86407]: DEBUG oslo_concurrency.lockutils [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] Releasing lock "singleton_lock" {{(pid=86407) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 04 10:09:29 devstack cinder-volume[86407]: WARNING amqp [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 04 10:09:29 devstack cinder-volume[86407]: WARNING amqp [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 04 10:09:29 devstack cinder-volume[86188]: INFO oslo_service.backend._eventlet.service [None req-879ec2e1-3b00-4068-a272-163acf1b569f None None] Child 86407 exited with status 0 Nov 04 10:09:29 devstack cinder-volume[86744]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Nov 04 10:09:29 devstack cinder-volume[86744]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 04 10:09:29 devstack cinder-volume[86744]: we strongly recommend against using it for new projects. Nov 04 10:09:29 devstack cinder-volume[86744]: If you are already using Eventlet, we recommend migrating to a different Nov 04 10:09:29 devstack cinder-volume[86744]: framework. For more detail see Nov 04 10:09:29 devstack cinder-volume[86744]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 04 10:09:29 devstack cinder-volume[86744]: import eventlet # noqa Nov 04 10:09:32 devstack cinder-volume[86744]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86744) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 04 10:09:32 devstack cinder-volume[86744]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86744) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 04 10:09:32 devstack cinder-volume[86744]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86744) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 04 10:09:33 devstack cinder-volume[86744]: INFO dbcounter [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] Registered counter for database cinder Nov 04 10:09:33 devstack cinder-volume[86744]: DEBUG oslo_db.sqlalchemy.engines [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86744) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 04 10:09:33 devstack cinder-volume[86744]: DEBUG dbcounter [-] [86744] Writer thread running {{(pid=86744) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 04 10:09:33 devstack cinder-volume[86744]: INFO cinder.rpc [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Nov 04 10:09:33 devstack cinder-volume[86744]: INFO cinder.rpc [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Nov 04 10:09:33 devstack cinder-volume[86744]: DEBUG oslo_db.sqlalchemy.engines [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86744) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 04 10:09:34 devstack cinder-volume[86744]: INFO cinder.volume.manager [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] Determined volume DB was empty at startup. Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG cinder.volume.manager [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86744) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Nov 04 10:09:34 devstack cinder-volume[86744]: WARNING stevedore.named [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 04 10:09:34 devstack cinder-volume[86744]: WARNING castellan.key_manager [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 04 10:09:34 devstack cinder-volume[86744]: WARNING cinder.keymgr.conf_key_mgr [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 04 10:09:34 devstack cinder-volume[86744]: INFO cinder.volume.manager [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] Image-volume cache disabled for host devstack@QuobyteHD. Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_db.sqlalchemy.engines [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86744) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 04 10:09:34 devstack cinder-volume[86744]: INFO oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] Starting 1 workers Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] Started child 87068 {{(pid=86744) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] Full set of CONF: {{(pid=86744) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] ******************************************************************************** {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] Configuration options gathered from: {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] ================================================================================ {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] allow_availability_zone_fallback = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] allow_compression_on_image_upload = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] allowed_direct_url_schemes = [] {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] api_rate_limit = True {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] auth_strategy = keystone {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] backend_availability_zone = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] backend_host = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] backend_name = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] backend_stats_polling_interval = 60 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] backup_api_class = cinder.backup.api.API {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] backup_name_template = backup-%s {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] backup_use_same_host = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] backup_use_temp_snapshot = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] chap_password = **** {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] chap_username = {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] cinder_internal_tenant_project_id = a85b313ab0e944f99d892b171ef94c6d {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] cinder_internal_tenant_user_id = 80fa15addae64e0d8d4ebc40243ac754 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] cluster = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:34 devstack cinder-volume[87068]: INFO cinder.service [-] Starting cinder-volume node (version 29.0.1) Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] compression_format = gzip {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] compute_api_class = cinder.compute.nova.API {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] config_dir = [] {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] config_source = [] {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] control_exchange = openstack {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] debug = True {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] default_availability_zone = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] default_group_type = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] default_volume_type = QuobyteHD {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] disk_geometry = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] driver_client_cert = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] driver_client_cert_key = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] driver_data_namespace = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] driver_ssl_cert_path = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] driver_ssl_cert_verify = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] driver_use_ssl = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] enable_new_services = True {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] enable_unsupported_driver = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] enabled_backends = ['QuobyteHD'] {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] enforce_multipath_for_image_xfer = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] filter_function = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] glance_api_insecure = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] glance_api_servers = ['http://192.168.122.176/image'] {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] glance_api_ssl_compression = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] glance_ca_certificates_file = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] glance_catalog_info = image:glance:publicURL {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] glance_certfile = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] glance_keyfile = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] glance_num_retries = 3 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] glance_request_timeout = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] goodness_function = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] graceful_shutdown_timeout = 5 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] group_api_class = cinder.group.api.API {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] host = devstack {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] image_compress_on_upload = True {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] image_conversion_address_space_limit = 1 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] image_conversion_cpu_limit = 60 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] image_conversion_disable = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] image_introspection_address_space_limit = 1 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] image_introspection_cpu_limit = 60 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] image_upload_use_cinder_backend = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] image_upload_use_internal_tenant = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] image_volume_cache_enabled = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] image_volume_cache_max_count = 0 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] image_volume_cache_max_size_gb = 0 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] init_host_max_objects_retrieval = 0 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] instance_format = [instance: %(uuid)s] {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] iscsi_target_flags = {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] iscsi_write_cache = on {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] iser_helper = tgtadm {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] iser_ip_address = 192.168.122.176 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] iser_port = 3260 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] log_color = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] log_config_append = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:34 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-84fd1a03-9eff-45dc-a0bd-0f4836e8694d None None] Starting volume driver QuobyteDriver (1.2.1) Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:34 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-84fd1a03-9eff-45dc-a0bd-0f4836e8694d None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87068) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] log_dir = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] log_file = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] log_options = True {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] log_rotate_interval = 1 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] log_rotate_interval_type = days {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] log_rotation_type = none {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] max_age = 0 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] max_logfile_count = 30 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] max_logfile_size_mb = 200 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] max_over_subscription_ratio = 20.0 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] message_reap_interval = 86400 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] message_ttl = 2592000 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] migration_create_volume_timeout_secs = 300 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] monkey_patch = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] monkey_patch_modules = [] {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] my_ip = 192.168.122.176 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] no_snapshot_gb_quota = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] num_iser_scan_tries = 3 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] num_shell_tries = 3 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] num_volume_device_scan_tries = 3 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] nvmeof_conn_info_version = 1 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] nvmet_ns_id = 10 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] nvmet_port_id = 1 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] osapi_max_limit = 1000 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] osapi_volume_ext_list = [] {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] osapi_volume_listen_port = 8776 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] osapi_volume_use_ssl = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] osapi_volume_workers = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] per_volume_size_limit = -1 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] periodic_fuzzy_delay = 60 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] periodic_interval = 60 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] public_endpoint = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] publish_errors = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] quota_backup_gigabytes = 1000 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] quota_backups = 10 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] quota_gigabytes = 1000 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] quota_groups = 10 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] quota_snapshots = 10 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] quota_volumes = 10 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] rate_limit_burst = 0 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] rate_limit_except_level = CRITICAL {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] rate_limit_interval = 0 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] reinit_driver_count = 3 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] replication_device = **** {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] report_discard_supported = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] report_interval = 120 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] reservation_clean_interval = 86400 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] reservation_expire = 86400 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] reserved_image_namespaces = [] {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] reserved_percentage = 0 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] rpc_response_timeout = 120 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] run_external_periodic_tasks = True {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] scst_target_driver = iscsi {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] scst_target_iqn_name = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] service_down_time = 720 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] shell_completion = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] snapshot_name_template = snapshot-%s {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] split_loggers = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] state_path = /opt/stack/data/cinder {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] storage_availability_zone = nova {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] storage_protocol = iSCSI {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] syslog_log_facility = LOG_USER {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] target_helper = lioadm {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] target_ip_address = 192.168.122.176 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] target_port = 3260 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] target_protocol = iscsi {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] target_secondary_ip_addresses = [] {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] trace_flags = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] transport_url = **** {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] until_refresh = 0 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] use_chap_auth = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] use_default_quota_class = True {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] use_journal = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] use_json = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] use_multipath_for_image_xfer = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] use_stderr = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] use_syslog = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] verify_glance_signatures = enabled {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] volume_api_class = cinder.volume.api.API {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] volume_backend_name = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] volume_clear = zero {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] volume_clear_ionice = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] volume_clear_size = 0 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] volume_copy_bps_limit = 0 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] volume_dd_blocksize = 1M {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] volume_name_template = volume-%s {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] volume_service_inithost_offload = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] volume_usage_audit_period = month {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] zoning_mode = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] oslo_concurrency.disable_process_locking = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] keystone_authtoken.auth_section = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] keystone_authtoken.auth_type = password {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] keystone_authtoken.auth_version = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] keystone_authtoken.cache = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] keystone_authtoken.certfile = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-84fd1a03-9eff-45dc-a0bd-0f4836e8694d None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87068) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Nov 04 10:09:34 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.quobyte [None req-84fd1a03-9eff-45dc-a0bd-0f4836e8694d None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Nov 04 10:09:34 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.quobyte [None req-84fd1a03-9eff-45dc-a0bd-0f4836e8694d None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] keystone_authtoken.include_service_catalog = True {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] keystone_authtoken.insecure = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] keystone_authtoken.interface = public {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] keystone_authtoken.keyfile = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] keystone_authtoken.memcache_password = **** {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-84fd1a03-9eff-45dc-a0bd-0f4836e8694d None None] Running cmd (subprocess): mount.quobyte {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] keystone_authtoken.memcache_username = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] keystone_authtoken.region_name = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] keystone_authtoken.service_type = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.176/identity {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] cache.backend = dogpile.cache.null {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] cache.backend_argument = **** {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] cache.backend_expiration_time = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] cache.config_prefix = cache.oslo {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] cache.debug_cache_backend = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] cache.enable_retry_client = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] cache.enable_socket_keepalive = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] cache.enabled = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] cache.expiration_time = 600 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] cache.hashclient_retry_attempts = 2 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] cache.memcache_dead_retry = 300 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] cache.memcache_pool_maxsize = 10 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] cache.memcache_sasl_enabled = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] cache.password = **** {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] cache.proxies = [] {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] cache.redis_db = 0 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] cache.redis_server = localhost:6379 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] cache.retry_attempts = 2 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] cache.retry_delay = 0.0 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] cache.socket_keepalive_count = 1 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] cache.socket_keepalive_idle = 1 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] cache.socket_keepalive_interval = 1 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] cache.socket_timeout = 1.0 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] cache.tls_allowed_ciphers = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] cache.tls_cafile = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] cache.tls_certfile = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] cache.tls_enabled = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] cache.tls_keyfile = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] cache.username = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] coordination.backend_url = **** {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] database.asyncio_connection = **** {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] database.asyncio_slave_connection = **** {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] database.backend = sqlalchemy {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] database.connection = **** {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] database.connection_debug = 0 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] database.connection_parameters = {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] database.connection_recycle_time = 3600 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] database.connection_trace = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] database.db_inc_retry_interval = True {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] database.db_max_retries = 20 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] database.db_max_retry_interval = 10 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] database.db_retry_interval = 1 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] database.max_overflow = 50 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] database.max_pool_size = 5 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] database.max_retries = 10 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] database.mysql_wsrep_sync_wait = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] database.pool_timeout = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] database.retry_interval = 10 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] database.slave_connection = **** {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] database.sqlite_synchronous = True {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] database.synchronous_reader = True {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] database.use_db_reconnect = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] oslo_messaging_tracing.insecure = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] profiler.connection_string = messaging:// {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] profiler.enabled = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] profiler.es_doc_type = notification {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] profiler.es_scroll_size = 10000 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] profiler.es_scroll_time = 2m {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] profiler.filter_error_trace = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] profiler.hmac_keys = **** {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] profiler.sentinel_service_name = mymaster {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] profiler.socket_timeout = 0.1 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] profiler.trace_requests = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] profiler.trace_sqlalchemy = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] profiler_jaeger.process_tags = {} {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] profiler_jaeger.service_name_prefix = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] profiler_otlp.service_name_prefix = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] oslo_policy.enforce_new_defaults = True {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] oslo_policy.policy_default_rule = default {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] oslo_policy.policy_file = policy.yaml {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] privsep_osbrick.group = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] privsep_osbrick.helper_command = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] privsep_osbrick.user = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] cinder_sys_admin.group = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] cinder_sys_admin.helper_command = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] cinder_sys_admin.user = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] service_user.auth_section = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] service_user.auth_type = password {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] service_user.cafile = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] service_user.certfile = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] service_user.collect_timing = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] service_user.insecure = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] service_user.keyfile = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] service_user.send_service_user_token = True {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] service_user.split_loggers = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] service_user.timeout = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] service_user.tls_ciphers = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] service_user.tls_min_version = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] glance.auth_section = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] glance.auth_type = password {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] glance.certfile = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] glance.collect_timing = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] glance.insecure = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] glance.keyfile = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] glance.region_name = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] glance.split_loggers = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] glance.timeout = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] glance.tls_ciphers = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] glance.tls_min_version = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] backend_defaults.backend_availability_zone = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] backend_defaults.chap_password = **** {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] backend_defaults.chap_username = {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] backend_defaults.disk_geometry = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] backend_defaults.driver_client_cert = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] backend_defaults.driver_client_cert_key = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] backend_defaults.driver_data_namespace = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] backend_defaults.driver_use_ssl = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] backend_defaults.extra_capabilities = {} {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] backend_defaults.filter_function = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] backend_defaults.goodness_function = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] backend_defaults.iscsi_target_flags = {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] backend_defaults.iscsi_write_cache = on {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] backend_defaults.iser_helper = tgtadm {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] backend_defaults.iser_ip_address = 192.168.122.176 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] backend_defaults.iser_port = 3260 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] backend_defaults.nas_host = {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] backend_defaults.nas_login = admin {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] backend_defaults.nas_mount_options = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] backend_defaults.nas_password = **** {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-84fd1a03-9eff-45dc-a0bd-0f4836e8694d None None] CMD "mount.quobyte" returned: 1 in 0.094s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:09:34 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-84fd1a03-9eff-45dc-a0bd-0f4836e8694d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] backend_defaults.nas_private_key = {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] backend_defaults.nas_share_path = {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-84fd1a03-9eff-45dc-a0bd-0f4836e8694d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:09:34 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-84fd1a03-9eff-45dc-a0bd-0f4836e8694d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] backend_defaults.num_shell_tries = 3 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] backend_defaults.quobyte_volume_url = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] backend_defaults.replication_device = **** {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] backend_defaults.report_discard_supported = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] backend_defaults.reserved_percentage = 0 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] backend_defaults.target_helper = tgtadm {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] backend_defaults.target_ip_address = 192.168.122.176 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] backend_defaults.target_port = 3260 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] backend_defaults.target_protocol = iscsi {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-84fd1a03-9eff-45dc-a0bd-0f4836e8694d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:09:34 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-84fd1a03-9eff-45dc-a0bd-0f4836e8694d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:09:34 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-84fd1a03-9eff-45dc-a0bd-0f4836e8694d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] backend_defaults.trace_flags = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] backend_defaults.unique_fqdn_network = True {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] backend_defaults.use_chap_auth = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] backend_defaults.volume_backend_name = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] backend_defaults.volume_clear = zero {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] backend_defaults.volume_clear_ionice = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] backend_defaults.volume_clear_size = 0 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] oslo_reports.file_event_handler = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] oslo_reports.log_dir = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] QuobyteHD.backend_availability_zone = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] QuobyteHD.backend_host = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] QuobyteHD.chap_password = **** {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] QuobyteHD.chap_username = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] QuobyteHD.chiscsi_conf = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] QuobyteHD.disk_geometry = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] QuobyteHD.driver_client_cert = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] QuobyteHD.driver_data_namespace = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] QuobyteHD.driver_use_ssl = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] QuobyteHD.extra_capabilities = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] QuobyteHD.filter_function = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] QuobyteHD.goodness_function = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] QuobyteHD.iser_helper = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] QuobyteHD.iser_ip_address = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] QuobyteHD.iser_port = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] QuobyteHD.iser_target_prefix = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack sudo[87079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] QuobyteHD.nas_host = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] QuobyteHD.nas_login = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] QuobyteHD.nas_mount_options = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] QuobyteHD.nas_password = **** {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] QuobyteHD.nas_private_key = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] QuobyteHD.nas_share_path = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] QuobyteHD.nas_ssh_port = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] QuobyteHD.num_shell_tries = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack sudo[87079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] QuobyteHD.nvmet_port_id = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] QuobyteHD.replication_device = **** {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] QuobyteHD.report_discard_supported = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] QuobyteHD.reserved_percentage = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] QuobyteHD.scst_target_driver = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] QuobyteHD.storage_protocol = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] QuobyteHD.target_helper = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] QuobyteHD.target_ip_address = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] QuobyteHD.target_port = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] QuobyteHD.target_prefix = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] QuobyteHD.target_protocol = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] QuobyteHD.trace_flags = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] QuobyteHD.use_chap_auth = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] QuobyteHD.volume_clear = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] QuobyteHD.volume_clear_size = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] QuobyteHD.volumes_dir = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] oslo_messaging_rabbit.ssl = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] oslo_messaging_notifications.driver = [] {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] oslo_messaging_notifications.retry = -1 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] key_manager.fixed_key = **** {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] barbican.barbican_api_version = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] barbican.barbican_endpoint = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] barbican.barbican_endpoint_type = public {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] barbican.barbican_region_name = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] barbican.cafile = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] barbican.certfile = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] barbican.collect_timing = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] barbican.insecure = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] barbican.keyfile = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] barbican.number_of_retries = 60 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] barbican.retry_delay = 1 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] barbican.send_service_user_token = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] barbican.split_loggers = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] barbican.timeout = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] barbican.tls_ciphers = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] barbican.tls_min_version = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] barbican.verify_ssl = True {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] barbican.verify_ssl_path = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] barbican_service_user.auth_section = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] barbican_service_user.auth_type = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] barbican_service_user.cafile = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] barbican_service_user.certfile = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] barbican_service_user.collect_timing = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] barbican_service_user.insecure = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] barbican_service_user.keyfile = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] barbican_service_user.split_loggers = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] barbican_service_user.timeout = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] barbican_service_user.tls_ciphers = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] barbican_service_user.tls_min_version = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] vault.approle_role_id = **** {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] vault.approle_secret_id = **** {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] vault.auth_method = approle {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] vault.auth_path = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] vault.kv_mountpoint = secret {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] vault.kv_path = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] vault.kv_version = 2 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] vault.namespace = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] vault.root_token_id = **** {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] vault.ssl_ca_crt_file = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] vault.timeout = 60.0 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] vault.token_file = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] vault.token_role = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] vault.use_ssl = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:09:34 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-e9c111a6-0502-4b0c-90bb-3699ff259478 None None] ******************************************************************************** {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Nov 04 10:09:34 devstack sudo[87079]: pam_unix(sudo:session): session closed for user root Nov 04 10:09:34 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-84fd1a03-9eff-45dc-a0bd-0f4836e8694d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.337s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:09:34 devstack cinder-volume[87068]: INFO cinder.volume.driver [None req-84fd1a03-9eff-45dc-a0bd-0f4836e8694d None None] Driver hasn't implemented _init_vendor_properties() Nov 04 10:09:34 devstack cinder-volume[87068]: DEBUG cinder.volume.driver [None req-84fd1a03-9eff-45dc-a0bd-0f4836e8694d None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.62748336792, 'free_capacity_gb': 1773.62748336792, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87068) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Nov 04 10:09:34 devstack cinder-volume[87068]: DEBUG oslo_db.sqlalchemy.engines [None req-84fd1a03-9eff-45dc-a0bd-0f4836e8694d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87068) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 04 10:09:34 devstack cinder-volume[87068]: DEBUG dbcounter [-] [87068] Writer thread running {{(pid=87068) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 04 10:09:34 devstack cinder-volume[87068]: DEBUG cinder.db.api [None req-84fd1a03-9eff-45dc-a0bd-0f4836e8694d None None] Building query based on filter {{(pid=87068) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Nov 04 10:09:34 devstack cinder-volume[87068]: DEBUG cinder.image.image_utils [None req-84fd1a03-9eff-45dc-a0bd-0f4836e8694d None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87068) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Nov 04 10:09:34 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-84fd1a03-9eff-45dc-a0bd-0f4836e8694d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:09:34 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-84fd1a03-9eff-45dc-a0bd-0f4836e8694d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:09:34 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-84fd1a03-9eff-45dc-a0bd-0f4836e8694d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:09:34 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-84fd1a03-9eff-45dc-a0bd-0f4836e8694d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:09:34 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-84fd1a03-9eff-45dc-a0bd-0f4836e8694d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:09:34 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-84fd1a03-9eff-45dc-a0bd-0f4836e8694d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:09:34 devstack cinder-volume[87068]: INFO cinder.keymgr.migration [None req-8955f92f-f654-4c0e-85f2-8855dab16824 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Nov 04 10:09:34 devstack sudo[87090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:09:34 devstack sudo[87090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:09:35 devstack sudo[87090]: pam_unix(sudo:session): session closed for user root Nov 04 10:09:35 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-84fd1a03-9eff-45dc-a0bd-0f4836e8694d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.245s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:09:35 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-84fd1a03-9eff-45dc-a0bd-0f4836e8694d None None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:09:35 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-84fd1a03-9eff-45dc-a0bd-0f4836e8694d None None] Driver initialization completed successfully. Nov 04 10:09:35 devstack cinder-volume[87068]: INFO cinder.manager [None req-84fd1a03-9eff-45dc-a0bd-0f4836e8694d None None] Initiating service 3 cleanup Nov 04 10:09:35 devstack cinder-volume[87068]: INFO cinder.manager [None req-84fd1a03-9eff-45dc-a0bd-0f4836e8694d None None] Service 3 cleanup completed. Nov 04 10:09:35 devstack cinder-volume[87068]: DEBUG cinder.service [None req-84fd1a03-9eff-45dc-a0bd-0f4836e8694d None None] Creating RPC server for service cinder-volume {{(pid=87068) start /opt/stack/cinder/cinder/service.py:231}} Nov 04 10:09:35 devstack cinder-volume[87068]: DEBUG cinder.service [None req-84fd1a03-9eff-45dc-a0bd-0f4836e8694d None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87068) start /opt/stack/cinder/cinder/service.py:237}} Nov 04 10:09:35 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-84fd1a03-9eff-45dc-a0bd-0f4836e8694d None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Nov 04 10:09:35 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-84fd1a03-9eff-45dc-a0bd-0f4836e8694d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:09:35 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-84fd1a03-9eff-45dc-a0bd-0f4836e8694d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:09:35 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-84fd1a03-9eff-45dc-a0bd-0f4836e8694d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:09:35 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-84fd1a03-9eff-45dc-a0bd-0f4836e8694d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:09:35 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-84fd1a03-9eff-45dc-a0bd-0f4836e8694d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:09:35 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-84fd1a03-9eff-45dc-a0bd-0f4836e8694d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:09:35 devstack sudo[87103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:09:35 devstack sudo[87103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:09:35 devstack sudo[87103]: pam_unix(sudo:session): session closed for user root Nov 04 10:09:35 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-84fd1a03-9eff-45dc-a0bd-0f4836e8694d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.255s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:09:35 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-84fd1a03-9eff-45dc-a0bd-0f4836e8694d None None] Driver post RPC initialization completed successfully. Nov 04 10:09:44 devstack cinder-volume[86744]: DEBUG dbcounter [-] [86744] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86744) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 10:09:45 devstack cinder-volume[87068]: DEBUG dbcounter [-] [87068] Writing DB stats cinder:SELECT=2 {{(pid=87068) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 10:09:45 devstack cinder-volume[87068]: DEBUG dbcounter [-] [87068] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=87068) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 10:09:53 devstack cinder-volume[87068]: DEBUG oslo_service.periodic_task [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Running periodic task VolumeManager._thread_info {{(pid=87068) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 10:09:53 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] thread count: 6 {{(pid=87068) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 04 10:09:53 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] thread info: [<_MainThread(MainThread, started 126275656192128)>, , , , , ] {{(pid=87068) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 04 10:10:35 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8335cec-a170-44eb-ba07-b1392355eb0c tempest-TaggedAttachmentsTest-2100419357 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:10:35 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-f8335cec-a170-44eb-ba07-b1392355eb0c tempest-TaggedAttachmentsTest-2100419357 None] Flow 'volume_create_manager' (1efacf4d-a93f-4acb-8717-712b0baa72cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:10:35 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-f8335cec-a170-44eb-ba07-b1392355eb0c tempest-TaggedAttachmentsTest-2100419357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0439f1e-965d-4f82-9c38-0a08e3d089dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:10:35 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-f8335cec-a170-44eb-ba07-b1392355eb0c tempest-TaggedAttachmentsTest-2100419357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0439f1e-965d-4f82-9c38-0a08e3d089dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:10:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1754080657',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c907e08f-679b-4d9e-9509-f9cedb6db50b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29c0fae1968d412f879709c70d3dccfa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:10:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:10:35Z,use_quota=True,user_id='7cde3b63e6d546f5a27d9b8f70b35f97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:10:35 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-f8335cec-a170-44eb-ba07-b1392355eb0c tempest-TaggedAttachmentsTest-2100419357 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8d4afc1-8ea2-485f-aa66-f27377de9e53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:10:35 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-f8335cec-a170-44eb-ba07-b1392355eb0c tempest-TaggedAttachmentsTest-2100419357 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8d4afc1-8ea2-485f-aa66-f27377de9e53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:10:35 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-f8335cec-a170-44eb-ba07-b1392355eb0c tempest-TaggedAttachmentsTest-2100419357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bdd70653-67d1-4dc5-afd7-1bea65beeb08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:10:35 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-f8335cec-a170-44eb-ba07-b1392355eb0c tempest-TaggedAttachmentsTest-2100419357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bdd70653-67d1-4dc5-afd7-1bea65beeb08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c907e08f-679b-4d9e-9509-f9cedb6db50b', 'volume_name': 'volume-c907e08f-679b-4d9e-9509-f9cedb6db50b', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:10:35 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-f8335cec-a170-44eb-ba07-b1392355eb0c tempest-TaggedAttachmentsTest-2100419357 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0428f822-2e34-47e1-8ba6-9f42aa5e8c44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:10:35 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-f8335cec-a170-44eb-ba07-b1392355eb0c tempest-TaggedAttachmentsTest-2100419357 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0428f822-2e34-47e1-8ba6-9f42aa5e8c44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:10:35 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-f8335cec-a170-44eb-ba07-b1392355eb0c tempest-TaggedAttachmentsTest-2100419357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b6c9000-8728-4559-9887-3d9a876fbe8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:10:35 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-f8335cec-a170-44eb-ba07-b1392355eb0c tempest-TaggedAttachmentsTest-2100419357 None] Volume c907e08f-679b-4d9e-9509-f9cedb6db50b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c907e08f-679b-4d9e-9509-f9cedb6db50b', 'volume_size': 1} Nov 04 10:10:35 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-f8335cec-a170-44eb-ba07-b1392355eb0c tempest-TaggedAttachmentsTest-2100419357 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:10:35 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-f8335cec-a170-44eb-ba07-b1392355eb0c tempest-TaggedAttachmentsTest-2100419357 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:10:35 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-f8335cec-a170-44eb-ba07-b1392355eb0c tempest-TaggedAttachmentsTest-2100419357 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:10:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1754080657',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c907e08f-679b-4d9e-9509-f9cedb6db50b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29c0fae1968d412f879709c70d3dccfa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:10:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:10:35Z,use_quota=True,user_id='7cde3b63e6d546f5a27d9b8f70b35f97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 10:10:35 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-f8335cec-a170-44eb-ba07-b1392355eb0c tempest-TaggedAttachmentsTest-2100419357 None] Creating volume c907e08f-679b-4d9e-9509-f9cedb6db50b {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:10:35 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-f8335cec-a170-44eb-ba07-b1392355eb0c tempest-TaggedAttachmentsTest-2100419357 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:10:35 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-f8335cec-a170-44eb-ba07-b1392355eb0c tempest-TaggedAttachmentsTest-2100419357 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:10:35 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-f8335cec-a170-44eb-ba07-b1392355eb0c tempest-TaggedAttachmentsTest-2100419357 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:10:35 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-f8335cec-a170-44eb-ba07-b1392355eb0c tempest-TaggedAttachmentsTest-2100419357 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:10:35 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-f8335cec-a170-44eb-ba07-b1392355eb0c tempest-TaggedAttachmentsTest-2100419357 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:10:35 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-f8335cec-a170-44eb-ba07-b1392355eb0c tempest-TaggedAttachmentsTest-2100419357 None] Selected osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:10:35 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-f8335cec-a170-44eb-ba07-b1392355eb0c tempest-TaggedAttachmentsTest-2100419357 None] casted to osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 Nov 04 10:10:35 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f8335cec-a170-44eb-ba07-b1392355eb0c tempest-TaggedAttachmentsTest-2100419357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-c907e08f-679b-4d9e-9509-f9cedb6db50b 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:10:35 devstack sudo[87465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-c907e08f-679b-4d9e-9509-f9cedb6db50b 1073741824 Nov 04 10:10:35 devstack sudo[87465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:10:36 devstack sudo[87465]: pam_unix(sudo:session): session closed for user root Nov 04 10:10:36 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f8335cec-a170-44eb-ba07-b1392355eb0c tempest-TaggedAttachmentsTest-2100419357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-c907e08f-679b-4d9e-9509-f9cedb6db50b 1073741824" returned: 0 in 0.646s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:10:36 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f8335cec-a170-44eb-ba07-b1392355eb0c tempest-TaggedAttachmentsTest-2100419357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-c907e08f-679b-4d9e-9509-f9cedb6db50b {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:10:36 devstack sudo[87784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-c907e08f-679b-4d9e-9509-f9cedb6db50b Nov 04 10:10:36 devstack sudo[87784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:10:36 devstack sudo[87784]: pam_unix(sudo:session): session closed for user root Nov 04 10:10:36 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f8335cec-a170-44eb-ba07-b1392355eb0c tempest-TaggedAttachmentsTest-2100419357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-c907e08f-679b-4d9e-9509-f9cedb6db50b" returned: 0 in 0.284s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:10:36 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-f8335cec-a170-44eb-ba07-b1392355eb0c tempest-TaggedAttachmentsTest-2100419357 None] <== create_volume: return (990ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 10:10:36 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-f8335cec-a170-44eb-ba07-b1392355eb0c tempest-TaggedAttachmentsTest-2100419357 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.993s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:10:36 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-f8335cec-a170-44eb-ba07-b1392355eb0c tempest-TaggedAttachmentsTest-2100419357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b6c9000-8728-4559-9887-3d9a876fbe8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c907e08f-679b-4d9e-9509-f9cedb6db50b', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:10:36 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-f8335cec-a170-44eb-ba07-b1392355eb0c tempest-TaggedAttachmentsTest-2100419357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0975e45-a339-4e51-986a-47ddd1c6cc8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:10:36 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-f8335cec-a170-44eb-ba07-b1392355eb0c tempest-TaggedAttachmentsTest-2100419357 None] Volume volume-c907e08f-679b-4d9e-9509-f9cedb6db50b (c907e08f-679b-4d9e-9509-f9cedb6db50b): created successfully Nov 04 10:10:36 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-f8335cec-a170-44eb-ba07-b1392355eb0c tempest-TaggedAttachmentsTest-2100419357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0975e45-a339-4e51-986a-47ddd1c6cc8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:10:36 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-f8335cec-a170-44eb-ba07-b1392355eb0c tempest-TaggedAttachmentsTest-2100419357 None] Flow 'volume_create_manager' (1efacf4d-a93f-4acb-8717-712b0baa72cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:10:36 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-f8335cec-a170-44eb-ba07-b1392355eb0c tempest-TaggedAttachmentsTest-2100419357 None] Created volume successfully. Nov 04 10:10:46 devstack cinder-volume[87068]: DEBUG dbcounter [-] [87068] Writing DB stats cinder:SELECT=2,cinder:UPDATE=5 {{(pid=87068) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 10:10:46 devstack cinder-volume[87068]: DEBUG dbcounter [-] [87068] Writing DB stats cinder:SELECT=2,cinder:INSERT=1,cinder:UPDATE=1,cinder:DELETE=1 {{(pid=87068) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 10:10:53 devstack cinder-volume[87068]: DEBUG oslo_service.periodic_task [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87068) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 10:10:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:10:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:10:53 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:10:53 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:10:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:10:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:10:53 devstack sudo[88066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:10:53 devstack sudo[88066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:10:54 devstack sudo[88066]: pam_unix(sudo:session): session closed for user root Nov 04 10:10:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.500s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:10:54 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:10:54 devstack cinder-volume[87068]: DEBUG oslo_service.periodic_task [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Running periodic task VolumeManager._thread_info {{(pid=87068) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 10:10:54 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] thread count: 6 {{(pid=87068) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 04 10:10:54 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] thread info: [<_MainThread(MainThread, started 126275656192128)>, , , , , ] {{(pid=87068) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 04 10:11:01 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ba41318-663c-44ae-b7a5-63e9cbd121f7 tempest-VolumesAdminNegativeTest-1923665913 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:11:01 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-5ba41318-663c-44ae-b7a5-63e9cbd121f7 tempest-VolumesAdminNegativeTest-1923665913 None] Flow 'volume_create_manager' (826dd5c0-b51c-4cd5-9d4f-6d660795290b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:11:01 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-5ba41318-663c-44ae-b7a5-63e9cbd121f7 tempest-VolumesAdminNegativeTest-1923665913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20bd3a77-1ba7-41cc-9b50-510b158ed486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:11:01 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-5ba41318-663c-44ae-b7a5-63e9cbd121f7 tempest-VolumesAdminNegativeTest-1923665913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20bd3a77-1ba7-41cc-9b50-510b158ed486) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:11:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-596878496',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7590b585-03a4-44ad-81f6-eafc82051037,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7595bdf469846d09feb622abcf2b623',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:11:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:11:01Z,use_quota=True,user_id='d74767bfafbd48ce91340b5712f8cb66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:11:01 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-5ba41318-663c-44ae-b7a5-63e9cbd121f7 tempest-VolumesAdminNegativeTest-1923665913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91523607-082c-4e64-bea9-b2b5e036d316) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:11:01 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-5ba41318-663c-44ae-b7a5-63e9cbd121f7 tempest-VolumesAdminNegativeTest-1923665913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91523607-082c-4e64-bea9-b2b5e036d316) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:11:01 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-5ba41318-663c-44ae-b7a5-63e9cbd121f7 tempest-VolumesAdminNegativeTest-1923665913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (114f08c0-2729-4e48-979d-0fdaffcc5140) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:11:01 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-5ba41318-663c-44ae-b7a5-63e9cbd121f7 tempest-VolumesAdminNegativeTest-1923665913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (114f08c0-2729-4e48-979d-0fdaffcc5140) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7590b585-03a4-44ad-81f6-eafc82051037', 'volume_name': 'volume-7590b585-03a4-44ad-81f6-eafc82051037', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:11:01 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-5ba41318-663c-44ae-b7a5-63e9cbd121f7 tempest-VolumesAdminNegativeTest-1923665913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bef1aed-e127-46e2-a14d-2009ab6dafcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:11:01 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-5ba41318-663c-44ae-b7a5-63e9cbd121f7 tempest-VolumesAdminNegativeTest-1923665913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bef1aed-e127-46e2-a14d-2009ab6dafcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:11:01 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-5ba41318-663c-44ae-b7a5-63e9cbd121f7 tempest-VolumesAdminNegativeTest-1923665913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5a16695-127b-4130-a9c4-66cc1d4d8149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:11:01 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-5ba41318-663c-44ae-b7a5-63e9cbd121f7 tempest-VolumesAdminNegativeTest-1923665913 None] Volume 7590b585-03a4-44ad-81f6-eafc82051037: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7590b585-03a4-44ad-81f6-eafc82051037', 'volume_size': 1} Nov 04 10:11:01 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-5ba41318-663c-44ae-b7a5-63e9cbd121f7 tempest-VolumesAdminNegativeTest-1923665913 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:11:01 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-5ba41318-663c-44ae-b7a5-63e9cbd121f7 tempest-VolumesAdminNegativeTest-1923665913 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:11:01 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-5ba41318-663c-44ae-b7a5-63e9cbd121f7 tempest-VolumesAdminNegativeTest-1923665913 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:11:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-596878496',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7590b585-03a4-44ad-81f6-eafc82051037,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7595bdf469846d09feb622abcf2b623',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:11:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:11:01Z,use_quota=True,user_id='d74767bfafbd48ce91340b5712f8cb66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 10:11:01 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-5ba41318-663c-44ae-b7a5-63e9cbd121f7 tempest-VolumesAdminNegativeTest-1923665913 None] Creating volume 7590b585-03a4-44ad-81f6-eafc82051037 {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:11:01 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-5ba41318-663c-44ae-b7a5-63e9cbd121f7 tempest-VolumesAdminNegativeTest-1923665913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:11:01 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-5ba41318-663c-44ae-b7a5-63e9cbd121f7 tempest-VolumesAdminNegativeTest-1923665913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:11:01 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-5ba41318-663c-44ae-b7a5-63e9cbd121f7 tempest-VolumesAdminNegativeTest-1923665913 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:11:01 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-5ba41318-663c-44ae-b7a5-63e9cbd121f7 tempest-VolumesAdminNegativeTest-1923665913 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:11:01 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-5ba41318-663c-44ae-b7a5-63e9cbd121f7 tempest-VolumesAdminNegativeTest-1923665913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:11:01 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-5ba41318-663c-44ae-b7a5-63e9cbd121f7 tempest-VolumesAdminNegativeTest-1923665913 None] Selected osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:11:01 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-5ba41318-663c-44ae-b7a5-63e9cbd121f7 tempest-VolumesAdminNegativeTest-1923665913 None] casted to osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 Nov 04 10:11:01 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-5ba41318-663c-44ae-b7a5-63e9cbd121f7 tempest-VolumesAdminNegativeTest-1923665913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-7590b585-03a4-44ad-81f6-eafc82051037 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:11:01 devstack sudo[88145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-7590b585-03a4-44ad-81f6-eafc82051037 1073741824 Nov 04 10:11:01 devstack sudo[88145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:11:02 devstack sudo[88145]: pam_unix(sudo:session): session closed for user root Nov 04 10:11:02 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-5ba41318-663c-44ae-b7a5-63e9cbd121f7 tempest-VolumesAdminNegativeTest-1923665913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-7590b585-03a4-44ad-81f6-eafc82051037 1073741824" returned: 0 in 1.076s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:11:02 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-5ba41318-663c-44ae-b7a5-63e9cbd121f7 tempest-VolumesAdminNegativeTest-1923665913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-7590b585-03a4-44ad-81f6-eafc82051037 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:11:02 devstack sudo[88155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-7590b585-03a4-44ad-81f6-eafc82051037 Nov 04 10:11:02 devstack sudo[88155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:11:03 devstack sudo[88155]: pam_unix(sudo:session): session closed for user root Nov 04 10:11:03 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-5ba41318-663c-44ae-b7a5-63e9cbd121f7 tempest-VolumesAdminNegativeTest-1923665913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-7590b585-03a4-44ad-81f6-eafc82051037" returned: 0 in 0.587s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:11:03 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-5ba41318-663c-44ae-b7a5-63e9cbd121f7 tempest-VolumesAdminNegativeTest-1923665913 None] <== create_volume: return (1811ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 10:11:03 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-5ba41318-663c-44ae-b7a5-63e9cbd121f7 tempest-VolumesAdminNegativeTest-1923665913 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.824s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:11:03 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-5ba41318-663c-44ae-b7a5-63e9cbd121f7 tempest-VolumesAdminNegativeTest-1923665913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5a16695-127b-4130-a9c4-66cc1d4d8149) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7590b585-03a4-44ad-81f6-eafc82051037', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:11:03 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-5ba41318-663c-44ae-b7a5-63e9cbd121f7 tempest-VolumesAdminNegativeTest-1923665913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2dff3e5f-d1e4-4685-9312-84994f788cb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:11:03 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-5ba41318-663c-44ae-b7a5-63e9cbd121f7 tempest-VolumesAdminNegativeTest-1923665913 None] Volume volume-7590b585-03a4-44ad-81f6-eafc82051037 (7590b585-03a4-44ad-81f6-eafc82051037): created successfully Nov 04 10:11:03 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-5ba41318-663c-44ae-b7a5-63e9cbd121f7 tempest-VolumesAdminNegativeTest-1923665913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2dff3e5f-d1e4-4685-9312-84994f788cb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:11:03 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-5ba41318-663c-44ae-b7a5-63e9cbd121f7 tempest-VolumesAdminNegativeTest-1923665913 None] Flow 'volume_create_manager' (826dd5c0-b51c-4cd5-9d4f-6d660795290b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:11:03 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-5ba41318-663c-44ae-b7a5-63e9cbd121f7 tempest-VolumesAdminNegativeTest-1923665913 None] Created volume successfully. Nov 04 10:11:06 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-fa29bf07-334f-4699-9d32-9ac978c770dd tempest-VolumesAdminNegativeTest-1923665913 None] Acquiring lock "cinder-7590b585-03a4-44ad-81f6-eafc82051037-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:11:06 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-fa29bf07-334f-4699-9d32-9ac978c770dd tempest-VolumesAdminNegativeTest-1923665913 None] Lock "cinder-7590b585-03a4-44ad-81f6-eafc82051037-delete_volume" acquired by "delete_volume" :: waited 0.149s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:11:06 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-fa29bf07-334f-4699-9d32-9ac978c770dd tempest-VolumesAdminNegativeTest-1923665913 None] Acquiring lock "cinder-quobyte-7590b585-03a4-44ad-81f6-eafc82051037" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:11:06 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-fa29bf07-334f-4699-9d32-9ac978c770dd tempest-VolumesAdminNegativeTest-1923665913 None] Lock "cinder-quobyte-7590b585-03a4-44ad-81f6-eafc82051037" acquired by "delete_volume" :: waited 0.052s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:11:06 devstack cinder-volume[87068]: INFO oslo.privsep.daemon [None req-fa29bf07-334f-4699-9d32-9ac978c770dd tempest-VolumesAdminNegativeTest-1923665913 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpxo0jk9qm/privsep.sock'] Nov 04 10:11:07 devstack sudo[88222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpxo0jk9qm/privsep.sock Nov 04 10:11:07 devstack sudo[88222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:11:08 devstack cinder-volume[87068]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Nov 04 10:11:08 devstack cinder-volume[87068]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 04 10:11:08 devstack cinder-volume[87068]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Nov 04 10:11:08 devstack cinder-volume[87068]: WARNING oslo.privsep.daemon [-] privsep log: Nov 04 10:11:08 devstack cinder-volume[87068]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Nov 04 10:11:08 devstack cinder-volume[87068]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Nov 04 10:11:08 devstack cinder-volume[87068]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 04 10:11:08 devstack cinder-volume[87068]: WARNING oslo.privsep.daemon [-] privsep log: Nov 04 10:11:08 devstack cinder-volume[87068]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Nov 04 10:11:09 devstack sudo[88222]: pam_unix(sudo:session): session closed for user root Nov 04 10:11:09 devstack cinder-volume[87068]: INFO oslo.privsep.daemon [None req-fa29bf07-334f-4699-9d32-9ac978c770dd tempest-VolumesAdminNegativeTest-1923665913 None] Spawned new privsep daemon via rootwrap Nov 04 10:11:09 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [None req-fa29bf07-334f-4699-9d32-9ac978c770dd tempest-VolumesAdminNegativeTest-1923665913 None] Accepted privsep connection to /tmp/tmpxo0jk9qm/privsep.sock {{(pid=87068) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Nov 04 10:11:09 devstack cinder-volume[87068]: INFO oslo.privsep.daemon [-] privsep daemon starting Nov 04 10:11:09 devstack cinder-volume[87068]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Nov 04 10:11:09 devstack cinder-volume[87068]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Nov 04 10:11:09 devstack cinder-volume[87068]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88271 Nov 04 10:11:09 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[756fed57-c953-43db-9c6f-8656771090e8]: (2,) {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:11:09 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[053fee8b-e9a1-42fa-bc7a-2e71a1af3771]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:11:09 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-fa29bf07-334f-4699-9d32-9ac978c770dd tempest-VolumesAdminNegativeTest-1923665913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-7590b585-03a4-44ad-81f6-eafc82051037 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:11:10 devstack sudo[88294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-7590b585-03a4-44ad-81f6-eafc82051037 Nov 04 10:11:10 devstack sudo[88294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:11:11 devstack sudo[88294]: pam_unix(sudo:session): session closed for user root Nov 04 10:11:11 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-fa29bf07-334f-4699-9d32-9ac978c770dd tempest-VolumesAdminNegativeTest-1923665913 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-7590b585-03a4-44ad-81f6-eafc82051037" returned: 0 in 1.235s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:11:11 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-fa29bf07-334f-4699-9d32-9ac978c770dd tempest-VolumesAdminNegativeTest-1923665913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-7590b585-03a4-44ad-81f6-eafc82051037 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:11:11 devstack sudo[88321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-7590b585-03a4-44ad-81f6-eafc82051037 Nov 04 10:11:11 devstack sudo[88321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:11:12 devstack sudo[88321]: pam_unix(sudo:session): session closed for user root Nov 04 10:11:12 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-fa29bf07-334f-4699-9d32-9ac978c770dd tempest-VolumesAdminNegativeTest-1923665913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-7590b585-03a4-44ad-81f6-eafc82051037" returned: 0 in 0.916s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:11:12 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-fa29bf07-334f-4699-9d32-9ac978c770dd tempest-VolumesAdminNegativeTest-1923665913 None] Lock "cinder-quobyte-7590b585-03a4-44ad-81f6-eafc82051037" released by "delete_volume" :: held 5.218s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:11:12 devstack cinder-volume[87068]: WARNING cinder.quota [None req-fa29bf07-334f-4699-9d32-9ac978c770dd tempest-VolumesAdminNegativeTest-1923665913 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Nov 04 10:11:12 devstack cinder-volume[87068]: WARNING cinder.quota [None req-fa29bf07-334f-4699-9d32-9ac978c770dd tempest-VolumesAdminNegativeTest-1923665913 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Nov 04 10:11:12 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-fa29bf07-334f-4699-9d32-9ac978c770dd tempest-VolumesAdminNegativeTest-1923665913 None] Created reservations ['4d3c1050-88b8-468f-ba7b-000742f5e118', '0ce614d7-69d3-4a51-a0d5-75cc2b99e459', '0b39c136-b7b3-453f-afcb-7a4df533c3d1', '9b7339b4-7292-44ef-9e16-b989eff432f5'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:11:12 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-fa29bf07-334f-4699-9d32-9ac978c770dd tempest-VolumesAdminNegativeTest-1923665913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:11:12 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-fa29bf07-334f-4699-9d32-9ac978c770dd tempest-VolumesAdminNegativeTest-1923665913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:11:12 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-fa29bf07-334f-4699-9d32-9ac978c770dd tempest-VolumesAdminNegativeTest-1923665913 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:11:12 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-fa29bf07-334f-4699-9d32-9ac978c770dd tempest-VolumesAdminNegativeTest-1923665913 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:11:12 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-fa29bf07-334f-4699-9d32-9ac978c770dd tempest-VolumesAdminNegativeTest-1923665913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:11:12 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-fa29bf07-334f-4699-9d32-9ac978c770dd tempest-VolumesAdminNegativeTest-1923665913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:11:12 devstack sudo[88347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:11:12 devstack sudo[88347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:11:13 devstack sudo[88347]: pam_unix(sudo:session): session closed for user root Nov 04 10:11:13 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-fa29bf07-334f-4699-9d32-9ac978c770dd tempest-VolumesAdminNegativeTest-1923665913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.661s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:11:13 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-fa29bf07-334f-4699-9d32-9ac978c770dd tempest-VolumesAdminNegativeTest-1923665913 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:11:13 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-fa29bf07-334f-4699-9d32-9ac978c770dd tempest-VolumesAdminNegativeTest-1923665913 None] Deleted volume successfully. Nov 04 10:11:13 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-fa29bf07-334f-4699-9d32-9ac978c770dd tempest-VolumesAdminNegativeTest-1923665913 None] Lock "cinder-7590b585-03a4-44ad-81f6-eafc82051037-delete_volume" released by "delete_volume" :: held 6.509s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:11:22 devstack cinder-volume[87068]: DEBUG dbcounter [-] [87068] Writing DB stats cinder:SELECT=5,cinder:UPDATE=11,cinder:INSERT=3,cinder:DELETE=1 {{(pid=87068) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 10:11:23 devstack cinder-volume[87068]: DEBUG dbcounter [-] [87068] Writing DB stats cinder:SELECT=9,cinder:UPDATE=11,cinder:INSERT=2,cinder:DELETE=1 {{(pid=87068) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 10:11:27 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-934e7bac-9d05-49c6-9db3-9cff1f089722 tempest-ServersNegativeTestJSON-563180391 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:11:27 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-934e7bac-9d05-49c6-9db3-9cff1f089722 tempest-ServersNegativeTestJSON-563180391 None] Flow 'volume_create_manager' (d8edb1a2-4fc7-4ea7-b424-c985f46f049f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:11:27 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-934e7bac-9d05-49c6-9db3-9cff1f089722 tempest-ServersNegativeTestJSON-563180391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed3878d3-01f4-48de-b276-c0b1f2b9a402) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:11:27 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-934e7bac-9d05-49c6-9db3-9cff1f089722 tempest-ServersNegativeTestJSON-563180391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed3878d3-01f4-48de-b276-c0b1f2b9a402) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:11:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1224122651',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcc52f9e-0b3e-470e-b994-299da7e45f28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c74615046ca47ada08d39ad9ba9e82b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:11:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:11:28Z,use_quota=True,user_id='528932282bd943a1970514e24ffa9cc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:11:27 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-934e7bac-9d05-49c6-9db3-9cff1f089722 tempest-ServersNegativeTestJSON-563180391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04ab3b3d-b12b-4f1e-8e6b-8ceb4fd0f297) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:11:27 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-934e7bac-9d05-49c6-9db3-9cff1f089722 tempest-ServersNegativeTestJSON-563180391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04ab3b3d-b12b-4f1e-8e6b-8ceb4fd0f297) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:11:27 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-934e7bac-9d05-49c6-9db3-9cff1f089722 tempest-ServersNegativeTestJSON-563180391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c45f16f0-4fd0-4ccc-9751-24001b38536b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:11:27 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-934e7bac-9d05-49c6-9db3-9cff1f089722 tempest-ServersNegativeTestJSON-563180391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c45f16f0-4fd0-4ccc-9751-24001b38536b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bcc52f9e-0b3e-470e-b994-299da7e45f28', 'volume_name': 'volume-bcc52f9e-0b3e-470e-b994-299da7e45f28', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:11:27 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-934e7bac-9d05-49c6-9db3-9cff1f089722 tempest-ServersNegativeTestJSON-563180391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79fc8518-03a3-4fee-b466-37c26ed3b0a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:11:27 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-934e7bac-9d05-49c6-9db3-9cff1f089722 tempest-ServersNegativeTestJSON-563180391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79fc8518-03a3-4fee-b466-37c26ed3b0a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:11:27 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-934e7bac-9d05-49c6-9db3-9cff1f089722 tempest-ServersNegativeTestJSON-563180391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c13b8e05-9d62-4e95-bb2b-7120c7144405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:11:27 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-934e7bac-9d05-49c6-9db3-9cff1f089722 tempest-ServersNegativeTestJSON-563180391 None] Volume bcc52f9e-0b3e-470e-b994-299da7e45f28: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bcc52f9e-0b3e-470e-b994-299da7e45f28', 'volume_size': 1} Nov 04 10:11:27 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-934e7bac-9d05-49c6-9db3-9cff1f089722 tempest-ServersNegativeTestJSON-563180391 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:11:27 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-934e7bac-9d05-49c6-9db3-9cff1f089722 tempest-ServersNegativeTestJSON-563180391 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:11:27 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-934e7bac-9d05-49c6-9db3-9cff1f089722 tempest-ServersNegativeTestJSON-563180391 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:11:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1224122651',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcc52f9e-0b3e-470e-b994-299da7e45f28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c74615046ca47ada08d39ad9ba9e82b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:11:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:11:28Z,use_quota=True,user_id='528932282bd943a1970514e24ffa9cc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 10:11:27 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-934e7bac-9d05-49c6-9db3-9cff1f089722 tempest-ServersNegativeTestJSON-563180391 None] Creating volume bcc52f9e-0b3e-470e-b994-299da7e45f28 {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:11:27 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-934e7bac-9d05-49c6-9db3-9cff1f089722 tempest-ServersNegativeTestJSON-563180391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:11:27 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-934e7bac-9d05-49c6-9db3-9cff1f089722 tempest-ServersNegativeTestJSON-563180391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:11:27 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-934e7bac-9d05-49c6-9db3-9cff1f089722 tempest-ServersNegativeTestJSON-563180391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:11:27 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-934e7bac-9d05-49c6-9db3-9cff1f089722 tempest-ServersNegativeTestJSON-563180391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:11:27 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-934e7bac-9d05-49c6-9db3-9cff1f089722 tempest-ServersNegativeTestJSON-563180391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:11:27 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-934e7bac-9d05-49c6-9db3-9cff1f089722 tempest-ServersNegativeTestJSON-563180391 None] Selected osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:11:27 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-934e7bac-9d05-49c6-9db3-9cff1f089722 tempest-ServersNegativeTestJSON-563180391 None] casted to osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 Nov 04 10:11:27 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-934e7bac-9d05-49c6-9db3-9cff1f089722 tempest-ServersNegativeTestJSON-563180391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-bcc52f9e-0b3e-470e-b994-299da7e45f28 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:11:27 devstack sudo[88441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-bcc52f9e-0b3e-470e-b994-299da7e45f28 1073741824 Nov 04 10:11:27 devstack sudo[88441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:11:28 devstack sudo[88441]: pam_unix(sudo:session): session closed for user root Nov 04 10:11:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-934e7bac-9d05-49c6-9db3-9cff1f089722 tempest-ServersNegativeTestJSON-563180391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-bcc52f9e-0b3e-470e-b994-299da7e45f28 1073741824" returned: 0 in 0.530s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:11:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-934e7bac-9d05-49c6-9db3-9cff1f089722 tempest-ServersNegativeTestJSON-563180391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-bcc52f9e-0b3e-470e-b994-299da7e45f28 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:11:28 devstack sudo[88447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-bcc52f9e-0b3e-470e-b994-299da7e45f28 Nov 04 10:11:28 devstack sudo[88447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:11:28 devstack sudo[88447]: pam_unix(sudo:session): session closed for user root Nov 04 10:11:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-934e7bac-9d05-49c6-9db3-9cff1f089722 tempest-ServersNegativeTestJSON-563180391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-bcc52f9e-0b3e-470e-b994-299da7e45f28" returned: 0 in 0.326s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:11:28 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-934e7bac-9d05-49c6-9db3-9cff1f089722 tempest-ServersNegativeTestJSON-563180391 None] <== create_volume: return (909ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 10:11:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-934e7bac-9d05-49c6-9db3-9cff1f089722 tempest-ServersNegativeTestJSON-563180391 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.913s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:11:28 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-934e7bac-9d05-49c6-9db3-9cff1f089722 tempest-ServersNegativeTestJSON-563180391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c13b8e05-9d62-4e95-bb2b-7120c7144405) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bcc52f9e-0b3e-470e-b994-299da7e45f28', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:11:28 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-934e7bac-9d05-49c6-9db3-9cff1f089722 tempest-ServersNegativeTestJSON-563180391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aea2e71c-3daa-4bd5-a4e5-ee47e638a89d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:11:28 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-934e7bac-9d05-49c6-9db3-9cff1f089722 tempest-ServersNegativeTestJSON-563180391 None] Volume volume-bcc52f9e-0b3e-470e-b994-299da7e45f28 (bcc52f9e-0b3e-470e-b994-299da7e45f28): created successfully Nov 04 10:11:28 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-934e7bac-9d05-49c6-9db3-9cff1f089722 tempest-ServersNegativeTestJSON-563180391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aea2e71c-3daa-4bd5-a4e5-ee47e638a89d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:11:28 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-934e7bac-9d05-49c6-9db3-9cff1f089722 tempest-ServersNegativeTestJSON-563180391 None] Flow 'volume_create_manager' (d8edb1a2-4fc7-4ea7-b424-c985f46f049f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:11:28 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-934e7bac-9d05-49c6-9db3-9cff1f089722 tempest-ServersNegativeTestJSON-563180391 None] Created volume successfully. Nov 04 10:11:32 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf779441-4483-4df9-b783-7cbee4f66e3b tempest-ServersNegativeTestJSON-563180391 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:11:32 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-bf779441-4483-4df9-b783-7cbee4f66e3b tempest-ServersNegativeTestJSON-563180391 None] Flow 'volume_create_manager' (dc715b7a-777f-4b36-b549-13037e9da944) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:11:32 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-bf779441-4483-4df9-b783-7cbee4f66e3b tempest-ServersNegativeTestJSON-563180391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7cad01cd-c745-4ef1-81fd-8e63a40f48ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:11:32 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-bf779441-4483-4df9-b783-7cbee4f66e3b tempest-ServersNegativeTestJSON-563180391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7cad01cd-c745-4ef1-81fd-8e63a40f48ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:11:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-65584269',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34e7aa0c-815e-45df-b8fc-b4577fef9d37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c74615046ca47ada08d39ad9ba9e82b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:11:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:11:32Z,use_quota=True,user_id='528932282bd943a1970514e24ffa9cc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:11:32 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-bf779441-4483-4df9-b783-7cbee4f66e3b tempest-ServersNegativeTestJSON-563180391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd937b72-1cb9-4751-aa78-6ba1766b1fec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:11:32 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-bf779441-4483-4df9-b783-7cbee4f66e3b tempest-ServersNegativeTestJSON-563180391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd937b72-1cb9-4751-aa78-6ba1766b1fec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:11:32 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-bf779441-4483-4df9-b783-7cbee4f66e3b tempest-ServersNegativeTestJSON-563180391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa28d00e-77c5-41b0-87c2-fc4724f8531a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:11:32 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-bf779441-4483-4df9-b783-7cbee4f66e3b tempest-ServersNegativeTestJSON-563180391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa28d00e-77c5-41b0-87c2-fc4724f8531a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34e7aa0c-815e-45df-b8fc-b4577fef9d37', 'volume_name': 'volume-34e7aa0c-815e-45df-b8fc-b4577fef9d37', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:11:32 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-bf779441-4483-4df9-b783-7cbee4f66e3b tempest-ServersNegativeTestJSON-563180391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e883711-b5c8-44d8-961d-4afd14c849a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:11:32 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-bf779441-4483-4df9-b783-7cbee4f66e3b tempest-ServersNegativeTestJSON-563180391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e883711-b5c8-44d8-961d-4afd14c849a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:11:32 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-bf779441-4483-4df9-b783-7cbee4f66e3b tempest-ServersNegativeTestJSON-563180391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8a23b51-2a98-4118-a23c-00cc413b9992) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:11:32 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-bf779441-4483-4df9-b783-7cbee4f66e3b tempest-ServersNegativeTestJSON-563180391 None] Volume 34e7aa0c-815e-45df-b8fc-b4577fef9d37: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34e7aa0c-815e-45df-b8fc-b4577fef9d37', 'volume_size': 1} Nov 04 10:11:32 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-bf779441-4483-4df9-b783-7cbee4f66e3b tempest-ServersNegativeTestJSON-563180391 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:11:32 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-bf779441-4483-4df9-b783-7cbee4f66e3b tempest-ServersNegativeTestJSON-563180391 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:11:32 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-bf779441-4483-4df9-b783-7cbee4f66e3b tempest-ServersNegativeTestJSON-563180391 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:11:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-65584269',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34e7aa0c-815e-45df-b8fc-b4577fef9d37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c74615046ca47ada08d39ad9ba9e82b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:11:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:11:32Z,use_quota=True,user_id='528932282bd943a1970514e24ffa9cc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 10:11:32 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-bf779441-4483-4df9-b783-7cbee4f66e3b tempest-ServersNegativeTestJSON-563180391 None] Creating volume 34e7aa0c-815e-45df-b8fc-b4577fef9d37 {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:11:32 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-bf779441-4483-4df9-b783-7cbee4f66e3b tempest-ServersNegativeTestJSON-563180391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:11:32 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-bf779441-4483-4df9-b783-7cbee4f66e3b tempest-ServersNegativeTestJSON-563180391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:11:32 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-bf779441-4483-4df9-b783-7cbee4f66e3b tempest-ServersNegativeTestJSON-563180391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:11:32 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-bf779441-4483-4df9-b783-7cbee4f66e3b tempest-ServersNegativeTestJSON-563180391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:11:32 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-bf779441-4483-4df9-b783-7cbee4f66e3b tempest-ServersNegativeTestJSON-563180391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:11:32 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-bf779441-4483-4df9-b783-7cbee4f66e3b tempest-ServersNegativeTestJSON-563180391 None] Selected osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:11:32 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-bf779441-4483-4df9-b783-7cbee4f66e3b tempest-ServersNegativeTestJSON-563180391 None] casted to osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 Nov 04 10:11:32 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-bf779441-4483-4df9-b783-7cbee4f66e3b tempest-ServersNegativeTestJSON-563180391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-34e7aa0c-815e-45df-b8fc-b4577fef9d37 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:11:32 devstack sudo[88506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-34e7aa0c-815e-45df-b8fc-b4577fef9d37 1073741824 Nov 04 10:11:32 devstack sudo[88506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:11:33 devstack sudo[88506]: pam_unix(sudo:session): session closed for user root Nov 04 10:11:33 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-bf779441-4483-4df9-b783-7cbee4f66e3b tempest-ServersNegativeTestJSON-563180391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-34e7aa0c-815e-45df-b8fc-b4577fef9d37 1073741824" returned: 0 in 0.616s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:11:33 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-bf779441-4483-4df9-b783-7cbee4f66e3b tempest-ServersNegativeTestJSON-563180391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-34e7aa0c-815e-45df-b8fc-b4577fef9d37 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:11:33 devstack sudo[88512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-34e7aa0c-815e-45df-b8fc-b4577fef9d37 Nov 04 10:11:33 devstack sudo[88512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:11:33 devstack sudo[88512]: pam_unix(sudo:session): session closed for user root Nov 04 10:11:33 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-bf779441-4483-4df9-b783-7cbee4f66e3b tempest-ServersNegativeTestJSON-563180391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-34e7aa0c-815e-45df-b8fc-b4577fef9d37" returned: 0 in 0.352s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:11:33 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-bf779441-4483-4df9-b783-7cbee4f66e3b tempest-ServersNegativeTestJSON-563180391 None] <== create_volume: return (1046ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 10:11:33 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-bf779441-4483-4df9-b783-7cbee4f66e3b tempest-ServersNegativeTestJSON-563180391 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.061s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:11:33 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-bf779441-4483-4df9-b783-7cbee4f66e3b tempest-ServersNegativeTestJSON-563180391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8a23b51-2a98-4118-a23c-00cc413b9992) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34e7aa0c-815e-45df-b8fc-b4577fef9d37', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:11:33 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-bf779441-4483-4df9-b783-7cbee4f66e3b tempest-ServersNegativeTestJSON-563180391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4a9574c-66fc-42c4-b74a-4e91d8f2e886) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:11:33 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-bf779441-4483-4df9-b783-7cbee4f66e3b tempest-ServersNegativeTestJSON-563180391 None] Volume volume-34e7aa0c-815e-45df-b8fc-b4577fef9d37 (34e7aa0c-815e-45df-b8fc-b4577fef9d37): created successfully Nov 04 10:11:33 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-bf779441-4483-4df9-b783-7cbee4f66e3b tempest-ServersNegativeTestJSON-563180391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4a9574c-66fc-42c4-b74a-4e91d8f2e886) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:11:33 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-bf779441-4483-4df9-b783-7cbee4f66e3b tempest-ServersNegativeTestJSON-563180391 None] Flow 'volume_create_manager' (dc715b7a-777f-4b36-b549-13037e9da944) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:11:33 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-bf779441-4483-4df9-b783-7cbee4f66e3b tempest-ServersNegativeTestJSON-563180391 None] Created volume successfully. Nov 04 10:11:35 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-ba051c34-0a29-4c24-a1f3-dda32e4a1137 tempest-ServersNegativeTestJSON-563180391 None] Acquiring lock "cinder-34e7aa0c-815e-45df-b8fc-b4577fef9d37-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:11:35 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-ba051c34-0a29-4c24-a1f3-dda32e4a1137 tempest-ServersNegativeTestJSON-563180391 None] Lock "cinder-34e7aa0c-815e-45df-b8fc-b4577fef9d37-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:11:35 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-ba051c34-0a29-4c24-a1f3-dda32e4a1137 tempest-ServersNegativeTestJSON-563180391 None] Acquiring lock "cinder-quobyte-34e7aa0c-815e-45df-b8fc-b4577fef9d37" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:11:35 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-ba051c34-0a29-4c24-a1f3-dda32e4a1137 tempest-ServersNegativeTestJSON-563180391 None] Lock "cinder-quobyte-34e7aa0c-815e-45df-b8fc-b4577fef9d37" acquired by "delete_volume" :: waited 0.015s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:11:35 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[6543da96-d287-42a9-b53d-faf512f58275]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:11:35 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ba051c34-0a29-4c24-a1f3-dda32e4a1137 tempest-ServersNegativeTestJSON-563180391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-34e7aa0c-815e-45df-b8fc-b4577fef9d37 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:11:35 devstack sudo[88522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-34e7aa0c-815e-45df-b8fc-b4577fef9d37 Nov 04 10:11:35 devstack sudo[88522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:11:35 devstack sudo[88522]: pam_unix(sudo:session): session closed for user root Nov 04 10:11:35 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ba051c34-0a29-4c24-a1f3-dda32e4a1137 tempest-ServersNegativeTestJSON-563180391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-34e7aa0c-815e-45df-b8fc-b4577fef9d37" returned: 0 in 0.426s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:11:35 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ba051c34-0a29-4c24-a1f3-dda32e4a1137 tempest-ServersNegativeTestJSON-563180391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-34e7aa0c-815e-45df-b8fc-b4577fef9d37 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:11:35 devstack sudo[88530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-34e7aa0c-815e-45df-b8fc-b4577fef9d37 Nov 04 10:11:35 devstack sudo[88530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:11:35 devstack sudo[88530]: pam_unix(sudo:session): session closed for user root Nov 04 10:11:35 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ba051c34-0a29-4c24-a1f3-dda32e4a1137 tempest-ServersNegativeTestJSON-563180391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-34e7aa0c-815e-45df-b8fc-b4577fef9d37" returned: 0 in 0.276s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:11:36 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-ba051c34-0a29-4c24-a1f3-dda32e4a1137 tempest-ServersNegativeTestJSON-563180391 None] Lock "cinder-quobyte-34e7aa0c-815e-45df-b8fc-b4577fef9d37" released by "delete_volume" :: held 0.770s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:11:36 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-ba051c34-0a29-4c24-a1f3-dda32e4a1137 tempest-ServersNegativeTestJSON-563180391 None] Created reservations ['171918d5-f9ae-4dfa-bf2a-277a9430799b', 'c7108f75-3c96-4b2d-a162-603ce714e761', '42b42ff1-b9ed-4431-92c4-50912e9b2b11', '750f800f-e611-443e-adfe-09bd1c724f1c'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:11:36 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-ba051c34-0a29-4c24-a1f3-dda32e4a1137 tempest-ServersNegativeTestJSON-563180391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:11:36 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-ba051c34-0a29-4c24-a1f3-dda32e4a1137 tempest-ServersNegativeTestJSON-563180391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:11:36 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-ba051c34-0a29-4c24-a1f3-dda32e4a1137 tempest-ServersNegativeTestJSON-563180391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:11:36 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-ba051c34-0a29-4c24-a1f3-dda32e4a1137 tempest-ServersNegativeTestJSON-563180391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:11:36 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-ba051c34-0a29-4c24-a1f3-dda32e4a1137 tempest-ServersNegativeTestJSON-563180391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:11:36 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ba051c34-0a29-4c24-a1f3-dda32e4a1137 tempest-ServersNegativeTestJSON-563180391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:11:36 devstack sudo[88534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:11:36 devstack sudo[88534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:11:36 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-c011bae1-e5f5-44e7-ad5c-25724dd5c808 tempest-ServersNegativeTestJSON-563180391 None] Acquiring lock "cinder-bcc52f9e-0b3e-470e-b994-299da7e45f28-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:11:36 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-c011bae1-e5f5-44e7-ad5c-25724dd5c808 tempest-ServersNegativeTestJSON-563180391 None] Lock "cinder-bcc52f9e-0b3e-470e-b994-299da7e45f28-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:11:36 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-c011bae1-e5f5-44e7-ad5c-25724dd5c808 tempest-ServersNegativeTestJSON-563180391 None] Acquiring lock "cinder-quobyte-bcc52f9e-0b3e-470e-b994-299da7e45f28" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:11:36 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-c011bae1-e5f5-44e7-ad5c-25724dd5c808 tempest-ServersNegativeTestJSON-563180391 None] Lock "cinder-quobyte-bcc52f9e-0b3e-470e-b994-299da7e45f28" acquired by "delete_volume" :: waited 0.020s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:11:36 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[82083f36-be61-4393-8392-3779b5005380]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:11:36 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c011bae1-e5f5-44e7-ad5c-25724dd5c808 tempest-ServersNegativeTestJSON-563180391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-bcc52f9e-0b3e-470e-b994-299da7e45f28 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:11:36 devstack sudo[88537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-bcc52f9e-0b3e-470e-b994-299da7e45f28 Nov 04 10:11:36 devstack sudo[88537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:11:36 devstack sudo[88534]: pam_unix(sudo:session): session closed for user root Nov 04 10:11:36 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ba051c34-0a29-4c24-a1f3-dda32e4a1137 tempest-ServersNegativeTestJSON-563180391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.508s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:11:36 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-ba051c34-0a29-4c24-a1f3-dda32e4a1137 tempest-ServersNegativeTestJSON-563180391 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:11:36 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-ba051c34-0a29-4c24-a1f3-dda32e4a1137 tempest-ServersNegativeTestJSON-563180391 None] Deleted volume successfully. Nov 04 10:11:36 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-ba051c34-0a29-4c24-a1f3-dda32e4a1137 tempest-ServersNegativeTestJSON-563180391 None] Lock "cinder-34e7aa0c-815e-45df-b8fc-b4577fef9d37-delete_volume" released by "delete_volume" :: held 1.616s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:11:37 devstack sudo[88537]: pam_unix(sudo:session): session closed for user root Nov 04 10:11:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c011bae1-e5f5-44e7-ad5c-25724dd5c808 tempest-ServersNegativeTestJSON-563180391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-bcc52f9e-0b3e-470e-b994-299da7e45f28" returned: 0 in 0.494s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:11:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c011bae1-e5f5-44e7-ad5c-25724dd5c808 tempest-ServersNegativeTestJSON-563180391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-bcc52f9e-0b3e-470e-b994-299da7e45f28 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:11:37 devstack sudo[88557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-bcc52f9e-0b3e-470e-b994-299da7e45f28 Nov 04 10:11:37 devstack sudo[88557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:11:37 devstack sudo[88557]: pam_unix(sudo:session): session closed for user root Nov 04 10:11:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c011bae1-e5f5-44e7-ad5c-25724dd5c808 tempest-ServersNegativeTestJSON-563180391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-bcc52f9e-0b3e-470e-b994-299da7e45f28" returned: 0 in 0.339s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:11:37 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-c011bae1-e5f5-44e7-ad5c-25724dd5c808 tempest-ServersNegativeTestJSON-563180391 None] Lock "cinder-quobyte-bcc52f9e-0b3e-470e-b994-299da7e45f28" released by "delete_volume" :: held 0.905s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:11:37 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-c011bae1-e5f5-44e7-ad5c-25724dd5c808 tempest-ServersNegativeTestJSON-563180391 None] Created reservations ['025b0e8f-2b24-4927-a715-26e00e71629c', 'a22e63b6-3c2c-41e6-b319-9d7ebd228e50', '74d4d2a8-7bbd-4598-a7bb-5d6573ed449c', 'd58e46cc-87e4-43b0-a1bd-f4705661012d'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:11:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-c011bae1-e5f5-44e7-ad5c-25724dd5c808 tempest-ServersNegativeTestJSON-563180391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:11:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-c011bae1-e5f5-44e7-ad5c-25724dd5c808 tempest-ServersNegativeTestJSON-563180391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:11:37 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-c011bae1-e5f5-44e7-ad5c-25724dd5c808 tempest-ServersNegativeTestJSON-563180391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:11:37 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-c011bae1-e5f5-44e7-ad5c-25724dd5c808 tempest-ServersNegativeTestJSON-563180391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:11:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-c011bae1-e5f5-44e7-ad5c-25724dd5c808 tempest-ServersNegativeTestJSON-563180391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:11:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c011bae1-e5f5-44e7-ad5c-25724dd5c808 tempest-ServersNegativeTestJSON-563180391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:11:37 devstack sudo[88565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:11:37 devstack sudo[88565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:11:37 devstack sudo[88565]: pam_unix(sudo:session): session closed for user root Nov 04 10:11:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c011bae1-e5f5-44e7-ad5c-25724dd5c808 tempest-ServersNegativeTestJSON-563180391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.241s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:11:37 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-c011bae1-e5f5-44e7-ad5c-25724dd5c808 tempest-ServersNegativeTestJSON-563180391 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:11:37 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-c011bae1-e5f5-44e7-ad5c-25724dd5c808 tempest-ServersNegativeTestJSON-563180391 None] Deleted volume successfully. Nov 04 10:11:37 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-c011bae1-e5f5-44e7-ad5c-25724dd5c808 tempest-ServersNegativeTestJSON-563180391 None] Lock "cinder-bcc52f9e-0b3e-470e-b994-299da7e45f28-delete_volume" released by "delete_volume" :: held 1.381s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:11:47 devstack cinder-volume[87068]: DEBUG dbcounter [-] [87068] Writing DB stats cinder:SELECT=15,cinder:INSERT=3,cinder:UPDATE=21 {{(pid=87068) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 10:11:47 devstack cinder-volume[87068]: DEBUG dbcounter [-] [87068] Writing DB stats cinder:UPDATE=24,cinder:SELECT=14,cinder:DELETE=4,cinder:INSERT=7 {{(pid=87068) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 10:11:53 devstack cinder-volume[87068]: DEBUG oslo_service.periodic_task [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87068) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 10:11:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:11:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:11:53 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:11:53 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:11:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:11:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:11:53 devstack sudo[88743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:11:53 devstack sudo[88743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:11:54 devstack sudo[88743]: pam_unix(sudo:session): session closed for user root Nov 04 10:11:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.555s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:11:54 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:11:54 devstack cinder-volume[87068]: DEBUG oslo_service.periodic_task [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Running periodic task VolumeManager._thread_info {{(pid=87068) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 10:11:54 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] thread count: 8 {{(pid=87068) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 04 10:11:54 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] thread info: [<_MainThread(MainThread, started 126275656192128)>, , , , , , , ] {{(pid=87068) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 04 10:11:55 devstack cinder-volume[87068]: WARNING py.warnings [req-b0c26286-29d2-41fa-baea-9c04faa28089 req-42c03286-fa04-44ce-b960-6f6f109d9130 tempest-TaggedAttachmentsTest-2100419357 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment". Apply join condition(s) between each element to resolve. Nov 04 10:11:55 devstack cinder-volume[87068]: .first() Nov 04 10:11:55 devstack cinder-volume[87068]: Nov 04 10:11:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [req-b0c26286-29d2-41fa-baea-9c04faa28089 req-42c03286-fa04-44ce-b960-6f6f109d9130 tempest-TaggedAttachmentsTest-2100419357 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:11:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [req-b0c26286-29d2-41fa-baea-9c04faa28089 req-42c03286-fa04-44ce-b960-6f6f109d9130 tempest-TaggedAttachmentsTest-2100419357 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:11:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [req-b0c26286-29d2-41fa-baea-9c04faa28089 req-42c03286-fa04-44ce-b960-6f6f109d9130 tempest-TaggedAttachmentsTest-2100419357 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:11:56 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [req-b0c26286-29d2-41fa-baea-9c04faa28089 req-42c03286-fa04-44ce-b960-6f6f109d9130 tempest-TaggedAttachmentsTest-2100419357 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034', 'name': 'volume-c907e08f-679b-4d9e-9509-f9cedb6db50b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '76931d01-e5b7-40ed-b626-286c452beb3f', 'enforce_multipath': True} {{(pid=87068) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 04 10:11:56 devstack cinder-volume[87068]: INFO cinder.volume.manager [req-b0c26286-29d2-41fa-baea-9c04faa28089 req-42c03286-fa04-44ce-b960-6f6f109d9130 tempest-TaggedAttachmentsTest-2100419357 None] attachment_update completed successfully. Nov 04 10:11:58 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-f6a1d958-f0f1-4d8f-af92-8d6c448145a5 tempest-GroupsTest-1853585352 None] Group tempest-Group1-1699306507: creating Nov 04 10:11:58 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-f6a1d958-f0f1-4d8f-af92-8d6c448145a5 tempest-GroupsTest-1853585352 None] Group tempest-Group1-1699306507: created successfully Nov 04 10:11:58 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-f6a1d958-f0f1-4d8f-af92-8d6c448145a5 tempest-GroupsTest-1853585352 None] Create group completed successfully. Nov 04 10:11:59 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-deacd90a-a72e-4cd8-92e2-ab126a014a33 tempest-GroupsTest-1853585352 None] Group tempest-Group2-1204167738: creating Nov 04 10:11:59 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-deacd90a-a72e-4cd8-92e2-ab126a014a33 tempest-GroupsTest-1853585352 None] Group tempest-Group2-1204167738: created successfully Nov 04 10:11:59 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-deacd90a-a72e-4cd8-92e2-ab126a014a33 tempest-GroupsTest-1853585352 None] Create group completed successfully. Nov 04 10:12:00 devstack cinder-volume[87068]: INFO cinder.volume.manager [req-7a03b3dd-8e28-449c-96e2-e67ff6b92f73 req-85acbeaf-cc67-47d9-943c-5987a6dffc43 tempest-TaggedAttachmentsTest-2100419357 None] Terminate volume connection completed successfully. Nov 04 10:12:00 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [req-7a03b3dd-8e28-449c-96e2-e67ff6b92f73 req-85acbeaf-cc67-47d9-943c-5987a6dffc43 tempest-TaggedAttachmentsTest-2100419357 None] Deleting attachment 76931d01-e5b7-40ed-b626-286c452beb3f. {{(pid=87068) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 04 10:12:01 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-78796a54-5571-489d-b76d-89168c11464c tempest-GroupsTest-1853585352 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:12:01 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-78796a54-5571-489d-b76d-89168c11464c tempest-GroupsTest-1853585352 None] Flow 'volume_create_manager' (cd09973f-595c-48a1-92e7-34d32a635676) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:12:01 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-78796a54-5571-489d-b76d-89168c11464c tempest-GroupsTest-1853585352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cee5d4be-ce44-4c1e-9ce4-2b28d6a2882c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:12:01 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-78796a54-5571-489d-b76d-89168c11464c tempest-GroupsTest-1853585352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cee5d4be-ce44-4c1e-9ce4-2b28d6a2882c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:12:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2020092108',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2a85619e-7686-48c2-9f91-b8d2feea8650,host='devstack@QuobyteHD#QuobyteHD',id=b872f029-1017-41d3-b438-b858644566fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5fe58536636425880017af2e87b1b82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:12:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:12:01Z,use_quota=True,user_id='868dc92a974a474c8b4534276408bf1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f990dd9b-4634-443c-976a-b847f4c92127),volume_type_id=f990dd9b-4634-443c-976a-b847f4c92127)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:12:01 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-78796a54-5571-489d-b76d-89168c11464c tempest-GroupsTest-1853585352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52476520-e823-4f71-8ee4-1f39ab6ba125) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:12:01 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-78796a54-5571-489d-b76d-89168c11464c tempest-GroupsTest-1853585352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52476520-e823-4f71-8ee4-1f39ab6ba125) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:12:01 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-78796a54-5571-489d-b76d-89168c11464c tempest-GroupsTest-1853585352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b34ebccd-6e0b-4eb5-8469-0a3488ee5ae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:12:01 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-78796a54-5571-489d-b76d-89168c11464c tempest-GroupsTest-1853585352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b34ebccd-6e0b-4eb5-8469-0a3488ee5ae9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b872f029-1017-41d3-b438-b858644566fd', 'volume_name': 'volume-b872f029-1017-41d3-b438-b858644566fd', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:12:01 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-78796a54-5571-489d-b76d-89168c11464c tempest-GroupsTest-1853585352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6870d6c-74c5-4e92-9df6-030c4d68bfc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:12:01 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-78796a54-5571-489d-b76d-89168c11464c tempest-GroupsTest-1853585352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6870d6c-74c5-4e92-9df6-030c4d68bfc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:12:01 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-78796a54-5571-489d-b76d-89168c11464c tempest-GroupsTest-1853585352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (294b9146-4160-4b16-9eb0-abdcba780f48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:12:01 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-78796a54-5571-489d-b76d-89168c11464c tempest-GroupsTest-1853585352 None] Volume b872f029-1017-41d3-b438-b858644566fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b872f029-1017-41d3-b438-b858644566fd', 'volume_size': 1} Nov 04 10:12:01 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-78796a54-5571-489d-b76d-89168c11464c tempest-GroupsTest-1853585352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:12:01 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-78796a54-5571-489d-b76d-89168c11464c tempest-GroupsTest-1853585352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:12:01 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-78796a54-5571-489d-b76d-89168c11464c tempest-GroupsTest-1853585352 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=2a85619e-7686-48c2-9f91-b8d2feea8650,created_at=2026-11-04T09:12:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2020092108',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2a85619e-7686-48c2-9f91-b8d2feea8650,host='devstack@QuobyteHD#QuobyteHD',id=b872f029-1017-41d3-b438-b858644566fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5fe58536636425880017af2e87b1b82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:12:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:12:01Z,use_quota=True,user_id='868dc92a974a474c8b4534276408bf1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f990dd9b-4634-443c-976a-b847f4c92127),volume_type_id=f990dd9b-4634-443c-976a-b847f4c92127)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 10:12:01 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-78796a54-5571-489d-b76d-89168c11464c tempest-GroupsTest-1853585352 None] Creating volume b872f029-1017-41d3-b438-b858644566fd {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:12:01 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-78796a54-5571-489d-b76d-89168c11464c tempest-GroupsTest-1853585352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:12:01 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-78796a54-5571-489d-b76d-89168c11464c tempest-GroupsTest-1853585352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:12:01 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-78796a54-5571-489d-b76d-89168c11464c tempest-GroupsTest-1853585352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:12:01 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-78796a54-5571-489d-b76d-89168c11464c tempest-GroupsTest-1853585352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:12:01 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-78796a54-5571-489d-b76d-89168c11464c tempest-GroupsTest-1853585352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:12:01 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-78796a54-5571-489d-b76d-89168c11464c tempest-GroupsTest-1853585352 None] Selected osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:12:01 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-78796a54-5571-489d-b76d-89168c11464c tempest-GroupsTest-1853585352 None] casted to osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 Nov 04 10:12:01 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-78796a54-5571-489d-b76d-89168c11464c tempest-GroupsTest-1853585352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b872f029-1017-41d3-b438-b858644566fd 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:12:01 devstack sudo[89244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b872f029-1017-41d3-b438-b858644566fd 1073741824 Nov 04 10:12:01 devstack sudo[89244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:12:02 devstack sudo[89244]: pam_unix(sudo:session): session closed for user root Nov 04 10:12:02 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-78796a54-5571-489d-b76d-89168c11464c tempest-GroupsTest-1853585352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b872f029-1017-41d3-b438-b858644566fd 1073741824" returned: 0 in 0.661s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:12:02 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-78796a54-5571-489d-b76d-89168c11464c tempest-GroupsTest-1853585352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b872f029-1017-41d3-b438-b858644566fd {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:12:02 devstack sudo[89266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b872f029-1017-41d3-b438-b858644566fd Nov 04 10:12:02 devstack sudo[89266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:12:02 devstack sudo[89266]: pam_unix(sudo:session): session closed for user root Nov 04 10:12:02 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-78796a54-5571-489d-b76d-89168c11464c tempest-GroupsTest-1853585352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b872f029-1017-41d3-b438-b858644566fd" returned: 0 in 0.366s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:12:02 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-78796a54-5571-489d-b76d-89168c11464c tempest-GroupsTest-1853585352 None] <== create_volume: return (1083ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 10:12:02 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-78796a54-5571-489d-b76d-89168c11464c tempest-GroupsTest-1853585352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.086s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:12:02 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-78796a54-5571-489d-b76d-89168c11464c tempest-GroupsTest-1853585352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (294b9146-4160-4b16-9eb0-abdcba780f48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b872f029-1017-41d3-b438-b858644566fd', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:12:02 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-78796a54-5571-489d-b76d-89168c11464c tempest-GroupsTest-1853585352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e19f7d4-f59a-4270-b2c7-412c260f9301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:12:02 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-78796a54-5571-489d-b76d-89168c11464c tempest-GroupsTest-1853585352 None] Volume volume-b872f029-1017-41d3-b438-b858644566fd (b872f029-1017-41d3-b438-b858644566fd): created successfully Nov 04 10:12:02 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-78796a54-5571-489d-b76d-89168c11464c tempest-GroupsTest-1853585352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e19f7d4-f59a-4270-b2c7-412c260f9301) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:12:02 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-78796a54-5571-489d-b76d-89168c11464c tempest-GroupsTest-1853585352 None] Flow 'volume_create_manager' (cd09973f-595c-48a1-92e7-34d32a635676) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:12:02 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-78796a54-5571-489d-b76d-89168c11464c tempest-GroupsTest-1853585352 None] Created volume successfully. Nov 04 10:12:04 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-03796311-f531-401d-88be-b1422a951761 tempest-GroupsTest-1853585352 None] Acquiring lock "cinder-quobyte-b872f029-1017-41d3-b438-b858644566fd" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:12:04 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-03796311-f531-401d-88be-b1422a951761 tempest-GroupsTest-1853585352 None] Lock "cinder-quobyte-b872f029-1017-41d3-b438-b858644566fd" acquired by "delete_volume" :: waited 0.036s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:12:04 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[27877a05-d5e3-45e3-8df1-26604f968e4c]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:12:04 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-03796311-f531-401d-88be-b1422a951761 tempest-GroupsTest-1853585352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b872f029-1017-41d3-b438-b858644566fd {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:12:05 devstack sudo[89274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b872f029-1017-41d3-b438-b858644566fd Nov 04 10:12:05 devstack sudo[89274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:12:05 devstack sudo[89274]: pam_unix(sudo:session): session closed for user root Nov 04 10:12:05 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-03796311-f531-401d-88be-b1422a951761 tempest-GroupsTest-1853585352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b872f029-1017-41d3-b438-b858644566fd" returned: 0 in 0.643s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:12:05 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-03796311-f531-401d-88be-b1422a951761 tempest-GroupsTest-1853585352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b872f029-1017-41d3-b438-b858644566fd {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:12:05 devstack sudo[89297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b872f029-1017-41d3-b438-b858644566fd Nov 04 10:12:05 devstack sudo[89297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:12:05 devstack sudo[89297]: pam_unix(sudo:session): session closed for user root Nov 04 10:12:05 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-03796311-f531-401d-88be-b1422a951761 tempest-GroupsTest-1853585352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b872f029-1017-41d3-b438-b858644566fd" returned: 0 in 0.331s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:12:05 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-03796311-f531-401d-88be-b1422a951761 tempest-GroupsTest-1853585352 None] Lock "cinder-quobyte-b872f029-1017-41d3-b438-b858644566fd" released by "delete_volume" :: held 1.051s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:12:06 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-03796311-f531-401d-88be-b1422a951761 tempest-GroupsTest-1853585352 None] Created reservations ['4d7437af-26ec-4120-b5bc-d886e2683d9e'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:12:06 devstack cinder-volume[87068]: WARNING cinder.quota [None req-03796311-f531-401d-88be-b1422a951761 tempest-GroupsTest-1853585352 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-269535501 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-269535501, it is now deprecated. Please use the default quota class for default quota. Nov 04 10:12:06 devstack cinder-volume[87068]: WARNING cinder.quota [None req-03796311-f531-401d-88be-b1422a951761 tempest-GroupsTest-1853585352 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-269535501 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-269535501, it is now deprecated. Please use the default quota class for default quota. Nov 04 10:12:06 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-03796311-f531-401d-88be-b1422a951761 tempest-GroupsTest-1853585352 None] Created reservations ['eb935dec-c3aa-4296-bfb5-91dbac997013', '9764d8d5-9b5b-4fd6-af4e-ad25a77c7c58', 'e20a94f3-9d65-49ed-8e09-fa7f00718b45', '46862030-5c0c-43d4-a639-a0f5cf43ecf8'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:12:06 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-03796311-f531-401d-88be-b1422a951761 tempest-GroupsTest-1853585352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:12:06 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-03796311-f531-401d-88be-b1422a951761 tempest-GroupsTest-1853585352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:12:06 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-03796311-f531-401d-88be-b1422a951761 tempest-GroupsTest-1853585352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:12:06 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-03796311-f531-401d-88be-b1422a951761 tempest-GroupsTest-1853585352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:12:06 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-03796311-f531-401d-88be-b1422a951761 tempest-GroupsTest-1853585352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:12:06 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-03796311-f531-401d-88be-b1422a951761 tempest-GroupsTest-1853585352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:12:06 devstack sudo[89304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:12:06 devstack sudo[89304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:12:06 devstack sudo[89304]: pam_unix(sudo:session): session closed for user root Nov 04 10:12:06 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-03796311-f531-401d-88be-b1422a951761 tempest-GroupsTest-1853585352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.381s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:12:06 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-03796311-f531-401d-88be-b1422a951761 tempest-GroupsTest-1853585352 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:12:06 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-03796311-f531-401d-88be-b1422a951761 tempest-GroupsTest-1853585352 None] Delete group completed successfully. Nov 04 10:12:07 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-2ab7249e-1166-4c10-ada6-384c6374f1ac tempest-GroupsTest-1853585352 None] Created reservations ['4aa42c11-341e-46c0-a8b2-04de04c3f368'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:12:07 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-2ab7249e-1166-4c10-ada6-384c6374f1ac tempest-GroupsTest-1853585352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:12:07 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-2ab7249e-1166-4c10-ada6-384c6374f1ac tempest-GroupsTest-1853585352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:12:07 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-2ab7249e-1166-4c10-ada6-384c6374f1ac tempest-GroupsTest-1853585352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:12:07 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-2ab7249e-1166-4c10-ada6-384c6374f1ac tempest-GroupsTest-1853585352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:12:07 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-2ab7249e-1166-4c10-ada6-384c6374f1ac tempest-GroupsTest-1853585352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:12:07 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-2ab7249e-1166-4c10-ada6-384c6374f1ac tempest-GroupsTest-1853585352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:12:07 devstack sudo[89310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:12:07 devstack sudo[89310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:12:07 devstack sudo[89310]: pam_unix(sudo:session): session closed for user root Nov 04 10:12:07 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-2ab7249e-1166-4c10-ada6-384c6374f1ac tempest-GroupsTest-1853585352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.283s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:12:07 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-2ab7249e-1166-4c10-ada6-384c6374f1ac tempest-GroupsTest-1853585352 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:12:07 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-2ab7249e-1166-4c10-ada6-384c6374f1ac tempest-GroupsTest-1853585352 None] Delete group completed successfully. Nov 04 10:12:09 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-3db58b8c-fe8f-479b-b521-c5f1384d61ab tempest-GroupsTest-1853585352 None] Group tempest-GroupsTest-Group-181105790: creating Nov 04 10:12:09 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-3db58b8c-fe8f-479b-b521-c5f1384d61ab tempest-GroupsTest-1853585352 None] Group tempest-GroupsTest-Group-181105790: created successfully Nov 04 10:12:09 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-3db58b8c-fe8f-479b-b521-c5f1384d61ab tempest-GroupsTest-1853585352 None] Create group completed successfully. Nov 04 10:12:10 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-c86150b7-bef1-4251-9c79-426b66a2a6de tempest-AttachVolumeNegativeTest-227441756 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:12:10 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c86150b7-bef1-4251-9c79-426b66a2a6de tempest-AttachVolumeNegativeTest-227441756 None] Flow 'volume_create_manager' (dca3fd9f-09ff-4635-9350-fa35d9d40dc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:12:10 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c86150b7-bef1-4251-9c79-426b66a2a6de tempest-AttachVolumeNegativeTest-227441756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a370833-0d19-4f32-9b61-596755c4d0ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:12:10 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c86150b7-bef1-4251-9c79-426b66a2a6de tempest-AttachVolumeNegativeTest-227441756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a370833-0d19-4f32-9b61-596755c4d0ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:12:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2009258240',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f69ad7a1-0c95-471f-bbb5-e43c3af326aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee1b4eb5ed8d4a62988646aa86f9e86f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:12:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:12:11Z,use_quota=True,user_id='96ce21a16a9146f7870800cd774304b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:12:10 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c86150b7-bef1-4251-9c79-426b66a2a6de tempest-AttachVolumeNegativeTest-227441756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebe30489-dc97-4df3-a831-64ac49bc9fbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:12:10 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c86150b7-bef1-4251-9c79-426b66a2a6de tempest-AttachVolumeNegativeTest-227441756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebe30489-dc97-4df3-a831-64ac49bc9fbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:12:10 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c86150b7-bef1-4251-9c79-426b66a2a6de tempest-AttachVolumeNegativeTest-227441756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfbdfa3e-d690-4421-b6ce-e624fb81cc9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:12:10 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c86150b7-bef1-4251-9c79-426b66a2a6de tempest-AttachVolumeNegativeTest-227441756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfbdfa3e-d690-4421-b6ce-e624fb81cc9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f69ad7a1-0c95-471f-bbb5-e43c3af326aa', 'volume_name': 'volume-f69ad7a1-0c95-471f-bbb5-e43c3af326aa', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:12:10 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c86150b7-bef1-4251-9c79-426b66a2a6de tempest-AttachVolumeNegativeTest-227441756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c101f66-cd3a-42a3-ba4f-570d5dbfe0a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:12:10 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c86150b7-bef1-4251-9c79-426b66a2a6de tempest-AttachVolumeNegativeTest-227441756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c101f66-cd3a-42a3-ba4f-570d5dbfe0a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:12:10 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c86150b7-bef1-4251-9c79-426b66a2a6de tempest-AttachVolumeNegativeTest-227441756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43a13cc1-9340-4ede-9d0b-ad0c0392c7ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:12:10 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-c86150b7-bef1-4251-9c79-426b66a2a6de tempest-AttachVolumeNegativeTest-227441756 None] Volume f69ad7a1-0c95-471f-bbb5-e43c3af326aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f69ad7a1-0c95-471f-bbb5-e43c3af326aa', 'volume_size': 1} Nov 04 10:12:10 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-c86150b7-bef1-4251-9c79-426b66a2a6de tempest-AttachVolumeNegativeTest-227441756 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:12:10 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-c86150b7-bef1-4251-9c79-426b66a2a6de tempest-AttachVolumeNegativeTest-227441756 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:12:10 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-c86150b7-bef1-4251-9c79-426b66a2a6de tempest-AttachVolumeNegativeTest-227441756 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:12:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2009258240',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f69ad7a1-0c95-471f-bbb5-e43c3af326aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee1b4eb5ed8d4a62988646aa86f9e86f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:12:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:12:11Z,use_quota=True,user_id='96ce21a16a9146f7870800cd774304b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 10:12:10 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-c86150b7-bef1-4251-9c79-426b66a2a6de tempest-AttachVolumeNegativeTest-227441756 None] Creating volume f69ad7a1-0c95-471f-bbb5-e43c3af326aa {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:12:10 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-c86150b7-bef1-4251-9c79-426b66a2a6de tempest-AttachVolumeNegativeTest-227441756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:12:10 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-c86150b7-bef1-4251-9c79-426b66a2a6de tempest-AttachVolumeNegativeTest-227441756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:12:10 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-c86150b7-bef1-4251-9c79-426b66a2a6de tempest-AttachVolumeNegativeTest-227441756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:12:10 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-c86150b7-bef1-4251-9c79-426b66a2a6de tempest-AttachVolumeNegativeTest-227441756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:12:10 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-c86150b7-bef1-4251-9c79-426b66a2a6de tempest-AttachVolumeNegativeTest-227441756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:12:10 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-c86150b7-bef1-4251-9c79-426b66a2a6de tempest-AttachVolumeNegativeTest-227441756 None] Selected osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:12:10 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-c86150b7-bef1-4251-9c79-426b66a2a6de tempest-AttachVolumeNegativeTest-227441756 None] casted to osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 Nov 04 10:12:10 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c86150b7-bef1-4251-9c79-426b66a2a6de tempest-AttachVolumeNegativeTest-227441756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-f69ad7a1-0c95-471f-bbb5-e43c3af326aa 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:12:10 devstack sudo[89320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-f69ad7a1-0c95-471f-bbb5-e43c3af326aa 1073741824 Nov 04 10:12:10 devstack sudo[89320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:12:11 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce2cf42d-563c-4cf0-b9bd-e43a3e79f652 tempest-GroupsTest-1853585352 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:12:11 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-ce2cf42d-563c-4cf0-b9bd-e43a3e79f652 tempest-GroupsTest-1853585352 None] Flow 'volume_create_manager' (8dae4997-1143-4c2f-91a8-6b633eb47abe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:12:11 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-ce2cf42d-563c-4cf0-b9bd-e43a3e79f652 tempest-GroupsTest-1853585352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d89d849-f66a-4da4-b91b-05612af82d52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:12:11 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-ce2cf42d-563c-4cf0-b9bd-e43a3e79f652 tempest-GroupsTest-1853585352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d89d849-f66a-4da4-b91b-05612af82d52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:12:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1474724390',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=eeca37ad-179e-4dc2-b92c-270ded7aa5a9,host='devstack@QuobyteHD#QuobyteHD',id=d8c2ac77-f784-40e5-bb95-3051adad7a9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5fe58536636425880017af2e87b1b82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:12:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:12:11Z,use_quota=True,user_id='868dc92a974a474c8b4534276408bf1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1dc3d5f8-cf96-4645-9c72-52f9d7970b47),volume_type_id=1dc3d5f8-cf96-4645-9c72-52f9d7970b47)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:12:11 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-ce2cf42d-563c-4cf0-b9bd-e43a3e79f652 tempest-GroupsTest-1853585352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57b38968-a0b3-4c67-9dc5-0e5730b84abb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:12:11 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-ce2cf42d-563c-4cf0-b9bd-e43a3e79f652 tempest-GroupsTest-1853585352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57b38968-a0b3-4c67-9dc5-0e5730b84abb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:12:11 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-ce2cf42d-563c-4cf0-b9bd-e43a3e79f652 tempest-GroupsTest-1853585352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a8bac69-9c7e-46c7-82d8-c412ce552bc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:12:11 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-ce2cf42d-563c-4cf0-b9bd-e43a3e79f652 tempest-GroupsTest-1853585352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a8bac69-9c7e-46c7-82d8-c412ce552bc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8c2ac77-f784-40e5-bb95-3051adad7a9d', 'volume_name': 'volume-d8c2ac77-f784-40e5-bb95-3051adad7a9d', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:12:11 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-ce2cf42d-563c-4cf0-b9bd-e43a3e79f652 tempest-GroupsTest-1853585352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9c20a8e-55ec-40c9-965c-7081d780c1ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:12:11 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-ce2cf42d-563c-4cf0-b9bd-e43a3e79f652 tempest-GroupsTest-1853585352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9c20a8e-55ec-40c9-965c-7081d780c1ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:12:11 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-ce2cf42d-563c-4cf0-b9bd-e43a3e79f652 tempest-GroupsTest-1853585352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (890eeec4-2e29-4739-a786-5f215c84b221) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:12:11 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-ce2cf42d-563c-4cf0-b9bd-e43a3e79f652 tempest-GroupsTest-1853585352 None] Volume d8c2ac77-f784-40e5-bb95-3051adad7a9d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8c2ac77-f784-40e5-bb95-3051adad7a9d', 'volume_size': 1} Nov 04 10:12:11 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-ce2cf42d-563c-4cf0-b9bd-e43a3e79f652 tempest-GroupsTest-1853585352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:12:11 devstack sudo[89320]: pam_unix(sudo:session): session closed for user root Nov 04 10:12:11 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c86150b7-bef1-4251-9c79-426b66a2a6de tempest-AttachVolumeNegativeTest-227441756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-f69ad7a1-0c95-471f-bbb5-e43c3af326aa 1073741824" returned: 0 in 0.560s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:12:11 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c86150b7-bef1-4251-9c79-426b66a2a6de tempest-AttachVolumeNegativeTest-227441756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-f69ad7a1-0c95-471f-bbb5-e43c3af326aa {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:12:11 devstack sudo[89326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-f69ad7a1-0c95-471f-bbb5-e43c3af326aa Nov 04 10:12:11 devstack sudo[89326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:12:11 devstack sudo[89326]: pam_unix(sudo:session): session closed for user root Nov 04 10:12:11 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c86150b7-bef1-4251-9c79-426b66a2a6de tempest-AttachVolumeNegativeTest-227441756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-f69ad7a1-0c95-471f-bbb5-e43c3af326aa" returned: 0 in 0.271s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:12:11 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-c86150b7-bef1-4251-9c79-426b66a2a6de tempest-AttachVolumeNegativeTest-227441756 None] <== create_volume: return (882ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 10:12:11 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-c86150b7-bef1-4251-9c79-426b66a2a6de tempest-AttachVolumeNegativeTest-227441756 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.889s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:12:11 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-ce2cf42d-563c-4cf0-b9bd-e43a3e79f652 tempest-GroupsTest-1853585352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.331s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:12:11 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-ce2cf42d-563c-4cf0-b9bd-e43a3e79f652 tempest-GroupsTest-1853585352 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=eeca37ad-179e-4dc2-b92c-270ded7aa5a9,created_at=2026-11-04T09:12:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1474724390',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=eeca37ad-179e-4dc2-b92c-270ded7aa5a9,host='devstack@QuobyteHD#QuobyteHD',id=d8c2ac77-f784-40e5-bb95-3051adad7a9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5fe58536636425880017af2e87b1b82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:12:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:12:11Z,use_quota=True,user_id='868dc92a974a474c8b4534276408bf1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1dc3d5f8-cf96-4645-9c72-52f9d7970b47),volume_type_id=1dc3d5f8-cf96-4645-9c72-52f9d7970b47)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 10:12:11 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-ce2cf42d-563c-4cf0-b9bd-e43a3e79f652 tempest-GroupsTest-1853585352 None] Creating volume d8c2ac77-f784-40e5-bb95-3051adad7a9d {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:12:11 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-ce2cf42d-563c-4cf0-b9bd-e43a3e79f652 tempest-GroupsTest-1853585352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:12:11 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-ce2cf42d-563c-4cf0-b9bd-e43a3e79f652 tempest-GroupsTest-1853585352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:12:11 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-ce2cf42d-563c-4cf0-b9bd-e43a3e79f652 tempest-GroupsTest-1853585352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:12:11 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-ce2cf42d-563c-4cf0-b9bd-e43a3e79f652 tempest-GroupsTest-1853585352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:12:11 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-ce2cf42d-563c-4cf0-b9bd-e43a3e79f652 tempest-GroupsTest-1853585352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:12:11 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-ce2cf42d-563c-4cf0-b9bd-e43a3e79f652 tempest-GroupsTest-1853585352 None] Selected osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:12:11 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-ce2cf42d-563c-4cf0-b9bd-e43a3e79f652 tempest-GroupsTest-1853585352 None] casted to osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 Nov 04 10:12:11 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ce2cf42d-563c-4cf0-b9bd-e43a3e79f652 tempest-GroupsTest-1853585352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-d8c2ac77-f784-40e5-bb95-3051adad7a9d 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:12:11 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c86150b7-bef1-4251-9c79-426b66a2a6de tempest-AttachVolumeNegativeTest-227441756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43a13cc1-9340-4ede-9d0b-ad0c0392c7ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f69ad7a1-0c95-471f-bbb5-e43c3af326aa', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:12:11 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c86150b7-bef1-4251-9c79-426b66a2a6de tempest-AttachVolumeNegativeTest-227441756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7377b2bf-a8a2-4f5d-a34d-23020e1b951f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:12:11 devstack sudo[89330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-d8c2ac77-f784-40e5-bb95-3051adad7a9d 1073741824 Nov 04 10:12:11 devstack sudo[89330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:12:11 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-c86150b7-bef1-4251-9c79-426b66a2a6de tempest-AttachVolumeNegativeTest-227441756 None] Volume volume-f69ad7a1-0c95-471f-bbb5-e43c3af326aa (f69ad7a1-0c95-471f-bbb5-e43c3af326aa): created successfully Nov 04 10:12:11 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c86150b7-bef1-4251-9c79-426b66a2a6de tempest-AttachVolumeNegativeTest-227441756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7377b2bf-a8a2-4f5d-a34d-23020e1b951f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:12:11 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c86150b7-bef1-4251-9c79-426b66a2a6de tempest-AttachVolumeNegativeTest-227441756 None] Flow 'volume_create_manager' (dca3fd9f-09ff-4635-9350-fa35d9d40dc1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:12:11 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-c86150b7-bef1-4251-9c79-426b66a2a6de tempest-AttachVolumeNegativeTest-227441756 None] Created volume successfully. Nov 04 10:12:12 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-caf9e0e6-22b8-4eec-9c6e-38eb070430cc tempest-TaggedAttachmentsTest-2100419357 None] Acquiring lock "cinder-c907e08f-679b-4d9e-9509-f9cedb6db50b-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:12:12 devstack sudo[89330]: pam_unix(sudo:session): session closed for user root Nov 04 10:12:12 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ce2cf42d-563c-4cf0-b9bd-e43a3e79f652 tempest-GroupsTest-1853585352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-d8c2ac77-f784-40e5-bb95-3051adad7a9d 1073741824" returned: 0 in 0.610s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:12:12 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-caf9e0e6-22b8-4eec-9c6e-38eb070430cc tempest-TaggedAttachmentsTest-2100419357 None] Lock "cinder-c907e08f-679b-4d9e-9509-f9cedb6db50b-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:12:12 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ce2cf42d-563c-4cf0-b9bd-e43a3e79f652 tempest-GroupsTest-1853585352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-d8c2ac77-f784-40e5-bb95-3051adad7a9d {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:12:12 devstack sudo[89338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-d8c2ac77-f784-40e5-bb95-3051adad7a9d Nov 04 10:12:12 devstack sudo[89338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:12:12 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-caf9e0e6-22b8-4eec-9c6e-38eb070430cc tempest-TaggedAttachmentsTest-2100419357 None] Acquiring lock "cinder-quobyte-c907e08f-679b-4d9e-9509-f9cedb6db50b" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:12:12 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-caf9e0e6-22b8-4eec-9c6e-38eb070430cc tempest-TaggedAttachmentsTest-2100419357 None] Lock "cinder-quobyte-c907e08f-679b-4d9e-9509-f9cedb6db50b" acquired by "delete_volume" :: waited 0.021s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:12:12 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ecb78ba-3941-4322-807e-fc8c4a927539]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:12:12 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-caf9e0e6-22b8-4eec-9c6e-38eb070430cc tempest-TaggedAttachmentsTest-2100419357 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-c907e08f-679b-4d9e-9509-f9cedb6db50b {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:12:12 devstack sudo[89340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-c907e08f-679b-4d9e-9509-f9cedb6db50b Nov 04 10:12:12 devstack sudo[89340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:12:12 devstack sudo[89338]: pam_unix(sudo:session): session closed for user root Nov 04 10:12:12 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ce2cf42d-563c-4cf0-b9bd-e43a3e79f652 tempest-GroupsTest-1853585352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-d8c2ac77-f784-40e5-bb95-3051adad7a9d" returned: 0 in 0.288s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:12:12 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-ce2cf42d-563c-4cf0-b9bd-e43a3e79f652 tempest-GroupsTest-1853585352 None] <== create_volume: return (1020ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 10:12:12 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-ce2cf42d-563c-4cf0-b9bd-e43a3e79f652 tempest-GroupsTest-1853585352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.024s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:12:12 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-ce2cf42d-563c-4cf0-b9bd-e43a3e79f652 tempest-GroupsTest-1853585352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (890eeec4-2e29-4739-a786-5f215c84b221) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8c2ac77-f784-40e5-bb95-3051adad7a9d', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:12:12 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-ce2cf42d-563c-4cf0-b9bd-e43a3e79f652 tempest-GroupsTest-1853585352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b3b6491-9930-4422-a983-3d99f7890262) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:12:12 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-ce2cf42d-563c-4cf0-b9bd-e43a3e79f652 tempest-GroupsTest-1853585352 None] Volume volume-d8c2ac77-f784-40e5-bb95-3051adad7a9d (d8c2ac77-f784-40e5-bb95-3051adad7a9d): created successfully Nov 04 10:12:12 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-ce2cf42d-563c-4cf0-b9bd-e43a3e79f652 tempest-GroupsTest-1853585352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b3b6491-9930-4422-a983-3d99f7890262) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:12:12 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-ce2cf42d-563c-4cf0-b9bd-e43a3e79f652 tempest-GroupsTest-1853585352 None] Flow 'volume_create_manager' (8dae4997-1143-4c2f-91a8-6b633eb47abe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:12:12 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-ce2cf42d-563c-4cf0-b9bd-e43a3e79f652 tempest-GroupsTest-1853585352 None] Created volume successfully. Nov 04 10:12:13 devstack sudo[89340]: pam_unix(sudo:session): session closed for user root Nov 04 10:12:13 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-caf9e0e6-22b8-4eec-9c6e-38eb070430cc tempest-TaggedAttachmentsTest-2100419357 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-c907e08f-679b-4d9e-9509-f9cedb6db50b" returned: 0 in 0.454s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:12:13 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-caf9e0e6-22b8-4eec-9c6e-38eb070430cc tempest-TaggedAttachmentsTest-2100419357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-c907e08f-679b-4d9e-9509-f9cedb6db50b {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:12:13 devstack sudo[89352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-c907e08f-679b-4d9e-9509-f9cedb6db50b Nov 04 10:12:13 devstack sudo[89352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:12:13 devstack sudo[89352]: pam_unix(sudo:session): session closed for user root Nov 04 10:12:13 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-caf9e0e6-22b8-4eec-9c6e-38eb070430cc tempest-TaggedAttachmentsTest-2100419357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-c907e08f-679b-4d9e-9509-f9cedb6db50b" returned: 0 in 0.276s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:12:13 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-caf9e0e6-22b8-4eec-9c6e-38eb070430cc tempest-TaggedAttachmentsTest-2100419357 None] Lock "cinder-quobyte-c907e08f-679b-4d9e-9509-f9cedb6db50b" released by "delete_volume" :: held 0.777s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:12:13 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-caf9e0e6-22b8-4eec-9c6e-38eb070430cc tempest-TaggedAttachmentsTest-2100419357 None] Created reservations ['875d2e54-6e6d-408b-ba06-a4030be9aec4', '821b681f-f334-4ada-ac6a-d93e38cb5878', 'c4860846-9300-4800-abae-c7b379010b9e', '772d1d1e-3f90-4c01-b6f5-f1f67a8f8adb'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:12:13 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-caf9e0e6-22b8-4eec-9c6e-38eb070430cc tempest-TaggedAttachmentsTest-2100419357 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:12:13 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-caf9e0e6-22b8-4eec-9c6e-38eb070430cc tempest-TaggedAttachmentsTest-2100419357 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:12:13 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-caf9e0e6-22b8-4eec-9c6e-38eb070430cc tempest-TaggedAttachmentsTest-2100419357 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:12:13 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-caf9e0e6-22b8-4eec-9c6e-38eb070430cc tempest-TaggedAttachmentsTest-2100419357 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:12:13 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-caf9e0e6-22b8-4eec-9c6e-38eb070430cc tempest-TaggedAttachmentsTest-2100419357 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:12:13 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-caf9e0e6-22b8-4eec-9c6e-38eb070430cc tempest-TaggedAttachmentsTest-2100419357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:12:13 devstack sudo[89358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:12:13 devstack sudo[89358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:12:13 devstack sudo[89358]: pam_unix(sudo:session): session closed for user root Nov 04 10:12:13 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-caf9e0e6-22b8-4eec-9c6e-38eb070430cc tempest-TaggedAttachmentsTest-2100419357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.408s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:12:13 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-caf9e0e6-22b8-4eec-9c6e-38eb070430cc tempest-TaggedAttachmentsTest-2100419357 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:12:13 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-caf9e0e6-22b8-4eec-9c6e-38eb070430cc tempest-TaggedAttachmentsTest-2100419357 None] Deleted volume successfully. Nov 04 10:12:14 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-caf9e0e6-22b8-4eec-9c6e-38eb070430cc tempest-TaggedAttachmentsTest-2100419357 None] Lock "cinder-c907e08f-679b-4d9e-9509-f9cedb6db50b-delete_volume" released by "delete_volume" :: held 1.581s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:12:14 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-bab3a630-77d2-4501-9831-98d52d351232 tempest-GroupsTest-1853585352 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:12:14 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-bab3a630-77d2-4501-9831-98d52d351232 tempest-GroupsTest-1853585352 None] Flow 'volume_create_manager' (f416d320-6f0f-4fef-a718-6829a5c8815a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:12:14 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-bab3a630-77d2-4501-9831-98d52d351232 tempest-GroupsTest-1853585352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fef552bf-6666-46a4-8691-06ad567d0301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:12:14 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-bab3a630-77d2-4501-9831-98d52d351232 tempest-GroupsTest-1853585352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fef552bf-6666-46a4-8691-06ad567d0301) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:12:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-707754958',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=eeca37ad-179e-4dc2-b92c-270ded7aa5a9,host='devstack@QuobyteHD#QuobyteHD',id=e8f6cc36-5ccf-4d60-9ecd-9ff162dd150b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5fe58536636425880017af2e87b1b82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:12:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:12:15Z,use_quota=True,user_id='868dc92a974a474c8b4534276408bf1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1dc3d5f8-cf96-4645-9c72-52f9d7970b47),volume_type_id=1dc3d5f8-cf96-4645-9c72-52f9d7970b47)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:12:14 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-bab3a630-77d2-4501-9831-98d52d351232 tempest-GroupsTest-1853585352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (591278ab-fee2-4adc-a287-ae1a7b09610a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:12:14 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-bab3a630-77d2-4501-9831-98d52d351232 tempest-GroupsTest-1853585352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (591278ab-fee2-4adc-a287-ae1a7b09610a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:12:14 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-bab3a630-77d2-4501-9831-98d52d351232 tempest-GroupsTest-1853585352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b92059b1-6448-478c-a154-c6ceae3522b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:12:14 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-bab3a630-77d2-4501-9831-98d52d351232 tempest-GroupsTest-1853585352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b92059b1-6448-478c-a154-c6ceae3522b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8f6cc36-5ccf-4d60-9ecd-9ff162dd150b', 'volume_name': 'volume-e8f6cc36-5ccf-4d60-9ecd-9ff162dd150b', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:12:14 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-bab3a630-77d2-4501-9831-98d52d351232 tempest-GroupsTest-1853585352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c44e6120-86a2-41c3-8d6d-f57a3209d2e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:12:14 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-bab3a630-77d2-4501-9831-98d52d351232 tempest-GroupsTest-1853585352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c44e6120-86a2-41c3-8d6d-f57a3209d2e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:12:14 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-bab3a630-77d2-4501-9831-98d52d351232 tempest-GroupsTest-1853585352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea52fbaa-97ed-47a6-8b85-2412545a1adb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:12:14 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-bab3a630-77d2-4501-9831-98d52d351232 tempest-GroupsTest-1853585352 None] Volume e8f6cc36-5ccf-4d60-9ecd-9ff162dd150b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8f6cc36-5ccf-4d60-9ecd-9ff162dd150b', 'volume_size': 1} Nov 04 10:12:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-bab3a630-77d2-4501-9831-98d52d351232 tempest-GroupsTest-1853585352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:12:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-bab3a630-77d2-4501-9831-98d52d351232 tempest-GroupsTest-1853585352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:12:14 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-bab3a630-77d2-4501-9831-98d52d351232 tempest-GroupsTest-1853585352 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=eeca37ad-179e-4dc2-b92c-270ded7aa5a9,created_at=2026-11-04T09:12:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-707754958',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=eeca37ad-179e-4dc2-b92c-270ded7aa5a9,host='devstack@QuobyteHD#QuobyteHD',id=e8f6cc36-5ccf-4d60-9ecd-9ff162dd150b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5fe58536636425880017af2e87b1b82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:12:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:12:15Z,use_quota=True,user_id='868dc92a974a474c8b4534276408bf1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1dc3d5f8-cf96-4645-9c72-52f9d7970b47),volume_type_id=1dc3d5f8-cf96-4645-9c72-52f9d7970b47)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 10:12:14 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-bab3a630-77d2-4501-9831-98d52d351232 tempest-GroupsTest-1853585352 None] Creating volume e8f6cc36-5ccf-4d60-9ecd-9ff162dd150b {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:12:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-bab3a630-77d2-4501-9831-98d52d351232 tempest-GroupsTest-1853585352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:12:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-bab3a630-77d2-4501-9831-98d52d351232 tempest-GroupsTest-1853585352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:12:14 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-bab3a630-77d2-4501-9831-98d52d351232 tempest-GroupsTest-1853585352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:12:14 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-bab3a630-77d2-4501-9831-98d52d351232 tempest-GroupsTest-1853585352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:12:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-bab3a630-77d2-4501-9831-98d52d351232 tempest-GroupsTest-1853585352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:12:14 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-bab3a630-77d2-4501-9831-98d52d351232 tempest-GroupsTest-1853585352 None] Selected osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:12:14 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-bab3a630-77d2-4501-9831-98d52d351232 tempest-GroupsTest-1853585352 None] casted to osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 Nov 04 10:12:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-bab3a630-77d2-4501-9831-98d52d351232 tempest-GroupsTest-1853585352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-e8f6cc36-5ccf-4d60-9ecd-9ff162dd150b 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:12:14 devstack sudo[89373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-e8f6cc36-5ccf-4d60-9ecd-9ff162dd150b 1073741824 Nov 04 10:12:14 devstack sudo[89373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:12:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [req-745975db-1572-4077-9596-77e974afdc00 req-011e11a0-ed02-474b-8968-7b5b85c1c54b tempest-AttachVolumeNegativeTest-227441756 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:12:15 devstack sudo[89373]: pam_unix(sudo:session): session closed for user root Nov 04 10:12:15 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-bab3a630-77d2-4501-9831-98d52d351232 tempest-GroupsTest-1853585352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-e8f6cc36-5ccf-4d60-9ecd-9ff162dd150b 1073741824" returned: 0 in 0.645s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:12:15 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-bab3a630-77d2-4501-9831-98d52d351232 tempest-GroupsTest-1853585352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-e8f6cc36-5ccf-4d60-9ecd-9ff162dd150b {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:12:15 devstack sudo[89392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-e8f6cc36-5ccf-4d60-9ecd-9ff162dd150b Nov 04 10:12:15 devstack sudo[89392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:12:15 devstack sudo[89392]: pam_unix(sudo:session): session closed for user root Nov 04 10:12:15 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-bab3a630-77d2-4501-9831-98d52d351232 tempest-GroupsTest-1853585352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-e8f6cc36-5ccf-4d60-9ecd-9ff162dd150b" returned: 0 in 0.338s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:12:15 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-bab3a630-77d2-4501-9831-98d52d351232 tempest-GroupsTest-1853585352 None] <== create_volume: return (1050ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 10:12:15 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-bab3a630-77d2-4501-9831-98d52d351232 tempest-GroupsTest-1853585352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.053s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:12:15 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [req-745975db-1572-4077-9596-77e974afdc00 req-011e11a0-ed02-474b-8968-7b5b85c1c54b tempest-AttachVolumeNegativeTest-227441756 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.944s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:12:15 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [req-745975db-1572-4077-9596-77e974afdc00 req-011e11a0-ed02-474b-8968-7b5b85c1c54b tempest-AttachVolumeNegativeTest-227441756 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.025s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:12:15 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-bab3a630-77d2-4501-9831-98d52d351232 tempest-GroupsTest-1853585352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea52fbaa-97ed-47a6-8b85-2412545a1adb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8f6cc36-5ccf-4d60-9ecd-9ff162dd150b', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:12:15 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-bab3a630-77d2-4501-9831-98d52d351232 tempest-GroupsTest-1853585352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5eaa2e53-01e0-4293-a8c7-9dc357f36031) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:12:15 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-bab3a630-77d2-4501-9831-98d52d351232 tempest-GroupsTest-1853585352 None] Volume volume-e8f6cc36-5ccf-4d60-9ecd-9ff162dd150b (e8f6cc36-5ccf-4d60-9ecd-9ff162dd150b): created successfully Nov 04 10:12:15 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-bab3a630-77d2-4501-9831-98d52d351232 tempest-GroupsTest-1853585352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5eaa2e53-01e0-4293-a8c7-9dc357f36031) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:12:15 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-bab3a630-77d2-4501-9831-98d52d351232 tempest-GroupsTest-1853585352 None] Flow 'volume_create_manager' (f416d320-6f0f-4fef-a718-6829a5c8815a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:12:15 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [req-745975db-1572-4077-9596-77e974afdc00 req-011e11a0-ed02-474b-8968-7b5b85c1c54b tempest-AttachVolumeNegativeTest-227441756 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034', 'name': 'volume-f69ad7a1-0c95-471f-bbb5-e43c3af326aa', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9abfc47c-9f40-49d5-96c2-8d2681742662', 'enforce_multipath': True} {{(pid=87068) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 04 10:12:15 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-bab3a630-77d2-4501-9831-98d52d351232 tempest-GroupsTest-1853585352 None] Created volume successfully. Nov 04 10:12:16 devstack cinder-volume[87068]: INFO cinder.volume.manager [req-745975db-1572-4077-9596-77e974afdc00 req-011e11a0-ed02-474b-8968-7b5b85c1c54b tempest-AttachVolumeNegativeTest-227441756 None] attachment_update completed successfully. Nov 04 10:12:17 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-f3a6f085-39b1-43f7-a327-b1f84d3d07e0 tempest-GroupsTest-1853585352 None] Update group completed successfully. Nov 04 10:12:19 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-0e83a34c-875a-402b-8b60-36699b8ef553 tempest-GroupsTest-1853585352 None] Update group completed successfully. Nov 04 10:12:21 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-9b6c12ac-dd9d-405b-aa8a-439f71100890 tempest-GroupsTest-1853585352 None] Acquiring lock "cinder-quobyte-d8c2ac77-f784-40e5-bb95-3051adad7a9d" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:12:21 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-9b6c12ac-dd9d-405b-aa8a-439f71100890 tempest-GroupsTest-1853585352 None] Lock "cinder-quobyte-d8c2ac77-f784-40e5-bb95-3051adad7a9d" acquired by "delete_volume" :: waited 0.038s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:12:21 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cc8457b-2fb1-40c1-9a37-49bcd9fb770f]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:12:21 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-9b6c12ac-dd9d-405b-aa8a-439f71100890 tempest-GroupsTest-1853585352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-d8c2ac77-f784-40e5-bb95-3051adad7a9d {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:12:21 devstack sudo[89886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-d8c2ac77-f784-40e5-bb95-3051adad7a9d Nov 04 10:12:21 devstack sudo[89886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:12:21 devstack sudo[89886]: pam_unix(sudo:session): session closed for user root Nov 04 10:12:21 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-9b6c12ac-dd9d-405b-aa8a-439f71100890 tempest-GroupsTest-1853585352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-d8c2ac77-f784-40e5-bb95-3051adad7a9d" returned: 0 in 0.399s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:12:21 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-9b6c12ac-dd9d-405b-aa8a-439f71100890 tempest-GroupsTest-1853585352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-d8c2ac77-f784-40e5-bb95-3051adad7a9d {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:12:21 devstack sudo[89892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-d8c2ac77-f784-40e5-bb95-3051adad7a9d Nov 04 10:12:21 devstack sudo[89892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:12:22 devstack sudo[89892]: pam_unix(sudo:session): session closed for user root Nov 04 10:12:22 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-9b6c12ac-dd9d-405b-aa8a-439f71100890 tempest-GroupsTest-1853585352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-d8c2ac77-f784-40e5-bb95-3051adad7a9d" returned: 0 in 0.298s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:12:22 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-9b6c12ac-dd9d-405b-aa8a-439f71100890 tempest-GroupsTest-1853585352 None] Lock "cinder-quobyte-d8c2ac77-f784-40e5-bb95-3051adad7a9d" released by "delete_volume" :: held 0.771s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:12:22 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-9b6c12ac-dd9d-405b-aa8a-439f71100890 tempest-GroupsTest-1853585352 None] Acquiring lock "cinder-quobyte-e8f6cc36-5ccf-4d60-9ecd-9ff162dd150b" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:12:22 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-9b6c12ac-dd9d-405b-aa8a-439f71100890 tempest-GroupsTest-1853585352 None] Lock "cinder-quobyte-e8f6cc36-5ccf-4d60-9ecd-9ff162dd150b" acquired by "delete_volume" :: waited 0.014s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:12:22 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8fcd2bf-87d8-4fd9-aadd-82d47f9d99c9]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:12:22 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-9b6c12ac-dd9d-405b-aa8a-439f71100890 tempest-GroupsTest-1853585352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-e8f6cc36-5ccf-4d60-9ecd-9ff162dd150b {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:12:22 devstack sudo[89895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-e8f6cc36-5ccf-4d60-9ecd-9ff162dd150b Nov 04 10:12:22 devstack sudo[89895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:12:22 devstack sudo[89895]: pam_unix(sudo:session): session closed for user root Nov 04 10:12:22 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-9b6c12ac-dd9d-405b-aa8a-439f71100890 tempest-GroupsTest-1853585352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-e8f6cc36-5ccf-4d60-9ecd-9ff162dd150b" returned: 0 in 0.598s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:12:22 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-9b6c12ac-dd9d-405b-aa8a-439f71100890 tempest-GroupsTest-1853585352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-e8f6cc36-5ccf-4d60-9ecd-9ff162dd150b {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:12:22 devstack sudo[89902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-e8f6cc36-5ccf-4d60-9ecd-9ff162dd150b Nov 04 10:12:22 devstack sudo[89902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:12:23 devstack sudo[89902]: pam_unix(sudo:session): session closed for user root Nov 04 10:12:23 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-9b6c12ac-dd9d-405b-aa8a-439f71100890 tempest-GroupsTest-1853585352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-e8f6cc36-5ccf-4d60-9ecd-9ff162dd150b" returned: 0 in 0.322s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:12:23 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-9b6c12ac-dd9d-405b-aa8a-439f71100890 tempest-GroupsTest-1853585352 None] Lock "cinder-quobyte-e8f6cc36-5ccf-4d60-9ecd-9ff162dd150b" released by "delete_volume" :: held 0.987s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:12:23 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-9b6c12ac-dd9d-405b-aa8a-439f71100890 tempest-GroupsTest-1853585352 None] Created reservations ['4bf91c9c-b1f6-4860-9cdf-94c563c0d941'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:12:23 devstack cinder-volume[87068]: WARNING cinder.quota [None req-9b6c12ac-dd9d-405b-aa8a-439f71100890 tempest-GroupsTest-1853585352 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1586660264 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1586660264, it is now deprecated. Please use the default quota class for default quota. Nov 04 10:12:23 devstack cinder-volume[87068]: WARNING cinder.quota [None req-9b6c12ac-dd9d-405b-aa8a-439f71100890 tempest-GroupsTest-1853585352 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1586660264 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1586660264, it is now deprecated. Please use the default quota class for default quota. Nov 04 10:12:23 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-9b6c12ac-dd9d-405b-aa8a-439f71100890 tempest-GroupsTest-1853585352 None] Created reservations ['7ed5435a-5822-4fc9-b42a-d463a2fef988', 'dbc72cfc-33db-4769-9f17-1c9aa2ed4e4a', '6ef7bc9c-34c8-4174-a92a-e53535bdc0c1', '3e9f89f2-db9b-43f1-87d5-73e1ff324aaa'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:12:23 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-9b6c12ac-dd9d-405b-aa8a-439f71100890 tempest-GroupsTest-1853585352 None] Created reservations ['c1cd32bd-06ad-435d-8d01-7ea0980ec3ce', '3b42e3c3-f213-4deb-ad10-d8b1e96fea97', 'd4d365fc-51e9-4d40-9bf1-39832a6b5546', '5135bc54-8df0-4a64-a7ab-d43a809abdc7'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:12:23 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-9b6c12ac-dd9d-405b-aa8a-439f71100890 tempest-GroupsTest-1853585352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:12:23 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-9b6c12ac-dd9d-405b-aa8a-439f71100890 tempest-GroupsTest-1853585352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:12:23 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-9b6c12ac-dd9d-405b-aa8a-439f71100890 tempest-GroupsTest-1853585352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:12:23 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-9b6c12ac-dd9d-405b-aa8a-439f71100890 tempest-GroupsTest-1853585352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:12:23 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-9b6c12ac-dd9d-405b-aa8a-439f71100890 tempest-GroupsTest-1853585352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:12:23 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-9b6c12ac-dd9d-405b-aa8a-439f71100890 tempest-GroupsTest-1853585352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:12:23 devstack sudo[89905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:12:23 devstack sudo[89905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:12:24 devstack sudo[89905]: pam_unix(sudo:session): session closed for user root Nov 04 10:12:24 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-9b6c12ac-dd9d-405b-aa8a-439f71100890 tempest-GroupsTest-1853585352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.380s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:12:24 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-9b6c12ac-dd9d-405b-aa8a-439f71100890 tempest-GroupsTest-1853585352 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:12:24 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-9b6c12ac-dd9d-405b-aa8a-439f71100890 tempest-GroupsTest-1853585352 None] Delete group completed successfully. Nov 04 10:12:24 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-41c72100-64da-4637-bca4-ade994baeb15 tempest-DeleteServersTestJSON-1604425044 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:12:24 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-41c72100-64da-4637-bca4-ade994baeb15 tempest-DeleteServersTestJSON-1604425044 None] Flow 'volume_create_manager' (6257dead-2ff1-4b65-8502-2d9e3e5a1225) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:12:24 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-41c72100-64da-4637-bca4-ade994baeb15 tempest-DeleteServersTestJSON-1604425044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a297da43-be91-4ae5-85d7-c4b4671cf2c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:12:24 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-41c72100-64da-4637-bca4-ade994baeb15 tempest-DeleteServersTestJSON-1604425044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a297da43-be91-4ae5-85d7-c4b4671cf2c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:12:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1817659748',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dae39394-62fb-468b-abc4-6022ee2aef11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='257e8b2a520a4926bfa44f902934a40f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:12:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:12:24Z,use_quota=True,user_id='9dae72977576461da3da8cd2476406a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:12:24 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-41c72100-64da-4637-bca4-ade994baeb15 tempest-DeleteServersTestJSON-1604425044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d35f592-3006-4def-bb47-1edc2ca3a8fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:12:24 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-41c72100-64da-4637-bca4-ade994baeb15 tempest-DeleteServersTestJSON-1604425044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d35f592-3006-4def-bb47-1edc2ca3a8fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:12:24 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-41c72100-64da-4637-bca4-ade994baeb15 tempest-DeleteServersTestJSON-1604425044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b5330f4-7134-4824-95fc-2c4850c74304) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:12:24 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-41c72100-64da-4637-bca4-ade994baeb15 tempest-DeleteServersTestJSON-1604425044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b5330f4-7134-4824-95fc-2c4850c74304) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dae39394-62fb-468b-abc4-6022ee2aef11', 'volume_name': 'volume-dae39394-62fb-468b-abc4-6022ee2aef11', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:12:24 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-41c72100-64da-4637-bca4-ade994baeb15 tempest-DeleteServersTestJSON-1604425044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1986ea8-938f-4685-ab6c-056e38b6fdf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:12:24 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-41c72100-64da-4637-bca4-ade994baeb15 tempest-DeleteServersTestJSON-1604425044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1986ea8-938f-4685-ab6c-056e38b6fdf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:12:24 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-41c72100-64da-4637-bca4-ade994baeb15 tempest-DeleteServersTestJSON-1604425044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68bcd5e9-a838-4f10-840e-4d66f5e7000a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:12:24 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-41c72100-64da-4637-bca4-ade994baeb15 tempest-DeleteServersTestJSON-1604425044 None] Volume dae39394-62fb-468b-abc4-6022ee2aef11: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dae39394-62fb-468b-abc4-6022ee2aef11', 'volume_size': 1} Nov 04 10:12:24 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-41c72100-64da-4637-bca4-ade994baeb15 tempest-DeleteServersTestJSON-1604425044 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:12:24 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-41c72100-64da-4637-bca4-ade994baeb15 tempest-DeleteServersTestJSON-1604425044 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:12:24 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-41c72100-64da-4637-bca4-ade994baeb15 tempest-DeleteServersTestJSON-1604425044 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:12:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1817659748',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dae39394-62fb-468b-abc4-6022ee2aef11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='257e8b2a520a4926bfa44f902934a40f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:12:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:12:24Z,use_quota=True,user_id='9dae72977576461da3da8cd2476406a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 10:12:24 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-41c72100-64da-4637-bca4-ade994baeb15 tempest-DeleteServersTestJSON-1604425044 None] Creating volume dae39394-62fb-468b-abc4-6022ee2aef11 {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:12:24 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-41c72100-64da-4637-bca4-ade994baeb15 tempest-DeleteServersTestJSON-1604425044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:12:24 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-41c72100-64da-4637-bca4-ade994baeb15 tempest-DeleteServersTestJSON-1604425044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:12:24 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-41c72100-64da-4637-bca4-ade994baeb15 tempest-DeleteServersTestJSON-1604425044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:12:24 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-41c72100-64da-4637-bca4-ade994baeb15 tempest-DeleteServersTestJSON-1604425044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:12:24 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-41c72100-64da-4637-bca4-ade994baeb15 tempest-DeleteServersTestJSON-1604425044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:12:24 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-41c72100-64da-4637-bca4-ade994baeb15 tempest-DeleteServersTestJSON-1604425044 None] Selected osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:12:24 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-41c72100-64da-4637-bca4-ade994baeb15 tempest-DeleteServersTestJSON-1604425044 None] casted to osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 Nov 04 10:12:24 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-41c72100-64da-4637-bca4-ade994baeb15 tempest-DeleteServersTestJSON-1604425044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-dae39394-62fb-468b-abc4-6022ee2aef11 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:12:24 devstack sudo[89908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-dae39394-62fb-468b-abc4-6022ee2aef11 1073741824 Nov 04 10:12:24 devstack sudo[89908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:12:25 devstack sudo[89908]: pam_unix(sudo:session): session closed for user root Nov 04 10:12:25 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-41c72100-64da-4637-bca4-ade994baeb15 tempest-DeleteServersTestJSON-1604425044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-dae39394-62fb-468b-abc4-6022ee2aef11 1073741824" returned: 0 in 0.693s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:12:25 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-41c72100-64da-4637-bca4-ade994baeb15 tempest-DeleteServersTestJSON-1604425044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-dae39394-62fb-468b-abc4-6022ee2aef11 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:12:25 devstack sudo[89914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-dae39394-62fb-468b-abc4-6022ee2aef11 Nov 04 10:12:25 devstack sudo[89914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:12:25 devstack sudo[89914]: pam_unix(sudo:session): session closed for user root Nov 04 10:12:25 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-41c72100-64da-4637-bca4-ade994baeb15 tempest-DeleteServersTestJSON-1604425044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-dae39394-62fb-468b-abc4-6022ee2aef11" returned: 0 in 0.444s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:12:25 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-41c72100-64da-4637-bca4-ade994baeb15 tempest-DeleteServersTestJSON-1604425044 None] <== create_volume: return (1203ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 10:12:25 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-41c72100-64da-4637-bca4-ade994baeb15 tempest-DeleteServersTestJSON-1604425044 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.210s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:12:25 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-41c72100-64da-4637-bca4-ade994baeb15 tempest-DeleteServersTestJSON-1604425044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68bcd5e9-a838-4f10-840e-4d66f5e7000a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dae39394-62fb-468b-abc4-6022ee2aef11', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:12:25 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-41c72100-64da-4637-bca4-ade994baeb15 tempest-DeleteServersTestJSON-1604425044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a69f67e8-608c-4655-8621-f5a17048a4d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:12:25 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-41c72100-64da-4637-bca4-ade994baeb15 tempest-DeleteServersTestJSON-1604425044 None] Volume volume-dae39394-62fb-468b-abc4-6022ee2aef11 (dae39394-62fb-468b-abc4-6022ee2aef11): created successfully Nov 04 10:12:25 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-41c72100-64da-4637-bca4-ade994baeb15 tempest-DeleteServersTestJSON-1604425044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a69f67e8-608c-4655-8621-f5a17048a4d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:12:25 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-41c72100-64da-4637-bca4-ade994baeb15 tempest-DeleteServersTestJSON-1604425044 None] Flow 'volume_create_manager' (6257dead-2ff1-4b65-8502-2d9e3e5a1225) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:12:25 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-41c72100-64da-4637-bca4-ade994baeb15 tempest-DeleteServersTestJSON-1604425044 None] Created volume successfully. Nov 04 10:12:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [req-6c827437-0469-458e-b662-10c27e3826b6 req-e0dec7b1-1ee1-4adc-9e1c-44457f8df0ca tempest-DeleteServersTestJSON-1604425044 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:12:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [req-6c827437-0469-458e-b662-10c27e3826b6 req-e0dec7b1-1ee1-4adc-9e1c-44457f8df0ca tempest-DeleteServersTestJSON-1604425044 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:12:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [req-6c827437-0469-458e-b662-10c27e3826b6 req-e0dec7b1-1ee1-4adc-9e1c-44457f8df0ca tempest-DeleteServersTestJSON-1604425044 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:12:28 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [req-6c827437-0469-458e-b662-10c27e3826b6 req-e0dec7b1-1ee1-4adc-9e1c-44457f8df0ca tempest-DeleteServersTestJSON-1604425044 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034', 'name': 'volume-dae39394-62fb-468b-abc4-6022ee2aef11', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '96c649a3-d190-429a-8ccb-1c3b8d4966e7', 'enforce_multipath': True} {{(pid=87068) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 04 10:12:28 devstack cinder-volume[87068]: INFO cinder.volume.manager [req-6c827437-0469-458e-b662-10c27e3826b6 req-e0dec7b1-1ee1-4adc-9e1c-44457f8df0ca tempest-DeleteServersTestJSON-1604425044 None] attachment_update completed successfully. Nov 04 10:12:33 devstack cinder-volume[87068]: INFO cinder.volume.manager [req-c4685ec6-6cb3-4af2-9994-7a14b824036b req-42a6c061-0028-4433-aa12-209759e8c2e6 tempest-DeleteServersTestJSON-1604425044 None] Terminate volume connection completed successfully. Nov 04 10:12:33 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [req-c4685ec6-6cb3-4af2-9994-7a14b824036b req-42a6c061-0028-4433-aa12-209759e8c2e6 tempest-DeleteServersTestJSON-1604425044 None] Deleting attachment 96c649a3-d190-429a-8ccb-1c3b8d4966e7. {{(pid=87068) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 04 10:12:35 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-f8dc7373-7518-43c7-83ce-afc290e8fa3c tempest-DeleteServersTestJSON-1604425044 None] Acquiring lock "cinder-dae39394-62fb-468b-abc4-6022ee2aef11-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:12:35 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-f8dc7373-7518-43c7-83ce-afc290e8fa3c tempest-DeleteServersTestJSON-1604425044 None] Lock "cinder-dae39394-62fb-468b-abc4-6022ee2aef11-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:12:35 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-f8dc7373-7518-43c7-83ce-afc290e8fa3c tempest-DeleteServersTestJSON-1604425044 None] Acquiring lock "cinder-quobyte-dae39394-62fb-468b-abc4-6022ee2aef11" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:12:35 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-f8dc7373-7518-43c7-83ce-afc290e8fa3c tempest-DeleteServersTestJSON-1604425044 None] Lock "cinder-quobyte-dae39394-62fb-468b-abc4-6022ee2aef11" acquired by "delete_volume" :: waited 0.057s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:12:35 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[f52c8c6a-190b-44ba-b602-55bdc5b12343]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:12:35 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f8dc7373-7518-43c7-83ce-afc290e8fa3c tempest-DeleteServersTestJSON-1604425044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-dae39394-62fb-468b-abc4-6022ee2aef11 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:12:36 devstack sudo[90075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-dae39394-62fb-468b-abc4-6022ee2aef11 Nov 04 10:12:36 devstack sudo[90075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:12:36 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-c7e823db-ddc1-4b85-80b9-9b988624bb77 tempest-GroupsV314Test-180020061 None] Group tempest-GroupsV314Test-Group-21730120: creating Nov 04 10:12:36 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-c7e823db-ddc1-4b85-80b9-9b988624bb77 tempest-GroupsV314Test-180020061 None] Group tempest-GroupsV314Test-Group-21730120: created successfully Nov 04 10:12:36 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-c7e823db-ddc1-4b85-80b9-9b988624bb77 tempest-GroupsV314Test-180020061 None] Create group completed successfully. Nov 04 10:12:36 devstack sudo[90075]: pam_unix(sudo:session): session closed for user root Nov 04 10:12:36 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f8dc7373-7518-43c7-83ce-afc290e8fa3c tempest-DeleteServersTestJSON-1604425044 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-dae39394-62fb-468b-abc4-6022ee2aef11" returned: 0 in 0.492s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:12:36 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f8dc7373-7518-43c7-83ce-afc290e8fa3c tempest-DeleteServersTestJSON-1604425044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-dae39394-62fb-468b-abc4-6022ee2aef11 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:12:36 devstack sudo[90107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-dae39394-62fb-468b-abc4-6022ee2aef11 Nov 04 10:12:36 devstack sudo[90107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:12:36 devstack sudo[90107]: pam_unix(sudo:session): session closed for user root Nov 04 10:12:36 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f8dc7373-7518-43c7-83ce-afc290e8fa3c tempest-DeleteServersTestJSON-1604425044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-dae39394-62fb-468b-abc4-6022ee2aef11" returned: 0 in 0.305s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:12:36 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-f8dc7373-7518-43c7-83ce-afc290e8fa3c tempest-DeleteServersTestJSON-1604425044 None] Lock "cinder-quobyte-dae39394-62fb-468b-abc4-6022ee2aef11" released by "delete_volume" :: held 0.864s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:12:36 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-f8dc7373-7518-43c7-83ce-afc290e8fa3c tempest-DeleteServersTestJSON-1604425044 None] Created reservations ['4b318310-1b56-4cec-b4aa-176dbd1eb53d', '664d87ad-57d7-4f0a-8e01-c1cc7bd25b22', '2ad37cd5-d270-45bc-85ac-4f523b14c7d3', 'b61d1507-b8f5-48f3-870e-45c8381fa365'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:12:36 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-f8dc7373-7518-43c7-83ce-afc290e8fa3c tempest-DeleteServersTestJSON-1604425044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:12:36 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-f8dc7373-7518-43c7-83ce-afc290e8fa3c tempest-DeleteServersTestJSON-1604425044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:12:36 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-f8dc7373-7518-43c7-83ce-afc290e8fa3c tempest-DeleteServersTestJSON-1604425044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:12:36 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-f8dc7373-7518-43c7-83ce-afc290e8fa3c tempest-DeleteServersTestJSON-1604425044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:12:36 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-f8dc7373-7518-43c7-83ce-afc290e8fa3c tempest-DeleteServersTestJSON-1604425044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:12:36 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f8dc7373-7518-43c7-83ce-afc290e8fa3c tempest-DeleteServersTestJSON-1604425044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:12:36 devstack sudo[90110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:12:36 devstack sudo[90110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:12:37 devstack sudo[90110]: pam_unix(sudo:session): session closed for user root Nov 04 10:12:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f8dc7373-7518-43c7-83ce-afc290e8fa3c tempest-DeleteServersTestJSON-1604425044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.318s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:12:37 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-f8dc7373-7518-43c7-83ce-afc290e8fa3c tempest-DeleteServersTestJSON-1604425044 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:12:37 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-f8dc7373-7518-43c7-83ce-afc290e8fa3c tempest-DeleteServersTestJSON-1604425044 None] Deleted volume successfully. Nov 04 10:12:37 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-f8dc7373-7518-43c7-83ce-afc290e8fa3c tempest-DeleteServersTestJSON-1604425044 None] Lock "cinder-dae39394-62fb-468b-abc4-6022ee2aef11-delete_volume" released by "delete_volume" :: held 1.528s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:12:38 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f57518c-6d10-4846-bda0-414988c65d19 tempest-GroupsV314Test-180020061 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:12:38 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-0f57518c-6d10-4846-bda0-414988c65d19 tempest-GroupsV314Test-180020061 None] Flow 'volume_create_manager' (2010bb56-7d6c-4faf-bd3a-6d5d8b2b0cba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:12:38 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-0f57518c-6d10-4846-bda0-414988c65d19 tempest-GroupsV314Test-180020061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2597f80f-c354-4743-abf8-2a2db117fd6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:12:38 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-0f57518c-6d10-4846-bda0-414988c65d19 tempest-GroupsV314Test-180020061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2597f80f-c354-4743-abf8-2a2db117fd6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:12:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-549325249',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=76d3b421-1d6d-4d5f-8608-3ada7e236c8d,host='devstack@QuobyteHD#QuobyteHD',id=c6fc92a3-3924-4557-be44-faf8a888b85f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c70c3416ddc45cbb558c415c8b50e8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:12:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:12:38Z,use_quota=True,user_id='9ac5f6e27bbf4564908e3aef95d4e23e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(178e31a2-53f1-4ef2-883c-258835500813),volume_type_id=178e31a2-53f1-4ef2-883c-258835500813)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:12:38 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-0f57518c-6d10-4846-bda0-414988c65d19 tempest-GroupsV314Test-180020061 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc9b4399-f864-41a8-8013-3fb46c1a633e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:12:38 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-0f57518c-6d10-4846-bda0-414988c65d19 tempest-GroupsV314Test-180020061 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc9b4399-f864-41a8-8013-3fb46c1a633e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:12:38 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-0f57518c-6d10-4846-bda0-414988c65d19 tempest-GroupsV314Test-180020061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75a024e5-c938-4416-8823-876cd96ad956) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:12:38 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-0f57518c-6d10-4846-bda0-414988c65d19 tempest-GroupsV314Test-180020061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75a024e5-c938-4416-8823-876cd96ad956) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6fc92a3-3924-4557-be44-faf8a888b85f', 'volume_name': 'volume-c6fc92a3-3924-4557-be44-faf8a888b85f', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:12:38 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-0f57518c-6d10-4846-bda0-414988c65d19 tempest-GroupsV314Test-180020061 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef828d03-0658-4a7e-b3ee-aa6f08b929a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:12:38 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-0f57518c-6d10-4846-bda0-414988c65d19 tempest-GroupsV314Test-180020061 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef828d03-0658-4a7e-b3ee-aa6f08b929a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:12:38 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-0f57518c-6d10-4846-bda0-414988c65d19 tempest-GroupsV314Test-180020061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4f766d2-bf11-489f-b6f3-4a3694ab62a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:12:38 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-0f57518c-6d10-4846-bda0-414988c65d19 tempest-GroupsV314Test-180020061 None] Volume c6fc92a3-3924-4557-be44-faf8a888b85f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6fc92a3-3924-4557-be44-faf8a888b85f', 'volume_size': 1} Nov 04 10:12:38 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-0f57518c-6d10-4846-bda0-414988c65d19 tempest-GroupsV314Test-180020061 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:12:38 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-0f57518c-6d10-4846-bda0-414988c65d19 tempest-GroupsV314Test-180020061 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:12:38 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-0f57518c-6d10-4846-bda0-414988c65d19 tempest-GroupsV314Test-180020061 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=76d3b421-1d6d-4d5f-8608-3ada7e236c8d,created_at=2026-11-04T09:12:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-549325249',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=76d3b421-1d6d-4d5f-8608-3ada7e236c8d,host='devstack@QuobyteHD#QuobyteHD',id=c6fc92a3-3924-4557-be44-faf8a888b85f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c70c3416ddc45cbb558c415c8b50e8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:12:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:12:38Z,use_quota=True,user_id='9ac5f6e27bbf4564908e3aef95d4e23e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(178e31a2-53f1-4ef2-883c-258835500813),volume_type_id=178e31a2-53f1-4ef2-883c-258835500813)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 10:12:38 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-0f57518c-6d10-4846-bda0-414988c65d19 tempest-GroupsV314Test-180020061 None] Creating volume c6fc92a3-3924-4557-be44-faf8a888b85f {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:12:38 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-0f57518c-6d10-4846-bda0-414988c65d19 tempest-GroupsV314Test-180020061 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:12:38 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-0f57518c-6d10-4846-bda0-414988c65d19 tempest-GroupsV314Test-180020061 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:12:38 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-0f57518c-6d10-4846-bda0-414988c65d19 tempest-GroupsV314Test-180020061 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:12:38 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-0f57518c-6d10-4846-bda0-414988c65d19 tempest-GroupsV314Test-180020061 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:12:38 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-0f57518c-6d10-4846-bda0-414988c65d19 tempest-GroupsV314Test-180020061 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:12:38 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-0f57518c-6d10-4846-bda0-414988c65d19 tempest-GroupsV314Test-180020061 None] Selected osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:12:38 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-0f57518c-6d10-4846-bda0-414988c65d19 tempest-GroupsV314Test-180020061 None] casted to osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 Nov 04 10:12:38 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-0f57518c-6d10-4846-bda0-414988c65d19 tempest-GroupsV314Test-180020061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-c6fc92a3-3924-4557-be44-faf8a888b85f 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:12:38 devstack sudo[90113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-c6fc92a3-3924-4557-be44-faf8a888b85f 1073741824 Nov 04 10:12:38 devstack sudo[90113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:12:39 devstack sudo[90113]: pam_unix(sudo:session): session closed for user root Nov 04 10:12:39 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-0f57518c-6d10-4846-bda0-414988c65d19 tempest-GroupsV314Test-180020061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-c6fc92a3-3924-4557-be44-faf8a888b85f 1073741824" returned: 0 in 0.692s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:12:39 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-0f57518c-6d10-4846-bda0-414988c65d19 tempest-GroupsV314Test-180020061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-c6fc92a3-3924-4557-be44-faf8a888b85f {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:12:39 devstack sudo[90119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-c6fc92a3-3924-4557-be44-faf8a888b85f Nov 04 10:12:39 devstack sudo[90119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:12:39 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-0f57518c-6d10-4846-bda0-414988c65d19 tempest-GroupsV314Test-180020061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-c6fc92a3-3924-4557-be44-faf8a888b85f" returned: 0 in 0.350s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:12:39 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-0f57518c-6d10-4846-bda0-414988c65d19 tempest-GroupsV314Test-180020061 None] <== create_volume: return (1116ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 10:12:39 devstack sudo[90119]: pam_unix(sudo:session): session closed for user root Nov 04 10:12:39 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-0f57518c-6d10-4846-bda0-414988c65d19 tempest-GroupsV314Test-180020061 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.121s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:12:39 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-0f57518c-6d10-4846-bda0-414988c65d19 tempest-GroupsV314Test-180020061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4f766d2-bf11-489f-b6f3-4a3694ab62a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6fc92a3-3924-4557-be44-faf8a888b85f', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:12:39 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-0f57518c-6d10-4846-bda0-414988c65d19 tempest-GroupsV314Test-180020061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8d8f074-f9f3-4d78-bcb1-b2ab44d82e36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:12:39 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-0f57518c-6d10-4846-bda0-414988c65d19 tempest-GroupsV314Test-180020061 None] Volume volume-c6fc92a3-3924-4557-be44-faf8a888b85f (c6fc92a3-3924-4557-be44-faf8a888b85f): created successfully Nov 04 10:12:39 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-0f57518c-6d10-4846-bda0-414988c65d19 tempest-GroupsV314Test-180020061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8d8f074-f9f3-4d78-bcb1-b2ab44d82e36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:12:39 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-0f57518c-6d10-4846-bda0-414988c65d19 tempest-GroupsV314Test-180020061 None] Flow 'volume_create_manager' (2010bb56-7d6c-4faf-bd3a-6d5d8b2b0cba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:12:39 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-0f57518c-6d10-4846-bda0-414988c65d19 tempest-GroupsV314Test-180020061 None] Created volume successfully. Nov 04 10:12:41 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-5e791481-19f8-432a-b6bc-ded4bb01863c tempest-GroupsV314Test-180020061 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:12:41 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-5e791481-19f8-432a-b6bc-ded4bb01863c tempest-GroupsV314Test-180020061 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:12:41 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-5e791481-19f8-432a-b6bc-ded4bb01863c tempest-GroupsV314Test-180020061 None] Cloning volume c6fc92a3-3924-4557-be44-faf8a888b85f to volume 4dbd7590-6349-4941-9b09-026ef8965b22 Nov 04 10:12:41 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-5e791481-19f8-432a-b6bc-ded4bb01863c tempest-GroupsV314Test-180020061 None] Creating offline snapshot ea357763-09dc-403e-9761-a52e8f0055e6 of volume c6fc92a3-3924-4557-be44-faf8a888b85f {{(pid=87068) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 10:12:41 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[96fa9093-795b-4ff3-bc93-9a30cc7f4719]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:12:41 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-5e791481-19f8-432a-b6bc-ded4bb01863c tempest-GroupsV314Test-180020061 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-c6fc92a3-3924-4557-be44-faf8a888b85f {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:12:41 devstack sudo[90124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-c6fc92a3-3924-4557-be44-faf8a888b85f Nov 04 10:12:41 devstack sudo[90124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:12:42 devstack sudo[90124]: pam_unix(sudo:session): session closed for user root Nov 04 10:12:42 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-5e791481-19f8-432a-b6bc-ded4bb01863c tempest-GroupsV314Test-180020061 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-c6fc92a3-3924-4557-be44-faf8a888b85f" returned: 0 in 0.560s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:12:42 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-5e791481-19f8-432a-b6bc-ded4bb01863c tempest-GroupsV314Test-180020061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-c6fc92a3-3924-4557-be44-faf8a888b85f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-c6fc92a3-3924-4557-be44-faf8a888b85f.ea357763-09dc-403e-9761-a52e8f0055e6 1G {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:12:42 devstack sudo[90129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-c6fc92a3-3924-4557-be44-faf8a888b85f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-c6fc92a3-3924-4557-be44-faf8a888b85f.ea357763-09dc-403e-9761-a52e8f0055e6 1G Nov 04 10:12:42 devstack sudo[90129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:12:43 devstack sudo[90129]: pam_unix(sudo:session): session closed for user root Nov 04 10:12:43 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-5e791481-19f8-432a-b6bc-ded4bb01863c tempest-GroupsV314Test-180020061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-c6fc92a3-3924-4557-be44-faf8a888b85f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-c6fc92a3-3924-4557-be44-faf8a888b85f.ea357763-09dc-403e-9761-a52e8f0055e6 1G" returned: 0 in 0.785s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:12:43 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-5e791481-19f8-432a-b6bc-ded4bb01863c tempest-GroupsV314Test-180020061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6fc92a3-3924-4557-be44-faf8a888b85f -F qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-c6fc92a3-3924-4557-be44-faf8a888b85f.ea357763-09dc-403e-9761-a52e8f0055e6 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:12:43 devstack sudo[90135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6fc92a3-3924-4557-be44-faf8a888b85f -F qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-c6fc92a3-3924-4557-be44-faf8a888b85f.ea357763-09dc-403e-9761-a52e8f0055e6 Nov 04 10:12:43 devstack sudo[90135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:12:43 devstack sudo[90135]: pam_unix(sudo:session): session closed for user root Nov 04 10:12:43 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-5e791481-19f8-432a-b6bc-ded4bb01863c tempest-GroupsV314Test-180020061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6fc92a3-3924-4557-be44-faf8a888b85f -F qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-c6fc92a3-3924-4557-be44-faf8a888b85f.ea357763-09dc-403e-9761-a52e8f0055e6" returned: 0 in 0.347s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:12:43 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-5e791481-19f8-432a-b6bc-ded4bb01863c tempest-GroupsV314Test-180020061 None] /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-c6fc92a3-3924-4557-be44-faf8a888b85f.ea357763-09dc-403e-9761-a52e8f0055e6 is being set with open permissions: ugo+rw: NotImplementedError Nov 04 10:12:43 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-5e791481-19f8-432a-b6bc-ded4bb01863c tempest-GroupsV314Test-180020061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-c6fc92a3-3924-4557-be44-faf8a888b85f.ea357763-09dc-403e-9761-a52e8f0055e6 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:12:43 devstack sudo[90141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-c6fc92a3-3924-4557-be44-faf8a888b85f.ea357763-09dc-403e-9761-a52e8f0055e6 Nov 04 10:12:43 devstack sudo[90141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:12:43 devstack sudo[90141]: pam_unix(sudo:session): session closed for user root Nov 04 10:12:43 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-5e791481-19f8-432a-b6bc-ded4bb01863c tempest-GroupsV314Test-180020061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-c6fc92a3-3924-4557-be44-faf8a888b85f.ea357763-09dc-403e-9761-a52e8f0055e6" returned: 0 in 0.479s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:12:43 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-5e791481-19f8-432a-b6bc-ded4bb01863c tempest-GroupsV314Test-180020061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-c6fc92a3-3924-4557-be44-faf8a888b85f.info {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:12:44 devstack sudo[90145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-c6fc92a3-3924-4557-be44-faf8a888b85f.info Nov 04 10:12:44 devstack sudo[90145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:12:44 devstack sudo[90145]: pam_unix(sudo:session): session closed for user root Nov 04 10:12:44 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-5e791481-19f8-432a-b6bc-ded4bb01863c tempest-GroupsV314Test-180020061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-c6fc92a3-3924-4557-be44-faf8a888b85f.info" returned: 0 in 0.486s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:12:44 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-5e791481-19f8-432a-b6bc-ded4bb01863c tempest-GroupsV314Test-180020061 None] /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-c6fc92a3-3924-4557-be44-faf8a888b85f.info is being set with open permissions: ugo+rw: NotImplementedError Nov 04 10:12:44 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-5e791481-19f8-432a-b6bc-ded4bb01863c tempest-GroupsV314Test-180020061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-c6fc92a3-3924-4557-be44-faf8a888b85f.info {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:12:44 devstack sudo[90149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-c6fc92a3-3924-4557-be44-faf8a888b85f.info Nov 04 10:12:44 devstack sudo[90149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:12:44 devstack sudo[90149]: pam_unix(sudo:session): session closed for user root Nov 04 10:12:44 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-5e791481-19f8-432a-b6bc-ded4bb01863c tempest-GroupsV314Test-180020061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-c6fc92a3-3924-4557-be44-faf8a888b85f.info" returned: 0 in 0.383s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:12:44 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-5e791481-19f8-432a-b6bc-ded4bb01863c tempest-GroupsV314Test-180020061 None] Acquiring lock "cinder-quobyte-4dbd7590-6349-4941-9b09-026ef8965b22" by "_copy_volume_from_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:12:44 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-5e791481-19f8-432a-b6bc-ded4bb01863c tempest-GroupsV314Test-180020061 None] Lock "cinder-quobyte-4dbd7590-6349-4941-9b09-026ef8965b22" acquired by "_copy_volume_from_snapshot" :: waited 0.033s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:12:44 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-5e791481-19f8-432a-b6bc-ded4bb01863c tempest-GroupsV314Test-180020061 None] snapshot: ea357763-09dc-403e-9761-a52e8f0055e6, volume: 4dbd7590-6349-4941-9b09-026ef8965b22, {{(pid=87068) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 04 10:12:44 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-5e791481-19f8-432a-b6bc-ded4bb01863c tempest-GroupsV314Test-180020061 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:12:44 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-5e791481-19f8-432a-b6bc-ded4bb01863c tempest-GroupsV314Test-180020061 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:12:44 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-5e791481-19f8-432a-b6bc-ded4bb01863c tempest-GroupsV314Test-180020061 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:12:44 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-5e791481-19f8-432a-b6bc-ded4bb01863c tempest-GroupsV314Test-180020061 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:12:44 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-5e791481-19f8-432a-b6bc-ded4bb01863c tempest-GroupsV314Test-180020061 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:12:44 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[655cd933-b98c-41e9-9f02-4097b82682d3]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:12:44 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-5e791481-19f8-432a-b6bc-ded4bb01863c tempest-GroupsV314Test-180020061 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-c6fc92a3-3924-4557-be44-faf8a888b85f.ea357763-09dc-403e-9761-a52e8f0055e6 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:12:45 devstack sudo[90154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-c6fc92a3-3924-4557-be44-faf8a888b85f.ea357763-09dc-403e-9761-a52e8f0055e6 Nov 04 10:12:45 devstack sudo[90154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:12:45 devstack sudo[90154]: pam_unix(sudo:session): session closed for user root Nov 04 10:12:45 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-5e791481-19f8-432a-b6bc-ded4bb01863c tempest-GroupsV314Test-180020061 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-c6fc92a3-3924-4557-be44-faf8a888b85f.ea357763-09dc-403e-9761-a52e8f0055e6" returned: 0 in 0.577s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:12:45 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-5e791481-19f8-432a-b6bc-ded4bb01863c tempest-GroupsV314Test-180020061 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c6fc92a3-3924-4557-be44-faf8a888b85f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87068) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 10:12:45 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea428aae-3293-4515-a4d2-ac6b89997b06]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:12:45 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-5e791481-19f8-432a-b6bc-ded4bb01863c tempest-GroupsV314Test-180020061 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-c6fc92a3-3924-4557-be44-faf8a888b85f {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:12:45 devstack sudo[90159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-c6fc92a3-3924-4557-be44-faf8a888b85f Nov 04 10:12:45 devstack sudo[90159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:12:46 devstack sudo[90159]: pam_unix(sudo:session): session closed for user root Nov 04 10:12:46 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-5e791481-19f8-432a-b6bc-ded4bb01863c tempest-GroupsV314Test-180020061 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-c6fc92a3-3924-4557-be44-faf8a888b85f" returned: 0 in 0.748s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:12:46 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-5e791481-19f8-432a-b6bc-ded4bb01863c tempest-GroupsV314Test-180020061 None] will copy from snapshot at /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-c6fc92a3-3924-4557-be44-faf8a888b85f {{(pid=87068) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 04 10:12:46 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-5e791481-19f8-432a-b6bc-ded4bb01863c tempest-GroupsV314Test-180020061 None] Creating direct copy from snapshot {{(pid=87068) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 04 10:12:46 devstack cinder-volume[87068]: DEBUG cinder.utils [None req-5e791481-19f8-432a-b6bc-ded4bb01863c tempest-GroupsV314Test-180020061 None] Path /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-4dbd7590-6349-4941-9b09-026ef8965b22 not found in is_blk_device check {{(pid=87068) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 04 10:12:46 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-5e791481-19f8-432a-b6bc-ded4bb01863c tempest-GroupsV314Test-180020061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-c6fc92a3-3924-4557-be44-faf8a888b85f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-4dbd7590-6349-4941-9b09-026ef8965b22 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:12:46 devstack sudo[90171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-c6fc92a3-3924-4557-be44-faf8a888b85f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-4dbd7590-6349-4941-9b09-026ef8965b22 Nov 04 10:12:46 devstack sudo[90171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:12:53 devstack cinder-volume[87068]: DEBUG oslo_service.periodic_task [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87068) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 10:12:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:12:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:12:53 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:12:53 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:12:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:12:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:12:53 devstack sudo[90229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:12:53 devstack sudo[90229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:12:53 devstack cinder-volume[87068]: DEBUG dbcounter [-] [87068] Writing DB stats cinder:SELECT=89,cinder:UPDATE=81,cinder:DELETE=3,cinder:INSERT=13 {{(pid=87068) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 10:12:53 devstack cinder-volume[87068]: DEBUG dbcounter [-] [87068] Writing DB stats cinder:SELECT=82,cinder:UPDATE=72,cinder:INSERT=18,cinder:DELETE=5 {{(pid=87068) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 10:12:54 devstack sudo[90229]: pam_unix(sudo:session): session closed for user root Nov 04 10:12:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.673s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:12:54 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:12:56 devstack sudo[90171]: pam_unix(sudo:session): session closed for user root Nov 04 10:12:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-5e791481-19f8-432a-b6bc-ded4bb01863c tempest-GroupsV314Test-180020061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-c6fc92a3-3924-4557-be44-faf8a888b85f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-4dbd7590-6349-4941-9b09-026ef8965b22" returned: 0 in 10.185s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:12:56 devstack cinder-volume[87068]: DEBUG cinder.image.image_utils [None req-5e791481-19f8-432a-b6bc-ded4bb01863c tempest-GroupsV314Test-180020061 None] Image conversion details: src /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-c6fc92a3-3924-4557-be44-faf8a888b85f, size 1024.00 MB, duration 10.19 sec, destination /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-4dbd7590-6349-4941-9b09-026ef8965b22 {{(pid=87068) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 04 10:12:56 devstack cinder-volume[87068]: INFO cinder.image.image_utils [None req-5e791481-19f8-432a-b6bc-ded4bb01863c tempest-GroupsV314Test-180020061 None] Converted 1024.00 MB image at 100.53 MB/s Nov 04 10:12:56 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-5e791481-19f8-432a-b6bc-ded4bb01863c tempest-GroupsV314Test-180020061 None] /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-4dbd7590-6349-4941-9b09-026ef8965b22 is being set with open permissions: ugo+rw: NotImplementedError Nov 04 10:12:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-5e791481-19f8-432a-b6bc-ded4bb01863c tempest-GroupsV314Test-180020061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-4dbd7590-6349-4941-9b09-026ef8965b22 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:12:56 devstack sudo[90232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-4dbd7590-6349-4941-9b09-026ef8965b22 Nov 04 10:12:56 devstack sudo[90232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:12:56 devstack sudo[90232]: pam_unix(sudo:session): session closed for user root Nov 04 10:12:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-5e791481-19f8-432a-b6bc-ded4bb01863c tempest-GroupsV314Test-180020061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-4dbd7590-6349-4941-9b09-026ef8965b22" returned: 0 in 0.351s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:12:56 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-5e791481-19f8-432a-b6bc-ded4bb01863c tempest-GroupsV314Test-180020061 None] Lock "cinder-quobyte-4dbd7590-6349-4941-9b09-026ef8965b22" released by "_copy_volume_from_snapshot" :: held 11.978s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:12:56 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-5e791481-19f8-432a-b6bc-ded4bb01863c tempest-GroupsV314Test-180020061 None] Acquiring lock "cinder-quobyte-ea357763-09dc-403e-9761-a52e8f0055e6" by "_delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:12:56 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-5e791481-19f8-432a-b6bc-ded4bb01863c tempest-GroupsV314Test-180020061 None] Lock "cinder-quobyte-ea357763-09dc-403e-9761-a52e8f0055e6" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:12:56 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-5e791481-19f8-432a-b6bc-ded4bb01863c tempest-GroupsV314Test-180020061 None] Deleting offline snapshot ea357763-09dc-403e-9761-a52e8f0055e6 of volume c6fc92a3-3924-4557-be44-faf8a888b85f {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 10:12:56 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-5e791481-19f8-432a-b6bc-ded4bb01863c tempest-GroupsV314Test-180020061 None] snapshot_file for this snap is: volume-c6fc92a3-3924-4557-be44-faf8a888b85f.ea357763-09dc-403e-9761-a52e8f0055e6 {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 10:12:56 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[670c53c4-9454-4d8b-9202-b775e126ceee]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:12:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-5e791481-19f8-432a-b6bc-ded4bb01863c tempest-GroupsV314Test-180020061 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-c6fc92a3-3924-4557-be44-faf8a888b85f.ea357763-09dc-403e-9761-a52e8f0055e6 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:12:57 devstack sudo[90235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-c6fc92a3-3924-4557-be44-faf8a888b85f.ea357763-09dc-403e-9761-a52e8f0055e6 Nov 04 10:12:57 devstack sudo[90235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:12:57 devstack sudo[90235]: pam_unix(sudo:session): session closed for user root Nov 04 10:12:57 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-5e791481-19f8-432a-b6bc-ded4bb01863c tempest-GroupsV314Test-180020061 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-c6fc92a3-3924-4557-be44-faf8a888b85f.ea357763-09dc-403e-9761-a52e8f0055e6" returned: 0 in 0.431s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:12:57 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-5e791481-19f8-432a-b6bc-ded4bb01863c tempest-GroupsV314Test-180020061 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c6fc92a3-3924-4557-be44-faf8a888b85f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87068) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 10:12:57 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f50c082-85ec-44c4-a53f-5a4214cc1cf4]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:12:57 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-5e791481-19f8-432a-b6bc-ded4bb01863c tempest-GroupsV314Test-180020061 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-c6fc92a3-3924-4557-be44-faf8a888b85f {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:12:57 devstack sudo[90241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-c6fc92a3-3924-4557-be44-faf8a888b85f Nov 04 10:12:57 devstack sudo[90241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:12:58 devstack sudo[90241]: pam_unix(sudo:session): session closed for user root Nov 04 10:12:58 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-5e791481-19f8-432a-b6bc-ded4bb01863c tempest-GroupsV314Test-180020061 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-c6fc92a3-3924-4557-be44-faf8a888b85f" returned: 0 in 0.595s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:12:58 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-5e791481-19f8-432a-b6bc-ded4bb01863c tempest-GroupsV314Test-180020061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-c6fc92a3-3924-4557-be44-faf8a888b85f.ea357763-09dc-403e-9761-a52e8f0055e6 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:12:58 devstack sudo[90247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-c6fc92a3-3924-4557-be44-faf8a888b85f.ea357763-09dc-403e-9761-a52e8f0055e6 Nov 04 10:12:58 devstack sudo[90247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:12:58 devstack sudo[90247]: pam_unix(sudo:session): session closed for user root Nov 04 10:12:58 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-5e791481-19f8-432a-b6bc-ded4bb01863c tempest-GroupsV314Test-180020061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-c6fc92a3-3924-4557-be44-faf8a888b85f.ea357763-09dc-403e-9761-a52e8f0055e6" returned: 0 in 0.372s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:12:58 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-5e791481-19f8-432a-b6bc-ded4bb01863c tempest-GroupsV314Test-180020061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-c6fc92a3-3924-4557-be44-faf8a888b85f.ea357763-09dc-403e-9761-a52e8f0055e6 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:12:58 devstack sudo[90253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-c6fc92a3-3924-4557-be44-faf8a888b85f.ea357763-09dc-403e-9761-a52e8f0055e6 Nov 04 10:12:58 devstack sudo[90253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:12:58 devstack sudo[90253]: pam_unix(sudo:session): session closed for user root Nov 04 10:12:58 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-5e791481-19f8-432a-b6bc-ded4bb01863c tempest-GroupsV314Test-180020061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-c6fc92a3-3924-4557-be44-faf8a888b85f.ea357763-09dc-403e-9761-a52e8f0055e6" returned: 0 in 0.323s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:12:58 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-5e791481-19f8-432a-b6bc-ded4bb01863c tempest-GroupsV314Test-180020061 None] Lock "cinder-quobyte-ea357763-09dc-403e-9761-a52e8f0055e6" released by "_delete_snapshot" :: held 1.881s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:12:58 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-5e791481-19f8-432a-b6bc-ded4bb01863c tempest-GroupsV314Test-180020061 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 17.226s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:12:58 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-5e791481-19f8-432a-b6bc-ded4bb01863c tempest-GroupsV314Test-180020061 None] Create group from source-group-76d3b421-1d6d-4d5f-8608-3ada7e236c8d completed successfully. Nov 04 10:13:00 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-97f0ab55-3e67-4629-8d2b-c04987e62b72 tempest-GroupsV314Test-180020061 None] Acquiring lock "cinder-quobyte-4dbd7590-6349-4941-9b09-026ef8965b22" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:13:00 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-97f0ab55-3e67-4629-8d2b-c04987e62b72 tempest-GroupsV314Test-180020061 None] Lock "cinder-quobyte-4dbd7590-6349-4941-9b09-026ef8965b22" acquired by "delete_volume" :: waited 0.034s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:13:00 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[72bed7ec-bfe8-4601-ac09-329220ac7fc6]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:13:00 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-97f0ab55-3e67-4629-8d2b-c04987e62b72 tempest-GroupsV314Test-180020061 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-4dbd7590-6349-4941-9b09-026ef8965b22 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:13:00 devstack sudo[90286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-4dbd7590-6349-4941-9b09-026ef8965b22 Nov 04 10:13:00 devstack sudo[90286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:13:00 devstack sudo[90286]: pam_unix(sudo:session): session closed for user root Nov 04 10:13:00 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-97f0ab55-3e67-4629-8d2b-c04987e62b72 tempest-GroupsV314Test-180020061 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-4dbd7590-6349-4941-9b09-026ef8965b22" returned: 0 in 0.507s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:13:00 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-97f0ab55-3e67-4629-8d2b-c04987e62b72 tempest-GroupsV314Test-180020061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-4dbd7590-6349-4941-9b09-026ef8965b22 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:13:00 devstack sudo[90294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-4dbd7590-6349-4941-9b09-026ef8965b22 Nov 04 10:13:00 devstack sudo[90294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:13:01 devstack sudo[90294]: pam_unix(sudo:session): session closed for user root Nov 04 10:13:01 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-97f0ab55-3e67-4629-8d2b-c04987e62b72 tempest-GroupsV314Test-180020061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-4dbd7590-6349-4941-9b09-026ef8965b22" returned: 0 in 0.497s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:13:01 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-97f0ab55-3e67-4629-8d2b-c04987e62b72 tempest-GroupsV314Test-180020061 None] Lock "cinder-quobyte-4dbd7590-6349-4941-9b09-026ef8965b22" released by "delete_volume" :: held 1.093s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:13:01 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-97f0ab55-3e67-4629-8d2b-c04987e62b72 tempest-GroupsV314Test-180020061 None] Created reservations ['b003dea9-84e2-4d4f-9f4f-f000079d4f82'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:13:01 devstack cinder-volume[87068]: WARNING cinder.quota [None req-97f0ab55-3e67-4629-8d2b-c04987e62b72 tempest-GroupsV314Test-180020061 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1042225222 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1042225222, it is now deprecated. Please use the default quota class for default quota. Nov 04 10:13:01 devstack cinder-volume[87068]: WARNING cinder.quota [None req-97f0ab55-3e67-4629-8d2b-c04987e62b72 tempest-GroupsV314Test-180020061 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1042225222 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1042225222, it is now deprecated. Please use the default quota class for default quota. Nov 04 10:13:01 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-97f0ab55-3e67-4629-8d2b-c04987e62b72 tempest-GroupsV314Test-180020061 None] Created reservations ['dfec36f5-122a-4f7f-86a3-c78ea7d67469', 'c8bdb7ff-4bde-469d-87ef-ed631b3a4f26', '48725313-f125-4a67-9999-5d9a144d5faa', 'e54ed817-5a45-4a3b-a2d0-8698c585a534'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:13:01 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-97f0ab55-3e67-4629-8d2b-c04987e62b72 tempest-GroupsV314Test-180020061 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:13:01 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-97f0ab55-3e67-4629-8d2b-c04987e62b72 tempest-GroupsV314Test-180020061 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:13:01 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-97f0ab55-3e67-4629-8d2b-c04987e62b72 tempest-GroupsV314Test-180020061 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:13:01 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-97f0ab55-3e67-4629-8d2b-c04987e62b72 tempest-GroupsV314Test-180020061 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:13:01 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-97f0ab55-3e67-4629-8d2b-c04987e62b72 tempest-GroupsV314Test-180020061 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:13:01 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-97f0ab55-3e67-4629-8d2b-c04987e62b72 tempest-GroupsV314Test-180020061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:13:01 devstack sudo[90308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:13:01 devstack sudo[90308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:13:01 devstack sudo[90308]: pam_unix(sudo:session): session closed for user root Nov 04 10:13:01 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-97f0ab55-3e67-4629-8d2b-c04987e62b72 tempest-GroupsV314Test-180020061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.294s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:13:01 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-97f0ab55-3e67-4629-8d2b-c04987e62b72 tempest-GroupsV314Test-180020061 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:13:01 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-97f0ab55-3e67-4629-8d2b-c04987e62b72 tempest-GroupsV314Test-180020061 None] Delete group completed successfully. Nov 04 10:13:02 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-4cc4cad0-f45b-4b63-a373-5eb36c28d949 tempest-GroupsV314Test-180020061 None] Acquiring lock "cinder-quobyte-c6fc92a3-3924-4557-be44-faf8a888b85f" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:13:02 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-4cc4cad0-f45b-4b63-a373-5eb36c28d949 tempest-GroupsV314Test-180020061 None] Lock "cinder-quobyte-c6fc92a3-3924-4557-be44-faf8a888b85f" acquired by "delete_volume" :: waited 0.030s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:13:03 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[95ef08bd-7d74-42f5-95f2-ae554343e603]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:13:03 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-4cc4cad0-f45b-4b63-a373-5eb36c28d949 tempest-GroupsV314Test-180020061 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-c6fc92a3-3924-4557-be44-faf8a888b85f {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:13:03 devstack sudo[90321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-c6fc92a3-3924-4557-be44-faf8a888b85f Nov 04 10:13:03 devstack sudo[90321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:13:03 devstack sudo[90321]: pam_unix(sudo:session): session closed for user root Nov 04 10:13:03 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-4cc4cad0-f45b-4b63-a373-5eb36c28d949 tempest-GroupsV314Test-180020061 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-c6fc92a3-3924-4557-be44-faf8a888b85f" returned: 0 in 0.545s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:13:03 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-4cc4cad0-f45b-4b63-a373-5eb36c28d949 tempest-GroupsV314Test-180020061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-c6fc92a3-3924-4557-be44-faf8a888b85f {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:13:03 devstack sudo[90326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-c6fc92a3-3924-4557-be44-faf8a888b85f Nov 04 10:13:03 devstack sudo[90326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:13:04 devstack sudo[90326]: pam_unix(sudo:session): session closed for user root Nov 04 10:13:04 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-4cc4cad0-f45b-4b63-a373-5eb36c28d949 tempest-GroupsV314Test-180020061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-c6fc92a3-3924-4557-be44-faf8a888b85f" returned: 0 in 0.462s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:13:04 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-4cc4cad0-f45b-4b63-a373-5eb36c28d949 tempest-GroupsV314Test-180020061 None] Lock "cinder-quobyte-c6fc92a3-3924-4557-be44-faf8a888b85f" released by "delete_volume" :: held 1.117s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:13:04 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-4cc4cad0-f45b-4b63-a373-5eb36c28d949 tempest-GroupsV314Test-180020061 None] Created reservations ['a4147bff-c46c-4197-9fba-fd084247a74b'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:13:04 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-4cc4cad0-f45b-4b63-a373-5eb36c28d949 tempest-GroupsV314Test-180020061 None] Created reservations ['437b44a6-6e07-4314-8c07-be6d38c99119', '768d3870-cfeb-4c2d-9fbe-0d5c8c7b2220', 'e952fd4b-e227-49ab-81bd-47c25e2e1cf7', '87fdefdd-448a-47b3-add8-0356eb5f6e0d'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:13:04 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-4cc4cad0-f45b-4b63-a373-5eb36c28d949 tempest-GroupsV314Test-180020061 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:13:04 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-4cc4cad0-f45b-4b63-a373-5eb36c28d949 tempest-GroupsV314Test-180020061 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:13:04 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-4cc4cad0-f45b-4b63-a373-5eb36c28d949 tempest-GroupsV314Test-180020061 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:13:04 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-4cc4cad0-f45b-4b63-a373-5eb36c28d949 tempest-GroupsV314Test-180020061 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:13:04 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-4cc4cad0-f45b-4b63-a373-5eb36c28d949 tempest-GroupsV314Test-180020061 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:13:04 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-4cc4cad0-f45b-4b63-a373-5eb36c28d949 tempest-GroupsV314Test-180020061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:13:04 devstack sudo[90329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:13:04 devstack sudo[90329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:13:04 devstack sudo[90329]: pam_unix(sudo:session): session closed for user root Nov 04 10:13:04 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-4cc4cad0-f45b-4b63-a373-5eb36c28d949 tempest-GroupsV314Test-180020061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.343s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:13:04 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-4cc4cad0-f45b-4b63-a373-5eb36c28d949 tempest-GroupsV314Test-180020061 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:13:04 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-4cc4cad0-f45b-4b63-a373-5eb36c28d949 tempest-GroupsV314Test-180020061 None] Delete group completed successfully. Nov 04 10:13:09 devstack cinder-volume[87068]: INFO cinder.volume.manager [req-c82f41ed-6a48-4bb0-9436-9fd3964ad081 req-7bdf7037-b4ce-4509-885d-8547d2e9feea tempest-AttachVolumeNegativeTest-227441756 None] Terminate volume connection completed successfully. Nov 04 10:13:09 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [req-c82f41ed-6a48-4bb0-9436-9fd3964ad081 req-7bdf7037-b4ce-4509-885d-8547d2e9feea tempest-AttachVolumeNegativeTest-227441756 None] Deleting attachment 9abfc47c-9f40-49d5-96c2-8d2681742662. {{(pid=87068) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 04 10:13:14 devstack cinder-volume[87068]: DEBUG dbcounter [-] [87068] Writing DB stats cinder:UPDATE=27,cinder:SELECT=19,cinder:INSERT=6 {{(pid=87068) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 10:13:16 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a46d5a7-f3f2-4007-ba11-df1b54549ee0 tempest-SnapshotsActionsTest-2023777755 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:13:16 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1a46d5a7-f3f2-4007-ba11-df1b54549ee0 tempest-SnapshotsActionsTest-2023777755 None] Flow 'volume_create_manager' (3a3b5b63-692f-4a56-8872-b2aaae5b9a2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:13:16 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1a46d5a7-f3f2-4007-ba11-df1b54549ee0 tempest-SnapshotsActionsTest-2023777755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d96a1fac-8aa7-45ee-a13b-db4ccd00d2e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:13:16 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1a46d5a7-f3f2-4007-ba11-df1b54549ee0 tempest-SnapshotsActionsTest-2023777755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d96a1fac-8aa7-45ee-a13b-db4ccd00d2e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:13:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1196305647',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96b38429-18cb-4675-a979-e387259f6fa9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23907ed53a5b487fbf3223f0a6cf06ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:13:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:13:16Z,use_quota=True,user_id='0a33d84a97c3419d873e64606a83ce0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:13:16 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1a46d5a7-f3f2-4007-ba11-df1b54549ee0 tempest-SnapshotsActionsTest-2023777755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aeb8f182-133b-43d3-9585-e6a496ca1737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:13:16 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1a46d5a7-f3f2-4007-ba11-df1b54549ee0 tempest-SnapshotsActionsTest-2023777755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aeb8f182-133b-43d3-9585-e6a496ca1737) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:13:16 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1a46d5a7-f3f2-4007-ba11-df1b54549ee0 tempest-SnapshotsActionsTest-2023777755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c9f6ee6-ee85-485c-a90d-8ad10aae64bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:13:16 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1a46d5a7-f3f2-4007-ba11-df1b54549ee0 tempest-SnapshotsActionsTest-2023777755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c9f6ee6-ee85-485c-a90d-8ad10aae64bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96b38429-18cb-4675-a979-e387259f6fa9', 'volume_name': 'volume-96b38429-18cb-4675-a979-e387259f6fa9', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:13:16 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1a46d5a7-f3f2-4007-ba11-df1b54549ee0 tempest-SnapshotsActionsTest-2023777755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca53572a-7865-4912-b906-561ef582b4cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:13:16 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1a46d5a7-f3f2-4007-ba11-df1b54549ee0 tempest-SnapshotsActionsTest-2023777755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca53572a-7865-4912-b906-561ef582b4cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:13:16 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1a46d5a7-f3f2-4007-ba11-df1b54549ee0 tempest-SnapshotsActionsTest-2023777755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdc169fb-e5eb-47f5-9de0-cd6dd06c007a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:13:16 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-1a46d5a7-f3f2-4007-ba11-df1b54549ee0 tempest-SnapshotsActionsTest-2023777755 None] Volume 96b38429-18cb-4675-a979-e387259f6fa9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96b38429-18cb-4675-a979-e387259f6fa9', 'volume_size': 1} Nov 04 10:13:16 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-1a46d5a7-f3f2-4007-ba11-df1b54549ee0 tempest-SnapshotsActionsTest-2023777755 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:13:16 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-1a46d5a7-f3f2-4007-ba11-df1b54549ee0 tempest-SnapshotsActionsTest-2023777755 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:13:16 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-1a46d5a7-f3f2-4007-ba11-df1b54549ee0 tempest-SnapshotsActionsTest-2023777755 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:13:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1196305647',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96b38429-18cb-4675-a979-e387259f6fa9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23907ed53a5b487fbf3223f0a6cf06ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:13:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:13:16Z,use_quota=True,user_id='0a33d84a97c3419d873e64606a83ce0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 10:13:16 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-1a46d5a7-f3f2-4007-ba11-df1b54549ee0 tempest-SnapshotsActionsTest-2023777755 None] Creating volume 96b38429-18cb-4675-a979-e387259f6fa9 {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:13:16 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-1a46d5a7-f3f2-4007-ba11-df1b54549ee0 tempest-SnapshotsActionsTest-2023777755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:13:16 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-1a46d5a7-f3f2-4007-ba11-df1b54549ee0 tempest-SnapshotsActionsTest-2023777755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:13:16 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-1a46d5a7-f3f2-4007-ba11-df1b54549ee0 tempest-SnapshotsActionsTest-2023777755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:13:16 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-1a46d5a7-f3f2-4007-ba11-df1b54549ee0 tempest-SnapshotsActionsTest-2023777755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:13:16 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-1a46d5a7-f3f2-4007-ba11-df1b54549ee0 tempest-SnapshotsActionsTest-2023777755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:13:16 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-1a46d5a7-f3f2-4007-ba11-df1b54549ee0 tempest-SnapshotsActionsTest-2023777755 None] Selected osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:13:16 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-1a46d5a7-f3f2-4007-ba11-df1b54549ee0 tempest-SnapshotsActionsTest-2023777755 None] casted to osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 Nov 04 10:13:16 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-1a46d5a7-f3f2-4007-ba11-df1b54549ee0 tempest-SnapshotsActionsTest-2023777755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-96b38429-18cb-4675-a979-e387259f6fa9 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:13:16 devstack sudo[90438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-96b38429-18cb-4675-a979-e387259f6fa9 1073741824 Nov 04 10:13:16 devstack sudo[90438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:13:17 devstack sudo[90438]: pam_unix(sudo:session): session closed for user root Nov 04 10:13:17 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-1a46d5a7-f3f2-4007-ba11-df1b54549ee0 tempest-SnapshotsActionsTest-2023777755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-96b38429-18cb-4675-a979-e387259f6fa9 1073741824" returned: 0 in 0.807s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:13:17 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-1a46d5a7-f3f2-4007-ba11-df1b54549ee0 tempest-SnapshotsActionsTest-2023777755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-96b38429-18cb-4675-a979-e387259f6fa9 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:13:17 devstack sudo[90448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-96b38429-18cb-4675-a979-e387259f6fa9 Nov 04 10:13:17 devstack sudo[90448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:13:17 devstack sudo[90448]: pam_unix(sudo:session): session closed for user root Nov 04 10:13:17 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-1a46d5a7-f3f2-4007-ba11-df1b54549ee0 tempest-SnapshotsActionsTest-2023777755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-96b38429-18cb-4675-a979-e387259f6fa9" returned: 0 in 0.462s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:13:17 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-1a46d5a7-f3f2-4007-ba11-df1b54549ee0 tempest-SnapshotsActionsTest-2023777755 None] <== create_volume: return (1360ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 10:13:17 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-1a46d5a7-f3f2-4007-ba11-df1b54549ee0 tempest-SnapshotsActionsTest-2023777755 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.367s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:13:17 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1a46d5a7-f3f2-4007-ba11-df1b54549ee0 tempest-SnapshotsActionsTest-2023777755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdc169fb-e5eb-47f5-9de0-cd6dd06c007a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96b38429-18cb-4675-a979-e387259f6fa9', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:13:17 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1a46d5a7-f3f2-4007-ba11-df1b54549ee0 tempest-SnapshotsActionsTest-2023777755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9f15a45-56f6-4324-b478-03648bc7e821) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:13:17 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-1a46d5a7-f3f2-4007-ba11-df1b54549ee0 tempest-SnapshotsActionsTest-2023777755 None] Volume volume-96b38429-18cb-4675-a979-e387259f6fa9 (96b38429-18cb-4675-a979-e387259f6fa9): created successfully Nov 04 10:13:17 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1a46d5a7-f3f2-4007-ba11-df1b54549ee0 tempest-SnapshotsActionsTest-2023777755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9f15a45-56f6-4324-b478-03648bc7e821) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:13:17 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1a46d5a7-f3f2-4007-ba11-df1b54549ee0 tempest-SnapshotsActionsTest-2023777755 None] Flow 'volume_create_manager' (3a3b5b63-692f-4a56-8872-b2aaae5b9a2f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:13:18 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-1a46d5a7-f3f2-4007-ba11-df1b54549ee0 tempest-SnapshotsActionsTest-2023777755 None] Created volume successfully. Nov 04 10:13:19 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-a0874ea4-1b9b-436f-bc9a-5dff1bf795f5 tempest-SnapshotsActionsTest-2023777755 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:13:19 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-a0874ea4-1b9b-436f-bc9a-5dff1bf795f5 tempest-SnapshotsActionsTest-2023777755 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:13:19 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-a0874ea4-1b9b-436f-bc9a-5dff1bf795f5 tempest-SnapshotsActionsTest-2023777755 None] Creating offline snapshot 849e979f-9a3f-486b-ab3b-eab787d82837 of volume 96b38429-18cb-4675-a979-e387259f6fa9 {{(pid=87068) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 10:13:19 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[5af704ab-d352-47e5-8b56-cea6e780d4b5]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:13:19 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-a0874ea4-1b9b-436f-bc9a-5dff1bf795f5 tempest-SnapshotsActionsTest-2023777755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-96b38429-18cb-4675-a979-e387259f6fa9 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:13:19 devstack sudo[90469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-96b38429-18cb-4675-a979-e387259f6fa9 Nov 04 10:13:19 devstack sudo[90469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:13:19 devstack sudo[90469]: pam_unix(sudo:session): session closed for user root Nov 04 10:13:19 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-a0874ea4-1b9b-436f-bc9a-5dff1bf795f5 tempest-SnapshotsActionsTest-2023777755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-96b38429-18cb-4675-a979-e387259f6fa9" returned: 0 in 0.583s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:13:19 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-a0874ea4-1b9b-436f-bc9a-5dff1bf795f5 tempest-SnapshotsActionsTest-2023777755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-96b38429-18cb-4675-a979-e387259f6fa9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-96b38429-18cb-4675-a979-e387259f6fa9.849e979f-9a3f-486b-ab3b-eab787d82837 1G {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:13:19 devstack sudo[90474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-96b38429-18cb-4675-a979-e387259f6fa9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-96b38429-18cb-4675-a979-e387259f6fa9.849e979f-9a3f-486b-ab3b-eab787d82837 1G Nov 04 10:13:19 devstack sudo[90474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:13:20 devstack sudo[90474]: pam_unix(sudo:session): session closed for user root Nov 04 10:13:20 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-a0874ea4-1b9b-436f-bc9a-5dff1bf795f5 tempest-SnapshotsActionsTest-2023777755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-96b38429-18cb-4675-a979-e387259f6fa9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-96b38429-18cb-4675-a979-e387259f6fa9.849e979f-9a3f-486b-ab3b-eab787d82837 1G" returned: 0 in 0.542s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:13:20 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-a0874ea4-1b9b-436f-bc9a-5dff1bf795f5 tempest-SnapshotsActionsTest-2023777755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96b38429-18cb-4675-a979-e387259f6fa9 -F qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-96b38429-18cb-4675-a979-e387259f6fa9.849e979f-9a3f-486b-ab3b-eab787d82837 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:13:20 devstack sudo[90480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96b38429-18cb-4675-a979-e387259f6fa9 -F qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-96b38429-18cb-4675-a979-e387259f6fa9.849e979f-9a3f-486b-ab3b-eab787d82837 Nov 04 10:13:20 devstack sudo[90480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:13:20 devstack sudo[90480]: pam_unix(sudo:session): session closed for user root Nov 04 10:13:20 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-a0874ea4-1b9b-436f-bc9a-5dff1bf795f5 tempest-SnapshotsActionsTest-2023777755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96b38429-18cb-4675-a979-e387259f6fa9 -F qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-96b38429-18cb-4675-a979-e387259f6fa9.849e979f-9a3f-486b-ab3b-eab787d82837" returned: 0 in 0.464s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:13:20 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-a0874ea4-1b9b-436f-bc9a-5dff1bf795f5 tempest-SnapshotsActionsTest-2023777755 None] /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-96b38429-18cb-4675-a979-e387259f6fa9.849e979f-9a3f-486b-ab3b-eab787d82837 is being set with open permissions: ugo+rw Nov 04 10:13:20 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-a0874ea4-1b9b-436f-bc9a-5dff1bf795f5 tempest-SnapshotsActionsTest-2023777755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-96b38429-18cb-4675-a979-e387259f6fa9.849e979f-9a3f-486b-ab3b-eab787d82837 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:13:20 devstack sudo[90487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-96b38429-18cb-4675-a979-e387259f6fa9.849e979f-9a3f-486b-ab3b-eab787d82837 Nov 04 10:13:20 devstack sudo[90487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:13:21 devstack sudo[90487]: pam_unix(sudo:session): session closed for user root Nov 04 10:13:21 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-a0874ea4-1b9b-436f-bc9a-5dff1bf795f5 tempest-SnapshotsActionsTest-2023777755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-96b38429-18cb-4675-a979-e387259f6fa9.849e979f-9a3f-486b-ab3b-eab787d82837" returned: 0 in 0.368s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:13:21 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-a0874ea4-1b9b-436f-bc9a-5dff1bf795f5 tempest-SnapshotsActionsTest-2023777755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-96b38429-18cb-4675-a979-e387259f6fa9.info {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:13:21 devstack sudo[90491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-96b38429-18cb-4675-a979-e387259f6fa9.info Nov 04 10:13:21 devstack sudo[90491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:13:21 devstack sudo[90491]: pam_unix(sudo:session): session closed for user root Nov 04 10:13:21 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-a0874ea4-1b9b-436f-bc9a-5dff1bf795f5 tempest-SnapshotsActionsTest-2023777755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-96b38429-18cb-4675-a979-e387259f6fa9.info" returned: 0 in 0.312s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:13:21 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-a0874ea4-1b9b-436f-bc9a-5dff1bf795f5 tempest-SnapshotsActionsTest-2023777755 None] /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-96b38429-18cb-4675-a979-e387259f6fa9.info is being set with open permissions: ugo+rw Nov 04 10:13:21 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-a0874ea4-1b9b-436f-bc9a-5dff1bf795f5 tempest-SnapshotsActionsTest-2023777755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-96b38429-18cb-4675-a979-e387259f6fa9.info {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:13:21 devstack sudo[90494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-96b38429-18cb-4675-a979-e387259f6fa9.info Nov 04 10:13:21 devstack sudo[90494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:13:22 devstack sudo[90494]: pam_unix(sudo:session): session closed for user root Nov 04 10:13:22 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-a0874ea4-1b9b-436f-bc9a-5dff1bf795f5 tempest-SnapshotsActionsTest-2023777755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-96b38429-18cb-4675-a979-e387259f6fa9.info" returned: 0 in 0.828s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:13:22 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-a0874ea4-1b9b-436f-bc9a-5dff1bf795f5 tempest-SnapshotsActionsTest-2023777755 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.280s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:13:22 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-a0874ea4-1b9b-436f-bc9a-5dff1bf795f5 tempest-SnapshotsActionsTest-2023777755 None] Create snapshot completed successfully Nov 04 10:13:24 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-070e3cb5-c8f6-4194-aaef-b9b8edefcacd tempest-SnapshotsActionsTest-2023777755 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:13:24 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-070e3cb5-c8f6-4194-aaef-b9b8edefcacd tempest-SnapshotsActionsTest-2023777755 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:13:24 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-070e3cb5-c8f6-4194-aaef-b9b8edefcacd tempest-SnapshotsActionsTest-2023777755 None] Creating offline snapshot 24e1a355-8d05-4a3d-a451-5403af799201 of volume 96b38429-18cb-4675-a979-e387259f6fa9 {{(pid=87068) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 10:13:24 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[429c11da-96c4-47dc-ba58-8dcbc762aae0]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:13:24 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-070e3cb5-c8f6-4194-aaef-b9b8edefcacd tempest-SnapshotsActionsTest-2023777755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-96b38429-18cb-4675-a979-e387259f6fa9.849e979f-9a3f-486b-ab3b-eab787d82837 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:13:24 devstack sudo[90596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-96b38429-18cb-4675-a979-e387259f6fa9.849e979f-9a3f-486b-ab3b-eab787d82837 Nov 04 10:13:24 devstack sudo[90596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:13:25 devstack sudo[90596]: pam_unix(sudo:session): session closed for user root Nov 04 10:13:25 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-070e3cb5-c8f6-4194-aaef-b9b8edefcacd tempest-SnapshotsActionsTest-2023777755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-96b38429-18cb-4675-a979-e387259f6fa9.849e979f-9a3f-486b-ab3b-eab787d82837" returned: 0 in 0.526s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:13:25 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-070e3cb5-c8f6-4194-aaef-b9b8edefcacd tempest-SnapshotsActionsTest-2023777755 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-96b38429-18cb-4675-a979-e387259f6fa9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87068) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 10:13:25 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-070e3cb5-c8f6-4194-aaef-b9b8edefcacd tempest-SnapshotsActionsTest-2023777755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-96b38429-18cb-4675-a979-e387259f6fa9.849e979f-9a3f-486b-ab3b-eab787d82837,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-96b38429-18cb-4675-a979-e387259f6fa9.24e1a355-8d05-4a3d-a451-5403af799201 1G {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:13:25 devstack sudo[90604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-96b38429-18cb-4675-a979-e387259f6fa9.849e979f-9a3f-486b-ab3b-eab787d82837,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-96b38429-18cb-4675-a979-e387259f6fa9.24e1a355-8d05-4a3d-a451-5403af799201 1G Nov 04 10:13:25 devstack sudo[90604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:13:26 devstack sudo[90604]: pam_unix(sudo:session): session closed for user root Nov 04 10:13:26 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-070e3cb5-c8f6-4194-aaef-b9b8edefcacd tempest-SnapshotsActionsTest-2023777755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-96b38429-18cb-4675-a979-e387259f6fa9.849e979f-9a3f-486b-ab3b-eab787d82837,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-96b38429-18cb-4675-a979-e387259f6fa9.24e1a355-8d05-4a3d-a451-5403af799201 1G" returned: 0 in 0.764s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:13:26 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-070e3cb5-c8f6-4194-aaef-b9b8edefcacd tempest-SnapshotsActionsTest-2023777755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96b38429-18cb-4675-a979-e387259f6fa9.849e979f-9a3f-486b-ab3b-eab787d82837 -F qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-96b38429-18cb-4675-a979-e387259f6fa9.24e1a355-8d05-4a3d-a451-5403af799201 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:13:26 devstack sudo[90617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96b38429-18cb-4675-a979-e387259f6fa9.849e979f-9a3f-486b-ab3b-eab787d82837 -F qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-96b38429-18cb-4675-a979-e387259f6fa9.24e1a355-8d05-4a3d-a451-5403af799201 Nov 04 10:13:26 devstack sudo[90617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:13:26 devstack sudo[90617]: pam_unix(sudo:session): session closed for user root Nov 04 10:13:26 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-070e3cb5-c8f6-4194-aaef-b9b8edefcacd tempest-SnapshotsActionsTest-2023777755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96b38429-18cb-4675-a979-e387259f6fa9.849e979f-9a3f-486b-ab3b-eab787d82837 -F qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-96b38429-18cb-4675-a979-e387259f6fa9.24e1a355-8d05-4a3d-a451-5403af799201" returned: 0 in 0.561s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:13:26 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-070e3cb5-c8f6-4194-aaef-b9b8edefcacd tempest-SnapshotsActionsTest-2023777755 None] /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-96b38429-18cb-4675-a979-e387259f6fa9.24e1a355-8d05-4a3d-a451-5403af799201 is being set with open permissions: ugo+rw Nov 04 10:13:26 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-070e3cb5-c8f6-4194-aaef-b9b8edefcacd tempest-SnapshotsActionsTest-2023777755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-96b38429-18cb-4675-a979-e387259f6fa9.24e1a355-8d05-4a3d-a451-5403af799201 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:13:26 devstack sudo[90633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-96b38429-18cb-4675-a979-e387259f6fa9.24e1a355-8d05-4a3d-a451-5403af799201 Nov 04 10:13:26 devstack sudo[90633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:13:27 devstack sudo[90633]: pam_unix(sudo:session): session closed for user root Nov 04 10:13:27 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-070e3cb5-c8f6-4194-aaef-b9b8edefcacd tempest-SnapshotsActionsTest-2023777755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-96b38429-18cb-4675-a979-e387259f6fa9.24e1a355-8d05-4a3d-a451-5403af799201" returned: 0 in 0.506s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:13:27 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-070e3cb5-c8f6-4194-aaef-b9b8edefcacd tempest-SnapshotsActionsTest-2023777755 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.550s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:13:27 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-070e3cb5-c8f6-4194-aaef-b9b8edefcacd tempest-SnapshotsActionsTest-2023777755 None] Create snapshot completed successfully Nov 04 10:13:28 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-7017a5b4-b39e-4c1f-88bc-b0a0fea64ad4 tempest-SnapshotsActionsTest-407174121 None] Acquiring lock "cinder-24e1a355-8d05-4a3d-a451-5403af799201-delete_snapshot" by "delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:13:28 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-7017a5b4-b39e-4c1f-88bc-b0a0fea64ad4 tempest-SnapshotsActionsTest-407174121 None] Lock "cinder-24e1a355-8d05-4a3d-a451-5403af799201-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:13:28 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-7017a5b4-b39e-4c1f-88bc-b0a0fea64ad4 tempest-SnapshotsActionsTest-407174121 None] Acquiring lock "cinder-quobyte-96b38429-18cb-4675-a979-e387259f6fa9" by "delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:13:28 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-7017a5b4-b39e-4c1f-88bc-b0a0fea64ad4 tempest-SnapshotsActionsTest-407174121 None] Lock "cinder-quobyte-96b38429-18cb-4675-a979-e387259f6fa9" acquired by "delete_snapshot" :: waited 0.045s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:13:28 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-7017a5b4-b39e-4c1f-88bc-b0a0fea64ad4 tempest-SnapshotsActionsTest-407174121 None] Acquiring lock "cinder-quobyte-24e1a355-8d05-4a3d-a451-5403af799201" by "_delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:13:28 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-7017a5b4-b39e-4c1f-88bc-b0a0fea64ad4 tempest-SnapshotsActionsTest-407174121 None] Lock "cinder-quobyte-24e1a355-8d05-4a3d-a451-5403af799201" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:13:28 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-7017a5b4-b39e-4c1f-88bc-b0a0fea64ad4 tempest-SnapshotsActionsTest-407174121 None] Deleting offline snapshot 24e1a355-8d05-4a3d-a451-5403af799201 of volume 96b38429-18cb-4675-a979-e387259f6fa9 {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 10:13:28 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-7017a5b4-b39e-4c1f-88bc-b0a0fea64ad4 tempest-SnapshotsActionsTest-407174121 None] snapshot_file for this snap is: volume-96b38429-18cb-4675-a979-e387259f6fa9.24e1a355-8d05-4a3d-a451-5403af799201 {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 10:13:28 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffe5c275-c4c6-4bd2-b7d7-b9aec312aea1]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:13:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7017a5b4-b39e-4c1f-88bc-b0a0fea64ad4 tempest-SnapshotsActionsTest-407174121 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-96b38429-18cb-4675-a979-e387259f6fa9.24e1a355-8d05-4a3d-a451-5403af799201 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:13:28 devstack sudo[90642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-96b38429-18cb-4675-a979-e387259f6fa9.24e1a355-8d05-4a3d-a451-5403af799201 Nov 04 10:13:28 devstack sudo[90642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:13:28 devstack sudo[90642]: pam_unix(sudo:session): session closed for user root Nov 04 10:13:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7017a5b4-b39e-4c1f-88bc-b0a0fea64ad4 tempest-SnapshotsActionsTest-407174121 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-96b38429-18cb-4675-a979-e387259f6fa9.24e1a355-8d05-4a3d-a451-5403af799201" returned: 0 in 0.520s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:13:28 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-7017a5b4-b39e-4c1f-88bc-b0a0fea64ad4 tempest-SnapshotsActionsTest-407174121 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-96b38429-18cb-4675-a979-e387259f6fa9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87068) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 10:13:28 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d4651db-d4f6-49d9-a0ed-108fa604cbc1]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:13:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7017a5b4-b39e-4c1f-88bc-b0a0fea64ad4 tempest-SnapshotsActionsTest-407174121 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-96b38429-18cb-4675-a979-e387259f6fa9.849e979f-9a3f-486b-ab3b-eab787d82837 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:13:29 devstack sudo[90649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-96b38429-18cb-4675-a979-e387259f6fa9.849e979f-9a3f-486b-ab3b-eab787d82837 Nov 04 10:13:29 devstack sudo[90649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:13:29 devstack sudo[90649]: pam_unix(sudo:session): session closed for user root Nov 04 10:13:29 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7017a5b4-b39e-4c1f-88bc-b0a0fea64ad4 tempest-SnapshotsActionsTest-407174121 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-96b38429-18cb-4675-a979-e387259f6fa9.849e979f-9a3f-486b-ab3b-eab787d82837" returned: 0 in 0.919s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:13:29 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-7017a5b4-b39e-4c1f-88bc-b0a0fea64ad4 tempest-SnapshotsActionsTest-407174121 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-96b38429-18cb-4675-a979-e387259f6fa9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87068) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 10:13:29 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7017a5b4-b39e-4c1f-88bc-b0a0fea64ad4 tempest-SnapshotsActionsTest-407174121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-96b38429-18cb-4675-a979-e387259f6fa9.24e1a355-8d05-4a3d-a451-5403af799201 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:13:29 devstack sudo[90710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-96b38429-18cb-4675-a979-e387259f6fa9.24e1a355-8d05-4a3d-a451-5403af799201 Nov 04 10:13:29 devstack sudo[90710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:13:30 devstack sudo[90710]: pam_unix(sudo:session): session closed for user root Nov 04 10:13:30 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7017a5b4-b39e-4c1f-88bc-b0a0fea64ad4 tempest-SnapshotsActionsTest-407174121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-96b38429-18cb-4675-a979-e387259f6fa9.24e1a355-8d05-4a3d-a451-5403af799201" returned: 0 in 0.767s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:13:30 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7017a5b4-b39e-4c1f-88bc-b0a0fea64ad4 tempest-SnapshotsActionsTest-407174121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-96b38429-18cb-4675-a979-e387259f6fa9.24e1a355-8d05-4a3d-a451-5403af799201 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:13:30 devstack sudo[90729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-96b38429-18cb-4675-a979-e387259f6fa9.24e1a355-8d05-4a3d-a451-5403af799201 Nov 04 10:13:30 devstack sudo[90729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:13:30 devstack sudo[90729]: pam_unix(sudo:session): session closed for user root Nov 04 10:13:30 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7017a5b4-b39e-4c1f-88bc-b0a0fea64ad4 tempest-SnapshotsActionsTest-407174121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-96b38429-18cb-4675-a979-e387259f6fa9.24e1a355-8d05-4a3d-a451-5403af799201" returned: 0 in 0.250s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:13:30 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-7017a5b4-b39e-4c1f-88bc-b0a0fea64ad4 tempest-SnapshotsActionsTest-407174121 None] Lock "cinder-quobyte-24e1a355-8d05-4a3d-a451-5403af799201" released by "_delete_snapshot" :: held 2.696s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:13:30 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-7017a5b4-b39e-4c1f-88bc-b0a0fea64ad4 tempest-SnapshotsActionsTest-407174121 None] Lock "cinder-quobyte-96b38429-18cb-4675-a979-e387259f6fa9" released by "delete_snapshot" :: held 2.737s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:13:31 devstack cinder-volume[87068]: WARNING cinder.quota [None req-7017a5b4-b39e-4c1f-88bc-b0a0fea64ad4 tempest-SnapshotsActionsTest-407174121 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Nov 04 10:13:31 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-7017a5b4-b39e-4c1f-88bc-b0a0fea64ad4 tempest-SnapshotsActionsTest-407174121 None] Created reservations ['f4457d6a-6033-4f91-bfff-6db1acbeced2', '1fa3f6df-6498-4f9e-9c44-f0ab32c957f8', '30dd6748-ab77-46d5-aec9-878fab846521', 'fe004fcf-3b0e-4551-87ae-45a37b11cf59'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:13:31 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-7017a5b4-b39e-4c1f-88bc-b0a0fea64ad4 tempest-SnapshotsActionsTest-407174121 None] Delete snapshot completed successfully. Nov 04 10:13:31 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-7017a5b4-b39e-4c1f-88bc-b0a0fea64ad4 tempest-SnapshotsActionsTest-407174121 None] Lock "cinder-24e1a355-8d05-4a3d-a451-5403af799201-delete_snapshot" released by "delete_snapshot" :: held 3.121s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:13:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-e5b992da-fb3c-4859-8243-a07c76a07dbc tempest-SnapshotsActionsTest-2023777755 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:13:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-e5b992da-fb3c-4859-8243-a07c76a07dbc tempest-SnapshotsActionsTest-2023777755 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:13:31 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-e5b992da-fb3c-4859-8243-a07c76a07dbc tempest-SnapshotsActionsTest-2023777755 None] Creating offline snapshot ee35113a-8569-4122-b1c4-29be7381ac05 of volume 96b38429-18cb-4675-a979-e387259f6fa9 {{(pid=87068) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 10:13:31 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[26d2c3d3-d68f-4a05-a742-07033d70fd0b]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:13:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-e5b992da-fb3c-4859-8243-a07c76a07dbc tempest-SnapshotsActionsTest-2023777755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-96b38429-18cb-4675-a979-e387259f6fa9.849e979f-9a3f-486b-ab3b-eab787d82837 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:13:32 devstack sudo[90735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-96b38429-18cb-4675-a979-e387259f6fa9.849e979f-9a3f-486b-ab3b-eab787d82837 Nov 04 10:13:32 devstack sudo[90735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:13:32 devstack sudo[90735]: pam_unix(sudo:session): session closed for user root Nov 04 10:13:32 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-e5b992da-fb3c-4859-8243-a07c76a07dbc tempest-SnapshotsActionsTest-2023777755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-96b38429-18cb-4675-a979-e387259f6fa9.849e979f-9a3f-486b-ab3b-eab787d82837" returned: 0 in 0.476s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:13:32 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-e5b992da-fb3c-4859-8243-a07c76a07dbc tempest-SnapshotsActionsTest-2023777755 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-96b38429-18cb-4675-a979-e387259f6fa9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87068) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 10:13:32 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-e5b992da-fb3c-4859-8243-a07c76a07dbc tempest-SnapshotsActionsTest-2023777755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-96b38429-18cb-4675-a979-e387259f6fa9.849e979f-9a3f-486b-ab3b-eab787d82837,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-96b38429-18cb-4675-a979-e387259f6fa9.ee35113a-8569-4122-b1c4-29be7381ac05 1G {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:13:32 devstack sudo[90776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-96b38429-18cb-4675-a979-e387259f6fa9.849e979f-9a3f-486b-ab3b-eab787d82837,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-96b38429-18cb-4675-a979-e387259f6fa9.ee35113a-8569-4122-b1c4-29be7381ac05 1G Nov 04 10:13:32 devstack sudo[90776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:13:33 devstack sudo[90776]: pam_unix(sudo:session): session closed for user root Nov 04 10:13:33 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-e5b992da-fb3c-4859-8243-a07c76a07dbc tempest-SnapshotsActionsTest-2023777755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-96b38429-18cb-4675-a979-e387259f6fa9.849e979f-9a3f-486b-ab3b-eab787d82837,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-96b38429-18cb-4675-a979-e387259f6fa9.ee35113a-8569-4122-b1c4-29be7381ac05 1G" returned: 0 in 1.281s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:13:33 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-e5b992da-fb3c-4859-8243-a07c76a07dbc tempest-SnapshotsActionsTest-2023777755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96b38429-18cb-4675-a979-e387259f6fa9.849e979f-9a3f-486b-ab3b-eab787d82837 -F qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-96b38429-18cb-4675-a979-e387259f6fa9.ee35113a-8569-4122-b1c4-29be7381ac05 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:13:33 devstack sudo[90789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96b38429-18cb-4675-a979-e387259f6fa9.849e979f-9a3f-486b-ab3b-eab787d82837 -F qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-96b38429-18cb-4675-a979-e387259f6fa9.ee35113a-8569-4122-b1c4-29be7381ac05 Nov 04 10:13:33 devstack sudo[90789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:13:34 devstack sudo[90789]: pam_unix(sudo:session): session closed for user root Nov 04 10:13:34 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-e5b992da-fb3c-4859-8243-a07c76a07dbc tempest-SnapshotsActionsTest-2023777755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96b38429-18cb-4675-a979-e387259f6fa9.849e979f-9a3f-486b-ab3b-eab787d82837 -F qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-96b38429-18cb-4675-a979-e387259f6fa9.ee35113a-8569-4122-b1c4-29be7381ac05" returned: 0 in 0.589s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:13:34 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-e5b992da-fb3c-4859-8243-a07c76a07dbc tempest-SnapshotsActionsTest-2023777755 None] /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-96b38429-18cb-4675-a979-e387259f6fa9.ee35113a-8569-4122-b1c4-29be7381ac05 is being set with open permissions: ugo+rw Nov 04 10:13:34 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-e5b992da-fb3c-4859-8243-a07c76a07dbc tempest-SnapshotsActionsTest-2023777755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-96b38429-18cb-4675-a979-e387259f6fa9.ee35113a-8569-4122-b1c4-29be7381ac05 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:13:34 devstack sudo[90800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-96b38429-18cb-4675-a979-e387259f6fa9.ee35113a-8569-4122-b1c4-29be7381ac05 Nov 04 10:13:34 devstack sudo[90800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:13:34 devstack sudo[90800]: pam_unix(sudo:session): session closed for user root Nov 04 10:13:34 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-e5b992da-fb3c-4859-8243-a07c76a07dbc tempest-SnapshotsActionsTest-2023777755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-96b38429-18cb-4675-a979-e387259f6fa9.ee35113a-8569-4122-b1c4-29be7381ac05" returned: 0 in 0.459s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:13:34 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-e5b992da-fb3c-4859-8243-a07c76a07dbc tempest-SnapshotsActionsTest-2023777755 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:13:34 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-e5b992da-fb3c-4859-8243-a07c76a07dbc tempest-SnapshotsActionsTest-2023777755 None] Create snapshot completed successfully Nov 04 10:13:35 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-cd17c8a4-06cb-401f-bcbe-c28acdfa7199 tempest-SnapshotsActionsTest-407174121 None] Acquiring lock "cinder-ee35113a-8569-4122-b1c4-29be7381ac05-delete_snapshot" by "delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:13:35 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-cd17c8a4-06cb-401f-bcbe-c28acdfa7199 tempest-SnapshotsActionsTest-407174121 None] Lock "cinder-ee35113a-8569-4122-b1c4-29be7381ac05-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:13:35 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-cd17c8a4-06cb-401f-bcbe-c28acdfa7199 tempest-SnapshotsActionsTest-407174121 None] Acquiring lock "cinder-quobyte-96b38429-18cb-4675-a979-e387259f6fa9" by "delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:13:35 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-cd17c8a4-06cb-401f-bcbe-c28acdfa7199 tempest-SnapshotsActionsTest-407174121 None] Lock "cinder-quobyte-96b38429-18cb-4675-a979-e387259f6fa9" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:13:35 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-cd17c8a4-06cb-401f-bcbe-c28acdfa7199 tempest-SnapshotsActionsTest-407174121 None] Acquiring lock "cinder-quobyte-ee35113a-8569-4122-b1c4-29be7381ac05" by "_delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:13:35 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-cd17c8a4-06cb-401f-bcbe-c28acdfa7199 tempest-SnapshotsActionsTest-407174121 None] Lock "cinder-quobyte-ee35113a-8569-4122-b1c4-29be7381ac05" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:13:35 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-cd17c8a4-06cb-401f-bcbe-c28acdfa7199 tempest-SnapshotsActionsTest-407174121 None] Deleting offline snapshot ee35113a-8569-4122-b1c4-29be7381ac05 of volume 96b38429-18cb-4675-a979-e387259f6fa9 {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 10:13:35 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-cd17c8a4-06cb-401f-bcbe-c28acdfa7199 tempest-SnapshotsActionsTest-407174121 None] snapshot_file for this snap is: volume-96b38429-18cb-4675-a979-e387259f6fa9.ee35113a-8569-4122-b1c4-29be7381ac05 {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 10:13:35 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6357268-ea28-4e5b-b1b5-d89b75b6d215]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:13:35 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-cd17c8a4-06cb-401f-bcbe-c28acdfa7199 tempest-SnapshotsActionsTest-407174121 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-96b38429-18cb-4675-a979-e387259f6fa9.ee35113a-8569-4122-b1c4-29be7381ac05 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:13:35 devstack sudo[90815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-96b38429-18cb-4675-a979-e387259f6fa9.ee35113a-8569-4122-b1c4-29be7381ac05 Nov 04 10:13:35 devstack sudo[90815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:13:36 devstack sudo[90815]: pam_unix(sudo:session): session closed for user root Nov 04 10:13:36 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-cd17c8a4-06cb-401f-bcbe-c28acdfa7199 tempest-SnapshotsActionsTest-407174121 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-96b38429-18cb-4675-a979-e387259f6fa9.ee35113a-8569-4122-b1c4-29be7381ac05" returned: 0 in 0.583s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:13:36 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-cd17c8a4-06cb-401f-bcbe-c28acdfa7199 tempest-SnapshotsActionsTest-407174121 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-96b38429-18cb-4675-a979-e387259f6fa9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87068) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 10:13:36 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[063dea76-bce7-454e-a11b-250fb4f8f782]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:13:36 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-cd17c8a4-06cb-401f-bcbe-c28acdfa7199 tempest-SnapshotsActionsTest-407174121 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-96b38429-18cb-4675-a979-e387259f6fa9.849e979f-9a3f-486b-ab3b-eab787d82837 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:13:36 devstack sudo[90820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-96b38429-18cb-4675-a979-e387259f6fa9.849e979f-9a3f-486b-ab3b-eab787d82837 Nov 04 10:13:36 devstack sudo[90820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:13:36 devstack sudo[90820]: pam_unix(sudo:session): session closed for user root Nov 04 10:13:36 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-cd17c8a4-06cb-401f-bcbe-c28acdfa7199 tempest-SnapshotsActionsTest-407174121 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-96b38429-18cb-4675-a979-e387259f6fa9.849e979f-9a3f-486b-ab3b-eab787d82837" returned: 0 in 0.488s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:13:36 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-cd17c8a4-06cb-401f-bcbe-c28acdfa7199 tempest-SnapshotsActionsTest-407174121 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-96b38429-18cb-4675-a979-e387259f6fa9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87068) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 10:13:36 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-cd17c8a4-06cb-401f-bcbe-c28acdfa7199 tempest-SnapshotsActionsTest-407174121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-96b38429-18cb-4675-a979-e387259f6fa9.ee35113a-8569-4122-b1c4-29be7381ac05 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:13:36 devstack sudo[90827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-96b38429-18cb-4675-a979-e387259f6fa9.ee35113a-8569-4122-b1c4-29be7381ac05 Nov 04 10:13:36 devstack sudo[90827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:13:37 devstack sudo[90827]: pam_unix(sudo:session): session closed for user root Nov 04 10:13:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-cd17c8a4-06cb-401f-bcbe-c28acdfa7199 tempest-SnapshotsActionsTest-407174121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-96b38429-18cb-4675-a979-e387259f6fa9.ee35113a-8569-4122-b1c4-29be7381ac05" returned: 0 in 0.553s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:13:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-cd17c8a4-06cb-401f-bcbe-c28acdfa7199 tempest-SnapshotsActionsTest-407174121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-96b38429-18cb-4675-a979-e387259f6fa9.ee35113a-8569-4122-b1c4-29be7381ac05 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:13:37 devstack sudo[90833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-96b38429-18cb-4675-a979-e387259f6fa9.ee35113a-8569-4122-b1c4-29be7381ac05 Nov 04 10:13:37 devstack sudo[90833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:13:37 devstack sudo[90833]: pam_unix(sudo:session): session closed for user root Nov 04 10:13:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-cd17c8a4-06cb-401f-bcbe-c28acdfa7199 tempest-SnapshotsActionsTest-407174121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-96b38429-18cb-4675-a979-e387259f6fa9.ee35113a-8569-4122-b1c4-29be7381ac05" returned: 0 in 0.311s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:13:37 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-cd17c8a4-06cb-401f-bcbe-c28acdfa7199 tempest-SnapshotsActionsTest-407174121 None] Lock "cinder-quobyte-ee35113a-8569-4122-b1c4-29be7381ac05" released by "_delete_snapshot" :: held 2.138s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:13:37 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-cd17c8a4-06cb-401f-bcbe-c28acdfa7199 tempest-SnapshotsActionsTest-407174121 None] Lock "cinder-quobyte-96b38429-18cb-4675-a979-e387259f6fa9" released by "delete_snapshot" :: held 2.183s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:13:37 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-cd17c8a4-06cb-401f-bcbe-c28acdfa7199 tempest-SnapshotsActionsTest-407174121 None] Created reservations ['1777b6f6-2310-4159-a186-0ee4aec39883', 'f986e198-e697-44a5-9384-47e27d3e1c5b', '708e6810-9774-4be6-8200-a8a0a2bd3502', '65a2c3cb-130b-49d8-a922-ff69630ca971'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:13:38 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-cd17c8a4-06cb-401f-bcbe-c28acdfa7199 tempest-SnapshotsActionsTest-407174121 None] Delete snapshot completed successfully. Nov 04 10:13:38 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-cd17c8a4-06cb-401f-bcbe-c28acdfa7199 tempest-SnapshotsActionsTest-407174121 None] Lock "cinder-ee35113a-8569-4122-b1c4-29be7381ac05-delete_snapshot" released by "delete_snapshot" :: held 2.482s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:13:38 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a21cdc0-1d26-4012-823c-29e712d4a0dc tempest-ServerActionsTestOtherA-1872812514 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:13:38 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1a21cdc0-1d26-4012-823c-29e712d4a0dc tempest-ServerActionsTestOtherA-1872812514 None] Flow 'volume_create_manager' (48ec7dd3-be68-477a-b8c8-444f71047112) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:13:38 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1a21cdc0-1d26-4012-823c-29e712d4a0dc tempest-ServerActionsTestOtherA-1872812514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8483c98a-c75b-40fa-908f-04f468cfea70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:13:38 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1a21cdc0-1d26-4012-823c-29e712d4a0dc tempest-ServerActionsTestOtherA-1872812514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8483c98a-c75b-40fa-908f-04f468cfea70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:13:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-746486810',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ff01dc7-7456-48f4-be1c-a362b704062b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7bd1813cc0dd4c83bd33eaffa5603a22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:13:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:13:38Z,use_quota=True,user_id='516862592ff6496d89448d29fca9000f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:13:38 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1a21cdc0-1d26-4012-823c-29e712d4a0dc tempest-ServerActionsTestOtherA-1872812514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9ae3ed1-f0c7-4f72-b53e-befea3d454a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:13:38 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1a21cdc0-1d26-4012-823c-29e712d4a0dc tempest-ServerActionsTestOtherA-1872812514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9ae3ed1-f0c7-4f72-b53e-befea3d454a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:13:38 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1a21cdc0-1d26-4012-823c-29e712d4a0dc tempest-ServerActionsTestOtherA-1872812514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4875fb7f-7351-459a-aea5-f229ff233265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:13:38 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1a21cdc0-1d26-4012-823c-29e712d4a0dc tempest-ServerActionsTestOtherA-1872812514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4875fb7f-7351-459a-aea5-f229ff233265) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ff01dc7-7456-48f4-be1c-a362b704062b', 'volume_name': 'volume-1ff01dc7-7456-48f4-be1c-a362b704062b', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:13:38 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1a21cdc0-1d26-4012-823c-29e712d4a0dc tempest-ServerActionsTestOtherA-1872812514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a29633ae-b0bb-40a8-a3b6-bb3003cd7716) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:13:38 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1a21cdc0-1d26-4012-823c-29e712d4a0dc tempest-ServerActionsTestOtherA-1872812514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a29633ae-b0bb-40a8-a3b6-bb3003cd7716) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:13:38 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1a21cdc0-1d26-4012-823c-29e712d4a0dc tempest-ServerActionsTestOtherA-1872812514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e10f103f-ab0d-42fc-9a8e-207988dd1259) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:13:38 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-1a21cdc0-1d26-4012-823c-29e712d4a0dc tempest-ServerActionsTestOtherA-1872812514 None] Volume 1ff01dc7-7456-48f4-be1c-a362b704062b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ff01dc7-7456-48f4-be1c-a362b704062b', 'volume_size': 1} Nov 04 10:13:38 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-1a21cdc0-1d26-4012-823c-29e712d4a0dc tempest-ServerActionsTestOtherA-1872812514 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:13:38 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-1a21cdc0-1d26-4012-823c-29e712d4a0dc tempest-ServerActionsTestOtherA-1872812514 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:13:38 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-1a21cdc0-1d26-4012-823c-29e712d4a0dc tempest-ServerActionsTestOtherA-1872812514 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:13:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-746486810',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ff01dc7-7456-48f4-be1c-a362b704062b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7bd1813cc0dd4c83bd33eaffa5603a22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:13:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:13:38Z,use_quota=True,user_id='516862592ff6496d89448d29fca9000f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 10:13:38 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-1a21cdc0-1d26-4012-823c-29e712d4a0dc tempest-ServerActionsTestOtherA-1872812514 None] Creating volume 1ff01dc7-7456-48f4-be1c-a362b704062b {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:13:38 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-1a21cdc0-1d26-4012-823c-29e712d4a0dc tempest-ServerActionsTestOtherA-1872812514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:13:38 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-1a21cdc0-1d26-4012-823c-29e712d4a0dc tempest-ServerActionsTestOtherA-1872812514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:13:38 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-1a21cdc0-1d26-4012-823c-29e712d4a0dc tempest-ServerActionsTestOtherA-1872812514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:13:38 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-1a21cdc0-1d26-4012-823c-29e712d4a0dc tempest-ServerActionsTestOtherA-1872812514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:13:38 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-1a21cdc0-1d26-4012-823c-29e712d4a0dc tempest-ServerActionsTestOtherA-1872812514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:13:38 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-1a21cdc0-1d26-4012-823c-29e712d4a0dc tempest-ServerActionsTestOtherA-1872812514 None] Selected osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:13:38 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-1a21cdc0-1d26-4012-823c-29e712d4a0dc tempest-ServerActionsTestOtherA-1872812514 None] casted to osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 Nov 04 10:13:38 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-1a21cdc0-1d26-4012-823c-29e712d4a0dc tempest-ServerActionsTestOtherA-1872812514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-1ff01dc7-7456-48f4-be1c-a362b704062b 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:13:38 devstack sudo[90871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-1ff01dc7-7456-48f4-be1c-a362b704062b 1073741824 Nov 04 10:13:38 devstack sudo[90871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:13:38 devstack sudo[90871]: pam_unix(sudo:session): session closed for user root Nov 04 10:13:38 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-1a21cdc0-1d26-4012-823c-29e712d4a0dc tempest-ServerActionsTestOtherA-1872812514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-1ff01dc7-7456-48f4-be1c-a362b704062b 1073741824" returned: 0 in 0.625s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:13:38 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-1a21cdc0-1d26-4012-823c-29e712d4a0dc tempest-ServerActionsTestOtherA-1872812514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-1ff01dc7-7456-48f4-be1c-a362b704062b {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:13:38 devstack sudo[90877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-1ff01dc7-7456-48f4-be1c-a362b704062b Nov 04 10:13:39 devstack sudo[90877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:13:39 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-14eab453-5cd8-484a-af12-ad008544282c tempest-SnapshotsActionsTest-2023777755 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:13:39 devstack sudo[90877]: pam_unix(sudo:session): session closed for user root Nov 04 10:13:39 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-1a21cdc0-1d26-4012-823c-29e712d4a0dc tempest-ServerActionsTestOtherA-1872812514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-1ff01dc7-7456-48f4-be1c-a362b704062b" returned: 0 in 0.355s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:13:39 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-1a21cdc0-1d26-4012-823c-29e712d4a0dc tempest-ServerActionsTestOtherA-1872812514 None] <== create_volume: return (1057ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 10:13:39 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-1a21cdc0-1d26-4012-823c-29e712d4a0dc tempest-ServerActionsTestOtherA-1872812514 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.060s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:13:39 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-14eab453-5cd8-484a-af12-ad008544282c tempest-SnapshotsActionsTest-2023777755 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.055s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:13:39 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1a21cdc0-1d26-4012-823c-29e712d4a0dc tempest-ServerActionsTestOtherA-1872812514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e10f103f-ab0d-42fc-9a8e-207988dd1259) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ff01dc7-7456-48f4-be1c-a362b704062b', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:13:39 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1a21cdc0-1d26-4012-823c-29e712d4a0dc tempest-ServerActionsTestOtherA-1872812514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5dee84ab-6b1a-4d3c-b232-99022a71cbc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:13:39 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-14eab453-5cd8-484a-af12-ad008544282c tempest-SnapshotsActionsTest-2023777755 None] Creating offline snapshot 55934726-8695-44e2-a2c8-36ff15ffe0f7 of volume 96b38429-18cb-4675-a979-e387259f6fa9 {{(pid=87068) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 10:13:39 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-1a21cdc0-1d26-4012-823c-29e712d4a0dc tempest-ServerActionsTestOtherA-1872812514 None] Volume volume-1ff01dc7-7456-48f4-be1c-a362b704062b (1ff01dc7-7456-48f4-be1c-a362b704062b): created successfully Nov 04 10:13:39 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1a21cdc0-1d26-4012-823c-29e712d4a0dc tempest-ServerActionsTestOtherA-1872812514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5dee84ab-6b1a-4d3c-b232-99022a71cbc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:13:39 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1a21cdc0-1d26-4012-823c-29e712d4a0dc tempest-ServerActionsTestOtherA-1872812514 None] Flow 'volume_create_manager' (48ec7dd3-be68-477a-b8c8-444f71047112) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:13:39 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[64bc1a0f-5294-40af-9e08-a717e9c4ec5b]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:13:39 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-14eab453-5cd8-484a-af12-ad008544282c tempest-SnapshotsActionsTest-2023777755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-96b38429-18cb-4675-a979-e387259f6fa9.849e979f-9a3f-486b-ab3b-eab787d82837 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:13:39 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-1a21cdc0-1d26-4012-823c-29e712d4a0dc tempest-ServerActionsTestOtherA-1872812514 None] Created volume successfully. Nov 04 10:13:39 devstack sudo[90880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-96b38429-18cb-4675-a979-e387259f6fa9.849e979f-9a3f-486b-ab3b-eab787d82837 Nov 04 10:13:39 devstack sudo[90880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:13:39 devstack sudo[90880]: pam_unix(sudo:session): session closed for user root Nov 04 10:13:39 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-14eab453-5cd8-484a-af12-ad008544282c tempest-SnapshotsActionsTest-2023777755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-96b38429-18cb-4675-a979-e387259f6fa9.849e979f-9a3f-486b-ab3b-eab787d82837" returned: 0 in 0.443s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:13:39 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-14eab453-5cd8-484a-af12-ad008544282c tempest-SnapshotsActionsTest-2023777755 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-96b38429-18cb-4675-a979-e387259f6fa9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87068) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 10:13:39 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-14eab453-5cd8-484a-af12-ad008544282c tempest-SnapshotsActionsTest-2023777755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-96b38429-18cb-4675-a979-e387259f6fa9.849e979f-9a3f-486b-ab3b-eab787d82837,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-96b38429-18cb-4675-a979-e387259f6fa9.55934726-8695-44e2-a2c8-36ff15ffe0f7 1G {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:13:39 devstack sudo[90885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-96b38429-18cb-4675-a979-e387259f6fa9.849e979f-9a3f-486b-ab3b-eab787d82837,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-96b38429-18cb-4675-a979-e387259f6fa9.55934726-8695-44e2-a2c8-36ff15ffe0f7 1G Nov 04 10:13:39 devstack sudo[90885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:13:40 devstack sudo[90885]: pam_unix(sudo:session): session closed for user root Nov 04 10:13:40 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-14eab453-5cd8-484a-af12-ad008544282c tempest-SnapshotsActionsTest-2023777755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-96b38429-18cb-4675-a979-e387259f6fa9.849e979f-9a3f-486b-ab3b-eab787d82837,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-96b38429-18cb-4675-a979-e387259f6fa9.55934726-8695-44e2-a2c8-36ff15ffe0f7 1G" returned: 0 in 0.481s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:13:40 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-14eab453-5cd8-484a-af12-ad008544282c tempest-SnapshotsActionsTest-2023777755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96b38429-18cb-4675-a979-e387259f6fa9.849e979f-9a3f-486b-ab3b-eab787d82837 -F qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-96b38429-18cb-4675-a979-e387259f6fa9.55934726-8695-44e2-a2c8-36ff15ffe0f7 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:13:40 devstack sudo[90891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96b38429-18cb-4675-a979-e387259f6fa9.849e979f-9a3f-486b-ab3b-eab787d82837 -F qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-96b38429-18cb-4675-a979-e387259f6fa9.55934726-8695-44e2-a2c8-36ff15ffe0f7 Nov 04 10:13:40 devstack sudo[90891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:13:40 devstack sudo[90891]: pam_unix(sudo:session): session closed for user root Nov 04 10:13:40 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-14eab453-5cd8-484a-af12-ad008544282c tempest-SnapshotsActionsTest-2023777755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96b38429-18cb-4675-a979-e387259f6fa9.849e979f-9a3f-486b-ab3b-eab787d82837 -F qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-96b38429-18cb-4675-a979-e387259f6fa9.55934726-8695-44e2-a2c8-36ff15ffe0f7" returned: 0 in 0.296s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:13:40 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-14eab453-5cd8-484a-af12-ad008544282c tempest-SnapshotsActionsTest-2023777755 None] /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-96b38429-18cb-4675-a979-e387259f6fa9.55934726-8695-44e2-a2c8-36ff15ffe0f7 is being set with open permissions: ugo+rw Nov 04 10:13:40 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-14eab453-5cd8-484a-af12-ad008544282c tempest-SnapshotsActionsTest-2023777755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-96b38429-18cb-4675-a979-e387259f6fa9.55934726-8695-44e2-a2c8-36ff15ffe0f7 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:13:40 devstack sudo[90897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-96b38429-18cb-4675-a979-e387259f6fa9.55934726-8695-44e2-a2c8-36ff15ffe0f7 Nov 04 10:13:40 devstack sudo[90897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:13:40 devstack sudo[90897]: pam_unix(sudo:session): session closed for user root Nov 04 10:13:40 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-14eab453-5cd8-484a-af12-ad008544282c tempest-SnapshotsActionsTest-2023777755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-96b38429-18cb-4675-a979-e387259f6fa9.55934726-8695-44e2-a2c8-36ff15ffe0f7" returned: 0 in 0.275s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:13:40 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-14eab453-5cd8-484a-af12-ad008544282c tempest-SnapshotsActionsTest-2023777755 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.634s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:13:40 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-14eab453-5cd8-484a-af12-ad008544282c tempest-SnapshotsActionsTest-2023777755 None] Create snapshot completed successfully Nov 04 10:13:41 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-6e91c4d0-b136-4287-b5a6-52a55cf90a4c tempest-SnapshotsActionsTest-407174121 None] Acquiring lock "cinder-55934726-8695-44e2-a2c8-36ff15ffe0f7-delete_snapshot" by "delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:13:41 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-6e91c4d0-b136-4287-b5a6-52a55cf90a4c tempest-SnapshotsActionsTest-407174121 None] Lock "cinder-55934726-8695-44e2-a2c8-36ff15ffe0f7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:13:41 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-6e91c4d0-b136-4287-b5a6-52a55cf90a4c tempest-SnapshotsActionsTest-407174121 None] Acquiring lock "cinder-quobyte-96b38429-18cb-4675-a979-e387259f6fa9" by "delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:13:41 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-6e91c4d0-b136-4287-b5a6-52a55cf90a4c tempest-SnapshotsActionsTest-407174121 None] Lock "cinder-quobyte-96b38429-18cb-4675-a979-e387259f6fa9" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:13:41 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-6e91c4d0-b136-4287-b5a6-52a55cf90a4c tempest-SnapshotsActionsTest-407174121 None] Acquiring lock "cinder-quobyte-55934726-8695-44e2-a2c8-36ff15ffe0f7" by "_delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:13:41 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-6e91c4d0-b136-4287-b5a6-52a55cf90a4c tempest-SnapshotsActionsTest-407174121 None] Lock "cinder-quobyte-55934726-8695-44e2-a2c8-36ff15ffe0f7" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:13:41 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-6e91c4d0-b136-4287-b5a6-52a55cf90a4c tempest-SnapshotsActionsTest-407174121 None] Deleting offline snapshot 55934726-8695-44e2-a2c8-36ff15ffe0f7 of volume 96b38429-18cb-4675-a979-e387259f6fa9 {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 10:13:41 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-6e91c4d0-b136-4287-b5a6-52a55cf90a4c tempest-SnapshotsActionsTest-407174121 None] snapshot_file for this snap is: volume-96b38429-18cb-4675-a979-e387259f6fa9.55934726-8695-44e2-a2c8-36ff15ffe0f7 {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 10:13:41 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cca6dbf-6e9b-40d8-aba8-03f4a36e8857]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:13:41 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6e91c4d0-b136-4287-b5a6-52a55cf90a4c tempest-SnapshotsActionsTest-407174121 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-96b38429-18cb-4675-a979-e387259f6fa9.55934726-8695-44e2-a2c8-36ff15ffe0f7 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:13:41 devstack sudo[90903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-96b38429-18cb-4675-a979-e387259f6fa9.55934726-8695-44e2-a2c8-36ff15ffe0f7 Nov 04 10:13:41 devstack sudo[90903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:13:42 devstack sudo[90903]: pam_unix(sudo:session): session closed for user root Nov 04 10:13:42 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6e91c4d0-b136-4287-b5a6-52a55cf90a4c tempest-SnapshotsActionsTest-407174121 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-96b38429-18cb-4675-a979-e387259f6fa9.55934726-8695-44e2-a2c8-36ff15ffe0f7" returned: 0 in 0.407s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:13:42 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-6e91c4d0-b136-4287-b5a6-52a55cf90a4c tempest-SnapshotsActionsTest-407174121 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-96b38429-18cb-4675-a979-e387259f6fa9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87068) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 10:13:42 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc304617-e35b-4f18-bd66-9eb7b564374b]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:13:42 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6e91c4d0-b136-4287-b5a6-52a55cf90a4c tempest-SnapshotsActionsTest-407174121 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-96b38429-18cb-4675-a979-e387259f6fa9.849e979f-9a3f-486b-ab3b-eab787d82837 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:13:42 devstack sudo[90911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-96b38429-18cb-4675-a979-e387259f6fa9.849e979f-9a3f-486b-ab3b-eab787d82837 Nov 04 10:13:42 devstack sudo[90911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:13:42 devstack sudo[90911]: pam_unix(sudo:session): session closed for user root Nov 04 10:13:42 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6e91c4d0-b136-4287-b5a6-52a55cf90a4c tempest-SnapshotsActionsTest-407174121 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-96b38429-18cb-4675-a979-e387259f6fa9.849e979f-9a3f-486b-ab3b-eab787d82837" returned: 0 in 0.411s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:13:42 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-6e91c4d0-b136-4287-b5a6-52a55cf90a4c tempest-SnapshotsActionsTest-407174121 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-96b38429-18cb-4675-a979-e387259f6fa9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87068) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 10:13:42 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6e91c4d0-b136-4287-b5a6-52a55cf90a4c tempest-SnapshotsActionsTest-407174121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-96b38429-18cb-4675-a979-e387259f6fa9.55934726-8695-44e2-a2c8-36ff15ffe0f7 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:13:42 devstack sudo[90917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-96b38429-18cb-4675-a979-e387259f6fa9.55934726-8695-44e2-a2c8-36ff15ffe0f7 Nov 04 10:13:42 devstack sudo[90917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:13:43 devstack sudo[90917]: pam_unix(sudo:session): session closed for user root Nov 04 10:13:43 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6e91c4d0-b136-4287-b5a6-52a55cf90a4c tempest-SnapshotsActionsTest-407174121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-96b38429-18cb-4675-a979-e387259f6fa9.55934726-8695-44e2-a2c8-36ff15ffe0f7" returned: 0 in 0.565s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:13:43 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6e91c4d0-b136-4287-b5a6-52a55cf90a4c tempest-SnapshotsActionsTest-407174121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-96b38429-18cb-4675-a979-e387259f6fa9.55934726-8695-44e2-a2c8-36ff15ffe0f7 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:13:43 devstack sudo[90924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-96b38429-18cb-4675-a979-e387259f6fa9.55934726-8695-44e2-a2c8-36ff15ffe0f7 Nov 04 10:13:43 devstack sudo[90924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:13:43 devstack sudo[90924]: pam_unix(sudo:session): session closed for user root Nov 04 10:13:43 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6e91c4d0-b136-4287-b5a6-52a55cf90a4c tempest-SnapshotsActionsTest-407174121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-96b38429-18cb-4675-a979-e387259f6fa9.55934726-8695-44e2-a2c8-36ff15ffe0f7" returned: 0 in 0.309s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:13:43 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-6e91c4d0-b136-4287-b5a6-52a55cf90a4c tempest-SnapshotsActionsTest-407174121 None] Lock "cinder-quobyte-55934726-8695-44e2-a2c8-36ff15ffe0f7" released by "_delete_snapshot" :: held 1.824s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:13:43 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-6e91c4d0-b136-4287-b5a6-52a55cf90a4c tempest-SnapshotsActionsTest-407174121 None] Lock "cinder-quobyte-96b38429-18cb-4675-a979-e387259f6fa9" released by "delete_snapshot" :: held 1.868s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:13:43 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-6e91c4d0-b136-4287-b5a6-52a55cf90a4c tempest-SnapshotsActionsTest-407174121 None] Created reservations ['bf741406-f78a-4f9f-abd3-0cbf63a63ac7', 'c5e922e9-79d8-4823-8774-b6bb0ae156f4', 'e9af7741-abfb-4939-964b-a203610418bf', '179bbe00-e708-4ac2-9a6e-61aa94ce82dc'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:13:43 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-6e91c4d0-b136-4287-b5a6-52a55cf90a4c tempest-SnapshotsActionsTest-407174121 None] Delete snapshot completed successfully. Nov 04 10:13:43 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-6e91c4d0-b136-4287-b5a6-52a55cf90a4c tempest-SnapshotsActionsTest-407174121 None] Lock "cinder-55934726-8695-44e2-a2c8-36ff15ffe0f7-delete_snapshot" released by "delete_snapshot" :: held 2.073s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:13:44 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-2d659544-37e6-415b-942a-ea4d2a9b8af6 tempest-SnapshotsActionsTest-2023777755 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:13:44 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-2d659544-37e6-415b-942a-ea4d2a9b8af6 tempest-SnapshotsActionsTest-2023777755 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:13:44 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-2d659544-37e6-415b-942a-ea4d2a9b8af6 tempest-SnapshotsActionsTest-2023777755 None] Creating offline snapshot ad28094f-d117-4503-8e69-034f40a0fcff of volume 96b38429-18cb-4675-a979-e387259f6fa9 {{(pid=87068) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 10:13:44 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[06c1fdfd-24ad-4ea6-acee-9f47941fdfc2]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:13:44 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-2d659544-37e6-415b-942a-ea4d2a9b8af6 tempest-SnapshotsActionsTest-2023777755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-96b38429-18cb-4675-a979-e387259f6fa9.849e979f-9a3f-486b-ab3b-eab787d82837 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:13:44 devstack sudo[90941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-96b38429-18cb-4675-a979-e387259f6fa9.849e979f-9a3f-486b-ab3b-eab787d82837 Nov 04 10:13:44 devstack sudo[90941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:13:44 devstack sudo[90941]: pam_unix(sudo:session): session closed for user root Nov 04 10:13:44 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-2d659544-37e6-415b-942a-ea4d2a9b8af6 tempest-SnapshotsActionsTest-2023777755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-96b38429-18cb-4675-a979-e387259f6fa9.849e979f-9a3f-486b-ab3b-eab787d82837" returned: 0 in 0.413s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:13:44 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-2d659544-37e6-415b-942a-ea4d2a9b8af6 tempest-SnapshotsActionsTest-2023777755 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-96b38429-18cb-4675-a979-e387259f6fa9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87068) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 10:13:44 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-2d659544-37e6-415b-942a-ea4d2a9b8af6 tempest-SnapshotsActionsTest-2023777755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-96b38429-18cb-4675-a979-e387259f6fa9.849e979f-9a3f-486b-ab3b-eab787d82837,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-96b38429-18cb-4675-a979-e387259f6fa9.ad28094f-d117-4503-8e69-034f40a0fcff 1G {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:13:44 devstack sudo[90947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-96b38429-18cb-4675-a979-e387259f6fa9.849e979f-9a3f-486b-ab3b-eab787d82837,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-96b38429-18cb-4675-a979-e387259f6fa9.ad28094f-d117-4503-8e69-034f40a0fcff 1G Nov 04 10:13:44 devstack sudo[90947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:13:45 devstack sudo[90947]: pam_unix(sudo:session): session closed for user root Nov 04 10:13:45 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-2d659544-37e6-415b-942a-ea4d2a9b8af6 tempest-SnapshotsActionsTest-2023777755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-96b38429-18cb-4675-a979-e387259f6fa9.849e979f-9a3f-486b-ab3b-eab787d82837,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-96b38429-18cb-4675-a979-e387259f6fa9.ad28094f-d117-4503-8e69-034f40a0fcff 1G" returned: 0 in 0.717s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:13:45 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-2d659544-37e6-415b-942a-ea4d2a9b8af6 tempest-SnapshotsActionsTest-2023777755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96b38429-18cb-4675-a979-e387259f6fa9.849e979f-9a3f-486b-ab3b-eab787d82837 -F qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-96b38429-18cb-4675-a979-e387259f6fa9.ad28094f-d117-4503-8e69-034f40a0fcff {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:13:45 devstack sudo[90967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96b38429-18cb-4675-a979-e387259f6fa9.849e979f-9a3f-486b-ab3b-eab787d82837 -F qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-96b38429-18cb-4675-a979-e387259f6fa9.ad28094f-d117-4503-8e69-034f40a0fcff Nov 04 10:13:45 devstack sudo[90967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:13:45 devstack sudo[90967]: pam_unix(sudo:session): session closed for user root Nov 04 10:13:45 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-2d659544-37e6-415b-942a-ea4d2a9b8af6 tempest-SnapshotsActionsTest-2023777755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96b38429-18cb-4675-a979-e387259f6fa9.849e979f-9a3f-486b-ab3b-eab787d82837 -F qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-96b38429-18cb-4675-a979-e387259f6fa9.ad28094f-d117-4503-8e69-034f40a0fcff" returned: 0 in 0.400s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:13:45 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-2d659544-37e6-415b-942a-ea4d2a9b8af6 tempest-SnapshotsActionsTest-2023777755 None] /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-96b38429-18cb-4675-a979-e387259f6fa9.ad28094f-d117-4503-8e69-034f40a0fcff is being set with open permissions: ugo+rw Nov 04 10:13:45 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-2d659544-37e6-415b-942a-ea4d2a9b8af6 tempest-SnapshotsActionsTest-2023777755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-96b38429-18cb-4675-a979-e387259f6fa9.ad28094f-d117-4503-8e69-034f40a0fcff {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:13:45 devstack sudo[90975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-96b38429-18cb-4675-a979-e387259f6fa9.ad28094f-d117-4503-8e69-034f40a0fcff Nov 04 10:13:45 devstack sudo[90975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:13:46 devstack sudo[90975]: pam_unix(sudo:session): session closed for user root Nov 04 10:13:46 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-2d659544-37e6-415b-942a-ea4d2a9b8af6 tempest-SnapshotsActionsTest-2023777755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-96b38429-18cb-4675-a979-e387259f6fa9.ad28094f-d117-4503-8e69-034f40a0fcff" returned: 0 in 0.391s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:13:46 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-2d659544-37e6-415b-942a-ea4d2a9b8af6 tempest-SnapshotsActionsTest-2023777755 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.076s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:13:46 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-2d659544-37e6-415b-942a-ea4d2a9b8af6 tempest-SnapshotsActionsTest-2023777755 None] Create snapshot completed successfully Nov 04 10:13:47 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-e1fd09e8-4b5d-4b35-9379-6f45b365a34b tempest-SnapshotsActionsTest-407174121 None] Acquiring lock "cinder-ad28094f-d117-4503-8e69-034f40a0fcff-delete_snapshot" by "delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:13:47 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-e1fd09e8-4b5d-4b35-9379-6f45b365a34b tempest-SnapshotsActionsTest-407174121 None] Lock "cinder-ad28094f-d117-4503-8e69-034f40a0fcff-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:13:47 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-e1fd09e8-4b5d-4b35-9379-6f45b365a34b tempest-SnapshotsActionsTest-407174121 None] Acquiring lock "cinder-quobyte-96b38429-18cb-4675-a979-e387259f6fa9" by "delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:13:47 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-e1fd09e8-4b5d-4b35-9379-6f45b365a34b tempest-SnapshotsActionsTest-407174121 None] Lock "cinder-quobyte-96b38429-18cb-4675-a979-e387259f6fa9" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:13:47 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-e1fd09e8-4b5d-4b35-9379-6f45b365a34b tempest-SnapshotsActionsTest-407174121 None] Acquiring lock "cinder-quobyte-ad28094f-d117-4503-8e69-034f40a0fcff" by "_delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:13:47 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-e1fd09e8-4b5d-4b35-9379-6f45b365a34b tempest-SnapshotsActionsTest-407174121 None] Lock "cinder-quobyte-ad28094f-d117-4503-8e69-034f40a0fcff" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:13:47 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-e1fd09e8-4b5d-4b35-9379-6f45b365a34b tempest-SnapshotsActionsTest-407174121 None] Deleting offline snapshot ad28094f-d117-4503-8e69-034f40a0fcff of volume 96b38429-18cb-4675-a979-e387259f6fa9 {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 10:13:47 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-e1fd09e8-4b5d-4b35-9379-6f45b365a34b tempest-SnapshotsActionsTest-407174121 None] snapshot_file for this snap is: volume-96b38429-18cb-4675-a979-e387259f6fa9.ad28094f-d117-4503-8e69-034f40a0fcff {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 10:13:47 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c83472f-3d96-424a-944a-eb43a00de49f]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:13:47 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-e1fd09e8-4b5d-4b35-9379-6f45b365a34b tempest-SnapshotsActionsTest-407174121 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-96b38429-18cb-4675-a979-e387259f6fa9.ad28094f-d117-4503-8e69-034f40a0fcff {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:13:48 devstack sudo[91029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-96b38429-18cb-4675-a979-e387259f6fa9.ad28094f-d117-4503-8e69-034f40a0fcff Nov 04 10:13:48 devstack sudo[91029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:13:48 devstack sudo[91029]: pam_unix(sudo:session): session closed for user root Nov 04 10:13:48 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-e1fd09e8-4b5d-4b35-9379-6f45b365a34b tempest-SnapshotsActionsTest-407174121 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-96b38429-18cb-4675-a979-e387259f6fa9.ad28094f-d117-4503-8e69-034f40a0fcff" returned: 0 in 0.634s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:13:48 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-e1fd09e8-4b5d-4b35-9379-6f45b365a34b tempest-SnapshotsActionsTest-407174121 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-96b38429-18cb-4675-a979-e387259f6fa9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87068) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 10:13:48 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[89114aab-e749-4cce-add9-d32495a9858e]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:13:48 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-e1fd09e8-4b5d-4b35-9379-6f45b365a34b tempest-SnapshotsActionsTest-407174121 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-96b38429-18cb-4675-a979-e387259f6fa9.849e979f-9a3f-486b-ab3b-eab787d82837 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:13:48 devstack sudo[91037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-96b38429-18cb-4675-a979-e387259f6fa9.849e979f-9a3f-486b-ab3b-eab787d82837 Nov 04 10:13:48 devstack sudo[91037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:13:48 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac8a651c-56b5-4da2-a4ab-b0a6a5c36722 tempest-AttachVolumeTestJSON-152907179 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:13:48 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-ac8a651c-56b5-4da2-a4ab-b0a6a5c36722 tempest-AttachVolumeTestJSON-152907179 None] Flow 'volume_create_manager' (423e6237-4617-4e90-9c58-47eb44c0b71f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:13:48 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-ac8a651c-56b5-4da2-a4ab-b0a6a5c36722 tempest-AttachVolumeTestJSON-152907179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a88bed8a-38c6-4338-8633-cbf93b507a37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:13:48 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-ac8a651c-56b5-4da2-a4ab-b0a6a5c36722 tempest-AttachVolumeTestJSON-152907179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a88bed8a-38c6-4338-8633-cbf93b507a37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:13:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2107889662',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a09f06d-1aa0-4400-84ed-9c2b7ff8cc68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a8a9cd1b4ed496491452baf69cf02b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:13:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:13:49Z,use_quota=True,user_id='91d767ee1a344503861fa899e9ccf9ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:13:48 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-ac8a651c-56b5-4da2-a4ab-b0a6a5c36722 tempest-AttachVolumeTestJSON-152907179 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (520c74cb-9837-46e7-adc1-9b6e48a2758e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:13:48 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-ac8a651c-56b5-4da2-a4ab-b0a6a5c36722 tempest-AttachVolumeTestJSON-152907179 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (520c74cb-9837-46e7-adc1-9b6e48a2758e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:13:48 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-ac8a651c-56b5-4da2-a4ab-b0a6a5c36722 tempest-AttachVolumeTestJSON-152907179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4cd08cc-77b9-45fd-a8a1-cfbf6253034d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:13:48 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-ac8a651c-56b5-4da2-a4ab-b0a6a5c36722 tempest-AttachVolumeTestJSON-152907179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4cd08cc-77b9-45fd-a8a1-cfbf6253034d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a09f06d-1aa0-4400-84ed-9c2b7ff8cc68', 'volume_name': 'volume-4a09f06d-1aa0-4400-84ed-9c2b7ff8cc68', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:13:48 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-ac8a651c-56b5-4da2-a4ab-b0a6a5c36722 tempest-AttachVolumeTestJSON-152907179 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e677e867-485c-41ec-93b3-0079d15c9654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:13:48 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-ac8a651c-56b5-4da2-a4ab-b0a6a5c36722 tempest-AttachVolumeTestJSON-152907179 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e677e867-485c-41ec-93b3-0079d15c9654) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:13:48 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-ac8a651c-56b5-4da2-a4ab-b0a6a5c36722 tempest-AttachVolumeTestJSON-152907179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47249b4a-34db-4d10-bb68-bb154b78e499) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:13:48 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-ac8a651c-56b5-4da2-a4ab-b0a6a5c36722 tempest-AttachVolumeTestJSON-152907179 None] Volume 4a09f06d-1aa0-4400-84ed-9c2b7ff8cc68: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a09f06d-1aa0-4400-84ed-9c2b7ff8cc68', 'volume_size': 1} Nov 04 10:13:48 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-ac8a651c-56b5-4da2-a4ab-b0a6a5c36722 tempest-AttachVolumeTestJSON-152907179 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:13:48 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-ac8a651c-56b5-4da2-a4ab-b0a6a5c36722 tempest-AttachVolumeTestJSON-152907179 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:13:48 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-ac8a651c-56b5-4da2-a4ab-b0a6a5c36722 tempest-AttachVolumeTestJSON-152907179 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:13:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2107889662',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a09f06d-1aa0-4400-84ed-9c2b7ff8cc68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a8a9cd1b4ed496491452baf69cf02b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:13:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:13:49Z,use_quota=True,user_id='91d767ee1a344503861fa899e9ccf9ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 10:13:48 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-ac8a651c-56b5-4da2-a4ab-b0a6a5c36722 tempest-AttachVolumeTestJSON-152907179 None] Creating volume 4a09f06d-1aa0-4400-84ed-9c2b7ff8cc68 {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:13:48 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-ac8a651c-56b5-4da2-a4ab-b0a6a5c36722 tempest-AttachVolumeTestJSON-152907179 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:13:48 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-ac8a651c-56b5-4da2-a4ab-b0a6a5c36722 tempest-AttachVolumeTestJSON-152907179 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:13:48 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-ac8a651c-56b5-4da2-a4ab-b0a6a5c36722 tempest-AttachVolumeTestJSON-152907179 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:13:48 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-ac8a651c-56b5-4da2-a4ab-b0a6a5c36722 tempest-AttachVolumeTestJSON-152907179 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:13:48 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-ac8a651c-56b5-4da2-a4ab-b0a6a5c36722 tempest-AttachVolumeTestJSON-152907179 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:13:48 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-ac8a651c-56b5-4da2-a4ab-b0a6a5c36722 tempest-AttachVolumeTestJSON-152907179 None] Selected osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:13:48 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-ac8a651c-56b5-4da2-a4ab-b0a6a5c36722 tempest-AttachVolumeTestJSON-152907179 None] casted to osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 Nov 04 10:13:48 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ac8a651c-56b5-4da2-a4ab-b0a6a5c36722 tempest-AttachVolumeTestJSON-152907179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-4a09f06d-1aa0-4400-84ed-9c2b7ff8cc68 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:13:48 devstack sudo[91037]: pam_unix(sudo:session): session closed for user root Nov 04 10:13:48 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-e1fd09e8-4b5d-4b35-9379-6f45b365a34b tempest-SnapshotsActionsTest-407174121 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-96b38429-18cb-4675-a979-e387259f6fa9.849e979f-9a3f-486b-ab3b-eab787d82837" returned: 0 in 0.431s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:13:48 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-e1fd09e8-4b5d-4b35-9379-6f45b365a34b tempest-SnapshotsActionsTest-407174121 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-96b38429-18cb-4675-a979-e387259f6fa9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87068) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 10:13:48 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-e1fd09e8-4b5d-4b35-9379-6f45b365a34b tempest-SnapshotsActionsTest-407174121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-96b38429-18cb-4675-a979-e387259f6fa9.ad28094f-d117-4503-8e69-034f40a0fcff {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:13:48 devstack sudo[91042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-4a09f06d-1aa0-4400-84ed-9c2b7ff8cc68 1073741824 Nov 04 10:13:48 devstack sudo[91042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:13:48 devstack sudo[91043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-96b38429-18cb-4675-a979-e387259f6fa9.ad28094f-d117-4503-8e69-034f40a0fcff Nov 04 10:13:48 devstack sudo[91043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:13:49 devstack sudo[91043]: pam_unix(sudo:session): session closed for user root Nov 04 10:13:49 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-e1fd09e8-4b5d-4b35-9379-6f45b365a34b tempest-SnapshotsActionsTest-407174121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-96b38429-18cb-4675-a979-e387259f6fa9.ad28094f-d117-4503-8e69-034f40a0fcff" returned: 0 in 0.436s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:13:49 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-e1fd09e8-4b5d-4b35-9379-6f45b365a34b tempest-SnapshotsActionsTest-407174121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-96b38429-18cb-4675-a979-e387259f6fa9.ad28094f-d117-4503-8e69-034f40a0fcff {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:13:49 devstack sudo[91053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-96b38429-18cb-4675-a979-e387259f6fa9.ad28094f-d117-4503-8e69-034f40a0fcff Nov 04 10:13:49 devstack sudo[91053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:13:49 devstack sudo[91042]: pam_unix(sudo:session): session closed for user root Nov 04 10:13:49 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ac8a651c-56b5-4da2-a4ab-b0a6a5c36722 tempest-AttachVolumeTestJSON-152907179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-4a09f06d-1aa0-4400-84ed-9c2b7ff8cc68 1073741824" returned: 0 in 0.498s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:13:49 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ac8a651c-56b5-4da2-a4ab-b0a6a5c36722 tempest-AttachVolumeTestJSON-152907179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-4a09f06d-1aa0-4400-84ed-9c2b7ff8cc68 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:13:49 devstack sudo[91055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-4a09f06d-1aa0-4400-84ed-9c2b7ff8cc68 Nov 04 10:13:49 devstack sudo[91055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:13:49 devstack sudo[91053]: pam_unix(sudo:session): session closed for user root Nov 04 10:13:49 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-e1fd09e8-4b5d-4b35-9379-6f45b365a34b tempest-SnapshotsActionsTest-407174121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-96b38429-18cb-4675-a979-e387259f6fa9.ad28094f-d117-4503-8e69-034f40a0fcff" returned: 0 in 0.418s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:13:49 devstack sudo[91055]: pam_unix(sudo:session): session closed for user root Nov 04 10:13:49 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ac8a651c-56b5-4da2-a4ab-b0a6a5c36722 tempest-AttachVolumeTestJSON-152907179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-4a09f06d-1aa0-4400-84ed-9c2b7ff8cc68" returned: 0 in 0.362s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:13:49 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-ac8a651c-56b5-4da2-a4ab-b0a6a5c36722 tempest-AttachVolumeTestJSON-152907179 None] <== create_volume: return (935ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 10:13:49 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-ac8a651c-56b5-4da2-a4ab-b0a6a5c36722 tempest-AttachVolumeTestJSON-152907179 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.938s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:13:49 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-e1fd09e8-4b5d-4b35-9379-6f45b365a34b tempest-SnapshotsActionsTest-407174121 None] Lock "cinder-quobyte-ad28094f-d117-4503-8e69-034f40a0fcff" released by "_delete_snapshot" :: held 2.099s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:13:49 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-e1fd09e8-4b5d-4b35-9379-6f45b365a34b tempest-SnapshotsActionsTest-407174121 None] Lock "cinder-quobyte-96b38429-18cb-4675-a979-e387259f6fa9" released by "delete_snapshot" :: held 2.130s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:13:49 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-ac8a651c-56b5-4da2-a4ab-b0a6a5c36722 tempest-AttachVolumeTestJSON-152907179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47249b4a-34db-4d10-bb68-bb154b78e499) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a09f06d-1aa0-4400-84ed-9c2b7ff8cc68', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:13:49 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-ac8a651c-56b5-4da2-a4ab-b0a6a5c36722 tempest-AttachVolumeTestJSON-152907179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99ade300-3b9f-4996-a092-34433e1dea52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:13:49 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-ac8a651c-56b5-4da2-a4ab-b0a6a5c36722 tempest-AttachVolumeTestJSON-152907179 None] Volume volume-4a09f06d-1aa0-4400-84ed-9c2b7ff8cc68 (4a09f06d-1aa0-4400-84ed-9c2b7ff8cc68): created successfully Nov 04 10:13:49 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-ac8a651c-56b5-4da2-a4ab-b0a6a5c36722 tempest-AttachVolumeTestJSON-152907179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99ade300-3b9f-4996-a092-34433e1dea52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:13:49 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-ac8a651c-56b5-4da2-a4ab-b0a6a5c36722 tempest-AttachVolumeTestJSON-152907179 None] Flow 'volume_create_manager' (423e6237-4617-4e90-9c58-47eb44c0b71f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:13:49 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-ac8a651c-56b5-4da2-a4ab-b0a6a5c36722 tempest-AttachVolumeTestJSON-152907179 None] Created volume successfully. Nov 04 10:13:49 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-e1fd09e8-4b5d-4b35-9379-6f45b365a34b tempest-SnapshotsActionsTest-407174121 None] Created reservations ['65e878cf-aa98-490a-89f9-2747bfb789b8', '3e39e718-e9a5-4392-a49e-4784cf8d3619', '9811d08a-c9e4-4ae7-a689-9005460c15b6', '904bc144-929a-4059-9209-8634e9f6c92e'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:13:50 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-e1fd09e8-4b5d-4b35-9379-6f45b365a34b tempest-SnapshotsActionsTest-407174121 None] Delete snapshot completed successfully. Nov 04 10:13:50 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-e1fd09e8-4b5d-4b35-9379-6f45b365a34b tempest-SnapshotsActionsTest-407174121 None] Lock "cinder-ad28094f-d117-4503-8e69-034f40a0fcff-delete_snapshot" released by "delete_snapshot" :: held 2.340s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:13:51 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-fcde5515-df27-4e29-a018-b6536ad6c1b0 tempest-SnapshotsActionsTest-2023777755 None] Acquiring lock "cinder-849e979f-9a3f-486b-ab3b-eab787d82837-delete_snapshot" by "delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:13:51 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-fcde5515-df27-4e29-a018-b6536ad6c1b0 tempest-SnapshotsActionsTest-2023777755 None] Lock "cinder-849e979f-9a3f-486b-ab3b-eab787d82837-delete_snapshot" acquired by "delete_snapshot" :: waited 0.058s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:13:51 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-fcde5515-df27-4e29-a018-b6536ad6c1b0 tempest-SnapshotsActionsTest-2023777755 None] Acquiring lock "cinder-quobyte-96b38429-18cb-4675-a979-e387259f6fa9" by "delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:13:51 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-fcde5515-df27-4e29-a018-b6536ad6c1b0 tempest-SnapshotsActionsTest-2023777755 None] Lock "cinder-quobyte-96b38429-18cb-4675-a979-e387259f6fa9" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:13:51 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-fcde5515-df27-4e29-a018-b6536ad6c1b0 tempest-SnapshotsActionsTest-2023777755 None] Acquiring lock "cinder-quobyte-849e979f-9a3f-486b-ab3b-eab787d82837" by "_delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:13:51 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-fcde5515-df27-4e29-a018-b6536ad6c1b0 tempest-SnapshotsActionsTest-2023777755 None] Lock "cinder-quobyte-849e979f-9a3f-486b-ab3b-eab787d82837" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:13:51 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-fcde5515-df27-4e29-a018-b6536ad6c1b0 tempest-SnapshotsActionsTest-2023777755 None] Deleting offline snapshot 849e979f-9a3f-486b-ab3b-eab787d82837 of volume 96b38429-18cb-4675-a979-e387259f6fa9 {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 10:13:51 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-fcde5515-df27-4e29-a018-b6536ad6c1b0 tempest-SnapshotsActionsTest-2023777755 None] snapshot_file for this snap is: volume-96b38429-18cb-4675-a979-e387259f6fa9.849e979f-9a3f-486b-ab3b-eab787d82837 {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 10:13:51 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ffedaf6-f1e2-4765-a1e8-1fc8bd28fc41]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:13:51 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-fcde5515-df27-4e29-a018-b6536ad6c1b0 tempest-SnapshotsActionsTest-2023777755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-96b38429-18cb-4675-a979-e387259f6fa9.849e979f-9a3f-486b-ab3b-eab787d82837 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:13:52 devstack sudo[91066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-96b38429-18cb-4675-a979-e387259f6fa9.849e979f-9a3f-486b-ab3b-eab787d82837 Nov 04 10:13:52 devstack sudo[91066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:13:52 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [req-104c77d5-8a66-4767-9c3e-ff351338def7 req-ff47f5dd-adf9-4f46-aee1-9c22f7f0f3d2 tempest-AttachVolumeTestJSON-152907179 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:13:52 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [req-104c77d5-8a66-4767-9c3e-ff351338def7 req-ff47f5dd-adf9-4f46-aee1-9c22f7f0f3d2 tempest-AttachVolumeTestJSON-152907179 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:13:52 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [req-104c77d5-8a66-4767-9c3e-ff351338def7 req-ff47f5dd-adf9-4f46-aee1-9c22f7f0f3d2 tempest-AttachVolumeTestJSON-152907179 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:13:52 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [req-104c77d5-8a66-4767-9c3e-ff351338def7 req-ff47f5dd-adf9-4f46-aee1-9c22f7f0f3d2 tempest-AttachVolumeTestJSON-152907179 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034', 'name': 'volume-4a09f06d-1aa0-4400-84ed-9c2b7ff8cc68', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1f9de799-986b-46de-8530-2e375de92c7e', 'enforce_multipath': True} {{(pid=87068) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 04 10:13:52 devstack cinder-volume[87068]: INFO cinder.volume.manager [req-104c77d5-8a66-4767-9c3e-ff351338def7 req-ff47f5dd-adf9-4f46-aee1-9c22f7f0f3d2 tempest-AttachVolumeTestJSON-152907179 None] attachment_update completed successfully. Nov 04 10:13:52 devstack sudo[91066]: pam_unix(sudo:session): session closed for user root Nov 04 10:13:52 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-fcde5515-df27-4e29-a018-b6536ad6c1b0 tempest-SnapshotsActionsTest-2023777755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-96b38429-18cb-4675-a979-e387259f6fa9.849e979f-9a3f-486b-ab3b-eab787d82837" returned: 0 in 0.726s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:13:52 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-fcde5515-df27-4e29-a018-b6536ad6c1b0 tempest-SnapshotsActionsTest-2023777755 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-96b38429-18cb-4675-a979-e387259f6fa9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87068) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 10:13:52 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[9632ce49-8e9b-4bde-90cf-35f7e0d93e8d]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:13:52 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-fcde5515-df27-4e29-a018-b6536ad6c1b0 tempest-SnapshotsActionsTest-2023777755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-96b38429-18cb-4675-a979-e387259f6fa9 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:13:52 devstack sudo[91082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-96b38429-18cb-4675-a979-e387259f6fa9 Nov 04 10:13:52 devstack sudo[91082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:13:53 devstack sudo[91082]: pam_unix(sudo:session): session closed for user root Nov 04 10:13:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-fcde5515-df27-4e29-a018-b6536ad6c1b0 tempest-SnapshotsActionsTest-2023777755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-96b38429-18cb-4675-a979-e387259f6fa9" returned: 0 in 0.683s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:13:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-fcde5515-df27-4e29-a018-b6536ad6c1b0 tempest-SnapshotsActionsTest-2023777755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-96b38429-18cb-4675-a979-e387259f6fa9.849e979f-9a3f-486b-ab3b-eab787d82837 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:13:53 devstack sudo[91501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-96b38429-18cb-4675-a979-e387259f6fa9.849e979f-9a3f-486b-ab3b-eab787d82837 Nov 04 10:13:53 devstack sudo[91501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:13:53 devstack cinder-volume[87068]: DEBUG oslo_service.periodic_task [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87068) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 10:13:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:13:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:13:53 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:13:53 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:13:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:13:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:13:53 devstack sudo[91505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:13:53 devstack sudo[91505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:13:53 devstack sudo[91501]: pam_unix(sudo:session): session closed for user root Nov 04 10:13:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-fcde5515-df27-4e29-a018-b6536ad6c1b0 tempest-SnapshotsActionsTest-2023777755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-96b38429-18cb-4675-a979-e387259f6fa9.849e979f-9a3f-486b-ab3b-eab787d82837" returned: 0 in 0.567s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:13:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-fcde5515-df27-4e29-a018-b6536ad6c1b0 tempest-SnapshotsActionsTest-2023777755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-96b38429-18cb-4675-a979-e387259f6fa9.849e979f-9a3f-486b-ab3b-eab787d82837 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:13:54 devstack sudo[91508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-96b38429-18cb-4675-a979-e387259f6fa9.849e979f-9a3f-486b-ab3b-eab787d82837 Nov 04 10:13:54 devstack sudo[91508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:13:54 devstack sudo[91505]: pam_unix(sudo:session): session closed for user root Nov 04 10:13:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.381s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:13:54 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:13:54 devstack cinder-volume[87068]: DEBUG oslo_service.periodic_task [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Running periodic task VolumeManager._thread_info {{(pid=87068) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 10:13:54 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] thread count: 8 {{(pid=87068) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 04 10:13:54 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] thread info: [<_MainThread(MainThread, started 126275656192128)>, , , , , , , ] {{(pid=87068) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 04 10:13:54 devstack sudo[91508]: pam_unix(sudo:session): session closed for user root Nov 04 10:13:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-fcde5515-df27-4e29-a018-b6536ad6c1b0 tempest-SnapshotsActionsTest-2023777755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-96b38429-18cb-4675-a979-e387259f6fa9.849e979f-9a3f-486b-ab3b-eab787d82837" returned: 0 in 0.327s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:13:54 devstack cinder-volume[87068]: DEBUG dbcounter [-] [87068] Writing DB stats cinder:UPDATE=65,cinder:SELECT=66,cinder:INSERT=13,cinder:DELETE=4 {{(pid=87068) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 10:13:54 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-fcde5515-df27-4e29-a018-b6536ad6c1b0 tempest-SnapshotsActionsTest-2023777755 None] Lock "cinder-quobyte-849e979f-9a3f-486b-ab3b-eab787d82837" released by "_delete_snapshot" :: held 2.543s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:13:54 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-fcde5515-df27-4e29-a018-b6536ad6c1b0 tempest-SnapshotsActionsTest-2023777755 None] Lock "cinder-quobyte-96b38429-18cb-4675-a979-e387259f6fa9" released by "delete_snapshot" :: held 2.581s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:13:54 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-fcde5515-df27-4e29-a018-b6536ad6c1b0 tempest-SnapshotsActionsTest-2023777755 None] Created reservations ['b390f802-29b6-4c64-aa18-3d73d4ee3272', '93af60fe-7ea7-4cf0-b787-7f6ca7978a44', '2ba78a0e-e86a-493c-bbc5-75de7540bd42', '9b38af0e-93e5-44f2-b416-96e93b42474f'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:13:54 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-fcde5515-df27-4e29-a018-b6536ad6c1b0 tempest-SnapshotsActionsTest-2023777755 None] Delete snapshot completed successfully. Nov 04 10:13:54 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-fcde5515-df27-4e29-a018-b6536ad6c1b0 tempest-SnapshotsActionsTest-2023777755 None] Lock "cinder-849e979f-9a3f-486b-ab3b-eab787d82837-delete_snapshot" released by "delete_snapshot" :: held 2.790s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:13:55 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-466ad73c-def8-4bf9-ae10-478797a2ae9f tempest-SnapshotsActionsTest-2023777755 None] Acquiring lock "cinder-96b38429-18cb-4675-a979-e387259f6fa9-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:13:55 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-466ad73c-def8-4bf9-ae10-478797a2ae9f tempest-SnapshotsActionsTest-2023777755 None] Lock "cinder-96b38429-18cb-4675-a979-e387259f6fa9-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:13:55 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-466ad73c-def8-4bf9-ae10-478797a2ae9f tempest-SnapshotsActionsTest-2023777755 None] Acquiring lock "cinder-quobyte-96b38429-18cb-4675-a979-e387259f6fa9" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:13:55 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-466ad73c-def8-4bf9-ae10-478797a2ae9f tempest-SnapshotsActionsTest-2023777755 None] Lock "cinder-quobyte-96b38429-18cb-4675-a979-e387259f6fa9" acquired by "delete_volume" :: waited 0.025s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:13:55 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[989dd671-b2d1-477c-b042-6e15d97a8fbc]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:13:55 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-466ad73c-def8-4bf9-ae10-478797a2ae9f tempest-SnapshotsActionsTest-2023777755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-96b38429-18cb-4675-a979-e387259f6fa9 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:13:55 devstack sudo[91520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-96b38429-18cb-4675-a979-e387259f6fa9 Nov 04 10:13:55 devstack sudo[91520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:13:55 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-081a0d9a-e200-4a81-9365-32dd69c23a7e tempest-AttachVolumeNegativeTest-227441756 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:13:55 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-081a0d9a-e200-4a81-9365-32dd69c23a7e tempest-AttachVolumeNegativeTest-227441756 None] Flow 'volume_create_manager' (1b9f31e4-7606-4c79-8823-d34363593df2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:13:55 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-081a0d9a-e200-4a81-9365-32dd69c23a7e tempest-AttachVolumeNegativeTest-227441756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c7a885c-8b5d-4d2e-91c3-63a953c468ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:13:55 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-081a0d9a-e200-4a81-9365-32dd69c23a7e tempest-AttachVolumeNegativeTest-227441756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c7a885c-8b5d-4d2e-91c3-63a953c468ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:13:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1398533985',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d97630c-19c4-4222-81c8-a6745204f963,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee1b4eb5ed8d4a62988646aa86f9e86f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:13:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:13:55Z,use_quota=True,user_id='96ce21a16a9146f7870800cd774304b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:13:55 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-081a0d9a-e200-4a81-9365-32dd69c23a7e tempest-AttachVolumeNegativeTest-227441756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb38444c-8d9b-4bb5-985b-c6eb0ea35543) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:13:55 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-081a0d9a-e200-4a81-9365-32dd69c23a7e tempest-AttachVolumeNegativeTest-227441756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb38444c-8d9b-4bb5-985b-c6eb0ea35543) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:13:55 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-081a0d9a-e200-4a81-9365-32dd69c23a7e tempest-AttachVolumeNegativeTest-227441756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b14aaefb-8236-46a2-9d51-8b85656f44ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:13:55 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-081a0d9a-e200-4a81-9365-32dd69c23a7e tempest-AttachVolumeNegativeTest-227441756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b14aaefb-8236-46a2-9d51-8b85656f44ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d97630c-19c4-4222-81c8-a6745204f963', 'volume_name': 'volume-1d97630c-19c4-4222-81c8-a6745204f963', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:13:55 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-081a0d9a-e200-4a81-9365-32dd69c23a7e tempest-AttachVolumeNegativeTest-227441756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4378caa-4362-411f-ac4d-2a8862491433) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:13:55 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-081a0d9a-e200-4a81-9365-32dd69c23a7e tempest-AttachVolumeNegativeTest-227441756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4378caa-4362-411f-ac4d-2a8862491433) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:13:55 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-081a0d9a-e200-4a81-9365-32dd69c23a7e tempest-AttachVolumeNegativeTest-227441756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (679ef68c-9bbe-4b1c-86bd-58d0d35b01f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:13:55 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-081a0d9a-e200-4a81-9365-32dd69c23a7e tempest-AttachVolumeNegativeTest-227441756 None] Volume 1d97630c-19c4-4222-81c8-a6745204f963: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d97630c-19c4-4222-81c8-a6745204f963', 'volume_size': 1} Nov 04 10:13:55 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-081a0d9a-e200-4a81-9365-32dd69c23a7e tempest-AttachVolumeNegativeTest-227441756 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:13:55 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-081a0d9a-e200-4a81-9365-32dd69c23a7e tempest-AttachVolumeNegativeTest-227441756 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:13:55 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-081a0d9a-e200-4a81-9365-32dd69c23a7e tempest-AttachVolumeNegativeTest-227441756 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:13:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1398533985',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d97630c-19c4-4222-81c8-a6745204f963,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee1b4eb5ed8d4a62988646aa86f9e86f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:13:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:13:55Z,use_quota=True,user_id='96ce21a16a9146f7870800cd774304b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 10:13:55 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-081a0d9a-e200-4a81-9365-32dd69c23a7e tempest-AttachVolumeNegativeTest-227441756 None] Creating volume 1d97630c-19c4-4222-81c8-a6745204f963 {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:13:55 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-081a0d9a-e200-4a81-9365-32dd69c23a7e tempest-AttachVolumeNegativeTest-227441756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:13:55 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-081a0d9a-e200-4a81-9365-32dd69c23a7e tempest-AttachVolumeNegativeTest-227441756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:13:55 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-081a0d9a-e200-4a81-9365-32dd69c23a7e tempest-AttachVolumeNegativeTest-227441756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:13:55 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-081a0d9a-e200-4a81-9365-32dd69c23a7e tempest-AttachVolumeNegativeTest-227441756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:13:55 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-081a0d9a-e200-4a81-9365-32dd69c23a7e tempest-AttachVolumeNegativeTest-227441756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:13:55 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-081a0d9a-e200-4a81-9365-32dd69c23a7e tempest-AttachVolumeNegativeTest-227441756 None] Selected osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:13:55 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-081a0d9a-e200-4a81-9365-32dd69c23a7e tempest-AttachVolumeNegativeTest-227441756 None] casted to osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 Nov 04 10:13:55 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-081a0d9a-e200-4a81-9365-32dd69c23a7e tempest-AttachVolumeNegativeTest-227441756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-1d97630c-19c4-4222-81c8-a6745204f963 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:13:55 devstack sudo[91522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-1d97630c-19c4-4222-81c8-a6745204f963 1073741824 Nov 04 10:13:55 devstack sudo[91522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:13:55 devstack sudo[91520]: pam_unix(sudo:session): session closed for user root Nov 04 10:13:55 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-466ad73c-def8-4bf9-ae10-478797a2ae9f tempest-SnapshotsActionsTest-2023777755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-96b38429-18cb-4675-a979-e387259f6fa9" returned: 0 in 0.417s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:13:55 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-466ad73c-def8-4bf9-ae10-478797a2ae9f tempest-SnapshotsActionsTest-2023777755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-96b38429-18cb-4675-a979-e387259f6fa9 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:13:55 devstack sudo[91527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-96b38429-18cb-4675-a979-e387259f6fa9 Nov 04 10:13:55 devstack sudo[91527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:13:56 devstack sudo[91527]: pam_unix(sudo:session): session closed for user root Nov 04 10:13:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-466ad73c-def8-4bf9-ae10-478797a2ae9f tempest-SnapshotsActionsTest-2023777755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-96b38429-18cb-4675-a979-e387259f6fa9" returned: 0 in 0.320s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:13:56 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-466ad73c-def8-4bf9-ae10-478797a2ae9f tempest-SnapshotsActionsTest-2023777755 None] Lock "cinder-quobyte-96b38429-18cb-4675-a979-e387259f6fa9" released by "delete_volume" :: held 0.843s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:13:56 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-466ad73c-def8-4bf9-ae10-478797a2ae9f tempest-SnapshotsActionsTest-2023777755 None] Created reservations ['6b04f6ec-7f48-4d87-91e8-5aa7fbd6519e', '4acf9d9a-db12-49d6-b303-78f7fc5d04a9', '765e514c-8b03-43b8-9bd2-a1a6c0e8860f', '38679d05-a241-4312-8887-57049b507cb3'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:13:56 devstack sudo[91522]: pam_unix(sudo:session): session closed for user root Nov 04 10:13:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-081a0d9a-e200-4a81-9365-32dd69c23a7e tempest-AttachVolumeNegativeTest-227441756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-1d97630c-19c4-4222-81c8-a6745204f963 1073741824" returned: 0 in 0.613s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:13:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-466ad73c-def8-4bf9-ae10-478797a2ae9f tempest-SnapshotsActionsTest-2023777755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:13:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-466ad73c-def8-4bf9-ae10-478797a2ae9f tempest-SnapshotsActionsTest-2023777755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:13:56 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-466ad73c-def8-4bf9-ae10-478797a2ae9f tempest-SnapshotsActionsTest-2023777755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:13:56 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-466ad73c-def8-4bf9-ae10-478797a2ae9f tempest-SnapshotsActionsTest-2023777755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:13:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-466ad73c-def8-4bf9-ae10-478797a2ae9f tempest-SnapshotsActionsTest-2023777755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:13:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-466ad73c-def8-4bf9-ae10-478797a2ae9f tempest-SnapshotsActionsTest-2023777755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:13:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-081a0d9a-e200-4a81-9365-32dd69c23a7e tempest-AttachVolumeNegativeTest-227441756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-1d97630c-19c4-4222-81c8-a6745204f963 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:13:56 devstack sudo[91536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:13:56 devstack sudo[91536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:13:56 devstack sudo[91538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-1d97630c-19c4-4222-81c8-a6745204f963 Nov 04 10:13:56 devstack sudo[91538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:13:56 devstack sudo[91536]: pam_unix(sudo:session): session closed for user root Nov 04 10:13:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-466ad73c-def8-4bf9-ae10-478797a2ae9f tempest-SnapshotsActionsTest-2023777755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.434s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:13:56 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-466ad73c-def8-4bf9-ae10-478797a2ae9f tempest-SnapshotsActionsTest-2023777755 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:13:56 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-466ad73c-def8-4bf9-ae10-478797a2ae9f tempest-SnapshotsActionsTest-2023777755 None] Deleted volume successfully. Nov 04 10:13:56 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-466ad73c-def8-4bf9-ae10-478797a2ae9f tempest-SnapshotsActionsTest-2023777755 None] Lock "cinder-96b38429-18cb-4675-a979-e387259f6fa9-delete_volume" released by "delete_volume" :: held 1.610s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:13:56 devstack sudo[91538]: pam_unix(sudo:session): session closed for user root Nov 04 10:13:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-081a0d9a-e200-4a81-9365-32dd69c23a7e tempest-AttachVolumeNegativeTest-227441756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-1d97630c-19c4-4222-81c8-a6745204f963" returned: 0 in 0.526s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:13:56 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-081a0d9a-e200-4a81-9365-32dd69c23a7e tempest-AttachVolumeNegativeTest-227441756 None] <== create_volume: return (1241ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 10:13:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-081a0d9a-e200-4a81-9365-32dd69c23a7e tempest-AttachVolumeNegativeTest-227441756 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.243s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:13:56 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-081a0d9a-e200-4a81-9365-32dd69c23a7e tempest-AttachVolumeNegativeTest-227441756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (679ef68c-9bbe-4b1c-86bd-58d0d35b01f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d97630c-19c4-4222-81c8-a6745204f963', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:13:56 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-081a0d9a-e200-4a81-9365-32dd69c23a7e tempest-AttachVolumeNegativeTest-227441756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a691afcb-5dab-4c61-b3fa-a238f5f85e0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:13:56 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-081a0d9a-e200-4a81-9365-32dd69c23a7e tempest-AttachVolumeNegativeTest-227441756 None] Volume volume-1d97630c-19c4-4222-81c8-a6745204f963 (1d97630c-19c4-4222-81c8-a6745204f963): created successfully Nov 04 10:13:56 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-081a0d9a-e200-4a81-9365-32dd69c23a7e tempest-AttachVolumeNegativeTest-227441756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a691afcb-5dab-4c61-b3fa-a238f5f85e0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:13:56 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-081a0d9a-e200-4a81-9365-32dd69c23a7e tempest-AttachVolumeNegativeTest-227441756 None] Flow 'volume_create_manager' (1b9f31e4-7606-4c79-8823-d34363593df2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:13:56 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-081a0d9a-e200-4a81-9365-32dd69c23a7e tempest-AttachVolumeNegativeTest-227441756 None] Created volume successfully. Nov 04 10:13:59 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [req-c605e85a-c420-4144-bee2-e3242c8db416 req-a7ce6233-7778-4577-8c3c-281656da0c37 tempest-AttachVolumeNegativeTest-227441756 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:13:59 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [req-c605e85a-c420-4144-bee2-e3242c8db416 req-a7ce6233-7778-4577-8c3c-281656da0c37 tempest-AttachVolumeNegativeTest-227441756 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:13:59 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [req-c605e85a-c420-4144-bee2-e3242c8db416 req-a7ce6233-7778-4577-8c3c-281656da0c37 tempest-AttachVolumeNegativeTest-227441756 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.042s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:13:59 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [req-c605e85a-c420-4144-bee2-e3242c8db416 req-a7ce6233-7778-4577-8c3c-281656da0c37 tempest-AttachVolumeNegativeTest-227441756 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034', 'name': 'volume-1d97630c-19c4-4222-81c8-a6745204f963', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'db6aab63-dce6-4936-bdfd-265dd99767db', 'enforce_multipath': True} {{(pid=87068) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 04 10:13:59 devstack cinder-volume[87068]: INFO cinder.volume.manager [req-c605e85a-c420-4144-bee2-e3242c8db416 req-a7ce6233-7778-4577-8c3c-281656da0c37 tempest-AttachVolumeNegativeTest-227441756 None] attachment_update completed successfully. Nov 04 10:14:02 devstack cinder-volume[87068]: INFO cinder.volume.manager [req-88361cc4-ca7c-4934-868b-de0514997330 req-9900d9f1-cd87-429f-94aa-97bb39541948 tempest-AttachVolumeNegativeTest-227441756 None] Terminate volume connection completed successfully. Nov 04 10:14:02 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [req-88361cc4-ca7c-4934-868b-de0514997330 req-9900d9f1-cd87-429f-94aa-97bb39541948 tempest-AttachVolumeNegativeTest-227441756 None] Deleting attachment db6aab63-dce6-4936-bdfd-265dd99767db. {{(pid=87068) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 04 10:14:12 devstack cinder-volume[87068]: DEBUG dbcounter [-] [87068] Writing DB stats cinder:SELECT=19,cinder:INSERT=6,cinder:UPDATE=17 {{(pid=87068) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 10:14:12 devstack cinder-volume[87068]: DEBUG dbcounter [-] [87068] Writing DB stats cinder:UPDATE=53,cinder:SELECT=63,cinder:DELETE=6,cinder:INSERT=14 {{(pid=87068) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 10:14:15 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [req-d4c2d468-615a-4566-b7e6-4053afe94a8d req-333e7b28-8136-4a42-91c9-653cee8dd8d3 tempest-ServerActionsTestOtherA-1872812514 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:14:15 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [req-d4c2d468-615a-4566-b7e6-4053afe94a8d req-333e7b28-8136-4a42-91c9-653cee8dd8d3 tempest-ServerActionsTestOtherA-1872812514 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:14:15 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [req-d4c2d468-615a-4566-b7e6-4053afe94a8d req-333e7b28-8136-4a42-91c9-653cee8dd8d3 tempest-ServerActionsTestOtherA-1872812514 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.029s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:14:15 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [req-d4c2d468-615a-4566-b7e6-4053afe94a8d req-333e7b28-8136-4a42-91c9-653cee8dd8d3 tempest-ServerActionsTestOtherA-1872812514 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034', 'name': 'volume-1ff01dc7-7456-48f4-be1c-a362b704062b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '23d430aa-ce49-45e4-8236-d38b27a98abc', 'enforce_multipath': True} {{(pid=87068) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 04 10:14:15 devstack cinder-volume[87068]: INFO cinder.volume.manager [req-d4c2d468-615a-4566-b7e6-4053afe94a8d req-333e7b28-8136-4a42-91c9-653cee8dd8d3 tempest-ServerActionsTestOtherA-1872812514 None] attachment_update completed successfully. Nov 04 10:14:20 devstack cinder-volume[87068]: INFO cinder.volume.manager [req-937eb29d-c777-4c85-995f-34ca6a9221c8 req-754d9f3f-8524-49d2-8bac-bf8746dc6970 tempest-ServerActionsTestOtherA-1872812514 None] Terminate volume connection completed successfully. Nov 04 10:14:20 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [req-937eb29d-c777-4c85-995f-34ca6a9221c8 req-754d9f3f-8524-49d2-8bac-bf8746dc6970 tempest-ServerActionsTestOtherA-1872812514 None] Deleting attachment 23d430aa-ce49-45e4-8236-d38b27a98abc. {{(pid=87068) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 04 10:14:21 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [req-937eb29d-c777-4c85-995f-34ca6a9221c8 req-1428f53d-86e7-4c85-94e9-ccc71c78ff25 tempest-ServerActionsTestOtherA-1872812514 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:14:21 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [req-937eb29d-c777-4c85-995f-34ca6a9221c8 req-1428f53d-86e7-4c85-94e9-ccc71c78ff25 tempest-ServerActionsTestOtherA-1872812514 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:14:21 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [req-937eb29d-c777-4c85-995f-34ca6a9221c8 req-1428f53d-86e7-4c85-94e9-ccc71c78ff25 tempest-ServerActionsTestOtherA-1872812514 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.035s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:14:21 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [req-937eb29d-c777-4c85-995f-34ca6a9221c8 req-1428f53d-86e7-4c85-94e9-ccc71c78ff25 tempest-ServerActionsTestOtherA-1872812514 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034', 'name': 'volume-1ff01dc7-7456-48f4-be1c-a362b704062b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '55de8ad2-728c-4713-b4b1-8563e8ce0cc0', 'enforce_multipath': True} {{(pid=87068) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 04 10:14:21 devstack cinder-volume[87068]: INFO cinder.volume.manager [req-937eb29d-c777-4c85-995f-34ca6a9221c8 req-1428f53d-86e7-4c85-94e9-ccc71c78ff25 tempest-ServerActionsTestOtherA-1872812514 None] attachment_update completed successfully. Nov 04 10:14:27 devstack cinder-volume[87068]: INFO cinder.volume.manager [req-8f161fba-5ee1-4224-b79a-93b0a8bbdcc4 req-2125d342-a4a1-491e-9eca-5525607a8d42 tempest-AttachVolumeTestJSON-152907179 None] Terminate volume connection completed successfully. Nov 04 10:14:27 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [req-8f161fba-5ee1-4224-b79a-93b0a8bbdcc4 req-2125d342-a4a1-491e-9eca-5525607a8d42 tempest-AttachVolumeTestJSON-152907179 None] Deleting attachment 1f9de799-986b-46de-8530-2e375de92c7e. {{(pid=87068) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 04 10:14:31 devstack cinder-volume[87068]: DEBUG dbcounter [-] [87068] Writing DB stats cinder:SELECT=13,cinder:UPDATE=3 {{(pid=87068) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 10:14:37 devstack cinder-volume[87068]: DEBUG dbcounter [-] [87068] Writing DB stats cinder:SELECT=17,cinder:UPDATE=3 {{(pid=87068) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 10:14:43 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-6eb72061-277e-4269-bc49-b153bb364570 tempest-AttachVolumeNegativeTest-227441756 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:14:43 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-6eb72061-277e-4269-bc49-b153bb364570 tempest-AttachVolumeNegativeTest-227441756 None] Flow 'volume_create_manager' (3cf9eb1d-190f-4f1a-a868-419a6c47d273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:14:43 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-6eb72061-277e-4269-bc49-b153bb364570 tempest-AttachVolumeNegativeTest-227441756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2be13395-eaf5-4e2b-9698-d3e1462c2155) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:14:43 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-6eb72061-277e-4269-bc49-b153bb364570 tempest-AttachVolumeNegativeTest-227441756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2be13395-eaf5-4e2b-9698-d3e1462c2155) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:14:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-110722900',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87f9ebfd-c058-4f1d-a04c-64e2776f1ffb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee1b4eb5ed8d4a62988646aa86f9e86f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:14:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:14:44Z,use_quota=True,user_id='96ce21a16a9146f7870800cd774304b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:14:43 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-6eb72061-277e-4269-bc49-b153bb364570 tempest-AttachVolumeNegativeTest-227441756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2fca3fc-78b8-4f3b-b492-8b66a4ab785c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:14:43 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-6eb72061-277e-4269-bc49-b153bb364570 tempest-AttachVolumeNegativeTest-227441756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2fca3fc-78b8-4f3b-b492-8b66a4ab785c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:14:43 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-6eb72061-277e-4269-bc49-b153bb364570 tempest-AttachVolumeNegativeTest-227441756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4cdb371-ab6a-44e9-9efe-3cb7f1329844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:14:43 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-6eb72061-277e-4269-bc49-b153bb364570 tempest-AttachVolumeNegativeTest-227441756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4cdb371-ab6a-44e9-9efe-3cb7f1329844) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87f9ebfd-c058-4f1d-a04c-64e2776f1ffb', 'volume_name': 'volume-87f9ebfd-c058-4f1d-a04c-64e2776f1ffb', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:14:43 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-6eb72061-277e-4269-bc49-b153bb364570 tempest-AttachVolumeNegativeTest-227441756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2899d91f-fd6d-4ff7-b4df-0d2c26641a6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:14:43 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-6eb72061-277e-4269-bc49-b153bb364570 tempest-AttachVolumeNegativeTest-227441756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2899d91f-fd6d-4ff7-b4df-0d2c26641a6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:14:43 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-6eb72061-277e-4269-bc49-b153bb364570 tempest-AttachVolumeNegativeTest-227441756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9db1091-e07b-4d1f-9795-04afa5bcb82a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:14:43 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-6eb72061-277e-4269-bc49-b153bb364570 tempest-AttachVolumeNegativeTest-227441756 None] Volume 87f9ebfd-c058-4f1d-a04c-64e2776f1ffb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87f9ebfd-c058-4f1d-a04c-64e2776f1ffb', 'volume_size': 1} Nov 04 10:14:43 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-6eb72061-277e-4269-bc49-b153bb364570 tempest-AttachVolumeNegativeTest-227441756 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:14:43 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-6eb72061-277e-4269-bc49-b153bb364570 tempest-AttachVolumeNegativeTest-227441756 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:14:43 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-6eb72061-277e-4269-bc49-b153bb364570 tempest-AttachVolumeNegativeTest-227441756 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:14:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-110722900',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87f9ebfd-c058-4f1d-a04c-64e2776f1ffb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee1b4eb5ed8d4a62988646aa86f9e86f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:14:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:14:44Z,use_quota=True,user_id='96ce21a16a9146f7870800cd774304b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 10:14:43 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-6eb72061-277e-4269-bc49-b153bb364570 tempest-AttachVolumeNegativeTest-227441756 None] Creating volume 87f9ebfd-c058-4f1d-a04c-64e2776f1ffb {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:14:43 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-6eb72061-277e-4269-bc49-b153bb364570 tempest-AttachVolumeNegativeTest-227441756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:14:43 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-6eb72061-277e-4269-bc49-b153bb364570 tempest-AttachVolumeNegativeTest-227441756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:14:43 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-6eb72061-277e-4269-bc49-b153bb364570 tempest-AttachVolumeNegativeTest-227441756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:14:43 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-6eb72061-277e-4269-bc49-b153bb364570 tempest-AttachVolumeNegativeTest-227441756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:14:43 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-6eb72061-277e-4269-bc49-b153bb364570 tempest-AttachVolumeNegativeTest-227441756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:14:43 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-6eb72061-277e-4269-bc49-b153bb364570 tempest-AttachVolumeNegativeTest-227441756 None] Selected osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:14:43 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-6eb72061-277e-4269-bc49-b153bb364570 tempest-AttachVolumeNegativeTest-227441756 None] casted to osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 Nov 04 10:14:43 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6eb72061-277e-4269-bc49-b153bb364570 tempest-AttachVolumeNegativeTest-227441756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-87f9ebfd-c058-4f1d-a04c-64e2776f1ffb 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:14:43 devstack sudo[92653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-87f9ebfd-c058-4f1d-a04c-64e2776f1ffb 1073741824 Nov 04 10:14:43 devstack sudo[92653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:14:44 devstack sudo[92653]: pam_unix(sudo:session): session closed for user root Nov 04 10:14:44 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6eb72061-277e-4269-bc49-b153bb364570 tempest-AttachVolumeNegativeTest-227441756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-87f9ebfd-c058-4f1d-a04c-64e2776f1ffb 1073741824" returned: 0 in 0.494s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:14:44 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6eb72061-277e-4269-bc49-b153bb364570 tempest-AttachVolumeNegativeTest-227441756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-87f9ebfd-c058-4f1d-a04c-64e2776f1ffb {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:14:44 devstack sudo[92659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-87f9ebfd-c058-4f1d-a04c-64e2776f1ffb Nov 04 10:14:44 devstack sudo[92659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:14:44 devstack sudo[92659]: pam_unix(sudo:session): session closed for user root Nov 04 10:14:44 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6eb72061-277e-4269-bc49-b153bb364570 tempest-AttachVolumeNegativeTest-227441756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-87f9ebfd-c058-4f1d-a04c-64e2776f1ffb" returned: 0 in 0.279s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:14:44 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-6eb72061-277e-4269-bc49-b153bb364570 tempest-AttachVolumeNegativeTest-227441756 None] <== create_volume: return (849ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 10:14:44 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-6eb72061-277e-4269-bc49-b153bb364570 tempest-AttachVolumeNegativeTest-227441756 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.851s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:14:44 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-6eb72061-277e-4269-bc49-b153bb364570 tempest-AttachVolumeNegativeTest-227441756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9db1091-e07b-4d1f-9795-04afa5bcb82a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87f9ebfd-c058-4f1d-a04c-64e2776f1ffb', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:14:44 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-6eb72061-277e-4269-bc49-b153bb364570 tempest-AttachVolumeNegativeTest-227441756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b7ce135-9c26-4a79-b60b-69ccb03482af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:14:44 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-6eb72061-277e-4269-bc49-b153bb364570 tempest-AttachVolumeNegativeTest-227441756 None] Volume volume-87f9ebfd-c058-4f1d-a04c-64e2776f1ffb (87f9ebfd-c058-4f1d-a04c-64e2776f1ffb): created successfully Nov 04 10:14:44 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-6eb72061-277e-4269-bc49-b153bb364570 tempest-AttachVolumeNegativeTest-227441756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b7ce135-9c26-4a79-b60b-69ccb03482af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:14:44 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-6eb72061-277e-4269-bc49-b153bb364570 tempest-AttachVolumeNegativeTest-227441756 None] Flow 'volume_create_manager' (3cf9eb1d-190f-4f1a-a868-419a6c47d273) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:14:44 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-6eb72061-277e-4269-bc49-b153bb364570 tempest-AttachVolumeNegativeTest-227441756 None] Created volume successfully. Nov 04 10:14:46 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [req-1ad089ec-bfb8-46e9-bd44-d47baf06e84a req-cde1f73b-9ce0-4f23-a5d3-241bf3341d0e tempest-AttachVolumeNegativeTest-227441756 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:14:46 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [req-1ad089ec-bfb8-46e9-bd44-d47baf06e84a req-cde1f73b-9ce0-4f23-a5d3-241bf3341d0e tempest-AttachVolumeNegativeTest-227441756 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:14:46 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [req-1ad089ec-bfb8-46e9-bd44-d47baf06e84a req-cde1f73b-9ce0-4f23-a5d3-241bf3341d0e tempest-AttachVolumeNegativeTest-227441756 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:14:46 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [req-1ad089ec-bfb8-46e9-bd44-d47baf06e84a req-cde1f73b-9ce0-4f23-a5d3-241bf3341d0e tempest-AttachVolumeNegativeTest-227441756 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034', 'name': 'volume-87f9ebfd-c058-4f1d-a04c-64e2776f1ffb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b1388e71-355d-47c5-98b1-240c7581daa7', 'enforce_multipath': True} {{(pid=87068) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 04 10:14:46 devstack cinder-volume[87068]: INFO cinder.volume.manager [req-1ad089ec-bfb8-46e9-bd44-d47baf06e84a req-cde1f73b-9ce0-4f23-a5d3-241bf3341d0e tempest-AttachVolumeNegativeTest-227441756 None] attachment_update completed successfully. Nov 04 10:14:48 devstack cinder-volume[87068]: INFO cinder.volume.manager [req-2831556a-2b29-480c-9794-fbe032b9b812 req-97dfeba1-0c40-4513-9f2a-87b241c53c24 tempest-AttachVolumeNegativeTest-227441756 None] Terminate volume connection completed successfully. Nov 04 10:14:48 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [req-2831556a-2b29-480c-9794-fbe032b9b812 req-97dfeba1-0c40-4513-9f2a-87b241c53c24 tempest-AttachVolumeNegativeTest-227441756 None] Deleting attachment b1388e71-355d-47c5-98b1-240c7581daa7. {{(pid=87068) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 04 10:14:51 devstack cinder-volume[87068]: INFO cinder.volume.manager [req-cff10f78-1a4b-4ced-ae60-dde4e9f0d24f req-7b8050ca-2196-4b72-9509-d36d7506d69c tempest-ServerActionsTestOtherA-1872812514 None] Terminate volume connection completed successfully. Nov 04 10:14:51 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [req-cff10f78-1a4b-4ced-ae60-dde4e9f0d24f req-7b8050ca-2196-4b72-9509-d36d7506d69c tempest-ServerActionsTestOtherA-1872812514 None] Deleting attachment 55de8ad2-728c-4713-b4b1-8563e8ce0cc0. {{(pid=87068) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 04 10:14:53 devstack cinder-volume[87068]: DEBUG oslo_service.periodic_task [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87068) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 10:14:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:14:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:14:53 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:14:53 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:14:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:14:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:14:53 devstack sudo[92745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:14:53 devstack sudo[92745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:14:54 devstack sudo[92745]: pam_unix(sudo:session): session closed for user root Nov 04 10:14:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.457s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:14:54 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:14:54 devstack cinder-volume[87068]: DEBUG oslo_service.periodic_task [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Running periodic task VolumeManager._thread_info {{(pid=87068) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 10:14:54 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] thread count: 8 {{(pid=87068) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 04 10:14:54 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] thread info: [<_MainThread(MainThread, started 126275656192128)>, , , , , , , ] {{(pid=87068) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 04 10:14:55 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-9307d9c0-c6d4-48ad-a27a-b024e7f2c28e tempest-AttachVolumeNegativeTest-227441756 None] Acquiring lock "cinder-87f9ebfd-c058-4f1d-a04c-64e2776f1ffb-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:14:55 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-9307d9c0-c6d4-48ad-a27a-b024e7f2c28e tempest-AttachVolumeNegativeTest-227441756 None] Lock "cinder-87f9ebfd-c058-4f1d-a04c-64e2776f1ffb-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:14:55 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-9307d9c0-c6d4-48ad-a27a-b024e7f2c28e tempest-AttachVolumeNegativeTest-227441756 None] Acquiring lock "cinder-quobyte-87f9ebfd-c058-4f1d-a04c-64e2776f1ffb" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:14:55 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-9307d9c0-c6d4-48ad-a27a-b024e7f2c28e tempest-AttachVolumeNegativeTest-227441756 None] Lock "cinder-quobyte-87f9ebfd-c058-4f1d-a04c-64e2776f1ffb" acquired by "delete_volume" :: waited 0.022s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:14:55 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ad21fc7-764c-4d8f-a264-09be10117447]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:14:55 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-9307d9c0-c6d4-48ad-a27a-b024e7f2c28e tempest-AttachVolumeNegativeTest-227441756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-87f9ebfd-c058-4f1d-a04c-64e2776f1ffb {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:14:55 devstack sudo[92751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-87f9ebfd-c058-4f1d-a04c-64e2776f1ffb Nov 04 10:14:55 devstack sudo[92751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:14:56 devstack sudo[92751]: pam_unix(sudo:session): session closed for user root Nov 04 10:14:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-9307d9c0-c6d4-48ad-a27a-b024e7f2c28e tempest-AttachVolumeNegativeTest-227441756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-87f9ebfd-c058-4f1d-a04c-64e2776f1ffb" returned: 0 in 0.432s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:14:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-9307d9c0-c6d4-48ad-a27a-b024e7f2c28e tempest-AttachVolumeNegativeTest-227441756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-87f9ebfd-c058-4f1d-a04c-64e2776f1ffb {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:14:56 devstack sudo[92756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-87f9ebfd-c058-4f1d-a04c-64e2776f1ffb Nov 04 10:14:56 devstack sudo[92756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:14:56 devstack sudo[92756]: pam_unix(sudo:session): session closed for user root Nov 04 10:14:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-9307d9c0-c6d4-48ad-a27a-b024e7f2c28e tempest-AttachVolumeNegativeTest-227441756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-87f9ebfd-c058-4f1d-a04c-64e2776f1ffb" returned: 0 in 0.259s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:14:56 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-9307d9c0-c6d4-48ad-a27a-b024e7f2c28e tempest-AttachVolumeNegativeTest-227441756 None] Lock "cinder-quobyte-87f9ebfd-c058-4f1d-a04c-64e2776f1ffb" released by "delete_volume" :: held 0.773s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:14:56 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-9307d9c0-c6d4-48ad-a27a-b024e7f2c28e tempest-AttachVolumeNegativeTest-227441756 None] Created reservations ['018c638a-95d7-4b29-bea3-4ae0d8611b21', 'be45f27d-9625-4b6c-be36-a189822b3fb9', '2d657be8-6b86-4e61-bf47-9210c7a7a54b', '3f0144d3-5c34-45ee-8d69-764175f49817'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:14:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-9307d9c0-c6d4-48ad-a27a-b024e7f2c28e tempest-AttachVolumeNegativeTest-227441756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:14:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-9307d9c0-c6d4-48ad-a27a-b024e7f2c28e tempest-AttachVolumeNegativeTest-227441756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:14:56 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-9307d9c0-c6d4-48ad-a27a-b024e7f2c28e tempest-AttachVolumeNegativeTest-227441756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:14:56 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-9307d9c0-c6d4-48ad-a27a-b024e7f2c28e tempest-AttachVolumeNegativeTest-227441756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:14:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-9307d9c0-c6d4-48ad-a27a-b024e7f2c28e tempest-AttachVolumeNegativeTest-227441756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:14:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-9307d9c0-c6d4-48ad-a27a-b024e7f2c28e tempest-AttachVolumeNegativeTest-227441756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:14:56 devstack sudo[92759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:14:56 devstack sudo[92759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:14:57 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-d77c6be8-ccc8-410b-99cf-ffa92a65b2d3 tempest-AttachVolumeNegativeTest-227441756 None] Acquiring lock "cinder-1d97630c-19c4-4222-81c8-a6745204f963-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:14:57 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-d77c6be8-ccc8-410b-99cf-ffa92a65b2d3 tempest-AttachVolumeNegativeTest-227441756 None] Lock "cinder-1d97630c-19c4-4222-81c8-a6745204f963-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:14:57 devstack sudo[92759]: pam_unix(sudo:session): session closed for user root Nov 04 10:14:57 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-9307d9c0-c6d4-48ad-a27a-b024e7f2c28e tempest-AttachVolumeNegativeTest-227441756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.466s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:14:57 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-9307d9c0-c6d4-48ad-a27a-b024e7f2c28e tempest-AttachVolumeNegativeTest-227441756 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:14:57 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-9307d9c0-c6d4-48ad-a27a-b024e7f2c28e tempest-AttachVolumeNegativeTest-227441756 None] Deleted volume successfully. Nov 04 10:14:57 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-d77c6be8-ccc8-410b-99cf-ffa92a65b2d3 tempest-AttachVolumeNegativeTest-227441756 None] Acquiring lock "cinder-quobyte-1d97630c-19c4-4222-81c8-a6745204f963" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:14:57 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-9307d9c0-c6d4-48ad-a27a-b024e7f2c28e tempest-AttachVolumeNegativeTest-227441756 None] Lock "cinder-87f9ebfd-c058-4f1d-a04c-64e2776f1ffb-delete_volume" released by "delete_volume" :: held 1.612s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:14:57 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-d77c6be8-ccc8-410b-99cf-ffa92a65b2d3 tempest-AttachVolumeNegativeTest-227441756 None] Lock "cinder-quobyte-1d97630c-19c4-4222-81c8-a6745204f963" acquired by "delete_volume" :: waited 0.033s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:14:57 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[22c09efe-970e-4c11-afba-90dadea8713d]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:14:57 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d77c6be8-ccc8-410b-99cf-ffa92a65b2d3 tempest-AttachVolumeNegativeTest-227441756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-1d97630c-19c4-4222-81c8-a6745204f963 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:14:57 devstack sudo[92762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-1d97630c-19c4-4222-81c8-a6745204f963 Nov 04 10:14:57 devstack sudo[92762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:14:57 devstack sudo[92762]: pam_unix(sudo:session): session closed for user root Nov 04 10:14:57 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d77c6be8-ccc8-410b-99cf-ffa92a65b2d3 tempest-AttachVolumeNegativeTest-227441756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-1d97630c-19c4-4222-81c8-a6745204f963" returned: 0 in 0.465s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:14:57 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d77c6be8-ccc8-410b-99cf-ffa92a65b2d3 tempest-AttachVolumeNegativeTest-227441756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-1d97630c-19c4-4222-81c8-a6745204f963 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:14:57 devstack sudo[92768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-1d97630c-19c4-4222-81c8-a6745204f963 Nov 04 10:14:57 devstack sudo[92768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:14:58 devstack sudo[92768]: pam_unix(sudo:session): session closed for user root Nov 04 10:14:58 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d77c6be8-ccc8-410b-99cf-ffa92a65b2d3 tempest-AttachVolumeNegativeTest-227441756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-1d97630c-19c4-4222-81c8-a6745204f963" returned: 0 in 0.296s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:14:58 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-d77c6be8-ccc8-410b-99cf-ffa92a65b2d3 tempest-AttachVolumeNegativeTest-227441756 None] Lock "cinder-quobyte-1d97630c-19c4-4222-81c8-a6745204f963" released by "delete_volume" :: held 0.807s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:14:58 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-d77c6be8-ccc8-410b-99cf-ffa92a65b2d3 tempest-AttachVolumeNegativeTest-227441756 None] Created reservations ['2fe339df-693f-42d7-ba3c-a7e02f210d00', 'e024e011-ebfd-41f6-a087-3d7cd8e677da', '8d9cb1ce-be06-4e34-9361-58f327d362e8', 'b6264586-262c-45d4-a026-eb2f8b964d48'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:14:58 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-d77c6be8-ccc8-410b-99cf-ffa92a65b2d3 tempest-AttachVolumeNegativeTest-227441756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:14:58 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-d77c6be8-ccc8-410b-99cf-ffa92a65b2d3 tempest-AttachVolumeNegativeTest-227441756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:14:58 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-d77c6be8-ccc8-410b-99cf-ffa92a65b2d3 tempest-AttachVolumeNegativeTest-227441756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:14:58 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-d77c6be8-ccc8-410b-99cf-ffa92a65b2d3 tempest-AttachVolumeNegativeTest-227441756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:14:58 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-d77c6be8-ccc8-410b-99cf-ffa92a65b2d3 tempest-AttachVolumeNegativeTest-227441756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:14:58 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d77c6be8-ccc8-410b-99cf-ffa92a65b2d3 tempest-AttachVolumeNegativeTest-227441756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:14:58 devstack sudo[92773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:14:58 devstack sudo[92773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:14:58 devstack sudo[92773]: pam_unix(sudo:session): session closed for user root Nov 04 10:14:58 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d77c6be8-ccc8-410b-99cf-ffa92a65b2d3 tempest-AttachVolumeNegativeTest-227441756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.361s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:14:58 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-d77c6be8-ccc8-410b-99cf-ffa92a65b2d3 tempest-AttachVolumeNegativeTest-227441756 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:14:58 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-d77c6be8-ccc8-410b-99cf-ffa92a65b2d3 tempest-AttachVolumeNegativeTest-227441756 None] Deleted volume successfully. Nov 04 10:14:58 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-d77c6be8-ccc8-410b-99cf-ffa92a65b2d3 tempest-AttachVolumeNegativeTest-227441756 None] Lock "cinder-1d97630c-19c4-4222-81c8-a6745204f963-delete_volume" released by "delete_volume" :: held 1.562s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:14:59 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-c3e3f98f-c620-4b61-94f3-781852b05cbe tempest-AttachVolumeNegativeTest-227441756 None] Acquiring lock "cinder-f69ad7a1-0c95-471f-bbb5-e43c3af326aa-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:14:59 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-c3e3f98f-c620-4b61-94f3-781852b05cbe tempest-AttachVolumeNegativeTest-227441756 None] Lock "cinder-f69ad7a1-0c95-471f-bbb5-e43c3af326aa-delete_volume" acquired by "delete_volume" :: waited 0.072s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:14:59 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-c3e3f98f-c620-4b61-94f3-781852b05cbe tempest-AttachVolumeNegativeTest-227441756 None] Acquiring lock "cinder-quobyte-f69ad7a1-0c95-471f-bbb5-e43c3af326aa" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:14:59 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-c3e3f98f-c620-4b61-94f3-781852b05cbe tempest-AttachVolumeNegativeTest-227441756 None] Lock "cinder-quobyte-f69ad7a1-0c95-471f-bbb5-e43c3af326aa" acquired by "delete_volume" :: waited 0.025s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:14:59 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[59ec3b57-616f-449a-9c53-a4b75578846e]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:14:59 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c3e3f98f-c620-4b61-94f3-781852b05cbe tempest-AttachVolumeNegativeTest-227441756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-f69ad7a1-0c95-471f-bbb5-e43c3af326aa {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:15:00 devstack sudo[92799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-f69ad7a1-0c95-471f-bbb5-e43c3af326aa Nov 04 10:15:00 devstack sudo[92799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:15:00 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae892940-7562-43e4-a599-4751ea81fb1c tempest-ServerActionsTestOtherA-1872812514 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:15:00 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-ae892940-7562-43e4-a599-4751ea81fb1c tempest-ServerActionsTestOtherA-1872812514 None] Flow 'volume_create_manager' (4a219e0f-7557-43e1-aa67-0947a3fe2fa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:15:00 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-ae892940-7562-43e4-a599-4751ea81fb1c tempest-ServerActionsTestOtherA-1872812514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1604f417-e16a-4035-96a9-799ac9d2350b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:15:00 devstack sudo[92799]: pam_unix(sudo:session): session closed for user root Nov 04 10:15:00 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-ae892940-7562-43e4-a599-4751ea81fb1c tempest-ServerActionsTestOtherA-1872812514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1604f417-e16a-4035-96a9-799ac9d2350b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:15:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-878037812',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=097433cf-7f53-4f25-8070-c2ac554c6695,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7bd1813cc0dd4c83bd33eaffa5603a22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:15:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:15:00Z,use_quota=True,user_id='516862592ff6496d89448d29fca9000f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:15:00 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-ae892940-7562-43e4-a599-4751ea81fb1c tempest-ServerActionsTestOtherA-1872812514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5589de5-ad12-4c08-ab65-f2e3363f9b3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:15:00 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-ae892940-7562-43e4-a599-4751ea81fb1c tempest-ServerActionsTestOtherA-1872812514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5589de5-ad12-4c08-ab65-f2e3363f9b3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:15:00 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-ae892940-7562-43e4-a599-4751ea81fb1c tempest-ServerActionsTestOtherA-1872812514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (721c310b-0ea5-4421-83b1-a4a8af3c055a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:15:00 devstack cinder-volume[87068]: DEBUG cinder.image.glance [None req-ae892940-7562-43e4-a599-4751ea81fb1c tempest-ServerActionsTestOtherA-1872812514 None] Creating Keystone auth plugin from conf {{(pid=87068) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 04 10:15:00 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c3e3f98f-c620-4b61-94f3-781852b05cbe tempest-AttachVolumeNegativeTest-227441756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-f69ad7a1-0c95-471f-bbb5-e43c3af326aa" returned: 0 in 0.658s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:15:00 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c3e3f98f-c620-4b61-94f3-781852b05cbe tempest-AttachVolumeNegativeTest-227441756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-f69ad7a1-0c95-471f-bbb5-e43c3af326aa {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:15:00 devstack sudo[92805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-f69ad7a1-0c95-471f-bbb5-e43c3af326aa Nov 04 10:15:00 devstack sudo[92805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:15:00 devstack sudo[92805]: pam_unix(sudo:session): session closed for user root Nov 04 10:15:00 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c3e3f98f-c620-4b61-94f3-781852b05cbe tempest-AttachVolumeNegativeTest-227441756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-f69ad7a1-0c95-471f-bbb5-e43c3af326aa" returned: 0 in 0.346s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:15:00 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-c3e3f98f-c620-4b61-94f3-781852b05cbe tempest-AttachVolumeNegativeTest-227441756 None] Lock "cinder-quobyte-f69ad7a1-0c95-471f-bbb5-e43c3af326aa" released by "delete_volume" :: held 1.097s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:15:01 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-c3e3f98f-c620-4b61-94f3-781852b05cbe tempest-AttachVolumeNegativeTest-227441756 None] Created reservations ['f2169f72-835a-45b4-a106-b41604b7e9d3', '8cd64051-0668-46d8-a2e2-5523965dc2ff', '7c76b392-1f8b-4886-a6d2-19454ecf0875', '52f0e60b-2950-40a7-baf6-98e9c0c11e16'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:15:01 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-ae892940-7562-43e4-a599-4751ea81fb1c tempest-ServerActionsTestOtherA-1872812514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (721c310b-0ea5-4421-83b1-a4a8af3c055a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '097433cf-7f53-4f25-8070-c2ac554c6695', 'volume_name': 'volume-097433cf-7f53-4f25-8070-c2ac554c6695', 'volume_size': 1, 'image_id': 'c589a328-f3ed-418a-8877-e90bfc4cf133', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c589a328-f3ed-418a-8877-e90bfc4cf133', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '046e78417f874f20873c25a0eb7adc65', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c589a328-f3ed-418a-8877-e90bfc4cf133', 'created_at': datetime.datetime(2026, 11, 4, 9, 4, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 9, 5, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c589a328-f3ed-418a-8877-e90bfc4cf133/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:15:01 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-ae892940-7562-43e4-a599-4751ea81fb1c tempest-ServerActionsTestOtherA-1872812514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7eeab3aa-1a50-4ab3-81b3-205771fa8de3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:15:01 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-ae892940-7562-43e4-a599-4751ea81fb1c tempest-ServerActionsTestOtherA-1872812514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7eeab3aa-1a50-4ab3-81b3-205771fa8de3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:15:01 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-ae892940-7562-43e4-a599-4751ea81fb1c tempest-ServerActionsTestOtherA-1872812514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4b6b08f-38ad-4a7b-bf16-0e6e878473d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:15:01 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-ae892940-7562-43e4-a599-4751ea81fb1c tempest-ServerActionsTestOtherA-1872812514 None] Volume 097433cf-7f53-4f25-8070-c2ac554c6695: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-097433cf-7f53-4f25-8070-c2ac554c6695', 'volume_size': 1, 'image_id': 'c589a328-f3ed-418a-8877-e90bfc4cf133', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c589a328-f3ed-418a-8877-e90bfc4cf133', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '046e78417f874f20873c25a0eb7adc65', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c589a328-f3ed-418a-8877-e90bfc4cf133', 'created_at': datetime.datetime(2026, 11, 4, 9, 4, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 9, 5, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c589a328-f3ed-418a-8877-e90bfc4cf133/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 04 10:15:01 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae892940-7562-43e4-a599-4751ea81fb1c tempest-ServerActionsTestOtherA-1872812514 None] Trying to clone 097433cf-7f53-4f25-8070-c2ac554c6695 from image c589a328-f3ed-418a-8877-e90bfc4cf133 at location (None, [{'url': 'file:///opt/stack/data/glance/images/c589a328-f3ed-418a-8877-e90bfc4cf133', 'metadata': {}}]). {{(pid=87068) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 04 10:15:01 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-c3e3f98f-c620-4b61-94f3-781852b05cbe tempest-AttachVolumeNegativeTest-227441756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:15:01 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-c3e3f98f-c620-4b61-94f3-781852b05cbe tempest-AttachVolumeNegativeTest-227441756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:15:01 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-c3e3f98f-c620-4b61-94f3-781852b05cbe tempest-AttachVolumeNegativeTest-227441756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:15:01 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-c3e3f98f-c620-4b61-94f3-781852b05cbe tempest-AttachVolumeNegativeTest-227441756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:15:01 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-c3e3f98f-c620-4b61-94f3-781852b05cbe tempest-AttachVolumeNegativeTest-227441756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:15:01 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c3e3f98f-c620-4b61-94f3-781852b05cbe tempest-AttachVolumeNegativeTest-227441756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:15:01 devstack sudo[92809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:15:01 devstack sudo[92809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:15:01 devstack sudo[92809]: pam_unix(sudo:session): session closed for user root Nov 04 10:15:01 devstack cinder-volume[87068]: DEBUG cinder.image.image_utils [None req-ae892940-7562-43e4-a599-4751ea81fb1c tempest-ServerActionsTestOtherA-1872812514 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c589a328-f3ed-418a-8877-e90bfc4cf133_uq55c5k9devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87068) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 04 10:15:01 devstack cinder-volume[87068]: INFO cinder.image.image_utils [None req-ae892940-7562-43e4-a599-4751ea81fb1c tempest-ServerActionsTestOtherA-1872812514 None] Image download 20.69 MB at 20.69 MB/s Nov 04 10:15:01 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c3e3f98f-c620-4b61-94f3-781852b05cbe tempest-AttachVolumeNegativeTest-227441756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.505s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:15:01 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-c3e3f98f-c620-4b61-94f3-781852b05cbe tempest-AttachVolumeNegativeTest-227441756 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:15:01 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-c3e3f98f-c620-4b61-94f3-781852b05cbe tempest-AttachVolumeNegativeTest-227441756 None] Deleted volume successfully. Nov 04 10:15:01 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-c3e3f98f-c620-4b61-94f3-781852b05cbe tempest-AttachVolumeNegativeTest-227441756 None] Lock "cinder-f69ad7a1-0c95-471f-bbb5-e43c3af326aa-delete_volume" released by "delete_volume" :: held 1.962s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:15:01 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[85d6a7b4-94c1-456e-8a78-b5aecdd59efb]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:15:01 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ae892940-7562-43e4-a599-4751ea81fb1c tempest-ServerActionsTestOtherA-1872812514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c589a328-f3ed-418a-8877-e90bfc4cf133_uq55c5k9devstack@QuobyteHD {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:15:01 devstack sudo[92833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c589a328-f3ed-418a-8877-e90bfc4cf133_uq55c5k9devstack@QuobyteHD Nov 04 10:15:01 devstack sudo[92833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:15:02 devstack sudo[92833]: pam_unix(sudo:session): session closed for user root Nov 04 10:15:02 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ae892940-7562-43e4-a599-4751ea81fb1c tempest-ServerActionsTestOtherA-1872812514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c589a328-f3ed-418a-8877-e90bfc4cf133_uq55c5k9devstack@QuobyteHD" returned: 0 in 0.432s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:15:02 devstack cinder-volume[87068]: DEBUG cinder.image.image_utils [None req-ae892940-7562-43e4-a599-4751ea81fb1c tempest-ServerActionsTestOtherA-1872812514 None] Temporary image c589a328-f3ed-418a-8877-e90bfc4cf133 is fetched for user 516862592ff6496d89448d29fca9000f. {{(pid=87068) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 04 10:15:02 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bb0e506-6652-47fb-aa1e-020e0e0bb998]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:15:02 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ae892940-7562-43e4-a599-4751ea81fb1c tempest-ServerActionsTestOtherA-1872812514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c589a328-f3ed-418a-8877-e90bfc4cf133_uq55c5k9devstack@QuobyteHD {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:15:02 devstack sudo[92843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c589a328-f3ed-418a-8877-e90bfc4cf133_uq55c5k9devstack@QuobyteHD Nov 04 10:15:02 devstack sudo[92843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:15:02 devstack sudo[92843]: pam_unix(sudo:session): session closed for user root Nov 04 10:15:02 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ae892940-7562-43e4-a599-4751ea81fb1c tempest-ServerActionsTestOtherA-1872812514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c589a328-f3ed-418a-8877-e90bfc4cf133_uq55c5k9devstack@QuobyteHD" returned: 0 in 0.419s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:15:02 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-ae892940-7562-43e4-a599-4751ea81fb1c tempest-ServerActionsTestOtherA-1872812514 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:15:02 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-ae892940-7562-43e4-a599-4751ea81fb1c tempest-ServerActionsTestOtherA-1872812514 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:15:02 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-ae892940-7562-43e4-a599-4751ea81fb1c tempest-ServerActionsTestOtherA-1872812514 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:15:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-878037812',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=097433cf-7f53-4f25-8070-c2ac554c6695,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7bd1813cc0dd4c83bd33eaffa5603a22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:15:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:15:00Z,use_quota=True,user_id='516862592ff6496d89448d29fca9000f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 10:15:02 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-ae892940-7562-43e4-a599-4751ea81fb1c tempest-ServerActionsTestOtherA-1872812514 None] Creating volume 097433cf-7f53-4f25-8070-c2ac554c6695 {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:15:02 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-ae892940-7562-43e4-a599-4751ea81fb1c tempest-ServerActionsTestOtherA-1872812514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:15:02 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-ae892940-7562-43e4-a599-4751ea81fb1c tempest-ServerActionsTestOtherA-1872812514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:15:02 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-ae892940-7562-43e4-a599-4751ea81fb1c tempest-ServerActionsTestOtherA-1872812514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:15:02 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-ae892940-7562-43e4-a599-4751ea81fb1c tempest-ServerActionsTestOtherA-1872812514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:15:02 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-ae892940-7562-43e4-a599-4751ea81fb1c tempest-ServerActionsTestOtherA-1872812514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:15:02 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-ae892940-7562-43e4-a599-4751ea81fb1c tempest-ServerActionsTestOtherA-1872812514 None] Selected osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:15:02 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-ae892940-7562-43e4-a599-4751ea81fb1c tempest-ServerActionsTestOtherA-1872812514 None] casted to osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 Nov 04 10:15:02 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ae892940-7562-43e4-a599-4751ea81fb1c tempest-ServerActionsTestOtherA-1872812514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-097433cf-7f53-4f25-8070-c2ac554c6695 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:15:02 devstack sudo[92848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-097433cf-7f53-4f25-8070-c2ac554c6695 1073741824 Nov 04 10:15:02 devstack sudo[92848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:15:03 devstack sudo[92848]: pam_unix(sudo:session): session closed for user root Nov 04 10:15:03 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ae892940-7562-43e4-a599-4751ea81fb1c tempest-ServerActionsTestOtherA-1872812514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-097433cf-7f53-4f25-8070-c2ac554c6695 1073741824" returned: 0 in 0.648s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:15:03 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ae892940-7562-43e4-a599-4751ea81fb1c tempest-ServerActionsTestOtherA-1872812514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-097433cf-7f53-4f25-8070-c2ac554c6695 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:15:03 devstack sudo[92854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-097433cf-7f53-4f25-8070-c2ac554c6695 Nov 04 10:15:03 devstack sudo[92854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:15:03 devstack sudo[92854]: pam_unix(sudo:session): session closed for user root Nov 04 10:15:03 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ae892940-7562-43e4-a599-4751ea81fb1c tempest-ServerActionsTestOtherA-1872812514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-097433cf-7f53-4f25-8070-c2ac554c6695" returned: 0 in 0.282s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:15:03 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-ae892940-7562-43e4-a599-4751ea81fb1c tempest-ServerActionsTestOtherA-1872812514 None] <== create_volume: return (985ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 10:15:03 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-ae892940-7562-43e4-a599-4751ea81fb1c tempest-ServerActionsTestOtherA-1872812514 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.988s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:15:03 devstack cinder-volume[87068]: DEBUG cinder.volume.volume_utils [None req-ae892940-7562-43e4-a599-4751ea81fb1c tempest-ServerActionsTestOtherA-1872812514 None] Attempting download of c589a328-f3ed-418a-8877-e90bfc4cf133 ((None, [{'url': 'file:///opt/stack/data/glance/images/c589a328-f3ed-418a-8877-e90bfc4cf133', 'metadata': {}}])) to volume 097433cf-7f53-4f25-8070-c2ac554c6695. {{(pid=87068) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 04 10:15:03 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b5a2473-6498-4a4a-a631-f099a414fa78]: (4, 'raw') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:15:03 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ae892940-7562-43e4-a599-4751ea81fb1c tempest-ServerActionsTestOtherA-1872812514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c589a328-f3ed-418a-8877-e90bfc4cf133_cg8o2vwa {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:15:04 devstack sudo[92857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c589a328-f3ed-418a-8877-e90bfc4cf133_cg8o2vwa Nov 04 10:15:04 devstack sudo[92857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:15:04 devstack sudo[92857]: pam_unix(sudo:session): session closed for user root Nov 04 10:15:04 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ae892940-7562-43e4-a599-4751ea81fb1c tempest-ServerActionsTestOtherA-1872812514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c589a328-f3ed-418a-8877-e90bfc4cf133_cg8o2vwa" returned: 0 in 0.379s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:15:04 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ae892940-7562-43e4-a599-4751ea81fb1c tempest-ServerActionsTestOtherA-1872812514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c589a328-f3ed-418a-8877-e90bfc4cf133_cg8o2vwa {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:15:04 devstack sudo[92862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c589a328-f3ed-418a-8877-e90bfc4cf133_cg8o2vwa Nov 04 10:15:04 devstack sudo[92862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:15:04 devstack sudo[92862]: pam_unix(sudo:session): session closed for user root Nov 04 10:15:04 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ae892940-7562-43e4-a599-4751ea81fb1c tempest-ServerActionsTestOtherA-1872812514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c589a328-f3ed-418a-8877-e90bfc4cf133_cg8o2vwa" returned: 1 in 0.401s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:15:04 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ae892940-7562-43e4-a599-4751ea81fb1c tempest-ServerActionsTestOtherA-1872812514 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c589a328-f3ed-418a-8877-e90bfc4cf133_cg8o2vwa' failed. Not Retrying. {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 04 10:15:04 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f955990-c63a-4a25-a0ca-c332dfe82229]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:15:04 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ae892940-7562-43e4-a599-4751ea81fb1c tempest-ServerActionsTestOtherA-1872812514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c589a328-f3ed-418a-8877-e90bfc4cf133_uq55c5k9devstack@QuobyteHD {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:15:04 devstack sudo[92866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c589a328-f3ed-418a-8877-e90bfc4cf133_uq55c5k9devstack@QuobyteHD Nov 04 10:15:04 devstack sudo[92866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:15:05 devstack sudo[92866]: pam_unix(sudo:session): session closed for user root Nov 04 10:15:05 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ae892940-7562-43e4-a599-4751ea81fb1c tempest-ServerActionsTestOtherA-1872812514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c589a328-f3ed-418a-8877-e90bfc4cf133_uq55c5k9devstack@QuobyteHD" returned: 0 in 0.359s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:15:05 devstack cinder-volume[87068]: DEBUG cinder.image.image_utils [None req-ae892940-7562-43e4-a599-4751ea81fb1c tempest-ServerActionsTestOtherA-1872812514 None] c589a328-f3ed-418a-8877-e90bfc4cf133 was qcow2, converting to qcow2 {{(pid=87068) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 04 10:15:05 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ae892940-7562-43e4-a599-4751ea81fb1c tempest-ServerActionsTestOtherA-1872812514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c589a328-f3ed-418a-8877-e90bfc4cf133_uq55c5k9devstack@QuobyteHD /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-097433cf-7f53-4f25-8070-c2ac554c6695 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:15:05 devstack sudo[92871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c589a328-f3ed-418a-8877-e90bfc4cf133_uq55c5k9devstack@QuobyteHD /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-097433cf-7f53-4f25-8070-c2ac554c6695 Nov 04 10:15:05 devstack sudo[92871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:15:07 devstack sudo[92871]: pam_unix(sudo:session): session closed for user root Nov 04 10:15:07 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ae892940-7562-43e4-a599-4751ea81fb1c tempest-ServerActionsTestOtherA-1872812514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c589a328-f3ed-418a-8877-e90bfc4cf133_uq55c5k9devstack@QuobyteHD /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-097433cf-7f53-4f25-8070-c2ac554c6695" returned: 0 in 2.496s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:15:07 devstack cinder-volume[87068]: DEBUG cinder.image.image_utils [None req-ae892940-7562-43e4-a599-4751ea81fb1c tempest-ServerActionsTestOtherA-1872812514 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c589a328-f3ed-418a-8877-e90bfc4cf133_uq55c5k9devstack@QuobyteHD, size 112.00 MB, duration 2.50 sec, destination /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-097433cf-7f53-4f25-8070-c2ac554c6695 {{(pid=87068) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 04 10:15:07 devstack cinder-volume[87068]: INFO cinder.image.image_utils [None req-ae892940-7562-43e4-a599-4751ea81fb1c tempest-ServerActionsTestOtherA-1872812514 None] Converted 112.00 MB image at 44.84 MB/s Nov 04 10:15:07 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ae892940-7562-43e4-a599-4751ea81fb1c tempest-ServerActionsTestOtherA-1872812514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-097433cf-7f53-4f25-8070-c2ac554c6695 1G {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:15:07 devstack sudo[92887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-097433cf-7f53-4f25-8070-c2ac554c6695 1G Nov 04 10:15:07 devstack sudo[92887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:15:08 devstack sudo[92887]: pam_unix(sudo:session): session closed for user root Nov 04 10:15:08 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ae892940-7562-43e4-a599-4751ea81fb1c tempest-ServerActionsTestOtherA-1872812514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-097433cf-7f53-4f25-8070-c2ac554c6695 1G" returned: 0 in 0.551s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:15:08 devstack cinder-volume[87068]: DEBUG cinder.volume.volume_utils [None req-ae892940-7562-43e4-a599-4751ea81fb1c tempest-ServerActionsTestOtherA-1872812514 None] Downloaded image c589a328-f3ed-418a-8877-e90bfc4cf133 ((None, [{'url': 'file:///opt/stack/data/glance/images/c589a328-f3ed-418a-8877-e90bfc4cf133', 'metadata': {}}])) to volume 097433cf-7f53-4f25-8070-c2ac554c6695 successfully. {{(pid=87068) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 04 10:15:08 devstack cinder-volume[87068]: DEBUG cinder.image.image_utils [None req-ae892940-7562-43e4-a599-4751ea81fb1c tempest-ServerActionsTestOtherA-1872812514 None] Temporary image c589a328-f3ed-418a-8877-e90bfc4cf133 for user 516862592ff6496d89448d29fca9000f is deleted. {{(pid=87068) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 04 10:15:08 devstack cinder-volume[87068]: DEBUG cinder.volume.volume_utils [None req-ae892940-7562-43e4-a599-4751ea81fb1c tempest-ServerActionsTestOtherA-1872812514 None] Marking volume 097433cf-7f53-4f25-8070-c2ac554c6695 as bootable. {{(pid=87068) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 04 10:15:08 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae892940-7562-43e4-a599-4751ea81fb1c tempest-ServerActionsTestOtherA-1872812514 None] Copying metadata from image c589a328-f3ed-418a-8877-e90bfc4cf133 to 097433cf-7f53-4f25-8070-c2ac554c6695. {{(pid=87068) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 04 10:15:08 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae892940-7562-43e4-a599-4751ea81fb1c tempest-ServerActionsTestOtherA-1872812514 None] Creating volume glance metadata for volume 097433cf-7f53-4f25-8070-c2ac554c6695 backed by image c589a328-f3ed-418a-8877-e90bfc4cf133 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'c589a328-f3ed-418a-8877-e90bfc4cf133', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87068) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 04 10:15:08 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-ae892940-7562-43e4-a599-4751ea81fb1c tempest-ServerActionsTestOtherA-1872812514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4b6b08f-38ad-4a7b-bf16-0e6e878473d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-097433cf-7f53-4f25-8070-c2ac554c6695', 'volume_size': 1, 'image_id': 'c589a328-f3ed-418a-8877-e90bfc4cf133', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c589a328-f3ed-418a-8877-e90bfc4cf133', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '046e78417f874f20873c25a0eb7adc65', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c589a328-f3ed-418a-8877-e90bfc4cf133', 'created_at': datetime.datetime(2026, 11, 4, 9, 4, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 9, 5, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c589a328-f3ed-418a-8877-e90bfc4cf133/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:15:08 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-ae892940-7562-43e4-a599-4751ea81fb1c tempest-ServerActionsTestOtherA-1872812514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85f1d74e-81a5-4b3b-bb8b-e72831756318) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:15:08 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-ae892940-7562-43e4-a599-4751ea81fb1c tempest-ServerActionsTestOtherA-1872812514 None] Volume volume-097433cf-7f53-4f25-8070-c2ac554c6695 (097433cf-7f53-4f25-8070-c2ac554c6695): created successfully Nov 04 10:15:08 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-ae892940-7562-43e4-a599-4751ea81fb1c tempest-ServerActionsTestOtherA-1872812514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85f1d74e-81a5-4b3b-bb8b-e72831756318) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:15:08 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-ae892940-7562-43e4-a599-4751ea81fb1c tempest-ServerActionsTestOtherA-1872812514 None] Flow 'volume_create_manager' (4a219e0f-7557-43e1-aa67-0947a3fe2fa6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:15:08 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-ae892940-7562-43e4-a599-4751ea81fb1c tempest-ServerActionsTestOtherA-1872812514 None] Created volume successfully. Nov 04 10:15:16 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [req-bfb53950-5371-470f-8c19-20047351a2ec req-bd957eac-65dd-4d05-a5b1-ba11af374110 tempest-ServerActionsTestOtherA-1872812514 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:15:16 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [req-bfb53950-5371-470f-8c19-20047351a2ec req-bd957eac-65dd-4d05-a5b1-ba11af374110 tempest-ServerActionsTestOtherA-1872812514 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:15:16 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [req-bfb53950-5371-470f-8c19-20047351a2ec req-bd957eac-65dd-4d05-a5b1-ba11af374110 tempest-ServerActionsTestOtherA-1872812514 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:15:16 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [req-bfb53950-5371-470f-8c19-20047351a2ec req-bd957eac-65dd-4d05-a5b1-ba11af374110 tempest-ServerActionsTestOtherA-1872812514 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034', 'name': 'volume-097433cf-7f53-4f25-8070-c2ac554c6695', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c343d58b-fd0e-419e-b2dc-0ec92360818f', 'enforce_multipath': True} {{(pid=87068) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 04 10:15:16 devstack cinder-volume[87068]: INFO cinder.volume.manager [req-bfb53950-5371-470f-8c19-20047351a2ec req-bd957eac-65dd-4d05-a5b1-ba11af374110 tempest-ServerActionsTestOtherA-1872812514 None] attachment_update completed successfully. Nov 04 10:15:26 devstack cinder-volume[87068]: DEBUG dbcounter [-] [87068] Writing DB stats cinder:SELECT=39,cinder:UPDATE=38,cinder:INSERT=10,cinder:DELETE=2 {{(pid=87068) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 10:15:26 devstack cinder-volume[87068]: DEBUG dbcounter [-] [87068] Writing DB stats cinder:SELECT=44,cinder:UPDATE=31,cinder:INSERT=17,cinder:DELETE=3 {{(pid=87068) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 10:15:27 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-46b5397a-e988-4dd0-ac6a-3eea30c91468 tempest-VolumesActionsTest-1242513407 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:15:27 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-46b5397a-e988-4dd0-ac6a-3eea30c91468 tempest-VolumesActionsTest-1242513407 None] Flow 'volume_create_manager' (6eb7b855-ae82-447f-b7e6-1632ad9cfd43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:15:27 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-46b5397a-e988-4dd0-ac6a-3eea30c91468 tempest-VolumesActionsTest-1242513407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c41629a8-94ee-4419-8e69-d425766618a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:15:27 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-46b5397a-e988-4dd0-ac6a-3eea30c91468 tempest-VolumesActionsTest-1242513407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c41629a8-94ee-4419-8e69-d425766618a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:15:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-465410292',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10a8a883-bd10-44bd-bfb1-bca0f4d59f4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef09188d1b1d4638b581343b902055a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:15:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:15:27Z,use_quota=True,user_id='fcefba7c587147fa837e6a42a2fc173d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:15:27 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-46b5397a-e988-4dd0-ac6a-3eea30c91468 tempest-VolumesActionsTest-1242513407 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ef4ced1-c833-481d-9a5b-fa8ffec6f704) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:15:27 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-46b5397a-e988-4dd0-ac6a-3eea30c91468 tempest-VolumesActionsTest-1242513407 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ef4ced1-c833-481d-9a5b-fa8ffec6f704) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:15:27 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-46b5397a-e988-4dd0-ac6a-3eea30c91468 tempest-VolumesActionsTest-1242513407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b110d42-8224-42f9-ba57-f28d1d38fd85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:15:27 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-46b5397a-e988-4dd0-ac6a-3eea30c91468 tempest-VolumesActionsTest-1242513407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b110d42-8224-42f9-ba57-f28d1d38fd85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10a8a883-bd10-44bd-bfb1-bca0f4d59f4d', 'volume_name': 'volume-10a8a883-bd10-44bd-bfb1-bca0f4d59f4d', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:15:27 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-46b5397a-e988-4dd0-ac6a-3eea30c91468 tempest-VolumesActionsTest-1242513407 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce602d81-7ead-4228-86f5-a1edad3c3357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:15:27 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-46b5397a-e988-4dd0-ac6a-3eea30c91468 tempest-VolumesActionsTest-1242513407 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce602d81-7ead-4228-86f5-a1edad3c3357) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:15:27 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-46b5397a-e988-4dd0-ac6a-3eea30c91468 tempest-VolumesActionsTest-1242513407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9a4edcb-9a10-4081-883e-50d7abdbdec9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:15:27 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-46b5397a-e988-4dd0-ac6a-3eea30c91468 tempest-VolumesActionsTest-1242513407 None] Volume 10a8a883-bd10-44bd-bfb1-bca0f4d59f4d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10a8a883-bd10-44bd-bfb1-bca0f4d59f4d', 'volume_size': 1} Nov 04 10:15:27 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-46b5397a-e988-4dd0-ac6a-3eea30c91468 tempest-VolumesActionsTest-1242513407 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:15:27 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-46b5397a-e988-4dd0-ac6a-3eea30c91468 tempest-VolumesActionsTest-1242513407 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:15:27 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-46b5397a-e988-4dd0-ac6a-3eea30c91468 tempest-VolumesActionsTest-1242513407 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:15:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-465410292',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10a8a883-bd10-44bd-bfb1-bca0f4d59f4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef09188d1b1d4638b581343b902055a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:15:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:15:27Z,use_quota=True,user_id='fcefba7c587147fa837e6a42a2fc173d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 10:15:27 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-46b5397a-e988-4dd0-ac6a-3eea30c91468 tempest-VolumesActionsTest-1242513407 None] Creating volume 10a8a883-bd10-44bd-bfb1-bca0f4d59f4d {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:15:27 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-46b5397a-e988-4dd0-ac6a-3eea30c91468 tempest-VolumesActionsTest-1242513407 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:15:27 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-46b5397a-e988-4dd0-ac6a-3eea30c91468 tempest-VolumesActionsTest-1242513407 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:15:27 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-46b5397a-e988-4dd0-ac6a-3eea30c91468 tempest-VolumesActionsTest-1242513407 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:15:27 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-46b5397a-e988-4dd0-ac6a-3eea30c91468 tempest-VolumesActionsTest-1242513407 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:15:27 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-46b5397a-e988-4dd0-ac6a-3eea30c91468 tempest-VolumesActionsTest-1242513407 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.041s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:15:27 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-46b5397a-e988-4dd0-ac6a-3eea30c91468 tempest-VolumesActionsTest-1242513407 None] Selected osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:15:27 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-46b5397a-e988-4dd0-ac6a-3eea30c91468 tempest-VolumesActionsTest-1242513407 None] casted to osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 Nov 04 10:15:27 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-46b5397a-e988-4dd0-ac6a-3eea30c91468 tempest-VolumesActionsTest-1242513407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-10a8a883-bd10-44bd-bfb1-bca0f4d59f4d 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:15:27 devstack sudo[93475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-10a8a883-bd10-44bd-bfb1-bca0f4d59f4d 1073741824 Nov 04 10:15:27 devstack sudo[93475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:15:27 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-5219fdda-14ee-4256-93ca-3004da64122a tempest-GroupSnapshotsTest-1028111199 None] Group tempest-GroupSnapshotsTest-Group-2135181131: creating Nov 04 10:15:27 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-5219fdda-14ee-4256-93ca-3004da64122a tempest-GroupSnapshotsTest-1028111199 None] Group tempest-GroupSnapshotsTest-Group-2135181131: created successfully Nov 04 10:15:27 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-5219fdda-14ee-4256-93ca-3004da64122a tempest-GroupSnapshotsTest-1028111199 None] Create group completed successfully. Nov 04 10:15:28 devstack sudo[93475]: pam_unix(sudo:session): session closed for user root Nov 04 10:15:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-46b5397a-e988-4dd0-ac6a-3eea30c91468 tempest-VolumesActionsTest-1242513407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-10a8a883-bd10-44bd-bfb1-bca0f4d59f4d 1073741824" returned: 0 in 1.427s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:15:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-46b5397a-e988-4dd0-ac6a-3eea30c91468 tempest-VolumesActionsTest-1242513407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-10a8a883-bd10-44bd-bfb1-bca0f4d59f4d {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:15:29 devstack sudo[93535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-10a8a883-bd10-44bd-bfb1-bca0f4d59f4d Nov 04 10:15:29 devstack sudo[93535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:15:29 devstack sudo[93535]: pam_unix(sudo:session): session closed for user root Nov 04 10:15:29 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-46b5397a-e988-4dd0-ac6a-3eea30c91468 tempest-VolumesActionsTest-1242513407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-10a8a883-bd10-44bd-bfb1-bca0f4d59f4d" returned: 0 in 0.773s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:15:29 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-46b5397a-e988-4dd0-ac6a-3eea30c91468 tempest-VolumesActionsTest-1242513407 None] <== create_volume: return (2355ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 10:15:29 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-46b5397a-e988-4dd0-ac6a-3eea30c91468 tempest-VolumesActionsTest-1242513407 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.369s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:15:29 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-46b5397a-e988-4dd0-ac6a-3eea30c91468 tempest-VolumesActionsTest-1242513407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9a4edcb-9a10-4081-883e-50d7abdbdec9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10a8a883-bd10-44bd-bfb1-bca0f4d59f4d', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:15:29 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-46b5397a-e988-4dd0-ac6a-3eea30c91468 tempest-VolumesActionsTest-1242513407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36b874d0-51d8-4d95-b4f7-52c66ce05d4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:15:29 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-46b5397a-e988-4dd0-ac6a-3eea30c91468 tempest-VolumesActionsTest-1242513407 None] Volume volume-10a8a883-bd10-44bd-bfb1-bca0f4d59f4d (10a8a883-bd10-44bd-bfb1-bca0f4d59f4d): created successfully Nov 04 10:15:29 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-46b5397a-e988-4dd0-ac6a-3eea30c91468 tempest-VolumesActionsTest-1242513407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36b874d0-51d8-4d95-b4f7-52c66ce05d4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:15:29 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-46b5397a-e988-4dd0-ac6a-3eea30c91468 tempest-VolumesActionsTest-1242513407 None] Flow 'volume_create_manager' (6eb7b855-ae82-447f-b7e6-1632ad9cfd43) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:15:29 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-46b5397a-e988-4dd0-ac6a-3eea30c91468 tempest-VolumesActionsTest-1242513407 None] Created volume successfully. Nov 04 10:15:30 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-917f4230-c726-4f1e-87ad-4e1dc8dc2490 tempest-VolumesActionsTest-1242513407 None] Acquiring lock "cinder-10a8a883-bd10-44bd-bfb1-bca0f4d59f4d" by "attach_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:15:30 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-917f4230-c726-4f1e-87ad-4e1dc8dc2490 tempest-VolumesActionsTest-1242513407 None] Lock "cinder-10a8a883-bd10-44bd-bfb1-bca0f4d59f4d" acquired by "attach_volume" :: waited 0.048s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:15:31 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b173eb5-543f-453e-ac5d-3dd22f2b1f0f tempest-GroupSnapshotsTest-1028111199 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:15:31 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7b173eb5-543f-453e-ac5d-3dd22f2b1f0f tempest-GroupSnapshotsTest-1028111199 None] Flow 'volume_create_manager' (38d6269c-7c7f-4430-a2d2-ddbb3a3de010) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:15:31 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7b173eb5-543f-453e-ac5d-3dd22f2b1f0f tempest-GroupSnapshotsTest-1028111199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23aa4e99-15f8-423d-980e-3460cfa82458) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:15:31 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7b173eb5-543f-453e-ac5d-3dd22f2b1f0f tempest-GroupSnapshotsTest-1028111199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23aa4e99-15f8-423d-980e-3460cfa82458) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:15:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1239625478',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9c52aa6d-4d38-4089-b6bf-0288ab6f105c,host='devstack@QuobyteHD#QuobyteHD',id=577a7a32-8d80-4510-8033-2ad959da0a3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b61be80679f440578895f93704afd709',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:15:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:15:31Z,use_quota=True,user_id='709c13bc9e734b63b1ccb2dfaf37dc3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d72d2f95-9a9a-4d71-ba9e-b22f4b9dc15e),volume_type_id=d72d2f95-9a9a-4d71-ba9e-b22f4b9dc15e)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:15:31 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7b173eb5-543f-453e-ac5d-3dd22f2b1f0f tempest-GroupSnapshotsTest-1028111199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e6dbd09-ba74-4025-90b7-e8587054431c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:15:31 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7b173eb5-543f-453e-ac5d-3dd22f2b1f0f tempest-GroupSnapshotsTest-1028111199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e6dbd09-ba74-4025-90b7-e8587054431c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:15:31 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7b173eb5-543f-453e-ac5d-3dd22f2b1f0f tempest-GroupSnapshotsTest-1028111199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70e4573f-77ae-45d2-b9ee-eec807094c72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:15:31 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7b173eb5-543f-453e-ac5d-3dd22f2b1f0f tempest-GroupSnapshotsTest-1028111199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70e4573f-77ae-45d2-b9ee-eec807094c72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '577a7a32-8d80-4510-8033-2ad959da0a3c', 'volume_name': 'volume-577a7a32-8d80-4510-8033-2ad959da0a3c', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:15:31 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7b173eb5-543f-453e-ac5d-3dd22f2b1f0f tempest-GroupSnapshotsTest-1028111199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f0f572c-5ba6-4b16-bef2-4667284b6c41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:15:31 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7b173eb5-543f-453e-ac5d-3dd22f2b1f0f tempest-GroupSnapshotsTest-1028111199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f0f572c-5ba6-4b16-bef2-4667284b6c41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:15:31 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7b173eb5-543f-453e-ac5d-3dd22f2b1f0f tempest-GroupSnapshotsTest-1028111199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cb1f0a5-e63e-4bad-872a-a34cdb0b7ff2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:15:31 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-7b173eb5-543f-453e-ac5d-3dd22f2b1f0f tempest-GroupSnapshotsTest-1028111199 None] Volume 577a7a32-8d80-4510-8033-2ad959da0a3c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-577a7a32-8d80-4510-8033-2ad959da0a3c', 'volume_size': 1} Nov 04 10:15:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-7b173eb5-543f-453e-ac5d-3dd22f2b1f0f tempest-GroupSnapshotsTest-1028111199 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:15:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-7b173eb5-543f-453e-ac5d-3dd22f2b1f0f tempest-GroupSnapshotsTest-1028111199 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:15:31 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-7b173eb5-543f-453e-ac5d-3dd22f2b1f0f tempest-GroupSnapshotsTest-1028111199 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=9c52aa6d-4d38-4089-b6bf-0288ab6f105c,created_at=2026-11-04T09:15:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1239625478',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9c52aa6d-4d38-4089-b6bf-0288ab6f105c,host='devstack@QuobyteHD#QuobyteHD',id=577a7a32-8d80-4510-8033-2ad959da0a3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b61be80679f440578895f93704afd709',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:15:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:15:31Z,use_quota=True,user_id='709c13bc9e734b63b1ccb2dfaf37dc3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d72d2f95-9a9a-4d71-ba9e-b22f4b9dc15e),volume_type_id=d72d2f95-9a9a-4d71-ba9e-b22f4b9dc15e)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 10:15:31 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-7b173eb5-543f-453e-ac5d-3dd22f2b1f0f tempest-GroupSnapshotsTest-1028111199 None] Creating volume 577a7a32-8d80-4510-8033-2ad959da0a3c {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:15:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-7b173eb5-543f-453e-ac5d-3dd22f2b1f0f tempest-GroupSnapshotsTest-1028111199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:15:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-7b173eb5-543f-453e-ac5d-3dd22f2b1f0f tempest-GroupSnapshotsTest-1028111199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:15:31 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-7b173eb5-543f-453e-ac5d-3dd22f2b1f0f tempest-GroupSnapshotsTest-1028111199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:15:31 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-7b173eb5-543f-453e-ac5d-3dd22f2b1f0f tempest-GroupSnapshotsTest-1028111199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:15:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-7b173eb5-543f-453e-ac5d-3dd22f2b1f0f tempest-GroupSnapshotsTest-1028111199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:15:31 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-7b173eb5-543f-453e-ac5d-3dd22f2b1f0f tempest-GroupSnapshotsTest-1028111199 None] Selected osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:15:31 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-7b173eb5-543f-453e-ac5d-3dd22f2b1f0f tempest-GroupSnapshotsTest-1028111199 None] casted to osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 Nov 04 10:15:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7b173eb5-543f-453e-ac5d-3dd22f2b1f0f tempest-GroupSnapshotsTest-1028111199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-577a7a32-8d80-4510-8033-2ad959da0a3c 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:15:32 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-917f4230-c726-4f1e-87ad-4e1dc8dc2490 tempest-VolumesActionsTest-1242513407 None] Attaching volume 10a8a883-bd10-44bd-bfb1-bca0f4d59f4d to instance 5a896446-a44e-4ce1-8dbc-018825d2c5e3 at mountpoint /dev/vdb on host None. Nov 04 10:15:32 devstack sudo[93557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-577a7a32-8d80-4510-8033-2ad959da0a3c 1073741824 Nov 04 10:15:32 devstack sudo[93557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:15:32 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-917f4230-c726-4f1e-87ad-4e1dc8dc2490 tempest-VolumesActionsTest-1242513407 None] Attach volume completed successfully. Nov 04 10:15:32 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-917f4230-c726-4f1e-87ad-4e1dc8dc2490 tempest-VolumesActionsTest-1242513407 None] Lock "cinder-10a8a883-bd10-44bd-bfb1-bca0f4d59f4d" released by "attach_volume" :: held 1.297s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:15:33 devstack sudo[93557]: pam_unix(sudo:session): session closed for user root Nov 04 10:15:33 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7b173eb5-543f-453e-ac5d-3dd22f2b1f0f tempest-GroupSnapshotsTest-1028111199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-577a7a32-8d80-4510-8033-2ad959da0a3c 1073741824" returned: 0 in 1.400s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:15:33 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7b173eb5-543f-453e-ac5d-3dd22f2b1f0f tempest-GroupSnapshotsTest-1028111199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-577a7a32-8d80-4510-8033-2ad959da0a3c {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:15:33 devstack sudo[93565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-577a7a32-8d80-4510-8033-2ad959da0a3c Nov 04 10:15:33 devstack sudo[93565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:15:34 devstack sudo[93565]: pam_unix(sudo:session): session closed for user root Nov 04 10:15:34 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7b173eb5-543f-453e-ac5d-3dd22f2b1f0f tempest-GroupSnapshotsTest-1028111199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-577a7a32-8d80-4510-8033-2ad959da0a3c" returned: 0 in 0.911s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:15:34 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-7b173eb5-543f-453e-ac5d-3dd22f2b1f0f tempest-GroupSnapshotsTest-1028111199 None] <== create_volume: return (2439ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 10:15:34 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-7b173eb5-543f-453e-ac5d-3dd22f2b1f0f tempest-GroupSnapshotsTest-1028111199 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.453s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:15:34 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7b173eb5-543f-453e-ac5d-3dd22f2b1f0f tempest-GroupSnapshotsTest-1028111199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cb1f0a5-e63e-4bad-872a-a34cdb0b7ff2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-577a7a32-8d80-4510-8033-2ad959da0a3c', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:15:34 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7b173eb5-543f-453e-ac5d-3dd22f2b1f0f tempest-GroupSnapshotsTest-1028111199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd09c98a-0b06-4a58-8209-cdec7428a59b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:15:34 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-7b173eb5-543f-453e-ac5d-3dd22f2b1f0f tempest-GroupSnapshotsTest-1028111199 None] Volume volume-577a7a32-8d80-4510-8033-2ad959da0a3c (577a7a32-8d80-4510-8033-2ad959da0a3c): created successfully Nov 04 10:15:34 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7b173eb5-543f-453e-ac5d-3dd22f2b1f0f tempest-GroupSnapshotsTest-1028111199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd09c98a-0b06-4a58-8209-cdec7428a59b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:15:34 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7b173eb5-543f-453e-ac5d-3dd22f2b1f0f tempest-GroupSnapshotsTest-1028111199 None] Flow 'volume_create_manager' (38d6269c-7c7f-4430-a2d2-ddbb3a3de010) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:15:34 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-1a876eef-34fb-4021-a884-7e278025c521 tempest-VolumesActionsTest-2097549633 None] Terminate volume connection completed successfully. Nov 04 10:15:34 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-7b173eb5-543f-453e-ac5d-3dd22f2b1f0f tempest-GroupSnapshotsTest-1028111199 None] Created volume successfully. Nov 04 10:15:34 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-1a876eef-34fb-4021-a884-7e278025c521 tempest-VolumesActionsTest-2097549633 None] Acquiring lock "cinder-10a8a883-bd10-44bd-bfb1-bca0f4d59f4d-detach_volume" by "detach_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:15:35 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-1a876eef-34fb-4021-a884-7e278025c521 tempest-VolumesActionsTest-2097549633 None] Lock "cinder-10a8a883-bd10-44bd-bfb1-bca0f4d59f4d-detach_volume" acquired by "detach_volume" :: waited 0.070s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:15:35 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-1a876eef-34fb-4021-a884-7e278025c521 tempest-VolumesActionsTest-2097549633 None] Detaching volume 10a8a883-bd10-44bd-bfb1-bca0f4d59f4d from instance 5a896446-a44e-4ce1-8dbc-018825d2c5e3. Nov 04 10:15:35 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-1a876eef-34fb-4021-a884-7e278025c521 tempest-VolumesActionsTest-2097549633 None] Detach volume completed successfully. Nov 04 10:15:35 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-1a876eef-34fb-4021-a884-7e278025c521 tempest-VolumesActionsTest-2097549633 None] Lock "cinder-10a8a883-bd10-44bd-bfb1-bca0f4d59f4d-detach_volume" released by "detach_volume" :: held 0.310s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:15:36 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-e029b927-12a1-4249-8ba9-f201c58c1952 tempest-VolumesActionsTest-1242513407 None] Acquiring lock "cinder-10a8a883-bd10-44bd-bfb1-bca0f4d59f4d-detach_volume" by "detach_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:15:36 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-e029b927-12a1-4249-8ba9-f201c58c1952 tempest-VolumesActionsTest-1242513407 None] Lock "cinder-10a8a883-bd10-44bd-bfb1-bca0f4d59f4d-detach_volume" acquired by "detach_volume" :: waited 0.063s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:15:36 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-e029b927-12a1-4249-8ba9-f201c58c1952 tempest-VolumesActionsTest-1242513407 None] Volume detach called, but volume not attached. Nov 04 10:15:36 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-e029b927-12a1-4249-8ba9-f201c58c1952 tempest-VolumesActionsTest-1242513407 None] Lock "cinder-10a8a883-bd10-44bd-bfb1-bca0f4d59f4d-detach_volume" released by "detach_volume" :: held 0.116s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:15:36 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-886ea874-cf87-4357-9205-6420d287ec68 tempest-GroupSnapshotsTest-1028111199 None] GroupSnapshot 814e3f8e-0608-4daf-81ad-2d31b5db7397: creating. Nov 04 10:15:37 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-886ea874-cf87-4357-9205-6420d287ec68 tempest-GroupSnapshotsTest-1028111199 None] Group snapshot 814e3f8e-0608-4daf-81ad-2d31b5db7397: creating. {{(pid=87068) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 04 10:15:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-886ea874-cf87-4357-9205-6420d287ec68 tempest-GroupSnapshotsTest-1028111199 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:15:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-886ea874-cf87-4357-9205-6420d287ec68 tempest-GroupSnapshotsTest-1028111199 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:15:37 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-886ea874-cf87-4357-9205-6420d287ec68 tempest-GroupSnapshotsTest-1028111199 None] Creating offline snapshot 13316be6-df88-4138-a614-3afe2afe8b1d of volume 577a7a32-8d80-4510-8033-2ad959da0a3c {{(pid=87068) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 10:15:37 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-961a5d0d-6ab8-479d-b80c-70244c4bc6b7 tempest-VolumesActionsTest-1242513407 None] Acquiring lock "cinder-10a8a883-bd10-44bd-bfb1-bca0f4d59f4d-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:15:37 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-961a5d0d-6ab8-479d-b80c-70244c4bc6b7 tempest-VolumesActionsTest-1242513407 None] Lock "cinder-10a8a883-bd10-44bd-bfb1-bca0f4d59f4d-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:15:37 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[de0532a8-f8d3-4ec8-957b-84caf8c62471]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:15:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-886ea874-cf87-4357-9205-6420d287ec68 tempest-GroupSnapshotsTest-1028111199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-577a7a32-8d80-4510-8033-2ad959da0a3c {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:15:37 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-961a5d0d-6ab8-479d-b80c-70244c4bc6b7 tempest-VolumesActionsTest-1242513407 None] Acquiring lock "cinder-quobyte-10a8a883-bd10-44bd-bfb1-bca0f4d59f4d" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:15:37 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-961a5d0d-6ab8-479d-b80c-70244c4bc6b7 tempest-VolumesActionsTest-1242513407 None] Lock "cinder-quobyte-10a8a883-bd10-44bd-bfb1-bca0f4d59f4d" acquired by "delete_volume" :: waited 0.063s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:15:37 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[341ed8f7-7b92-472e-b238-4fc54f3c5a98]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:15:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-961a5d0d-6ab8-479d-b80c-70244c4bc6b7 tempest-VolumesActionsTest-1242513407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-10a8a883-bd10-44bd-bfb1-bca0f4d59f4d {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:15:37 devstack sudo[93623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-577a7a32-8d80-4510-8033-2ad959da0a3c Nov 04 10:15:37 devstack sudo[93623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:15:38 devstack sudo[93625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-10a8a883-bd10-44bd-bfb1-bca0f4d59f4d Nov 04 10:15:38 devstack sudo[93625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:15:39 devstack sudo[93623]: pam_unix(sudo:session): session closed for user root Nov 04 10:15:39 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-886ea874-cf87-4357-9205-6420d287ec68 tempest-GroupSnapshotsTest-1028111199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-577a7a32-8d80-4510-8033-2ad959da0a3c" returned: 0 in 1.628s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:15:39 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-886ea874-cf87-4357-9205-6420d287ec68 tempest-GroupSnapshotsTest-1028111199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-577a7a32-8d80-4510-8033-2ad959da0a3c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-577a7a32-8d80-4510-8033-2ad959da0a3c.13316be6-df88-4138-a614-3afe2afe8b1d 1G {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:15:39 devstack sudo[93625]: pam_unix(sudo:session): session closed for user root Nov 04 10:15:39 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-961a5d0d-6ab8-479d-b80c-70244c4bc6b7 tempest-VolumesActionsTest-1242513407 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-10a8a883-bd10-44bd-bfb1-bca0f4d59f4d" returned: 0 in 1.300s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:15:39 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-961a5d0d-6ab8-479d-b80c-70244c4bc6b7 tempest-VolumesActionsTest-1242513407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-10a8a883-bd10-44bd-bfb1-bca0f4d59f4d {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:15:39 devstack sudo[93643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-577a7a32-8d80-4510-8033-2ad959da0a3c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-577a7a32-8d80-4510-8033-2ad959da0a3c.13316be6-df88-4138-a614-3afe2afe8b1d 1G Nov 04 10:15:39 devstack sudo[93643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:15:39 devstack sudo[93644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-10a8a883-bd10-44bd-bfb1-bca0f4d59f4d Nov 04 10:15:39 devstack sudo[93644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:15:40 devstack sudo[93644]: pam_unix(sudo:session): session closed for user root Nov 04 10:15:40 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-961a5d0d-6ab8-479d-b80c-70244c4bc6b7 tempest-VolumesActionsTest-1242513407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-10a8a883-bd10-44bd-bfb1-bca0f4d59f4d" returned: 0 in 1.042s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:15:40 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-961a5d0d-6ab8-479d-b80c-70244c4bc6b7 tempest-VolumesActionsTest-1242513407 None] Lock "cinder-quobyte-10a8a883-bd10-44bd-bfb1-bca0f4d59f4d" released by "delete_volume" :: held 2.510s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:15:40 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-961a5d0d-6ab8-479d-b80c-70244c4bc6b7 tempest-VolumesActionsTest-1242513407 None] Created reservations ['44705969-fdac-40fe-b969-d0c85a211e1b', '62298bd7-9807-4d62-9cc8-99c9332e13de', 'bc89af12-62a4-4f13-a5fd-34fa36c2b655', '21ae28b9-de4b-4f61-8c08-7029ce202bcb'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:15:40 devstack sudo[93643]: pam_unix(sudo:session): session closed for user root Nov 04 10:15:40 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-886ea874-cf87-4357-9205-6420d287ec68 tempest-GroupSnapshotsTest-1028111199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-577a7a32-8d80-4510-8033-2ad959da0a3c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-577a7a32-8d80-4510-8033-2ad959da0a3c.13316be6-df88-4138-a614-3afe2afe8b1d 1G" returned: 0 in 1.479s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:15:40 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-886ea874-cf87-4357-9205-6420d287ec68 tempest-GroupSnapshotsTest-1028111199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-577a7a32-8d80-4510-8033-2ad959da0a3c -F qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-577a7a32-8d80-4510-8033-2ad959da0a3c.13316be6-df88-4138-a614-3afe2afe8b1d {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:15:40 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-961a5d0d-6ab8-479d-b80c-70244c4bc6b7 tempest-VolumesActionsTest-1242513407 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:15:40 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-961a5d0d-6ab8-479d-b80c-70244c4bc6b7 tempest-VolumesActionsTest-1242513407 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:15:40 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-961a5d0d-6ab8-479d-b80c-70244c4bc6b7 tempest-VolumesActionsTest-1242513407 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:15:40 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-961a5d0d-6ab8-479d-b80c-70244c4bc6b7 tempest-VolumesActionsTest-1242513407 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:15:40 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-961a5d0d-6ab8-479d-b80c-70244c4bc6b7 tempest-VolumesActionsTest-1242513407 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:15:40 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-961a5d0d-6ab8-479d-b80c-70244c4bc6b7 tempest-VolumesActionsTest-1242513407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:15:40 devstack sudo[93652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-577a7a32-8d80-4510-8033-2ad959da0a3c -F qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-577a7a32-8d80-4510-8033-2ad959da0a3c.13316be6-df88-4138-a614-3afe2afe8b1d Nov 04 10:15:40 devstack sudo[93652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:15:40 devstack sudo[93663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:15:40 devstack sudo[93663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:15:41 devstack sudo[93663]: pam_unix(sudo:session): session closed for user root Nov 04 10:15:41 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-961a5d0d-6ab8-479d-b80c-70244c4bc6b7 tempest-VolumesActionsTest-1242513407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.731s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:15:41 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-961a5d0d-6ab8-479d-b80c-70244c4bc6b7 tempest-VolumesActionsTest-1242513407 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:15:41 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-961a5d0d-6ab8-479d-b80c-70244c4bc6b7 tempest-VolumesActionsTest-1242513407 None] Deleted volume successfully. Nov 04 10:15:41 devstack sudo[93652]: pam_unix(sudo:session): session closed for user root Nov 04 10:15:41 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-886ea874-cf87-4357-9205-6420d287ec68 tempest-GroupSnapshotsTest-1028111199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-577a7a32-8d80-4510-8033-2ad959da0a3c -F qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-577a7a32-8d80-4510-8033-2ad959da0a3c.13316be6-df88-4138-a614-3afe2afe8b1d" returned: 0 in 0.813s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:15:41 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-886ea874-cf87-4357-9205-6420d287ec68 tempest-GroupSnapshotsTest-1028111199 None] /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-577a7a32-8d80-4510-8033-2ad959da0a3c.13316be6-df88-4138-a614-3afe2afe8b1d is being set with open permissions: ugo+rw: NotImplementedError Nov 04 10:15:41 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-886ea874-cf87-4357-9205-6420d287ec68 tempest-GroupSnapshotsTest-1028111199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-577a7a32-8d80-4510-8033-2ad959da0a3c.13316be6-df88-4138-a614-3afe2afe8b1d {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:15:41 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-961a5d0d-6ab8-479d-b80c-70244c4bc6b7 tempest-VolumesActionsTest-1242513407 None] Lock "cinder-10a8a883-bd10-44bd-bfb1-bca0f4d59f4d-delete_volume" released by "delete_volume" :: held 4.015s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:15:41 devstack sudo[93717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-577a7a32-8d80-4510-8033-2ad959da0a3c.13316be6-df88-4138-a614-3afe2afe8b1d Nov 04 10:15:41 devstack sudo[93717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:15:41 devstack sudo[93717]: pam_unix(sudo:session): session closed for user root Nov 04 10:15:41 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-886ea874-cf87-4357-9205-6420d287ec68 tempest-GroupSnapshotsTest-1028111199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-577a7a32-8d80-4510-8033-2ad959da0a3c.13316be6-df88-4138-a614-3afe2afe8b1d" returned: 0 in 0.600s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:15:42 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-886ea874-cf87-4357-9205-6420d287ec68 tempest-GroupSnapshotsTest-1028111199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-577a7a32-8d80-4510-8033-2ad959da0a3c.info {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:15:42 devstack sudo[93727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-577a7a32-8d80-4510-8033-2ad959da0a3c.info Nov 04 10:15:42 devstack sudo[93727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:15:42 devstack sudo[93727]: pam_unix(sudo:session): session closed for user root Nov 04 10:15:42 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-886ea874-cf87-4357-9205-6420d287ec68 tempest-GroupSnapshotsTest-1028111199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-577a7a32-8d80-4510-8033-2ad959da0a3c.info" returned: 0 in 0.940s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:15:42 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-886ea874-cf87-4357-9205-6420d287ec68 tempest-GroupSnapshotsTest-1028111199 None] /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-577a7a32-8d80-4510-8033-2ad959da0a3c.info is being set with open permissions: ugo+rw: NotImplementedError Nov 04 10:15:42 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-886ea874-cf87-4357-9205-6420d287ec68 tempest-GroupSnapshotsTest-1028111199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-577a7a32-8d80-4510-8033-2ad959da0a3c.info {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:15:43 devstack sudo[93746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-577a7a32-8d80-4510-8033-2ad959da0a3c.info Nov 04 10:15:43 devstack sudo[93746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:15:43 devstack sudo[93746]: pam_unix(sudo:session): session closed for user root Nov 04 10:15:43 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-886ea874-cf87-4357-9205-6420d287ec68 tempest-GroupSnapshotsTest-1028111199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-577a7a32-8d80-4510-8033-2ad959da0a3c.info" returned: 0 in 0.725s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:15:43 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-886ea874-cf87-4357-9205-6420d287ec68 tempest-GroupSnapshotsTest-1028111199 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.523s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:15:44 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-886ea874-cf87-4357-9205-6420d287ec68 tempest-GroupSnapshotsTest-1028111199 None] group_snapshot 814e3f8e-0608-4daf-81ad-2d31b5db7397: created successfully Nov 04 10:15:46 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-8de83612-e5cf-488b-81d3-6f14bb8e8d18 tempest-GroupSnapshotsTest-1028111199 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:15:46 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-8de83612-e5cf-488b-81d3-6f14bb8e8d18 tempest-GroupSnapshotsTest-1028111199 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:15:46 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-8de83612-e5cf-488b-81d3-6f14bb8e8d18 tempest-GroupSnapshotsTest-1028111199 None] Acquiring lock "cinder-quobyte-13316be6-df88-4138-a614-3afe2afe8b1d-cfad8868-fbf3-4522-8560-087c4a797ca9" by "_create_volume_from_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:15:46 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-8de83612-e5cf-488b-81d3-6f14bb8e8d18 tempest-GroupSnapshotsTest-1028111199 None] Lock "cinder-quobyte-13316be6-df88-4138-a614-3afe2afe8b1d-cfad8868-fbf3-4522-8560-087c4a797ca9" acquired by "_create_volume_from_snapshot" :: waited 0.035s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:15:46 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-8de83612-e5cf-488b-81d3-6f14bb8e8d18 tempest-GroupSnapshotsTest-1028111199 None] Creating volume cfad8868-fbf3-4522-8560-087c4a797ca9 from snapshot 13316be6-df88-4138-a614-3afe2afe8b1d {{(pid=87068) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 04 10:15:46 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-8de83612-e5cf-488b-81d3-6f14bb8e8d18 tempest-GroupSnapshotsTest-1028111199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:15:46 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-8de83612-e5cf-488b-81d3-6f14bb8e8d18 tempest-GroupSnapshotsTest-1028111199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:15:46 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-8de83612-e5cf-488b-81d3-6f14bb8e8d18 tempest-GroupSnapshotsTest-1028111199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:15:46 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-8de83612-e5cf-488b-81d3-6f14bb8e8d18 tempest-GroupSnapshotsTest-1028111199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:15:46 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-8de83612-e5cf-488b-81d3-6f14bb8e8d18 tempest-GroupSnapshotsTest-1028111199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:15:46 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-8de83612-e5cf-488b-81d3-6f14bb8e8d18 tempest-GroupSnapshotsTest-1028111199 None] Selected osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:15:46 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-8de83612-e5cf-488b-81d3-6f14bb8e8d18 tempest-GroupSnapshotsTest-1028111199 None] Acquiring lock "cinder-quobyte-cfad8868-fbf3-4522-8560-087c4a797ca9" by "_copy_volume_from_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:15:46 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-8de83612-e5cf-488b-81d3-6f14bb8e8d18 tempest-GroupSnapshotsTest-1028111199 None] Lock "cinder-quobyte-cfad8868-fbf3-4522-8560-087c4a797ca9" acquired by "_copy_volume_from_snapshot" :: waited 0.037s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:15:46 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-8de83612-e5cf-488b-81d3-6f14bb8e8d18 tempest-GroupSnapshotsTest-1028111199 None] snapshot: 13316be6-df88-4138-a614-3afe2afe8b1d, volume: cfad8868-fbf3-4522-8560-087c4a797ca9, {{(pid=87068) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 04 10:15:46 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-8de83612-e5cf-488b-81d3-6f14bb8e8d18 tempest-GroupSnapshotsTest-1028111199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:15:46 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-8de83612-e5cf-488b-81d3-6f14bb8e8d18 tempest-GroupSnapshotsTest-1028111199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:15:46 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-8de83612-e5cf-488b-81d3-6f14bb8e8d18 tempest-GroupSnapshotsTest-1028111199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:15:46 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-8de83612-e5cf-488b-81d3-6f14bb8e8d18 tempest-GroupSnapshotsTest-1028111199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:15:46 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-8de83612-e5cf-488b-81d3-6f14bb8e8d18 tempest-GroupSnapshotsTest-1028111199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:15:46 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[faa9f599-b3ec-466d-bc62-07d604ebdff1]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:15:46 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-8de83612-e5cf-488b-81d3-6f14bb8e8d18 tempest-GroupSnapshotsTest-1028111199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-577a7a32-8d80-4510-8033-2ad959da0a3c.13316be6-df88-4138-a614-3afe2afe8b1d {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:15:46 devstack sudo[93758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-577a7a32-8d80-4510-8033-2ad959da0a3c.13316be6-df88-4138-a614-3afe2afe8b1d Nov 04 10:15:46 devstack sudo[93758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:15:47 devstack sudo[93758]: pam_unix(sudo:session): session closed for user root Nov 04 10:15:47 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-8de83612-e5cf-488b-81d3-6f14bb8e8d18 tempest-GroupSnapshotsTest-1028111199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-577a7a32-8d80-4510-8033-2ad959da0a3c.13316be6-df88-4138-a614-3afe2afe8b1d" returned: 0 in 0.650s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:15:47 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-8de83612-e5cf-488b-81d3-6f14bb8e8d18 tempest-GroupSnapshotsTest-1028111199 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-577a7a32-8d80-4510-8033-2ad959da0a3c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87068) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 10:15:47 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[fafa91a5-ac35-4149-aa35-40dbfcf86ded]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:15:47 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-8de83612-e5cf-488b-81d3-6f14bb8e8d18 tempest-GroupSnapshotsTest-1028111199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-577a7a32-8d80-4510-8033-2ad959da0a3c {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:15:47 devstack sudo[93782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-577a7a32-8d80-4510-8033-2ad959da0a3c Nov 04 10:15:47 devstack sudo[93782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:15:47 devstack cinder-volume[87068]: INFO cinder.volume.manager [req-9721862d-72e1-45c2-a928-6eba73b94b92 req-9abe1f27-166e-4a0c-b011-ac4a2f878654 tempest-ServerActionsTestOtherA-1872812514 None] Terminate volume connection completed successfully. Nov 04 10:15:47 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [req-9721862d-72e1-45c2-a928-6eba73b94b92 req-9abe1f27-166e-4a0c-b011-ac4a2f878654 tempest-ServerActionsTestOtherA-1872812514 None] Deleting attachment c343d58b-fd0e-419e-b2dc-0ec92360818f. {{(pid=87068) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 04 10:15:48 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-3298f1a4-ae75-4995-92cd-09162a26d955 tempest-VolumesActionsTest-1242513407 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:15:48 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-3298f1a4-ae75-4995-92cd-09162a26d955 tempest-VolumesActionsTest-1242513407 None] Flow 'volume_create_manager' (8c3e397b-40ba-4054-a030-f7e35e8698de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:15:48 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-3298f1a4-ae75-4995-92cd-09162a26d955 tempest-VolumesActionsTest-1242513407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (536034cd-52ac-48bc-bc70-fa1a2628f22b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:15:48 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-3298f1a4-ae75-4995-92cd-09162a26d955 tempest-VolumesActionsTest-1242513407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (536034cd-52ac-48bc-bc70-fa1a2628f22b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:15:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1515558627',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa8883dc-af23-474d-b6fb-835c05630d4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef09188d1b1d4638b581343b902055a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:15:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:15:48Z,use_quota=True,user_id='fcefba7c587147fa837e6a42a2fc173d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:15:48 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-3298f1a4-ae75-4995-92cd-09162a26d955 tempest-VolumesActionsTest-1242513407 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76d83291-c6ac-46eb-9ec8-0457e1df070f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:15:48 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-3298f1a4-ae75-4995-92cd-09162a26d955 tempest-VolumesActionsTest-1242513407 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76d83291-c6ac-46eb-9ec8-0457e1df070f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:15:48 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-3298f1a4-ae75-4995-92cd-09162a26d955 tempest-VolumesActionsTest-1242513407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d42adb3a-0f8b-4930-87c2-e4d0e4ea7dc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:15:48 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-3298f1a4-ae75-4995-92cd-09162a26d955 tempest-VolumesActionsTest-1242513407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d42adb3a-0f8b-4930-87c2-e4d0e4ea7dc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa8883dc-af23-474d-b6fb-835c05630d4e', 'volume_name': 'volume-fa8883dc-af23-474d-b6fb-835c05630d4e', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:15:48 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-3298f1a4-ae75-4995-92cd-09162a26d955 tempest-VolumesActionsTest-1242513407 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a3cf862-16b8-4e80-bf38-e4adc584b41c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:15:48 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-3298f1a4-ae75-4995-92cd-09162a26d955 tempest-VolumesActionsTest-1242513407 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a3cf862-16b8-4e80-bf38-e4adc584b41c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:15:48 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-3298f1a4-ae75-4995-92cd-09162a26d955 tempest-VolumesActionsTest-1242513407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a82698af-ad57-4e19-b7e5-a67279dcf366) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:15:48 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-3298f1a4-ae75-4995-92cd-09162a26d955 tempest-VolumesActionsTest-1242513407 None] Volume fa8883dc-af23-474d-b6fb-835c05630d4e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa8883dc-af23-474d-b6fb-835c05630d4e', 'volume_size': 1} Nov 04 10:15:48 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-3298f1a4-ae75-4995-92cd-09162a26d955 tempest-VolumesActionsTest-1242513407 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:15:48 devstack sudo[93782]: pam_unix(sudo:session): session closed for user root Nov 04 10:15:48 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-8de83612-e5cf-488b-81d3-6f14bb8e8d18 tempest-GroupSnapshotsTest-1028111199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-577a7a32-8d80-4510-8033-2ad959da0a3c" returned: 0 in 0.940s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:15:48 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-8de83612-e5cf-488b-81d3-6f14bb8e8d18 tempest-GroupSnapshotsTest-1028111199 None] will copy from snapshot at /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-577a7a32-8d80-4510-8033-2ad959da0a3c {{(pid=87068) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 04 10:15:48 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-8de83612-e5cf-488b-81d3-6f14bb8e8d18 tempest-GroupSnapshotsTest-1028111199 None] Creating direct copy from snapshot {{(pid=87068) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 04 10:15:48 devstack cinder-volume[87068]: DEBUG cinder.utils [None req-8de83612-e5cf-488b-81d3-6f14bb8e8d18 tempest-GroupSnapshotsTest-1028111199 None] Path /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-cfad8868-fbf3-4522-8560-087c4a797ca9 not found in is_blk_device check {{(pid=87068) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 04 10:15:48 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-8de83612-e5cf-488b-81d3-6f14bb8e8d18 tempest-GroupSnapshotsTest-1028111199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-577a7a32-8d80-4510-8033-2ad959da0a3c /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-cfad8868-fbf3-4522-8560-087c4a797ca9 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:15:48 devstack sudo[93791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-577a7a32-8d80-4510-8033-2ad959da0a3c /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-cfad8868-fbf3-4522-8560-087c4a797ca9 Nov 04 10:15:48 devstack sudo[93791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:15:50 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [req-9721862d-72e1-45c2-a928-6eba73b94b92 req-e8aa6491-afb3-4856-bfc0-707ca03d2dea tempest-ServerActionsTestOtherA-1872812514 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:15:53 devstack cinder-volume[87068]: DEBUG oslo_service.periodic_task [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87068) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 10:15:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:15:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:15:53 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:15:53 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:15:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:15:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:15:53 devstack sudo[93835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:15:53 devstack sudo[93835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:15:54 devstack sudo[93835]: pam_unix(sudo:session): session closed for user root Nov 04 10:15:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.566s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:15:54 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:15:54 devstack cinder-volume[87068]: DEBUG oslo_service.periodic_task [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Running periodic task VolumeManager._thread_info {{(pid=87068) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 10:15:54 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] thread count: 28 {{(pid=87068) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 04 10:15:54 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] thread info: [<_MainThread(MainThread, started 126275656192128)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87068) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 04 10:15:55 devstack sudo[93791]: pam_unix(sudo:session): session closed for user root Nov 04 10:15:55 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-8de83612-e5cf-488b-81d3-6f14bb8e8d18 tempest-GroupSnapshotsTest-1028111199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-577a7a32-8d80-4510-8033-2ad959da0a3c /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-cfad8868-fbf3-4522-8560-087c4a797ca9" returned: 0 in 7.204s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:15:55 devstack cinder-volume[87068]: DEBUG cinder.image.image_utils [None req-8de83612-e5cf-488b-81d3-6f14bb8e8d18 tempest-GroupSnapshotsTest-1028111199 None] Image conversion details: src /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-577a7a32-8d80-4510-8033-2ad959da0a3c, size 1024.00 MB, duration 7.20 sec, destination /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-cfad8868-fbf3-4522-8560-087c4a797ca9 {{(pid=87068) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 04 10:15:55 devstack cinder-volume[87068]: INFO cinder.image.image_utils [None req-8de83612-e5cf-488b-81d3-6f14bb8e8d18 tempest-GroupSnapshotsTest-1028111199 None] Converted 1024.00 MB image at 142.13 MB/s Nov 04 10:15:55 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-8de83612-e5cf-488b-81d3-6f14bb8e8d18 tempest-GroupSnapshotsTest-1028111199 None] /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-cfad8868-fbf3-4522-8560-087c4a797ca9 is being set with open permissions: ugo+rw: NotImplementedError Nov 04 10:15:55 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-8de83612-e5cf-488b-81d3-6f14bb8e8d18 tempest-GroupSnapshotsTest-1028111199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-cfad8868-fbf3-4522-8560-087c4a797ca9 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:15:55 devstack sudo[93838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-cfad8868-fbf3-4522-8560-087c4a797ca9 Nov 04 10:15:55 devstack sudo[93838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:15:55 devstack sudo[93838]: pam_unix(sudo:session): session closed for user root Nov 04 10:15:55 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-8de83612-e5cf-488b-81d3-6f14bb8e8d18 tempest-GroupSnapshotsTest-1028111199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-cfad8868-fbf3-4522-8560-087c4a797ca9" returned: 0 in 0.264s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:15:55 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-8de83612-e5cf-488b-81d3-6f14bb8e8d18 tempest-GroupSnapshotsTest-1028111199 None] Lock "cinder-quobyte-cfad8868-fbf3-4522-8560-087c4a797ca9" released by "_copy_volume_from_snapshot" :: held 9.250s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:15:55 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-8de83612-e5cf-488b-81d3-6f14bb8e8d18 tempest-GroupSnapshotsTest-1028111199 None] Lock "cinder-quobyte-13316be6-df88-4138-a614-3afe2afe8b1d-cfad8868-fbf3-4522-8560-087c4a797ca9" released by "_create_volume_from_snapshot" :: held 9.384s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:15:55 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-8de83612-e5cf-488b-81d3-6f14bb8e8d18 tempest-GroupSnapshotsTest-1028111199 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.421s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:15:55 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-3298f1a4-ae75-4995-92cd-09162a26d955 tempest-VolumesActionsTest-1242513407 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.582s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:15:55 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-3298f1a4-ae75-4995-92cd-09162a26d955 tempest-VolumesActionsTest-1242513407 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:15:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1515558627',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa8883dc-af23-474d-b6fb-835c05630d4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef09188d1b1d4638b581343b902055a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:15:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:15:48Z,use_quota=True,user_id='fcefba7c587147fa837e6a42a2fc173d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 10:15:55 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-3298f1a4-ae75-4995-92cd-09162a26d955 tempest-VolumesActionsTest-1242513407 None] Creating volume fa8883dc-af23-474d-b6fb-835c05630d4e {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:15:55 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-3298f1a4-ae75-4995-92cd-09162a26d955 tempest-VolumesActionsTest-1242513407 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:15:55 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-3298f1a4-ae75-4995-92cd-09162a26d955 tempest-VolumesActionsTest-1242513407 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:15:55 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-3298f1a4-ae75-4995-92cd-09162a26d955 tempest-VolumesActionsTest-1242513407 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:15:55 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-3298f1a4-ae75-4995-92cd-09162a26d955 tempest-VolumesActionsTest-1242513407 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:15:55 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-3298f1a4-ae75-4995-92cd-09162a26d955 tempest-VolumesActionsTest-1242513407 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:15:55 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-3298f1a4-ae75-4995-92cd-09162a26d955 tempest-VolumesActionsTest-1242513407 None] Selected osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:15:55 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-3298f1a4-ae75-4995-92cd-09162a26d955 tempest-VolumesActionsTest-1242513407 None] casted to osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 Nov 04 10:15:55 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-3298f1a4-ae75-4995-92cd-09162a26d955 tempest-VolumesActionsTest-1242513407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-fa8883dc-af23-474d-b6fb-835c05630d4e 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:15:55 devstack sudo[93841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-fa8883dc-af23-474d-b6fb-835c05630d4e 1073741824 Nov 04 10:15:55 devstack sudo[93841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:15:56 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-8de83612-e5cf-488b-81d3-6f14bb8e8d18 tempest-GroupSnapshotsTest-1028111199 None] Create group from source-snapshot-814e3f8e-0608-4daf-81ad-2d31b5db7397 completed successfully. Nov 04 10:15:56 devstack sudo[93841]: pam_unix(sudo:session): session closed for user root Nov 04 10:15:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-3298f1a4-ae75-4995-92cd-09162a26d955 tempest-VolumesActionsTest-1242513407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-fa8883dc-af23-474d-b6fb-835c05630d4e 1073741824" returned: 0 in 0.410s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:15:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-3298f1a4-ae75-4995-92cd-09162a26d955 tempest-VolumesActionsTest-1242513407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-fa8883dc-af23-474d-b6fb-835c05630d4e {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:15:56 devstack sudo[93847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-fa8883dc-af23-474d-b6fb-835c05630d4e Nov 04 10:15:56 devstack sudo[93847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:15:56 devstack sudo[93847]: pam_unix(sudo:session): session closed for user root Nov 04 10:15:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-3298f1a4-ae75-4995-92cd-09162a26d955 tempest-VolumesActionsTest-1242513407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-fa8883dc-af23-474d-b6fb-835c05630d4e" returned: 0 in 0.259s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:15:56 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-3298f1a4-ae75-4995-92cd-09162a26d955 tempest-VolumesActionsTest-1242513407 None] <== create_volume: return (706ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 10:15:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-3298f1a4-ae75-4995-92cd-09162a26d955 tempest-VolumesActionsTest-1242513407 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.710s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:15:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [req-9721862d-72e1-45c2-a928-6eba73b94b92 req-e8aa6491-afb3-4856-bfc0-707ca03d2dea tempest-ServerActionsTestOtherA-1872812514 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 6.016s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:15:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [req-9721862d-72e1-45c2-a928-6eba73b94b92 req-e8aa6491-afb3-4856-bfc0-707ca03d2dea tempest-ServerActionsTestOtherA-1872812514 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:15:56 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-3298f1a4-ae75-4995-92cd-09162a26d955 tempest-VolumesActionsTest-1242513407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a82698af-ad57-4e19-b7e5-a67279dcf366) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa8883dc-af23-474d-b6fb-835c05630d4e', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:15:56 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-3298f1a4-ae75-4995-92cd-09162a26d955 tempest-VolumesActionsTest-1242513407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e351fd76-1743-47a4-95dd-c9116a2cb6fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:15:56 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-3298f1a4-ae75-4995-92cd-09162a26d955 tempest-VolumesActionsTest-1242513407 None] Volume volume-fa8883dc-af23-474d-b6fb-835c05630d4e (fa8883dc-af23-474d-b6fb-835c05630d4e): created successfully Nov 04 10:15:56 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-3298f1a4-ae75-4995-92cd-09162a26d955 tempest-VolumesActionsTest-1242513407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e351fd76-1743-47a4-95dd-c9116a2cb6fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:15:56 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-3298f1a4-ae75-4995-92cd-09162a26d955 tempest-VolumesActionsTest-1242513407 None] Flow 'volume_create_manager' (8c3e397b-40ba-4054-a030-f7e35e8698de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:15:56 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-3298f1a4-ae75-4995-92cd-09162a26d955 tempest-VolumesActionsTest-1242513407 None] Created volume successfully. Nov 04 10:15:56 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [req-9721862d-72e1-45c2-a928-6eba73b94b92 req-e8aa6491-afb3-4856-bfc0-707ca03d2dea tempest-ServerActionsTestOtherA-1872812514 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034', 'name': 'volume-097433cf-7f53-4f25-8070-c2ac554c6695', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e34a013a-3927-4ccc-8f6b-6efe1a8da135', 'enforce_multipath': True} {{(pid=87068) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 04 10:15:56 devstack cinder-volume[87068]: INFO cinder.volume.manager [req-9721862d-72e1-45c2-a928-6eba73b94b92 req-e8aa6491-afb3-4856-bfc0-707ca03d2dea tempest-ServerActionsTestOtherA-1872812514 None] attachment_update completed successfully. Nov 04 10:15:57 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-a95d9417-ca7f-4e2e-b908-74c2bf404a02 tempest-VolumesActionsTest-2097549633 None] Acquiring lock "cinder-fa8883dc-af23-474d-b6fb-835c05630d4e-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:15:57 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-a95d9417-ca7f-4e2e-b908-74c2bf404a02 tempest-VolumesActionsTest-2097549633 None] Lock "cinder-fa8883dc-af23-474d-b6fb-835c05630d4e-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:15:57 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-a95d9417-ca7f-4e2e-b908-74c2bf404a02 tempest-VolumesActionsTest-2097549633 None] Acquiring lock "cinder-quobyte-fa8883dc-af23-474d-b6fb-835c05630d4e" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:15:57 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-a95d9417-ca7f-4e2e-b908-74c2bf404a02 tempest-VolumesActionsTest-2097549633 None] Lock "cinder-quobyte-fa8883dc-af23-474d-b6fb-835c05630d4e" acquired by "delete_volume" :: waited 0.024s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:15:57 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7eb5f56-b2e4-4c07-8f71-73fe343ac9e5]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:15:57 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-a95d9417-ca7f-4e2e-b908-74c2bf404a02 tempest-VolumesActionsTest-2097549633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-fa8883dc-af23-474d-b6fb-835c05630d4e {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:15:57 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-4e051081-4908-4fea-8109-45d662906edc tempest-GroupSnapshotsTest-1028111199 None] Acquiring lock "cinder-quobyte-cfad8868-fbf3-4522-8560-087c4a797ca9" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:15:57 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-4e051081-4908-4fea-8109-45d662906edc tempest-GroupSnapshotsTest-1028111199 None] Lock "cinder-quobyte-cfad8868-fbf3-4522-8560-087c4a797ca9" acquired by "delete_volume" :: waited 0.018s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:15:57 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[34b00edb-2820-4f39-a78b-8d7b01338298]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:15:57 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-4e051081-4908-4fea-8109-45d662906edc tempest-GroupSnapshotsTest-1028111199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-cfad8868-fbf3-4522-8560-087c4a797ca9 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:15:57 devstack sudo[93925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-fa8883dc-af23-474d-b6fb-835c05630d4e Nov 04 10:15:57 devstack sudo[93925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:15:57 devstack sudo[93952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-cfad8868-fbf3-4522-8560-087c4a797ca9 Nov 04 10:15:57 devstack sudo[93952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:15:58 devstack sudo[93925]: pam_unix(sudo:session): session closed for user root Nov 04 10:15:58 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-a95d9417-ca7f-4e2e-b908-74c2bf404a02 tempest-VolumesActionsTest-2097549633 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-fa8883dc-af23-474d-b6fb-835c05630d4e" returned: 0 in 0.822s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:15:58 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-a95d9417-ca7f-4e2e-b908-74c2bf404a02 tempest-VolumesActionsTest-2097549633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-fa8883dc-af23-474d-b6fb-835c05630d4e {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:15:58 devstack sudo[94292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-fa8883dc-af23-474d-b6fb-835c05630d4e Nov 04 10:15:58 devstack sudo[94292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:15:58 devstack sudo[93952]: pam_unix(sudo:session): session closed for user root Nov 04 10:15:58 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-4e051081-4908-4fea-8109-45d662906edc tempest-GroupSnapshotsTest-1028111199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-cfad8868-fbf3-4522-8560-087c4a797ca9" returned: 0 in 0.900s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:15:58 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-4e051081-4908-4fea-8109-45d662906edc tempest-GroupSnapshotsTest-1028111199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-cfad8868-fbf3-4522-8560-087c4a797ca9 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:15:58 devstack sudo[94303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-cfad8868-fbf3-4522-8560-087c4a797ca9 Nov 04 10:15:58 devstack sudo[94303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:15:59 devstack sudo[94303]: pam_unix(sudo:session): session closed for user root Nov 04 10:15:59 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-4e051081-4908-4fea-8109-45d662906edc tempest-GroupSnapshotsTest-1028111199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-cfad8868-fbf3-4522-8560-087c4a797ca9" returned: 0 in 0.352s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:15:59 devstack sudo[94292]: pam_unix(sudo:session): session closed for user root Nov 04 10:15:59 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-4e051081-4908-4fea-8109-45d662906edc tempest-GroupSnapshotsTest-1028111199 None] Lock "cinder-quobyte-cfad8868-fbf3-4522-8560-087c4a797ca9" released by "delete_volume" :: held 1.348s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:15:59 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-a95d9417-ca7f-4e2e-b908-74c2bf404a02 tempest-VolumesActionsTest-2097549633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-fa8883dc-af23-474d-b6fb-835c05630d4e" returned: 0 in 0.647s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:15:59 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-a95d9417-ca7f-4e2e-b908-74c2bf404a02 tempest-VolumesActionsTest-2097549633 None] Lock "cinder-quobyte-fa8883dc-af23-474d-b6fb-835c05630d4e" released by "delete_volume" :: held 1.555s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:15:59 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-a95d9417-ca7f-4e2e-b908-74c2bf404a02 tempest-VolumesActionsTest-2097549633 None] Created reservations ['05e1aba3-dba7-451d-8e11-effb86a715dc', '7e687f3f-044a-46f0-9ae3-670c78ad9882', '101e14d9-23e0-42ba-9694-8f7e74766fe6', '0030d79b-acfa-4472-a6f4-5a956dbadad1'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:15:59 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-4e051081-4908-4fea-8109-45d662906edc tempest-GroupSnapshotsTest-1028111199 None] Created reservations ['4725496b-6f2d-49db-92ef-78704b77b112'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:15:59 devstack cinder-volume[87068]: WARNING cinder.quota [None req-4e051081-4908-4fea-8109-45d662906edc tempest-GroupSnapshotsTest-1028111199 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-540268563 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-540268563, it is now deprecated. Please use the default quota class for default quota. Nov 04 10:15:59 devstack cinder-volume[87068]: WARNING cinder.quota [None req-4e051081-4908-4fea-8109-45d662906edc tempest-GroupSnapshotsTest-1028111199 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-540268563 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-540268563, it is now deprecated. Please use the default quota class for default quota. Nov 04 10:15:59 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-a95d9417-ca7f-4e2e-b908-74c2bf404a02 tempest-VolumesActionsTest-2097549633 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:15:59 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-a95d9417-ca7f-4e2e-b908-74c2bf404a02 tempest-VolumesActionsTest-2097549633 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:15:59 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-a95d9417-ca7f-4e2e-b908-74c2bf404a02 tempest-VolumesActionsTest-2097549633 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:15:59 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-a95d9417-ca7f-4e2e-b908-74c2bf404a02 tempest-VolumesActionsTest-2097549633 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:15:59 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-a95d9417-ca7f-4e2e-b908-74c2bf404a02 tempest-VolumesActionsTest-2097549633 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:15:59 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-a95d9417-ca7f-4e2e-b908-74c2bf404a02 tempest-VolumesActionsTest-2097549633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:15:59 devstack sudo[94318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:15:59 devstack sudo[94318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:15:59 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-4e051081-4908-4fea-8109-45d662906edc tempest-GroupSnapshotsTest-1028111199 None] Created reservations ['38675423-4b03-4e40-b4e6-c5bc44634cfd', 'a35aa37b-d01d-42ef-95dd-d0931c76ab4a', '6aa0d2d5-4db0-415a-a0b0-5263e74bdb6d', 'f5815462-4388-42d1-97c1-a133f65d60af'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:15:59 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-4e051081-4908-4fea-8109-45d662906edc tempest-GroupSnapshotsTest-1028111199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:15:59 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-4e051081-4908-4fea-8109-45d662906edc tempest-GroupSnapshotsTest-1028111199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:15:59 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-4e051081-4908-4fea-8109-45d662906edc tempest-GroupSnapshotsTest-1028111199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:15:59 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-4e051081-4908-4fea-8109-45d662906edc tempest-GroupSnapshotsTest-1028111199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:15:59 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-4e051081-4908-4fea-8109-45d662906edc tempest-GroupSnapshotsTest-1028111199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:15:59 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-4e051081-4908-4fea-8109-45d662906edc tempest-GroupSnapshotsTest-1028111199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:15:59 devstack sudo[94320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:15:59 devstack sudo[94320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:15:59 devstack sudo[94318]: pam_unix(sudo:session): session closed for user root Nov 04 10:15:59 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-a95d9417-ca7f-4e2e-b908-74c2bf404a02 tempest-VolumesActionsTest-2097549633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.294s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:15:59 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-a95d9417-ca7f-4e2e-b908-74c2bf404a02 tempest-VolumesActionsTest-2097549633 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:15:59 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-a95d9417-ca7f-4e2e-b908-74c2bf404a02 tempest-VolumesActionsTest-2097549633 None] Deleted volume successfully. Nov 04 10:15:59 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-a95d9417-ca7f-4e2e-b908-74c2bf404a02 tempest-VolumesActionsTest-2097549633 None] Lock "cinder-fa8883dc-af23-474d-b6fb-835c05630d4e-delete_volume" released by "delete_volume" :: held 2.220s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:15:59 devstack sudo[94320]: pam_unix(sudo:session): session closed for user root Nov 04 10:15:59 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-4e051081-4908-4fea-8109-45d662906edc tempest-GroupSnapshotsTest-1028111199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.289s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:15:59 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-4e051081-4908-4fea-8109-45d662906edc tempest-GroupSnapshotsTest-1028111199 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:15:59 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-4e051081-4908-4fea-8109-45d662906edc tempest-GroupSnapshotsTest-1028111199 None] Delete group completed successfully. Nov 04 10:16:00 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-842fab7a-5c60-48a7-8634-c64654d71ce3 tempest-GroupSnapshotsTest-1028111199 None] group_snapshot 814e3f8e-0608-4daf-81ad-2d31b5db7397: deleting Nov 04 10:16:00 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-aaca2224-e2c7-465d-badc-27b44d9d5927 tempest-VolumesActionsTest-1242513407 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:16:00 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-aaca2224-e2c7-465d-badc-27b44d9d5927 tempest-VolumesActionsTest-1242513407 None] Flow 'volume_create_manager' (6411c2c3-32a5-43c0-b406-5cbfb5a18402) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:16:00 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-aaca2224-e2c7-465d-badc-27b44d9d5927 tempest-VolumesActionsTest-1242513407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b12fa3cd-3f55-4887-9db2-c72c96eb33ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:16:00 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-842fab7a-5c60-48a7-8634-c64654d71ce3 tempest-GroupSnapshotsTest-1028111199 None] group_snapshot 814e3f8e-0608-4daf-81ad-2d31b5db7397: deleting {{(pid=87068) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 04 10:16:00 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-aaca2224-e2c7-465d-badc-27b44d9d5927 tempest-VolumesActionsTest-1242513407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b12fa3cd-3f55-4887-9db2-c72c96eb33ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:16:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1415385599',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6f2b437-74fb-4752-a0ea-c417a6ed357b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef09188d1b1d4638b581343b902055a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:16:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:16:01Z,use_quota=True,user_id='fcefba7c587147fa837e6a42a2fc173d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:16:00 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-aaca2224-e2c7-465d-badc-27b44d9d5927 tempest-VolumesActionsTest-1242513407 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8eaef407-4120-44da-bea7-119b65d8a5dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:16:00 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-aaca2224-e2c7-465d-badc-27b44d9d5927 tempest-VolumesActionsTest-1242513407 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8eaef407-4120-44da-bea7-119b65d8a5dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:16:00 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-aaca2224-e2c7-465d-badc-27b44d9d5927 tempest-VolumesActionsTest-1242513407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80e95d3e-7fa1-48ab-9b71-2395f07870be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:16:00 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-aaca2224-e2c7-465d-badc-27b44d9d5927 tempest-VolumesActionsTest-1242513407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80e95d3e-7fa1-48ab-9b71-2395f07870be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6f2b437-74fb-4752-a0ea-c417a6ed357b', 'volume_name': 'volume-a6f2b437-74fb-4752-a0ea-c417a6ed357b', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:16:00 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-aaca2224-e2c7-465d-badc-27b44d9d5927 tempest-VolumesActionsTest-1242513407 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2a144f0-34c0-4cec-8118-482baeb08265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:16:00 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-aaca2224-e2c7-465d-badc-27b44d9d5927 tempest-VolumesActionsTest-1242513407 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2a144f0-34c0-4cec-8118-482baeb08265) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:16:00 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-aaca2224-e2c7-465d-badc-27b44d9d5927 tempest-VolumesActionsTest-1242513407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (796b1774-5c7e-4431-829f-21b73c114580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:16:00 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-aaca2224-e2c7-465d-badc-27b44d9d5927 tempest-VolumesActionsTest-1242513407 None] Volume a6f2b437-74fb-4752-a0ea-c417a6ed357b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6f2b437-74fb-4752-a0ea-c417a6ed357b', 'volume_size': 1} Nov 04 10:16:00 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-aaca2224-e2c7-465d-badc-27b44d9d5927 tempest-VolumesActionsTest-1242513407 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:16:00 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-aaca2224-e2c7-465d-badc-27b44d9d5927 tempest-VolumesActionsTest-1242513407 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:16:00 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-aaca2224-e2c7-465d-badc-27b44d9d5927 tempest-VolumesActionsTest-1242513407 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:16:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1415385599',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6f2b437-74fb-4752-a0ea-c417a6ed357b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef09188d1b1d4638b581343b902055a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:16:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:16:01Z,use_quota=True,user_id='fcefba7c587147fa837e6a42a2fc173d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 10:16:00 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-aaca2224-e2c7-465d-badc-27b44d9d5927 tempest-VolumesActionsTest-1242513407 None] Creating volume a6f2b437-74fb-4752-a0ea-c417a6ed357b {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:16:00 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-aaca2224-e2c7-465d-badc-27b44d9d5927 tempest-VolumesActionsTest-1242513407 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:16:00 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-aaca2224-e2c7-465d-badc-27b44d9d5927 tempest-VolumesActionsTest-1242513407 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:16:00 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-aaca2224-e2c7-465d-badc-27b44d9d5927 tempest-VolumesActionsTest-1242513407 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:16:00 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-aaca2224-e2c7-465d-badc-27b44d9d5927 tempest-VolumesActionsTest-1242513407 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:16:00 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-aaca2224-e2c7-465d-badc-27b44d9d5927 tempest-VolumesActionsTest-1242513407 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:16:00 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-aaca2224-e2c7-465d-badc-27b44d9d5927 tempest-VolumesActionsTest-1242513407 None] Selected osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:16:00 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-aaca2224-e2c7-465d-badc-27b44d9d5927 tempest-VolumesActionsTest-1242513407 None] casted to osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 Nov 04 10:16:00 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-aaca2224-e2c7-465d-badc-27b44d9d5927 tempest-VolumesActionsTest-1242513407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-a6f2b437-74fb-4752-a0ea-c417a6ed357b 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:16:00 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-842fab7a-5c60-48a7-8634-c64654d71ce3 tempest-GroupSnapshotsTest-1028111199 None] Acquiring lock "cinder-quobyte-577a7a32-8d80-4510-8033-2ad959da0a3c" by "delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:16:01 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-842fab7a-5c60-48a7-8634-c64654d71ce3 tempest-GroupSnapshotsTest-1028111199 None] Lock "cinder-quobyte-577a7a32-8d80-4510-8033-2ad959da0a3c" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:16:01 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-842fab7a-5c60-48a7-8634-c64654d71ce3 tempest-GroupSnapshotsTest-1028111199 None] Acquiring lock "cinder-quobyte-13316be6-df88-4138-a614-3afe2afe8b1d" by "_delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:16:01 devstack sudo[94328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-a6f2b437-74fb-4752-a0ea-c417a6ed357b 1073741824 Nov 04 10:16:01 devstack sudo[94328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:16:01 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-842fab7a-5c60-48a7-8634-c64654d71ce3 tempest-GroupSnapshotsTest-1028111199 None] Lock "cinder-quobyte-13316be6-df88-4138-a614-3afe2afe8b1d" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:16:01 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-842fab7a-5c60-48a7-8634-c64654d71ce3 tempest-GroupSnapshotsTest-1028111199 None] Deleting offline snapshot 13316be6-df88-4138-a614-3afe2afe8b1d of volume 577a7a32-8d80-4510-8033-2ad959da0a3c {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 10:16:01 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-842fab7a-5c60-48a7-8634-c64654d71ce3 tempest-GroupSnapshotsTest-1028111199 None] snapshot_file for this snap is: volume-577a7a32-8d80-4510-8033-2ad959da0a3c.13316be6-df88-4138-a614-3afe2afe8b1d {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 10:16:01 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[db01571e-aaad-4a9b-a42c-96508e38192e]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:16:01 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-842fab7a-5c60-48a7-8634-c64654d71ce3 tempest-GroupSnapshotsTest-1028111199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-577a7a32-8d80-4510-8033-2ad959da0a3c.13316be6-df88-4138-a614-3afe2afe8b1d {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:16:01 devstack sudo[94330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-577a7a32-8d80-4510-8033-2ad959da0a3c.13316be6-df88-4138-a614-3afe2afe8b1d Nov 04 10:16:01 devstack sudo[94330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:16:01 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-01456423-f965-4bcd-bcd0-b62177df836f tempest-AttachVolumeTestJSON-152907179 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:16:01 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-01456423-f965-4bcd-bcd0-b62177df836f tempest-AttachVolumeTestJSON-152907179 None] Flow 'volume_create_manager' (1c40e074-541c-46dc-9dd4-a982968477f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:16:01 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-01456423-f965-4bcd-bcd0-b62177df836f tempest-AttachVolumeTestJSON-152907179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90971ba5-9f2a-455b-ae17-ee5b643f15a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:16:01 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-01456423-f965-4bcd-bcd0-b62177df836f tempest-AttachVolumeTestJSON-152907179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90971ba5-9f2a-455b-ae17-ee5b643f15a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:16:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2093664845',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f2e2647-d693-4698-9345-00f275612bbd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a8a9cd1b4ed496491452baf69cf02b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:16:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:16:01Z,use_quota=True,user_id='91d767ee1a344503861fa899e9ccf9ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:16:01 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-01456423-f965-4bcd-bcd0-b62177df836f tempest-AttachVolumeTestJSON-152907179 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf5f65c8-1baf-45b5-9e6d-133802b68abd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:16:01 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-01456423-f965-4bcd-bcd0-b62177df836f tempest-AttachVolumeTestJSON-152907179 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf5f65c8-1baf-45b5-9e6d-133802b68abd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:16:01 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-01456423-f965-4bcd-bcd0-b62177df836f tempest-AttachVolumeTestJSON-152907179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (668fceb2-c565-4820-b546-bae8c33d1f56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:16:01 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-01456423-f965-4bcd-bcd0-b62177df836f tempest-AttachVolumeTestJSON-152907179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (668fceb2-c565-4820-b546-bae8c33d1f56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f2e2647-d693-4698-9345-00f275612bbd', 'volume_name': 'volume-3f2e2647-d693-4698-9345-00f275612bbd', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:16:01 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-01456423-f965-4bcd-bcd0-b62177df836f tempest-AttachVolumeTestJSON-152907179 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35c55b01-2067-44ce-b51d-f737064d9aa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:16:01 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-01456423-f965-4bcd-bcd0-b62177df836f tempest-AttachVolumeTestJSON-152907179 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35c55b01-2067-44ce-b51d-f737064d9aa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:16:01 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-01456423-f965-4bcd-bcd0-b62177df836f tempest-AttachVolumeTestJSON-152907179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfd33405-0445-4654-a739-df3aa1182db0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:16:01 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-01456423-f965-4bcd-bcd0-b62177df836f tempest-AttachVolumeTestJSON-152907179 None] Volume 3f2e2647-d693-4698-9345-00f275612bbd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f2e2647-d693-4698-9345-00f275612bbd', 'volume_size': 1} Nov 04 10:16:01 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-01456423-f965-4bcd-bcd0-b62177df836f tempest-AttachVolumeTestJSON-152907179 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:16:01 devstack sudo[94328]: pam_unix(sudo:session): session closed for user root Nov 04 10:16:01 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-aaca2224-e2c7-465d-badc-27b44d9d5927 tempest-VolumesActionsTest-1242513407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-a6f2b437-74fb-4752-a0ea-c417a6ed357b 1073741824" returned: 0 in 0.966s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:16:01 devstack sudo[94330]: pam_unix(sudo:session): session closed for user root Nov 04 10:16:01 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-842fab7a-5c60-48a7-8634-c64654d71ce3 tempest-GroupSnapshotsTest-1028111199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-577a7a32-8d80-4510-8033-2ad959da0a3c.13316be6-df88-4138-a614-3afe2afe8b1d" returned: 0 in 0.777s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:16:01 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-842fab7a-5c60-48a7-8634-c64654d71ce3 tempest-GroupSnapshotsTest-1028111199 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-577a7a32-8d80-4510-8033-2ad959da0a3c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87068) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 10:16:02 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eb76443-d487-40ec-b011-fb9510261cd8]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:16:02 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-842fab7a-5c60-48a7-8634-c64654d71ce3 tempest-GroupSnapshotsTest-1028111199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-577a7a32-8d80-4510-8033-2ad959da0a3c {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:16:02 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-aaca2224-e2c7-465d-badc-27b44d9d5927 tempest-VolumesActionsTest-1242513407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-a6f2b437-74fb-4752-a0ea-c417a6ed357b {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:16:02 devstack sudo[94342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-a6f2b437-74fb-4752-a0ea-c417a6ed357b Nov 04 10:16:02 devstack sudo[94342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:16:02 devstack sudo[94341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-577a7a32-8d80-4510-8033-2ad959da0a3c Nov 04 10:16:02 devstack sudo[94341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:16:02 devstack sudo[94342]: pam_unix(sudo:session): session closed for user root Nov 04 10:16:02 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-aaca2224-e2c7-465d-badc-27b44d9d5927 tempest-VolumesActionsTest-1242513407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-a6f2b437-74fb-4752-a0ea-c417a6ed357b" returned: 0 in 0.385s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:16:02 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-aaca2224-e2c7-465d-badc-27b44d9d5927 tempest-VolumesActionsTest-1242513407 None] <== create_volume: return (1514ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 10:16:02 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-aaca2224-e2c7-465d-badc-27b44d9d5927 tempest-VolumesActionsTest-1242513407 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.519s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:16:02 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-01456423-f965-4bcd-bcd0-b62177df836f tempest-AttachVolumeTestJSON-152907179 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.875s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:16:02 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-01456423-f965-4bcd-bcd0-b62177df836f tempest-AttachVolumeTestJSON-152907179 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:16:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2093664845',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f2e2647-d693-4698-9345-00f275612bbd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a8a9cd1b4ed496491452baf69cf02b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:16:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:16:01Z,use_quota=True,user_id='91d767ee1a344503861fa899e9ccf9ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 10:16:02 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-01456423-f965-4bcd-bcd0-b62177df836f tempest-AttachVolumeTestJSON-152907179 None] Creating volume 3f2e2647-d693-4698-9345-00f275612bbd {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:16:02 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-01456423-f965-4bcd-bcd0-b62177df836f tempest-AttachVolumeTestJSON-152907179 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:16:02 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-01456423-f965-4bcd-bcd0-b62177df836f tempest-AttachVolumeTestJSON-152907179 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:16:02 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-01456423-f965-4bcd-bcd0-b62177df836f tempest-AttachVolumeTestJSON-152907179 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:16:02 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-01456423-f965-4bcd-bcd0-b62177df836f tempest-AttachVolumeTestJSON-152907179 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:16:02 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-01456423-f965-4bcd-bcd0-b62177df836f tempest-AttachVolumeTestJSON-152907179 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:16:02 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-01456423-f965-4bcd-bcd0-b62177df836f tempest-AttachVolumeTestJSON-152907179 None] Selected osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:16:02 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-01456423-f965-4bcd-bcd0-b62177df836f tempest-AttachVolumeTestJSON-152907179 None] casted to osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 Nov 04 10:16:02 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-01456423-f965-4bcd-bcd0-b62177df836f tempest-AttachVolumeTestJSON-152907179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-3f2e2647-d693-4698-9345-00f275612bbd 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:16:02 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-aaca2224-e2c7-465d-badc-27b44d9d5927 tempest-VolumesActionsTest-1242513407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (796b1774-5c7e-4431-829f-21b73c114580) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6f2b437-74fb-4752-a0ea-c417a6ed357b', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:16:02 devstack sudo[94346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-3f2e2647-d693-4698-9345-00f275612bbd 1073741824 Nov 04 10:16:02 devstack sudo[94346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:16:02 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-aaca2224-e2c7-465d-badc-27b44d9d5927 tempest-VolumesActionsTest-1242513407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (992eab15-9b60-4e7c-801e-5421059eddde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:16:02 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-aaca2224-e2c7-465d-badc-27b44d9d5927 tempest-VolumesActionsTest-1242513407 None] Volume volume-a6f2b437-74fb-4752-a0ea-c417a6ed357b (a6f2b437-74fb-4752-a0ea-c417a6ed357b): created successfully Nov 04 10:16:02 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-aaca2224-e2c7-465d-badc-27b44d9d5927 tempest-VolumesActionsTest-1242513407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (992eab15-9b60-4e7c-801e-5421059eddde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:16:02 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-aaca2224-e2c7-465d-badc-27b44d9d5927 tempest-VolumesActionsTest-1242513407 None] Flow 'volume_create_manager' (6411c2c3-32a5-43c0-b406-5cbfb5a18402) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:16:02 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-aaca2224-e2c7-465d-badc-27b44d9d5927 tempest-VolumesActionsTest-1242513407 None] Created volume successfully. Nov 04 10:16:02 devstack sudo[94341]: pam_unix(sudo:session): session closed for user root Nov 04 10:16:02 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-842fab7a-5c60-48a7-8634-c64654d71ce3 tempest-GroupSnapshotsTest-1028111199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-577a7a32-8d80-4510-8033-2ad959da0a3c" returned: 0 in 0.888s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:16:02 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-842fab7a-5c60-48a7-8634-c64654d71ce3 tempest-GroupSnapshotsTest-1028111199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-577a7a32-8d80-4510-8033-2ad959da0a3c.13316be6-df88-4138-a614-3afe2afe8b1d {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:16:02 devstack sudo[94351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-577a7a32-8d80-4510-8033-2ad959da0a3c.13316be6-df88-4138-a614-3afe2afe8b1d Nov 04 10:16:02 devstack sudo[94351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:16:03 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-bdd93b4f-7cdc-4280-9926-05df39a33ab0 tempest-VolumesActionsTest-2097549633 None] Acquiring lock "cinder-a6f2b437-74fb-4752-a0ea-c417a6ed357b-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:16:03 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-bdd93b4f-7cdc-4280-9926-05df39a33ab0 tempest-VolumesActionsTest-2097549633 None] Lock "cinder-a6f2b437-74fb-4752-a0ea-c417a6ed357b-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:16:03 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-bdd93b4f-7cdc-4280-9926-05df39a33ab0 tempest-VolumesActionsTest-2097549633 None] Acquiring lock "cinder-quobyte-a6f2b437-74fb-4752-a0ea-c417a6ed357b" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:16:03 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-bdd93b4f-7cdc-4280-9926-05df39a33ab0 tempest-VolumesActionsTest-2097549633 None] Lock "cinder-quobyte-a6f2b437-74fb-4752-a0ea-c417a6ed357b" acquired by "delete_volume" :: waited 0.054s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:16:03 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[12ebba55-70bc-4cc2-81bb-7a5825e17237]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:16:03 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-bdd93b4f-7cdc-4280-9926-05df39a33ab0 tempest-VolumesActionsTest-2097549633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-a6f2b437-74fb-4752-a0ea-c417a6ed357b {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:16:03 devstack sudo[94346]: pam_unix(sudo:session): session closed for user root Nov 04 10:16:03 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-01456423-f965-4bcd-bcd0-b62177df836f tempest-AttachVolumeTestJSON-152907179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-3f2e2647-d693-4698-9345-00f275612bbd 1073741824" returned: 0 in 1.094s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:16:03 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-01456423-f965-4bcd-bcd0-b62177df836f tempest-AttachVolumeTestJSON-152907179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-3f2e2647-d693-4698-9345-00f275612bbd {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:16:03 devstack sudo[94357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-a6f2b437-74fb-4752-a0ea-c417a6ed357b Nov 04 10:16:03 devstack sudo[94357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:16:03 devstack sudo[94362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-3f2e2647-d693-4698-9345-00f275612bbd Nov 04 10:16:03 devstack sudo[94362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:16:03 devstack sudo[94351]: pam_unix(sudo:session): session closed for user root Nov 04 10:16:03 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-842fab7a-5c60-48a7-8634-c64654d71ce3 tempest-GroupSnapshotsTest-1028111199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-577a7a32-8d80-4510-8033-2ad959da0a3c.13316be6-df88-4138-a614-3afe2afe8b1d" returned: 0 in 0.862s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:16:03 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-842fab7a-5c60-48a7-8634-c64654d71ce3 tempest-GroupSnapshotsTest-1028111199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-577a7a32-8d80-4510-8033-2ad959da0a3c.13316be6-df88-4138-a614-3afe2afe8b1d {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:16:03 devstack sudo[94364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-577a7a32-8d80-4510-8033-2ad959da0a3c.13316be6-df88-4138-a614-3afe2afe8b1d Nov 04 10:16:03 devstack sudo[94364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:16:04 devstack sudo[94362]: pam_unix(sudo:session): session closed for user root Nov 04 10:16:04 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-01456423-f965-4bcd-bcd0-b62177df836f tempest-AttachVolumeTestJSON-152907179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-3f2e2647-d693-4698-9345-00f275612bbd" returned: 0 in 0.505s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:16:04 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-01456423-f965-4bcd-bcd0-b62177df836f tempest-AttachVolumeTestJSON-152907179 None] <== create_volume: return (1681ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 10:16:04 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-01456423-f965-4bcd-bcd0-b62177df836f tempest-AttachVolumeTestJSON-152907179 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.691s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:16:04 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-01456423-f965-4bcd-bcd0-b62177df836f tempest-AttachVolumeTestJSON-152907179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfd33405-0445-4654-a739-df3aa1182db0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f2e2647-d693-4698-9345-00f275612bbd', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:16:04 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-01456423-f965-4bcd-bcd0-b62177df836f tempest-AttachVolumeTestJSON-152907179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (229dd629-0c7c-4ae4-8343-7a33d61ecde0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:16:04 devstack sudo[94357]: pam_unix(sudo:session): session closed for user root Nov 04 10:16:04 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-bdd93b4f-7cdc-4280-9926-05df39a33ab0 tempest-VolumesActionsTest-2097549633 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-a6f2b437-74fb-4752-a0ea-c417a6ed357b" returned: 0 in 0.847s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:16:04 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-bdd93b4f-7cdc-4280-9926-05df39a33ab0 tempest-VolumesActionsTest-2097549633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-a6f2b437-74fb-4752-a0ea-c417a6ed357b {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:16:04 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-01456423-f965-4bcd-bcd0-b62177df836f tempest-AttachVolumeTestJSON-152907179 None] Volume volume-3f2e2647-d693-4698-9345-00f275612bbd (3f2e2647-d693-4698-9345-00f275612bbd): created successfully Nov 04 10:16:04 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-01456423-f965-4bcd-bcd0-b62177df836f tempest-AttachVolumeTestJSON-152907179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (229dd629-0c7c-4ae4-8343-7a33d61ecde0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:16:04 devstack sudo[94371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-a6f2b437-74fb-4752-a0ea-c417a6ed357b Nov 04 10:16:04 devstack sudo[94371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:16:04 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-01456423-f965-4bcd-bcd0-b62177df836f tempest-AttachVolumeTestJSON-152907179 None] Flow 'volume_create_manager' (1c40e074-541c-46dc-9dd4-a982968477f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:16:04 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-01456423-f965-4bcd-bcd0-b62177df836f tempest-AttachVolumeTestJSON-152907179 None] Created volume successfully. Nov 04 10:16:04 devstack sudo[94364]: pam_unix(sudo:session): session closed for user root Nov 04 10:16:04 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-842fab7a-5c60-48a7-8634-c64654d71ce3 tempest-GroupSnapshotsTest-1028111199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-577a7a32-8d80-4510-8033-2ad959da0a3c.13316be6-df88-4138-a614-3afe2afe8b1d" returned: 0 in 0.594s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:16:04 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-842fab7a-5c60-48a7-8634-c64654d71ce3 tempest-GroupSnapshotsTest-1028111199 None] Lock "cinder-quobyte-13316be6-df88-4138-a614-3afe2afe8b1d" released by "_delete_snapshot" :: held 3.375s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:16:04 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-842fab7a-5c60-48a7-8634-c64654d71ce3 tempest-GroupSnapshotsTest-1028111199 None] Lock "cinder-quobyte-577a7a32-8d80-4510-8033-2ad959da0a3c" released by "delete_snapshot" :: held 3.429s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:16:04 devstack cinder-volume[87068]: WARNING cinder.quota [None req-842fab7a-5c60-48a7-8634-c64654d71ce3 tempest-GroupSnapshotsTest-1028111199 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-540268563 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-540268563, it is now deprecated. Please use the default quota class for default quota. Nov 04 10:16:04 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-842fab7a-5c60-48a7-8634-c64654d71ce3 tempest-GroupSnapshotsTest-1028111199 None] Created reservations ['8d1a4c83-49e3-40b8-97b0-4457606d0436', '378ce2c6-b762-4ab8-99d0-1067bdb8ddcf', '0308e103-48df-4860-9d25-d0893370a13e', '2febf310-c67f-498e-b22d-d9c8a8652b71'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:16:04 devstack sudo[94371]: pam_unix(sudo:session): session closed for user root Nov 04 10:16:04 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-bdd93b4f-7cdc-4280-9926-05df39a33ab0 tempest-VolumesActionsTest-2097549633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-a6f2b437-74fb-4752-a0ea-c417a6ed357b" returned: 0 in 0.497s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:16:04 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-bdd93b4f-7cdc-4280-9926-05df39a33ab0 tempest-VolumesActionsTest-2097549633 None] Lock "cinder-quobyte-a6f2b437-74fb-4752-a0ea-c417a6ed357b" released by "delete_volume" :: held 1.468s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:16:04 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-842fab7a-5c60-48a7-8634-c64654d71ce3 tempest-GroupSnapshotsTest-1028111199 None] group_snapshot 814e3f8e-0608-4daf-81ad-2d31b5db7397: deleted successfully Nov 04 10:16:04 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-bdd93b4f-7cdc-4280-9926-05df39a33ab0 tempest-VolumesActionsTest-2097549633 None] Created reservations ['d8a24d49-7ecf-4a39-9147-e08afb9e5f41', '4edc89cf-ce3d-47e5-8caf-312ef8bec246', 'ced9e16e-d1f9-421c-a036-9b44edd3d32e', '85d7e9a1-c1ef-4695-8d36-a6d0518ecf05'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:16:05 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-bdd93b4f-7cdc-4280-9926-05df39a33ab0 tempest-VolumesActionsTest-2097549633 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:16:05 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-bdd93b4f-7cdc-4280-9926-05df39a33ab0 tempest-VolumesActionsTest-2097549633 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:16:05 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-bdd93b4f-7cdc-4280-9926-05df39a33ab0 tempest-VolumesActionsTest-2097549633 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:16:05 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-bdd93b4f-7cdc-4280-9926-05df39a33ab0 tempest-VolumesActionsTest-2097549633 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:16:05 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-bdd93b4f-7cdc-4280-9926-05df39a33ab0 tempest-VolumesActionsTest-2097549633 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:16:05 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-bdd93b4f-7cdc-4280-9926-05df39a33ab0 tempest-VolumesActionsTest-2097549633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:16:05 devstack sudo[94375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:16:05 devstack sudo[94375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:16:05 devstack sudo[94375]: pam_unix(sudo:session): session closed for user root Nov 04 10:16:05 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-bdd93b4f-7cdc-4280-9926-05df39a33ab0 tempest-VolumesActionsTest-2097549633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.460s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:16:05 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-bdd93b4f-7cdc-4280-9926-05df39a33ab0 tempest-VolumesActionsTest-2097549633 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:16:05 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-bdd93b4f-7cdc-4280-9926-05df39a33ab0 tempest-VolumesActionsTest-2097549633 None] Deleted volume successfully. Nov 04 10:16:05 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-bdd93b4f-7cdc-4280-9926-05df39a33ab0 tempest-VolumesActionsTest-2097549633 None] Lock "cinder-a6f2b437-74fb-4752-a0ea-c417a6ed357b-delete_volume" released by "delete_volume" :: held 2.436s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:16:05 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-8f5b845d-5af1-4a09-bb34-ad1ef018eb9e tempest-GroupSnapshotsTest-1028111199 None] Acquiring lock "cinder-quobyte-577a7a32-8d80-4510-8033-2ad959da0a3c" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:16:05 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-8f5b845d-5af1-4a09-bb34-ad1ef018eb9e tempest-GroupSnapshotsTest-1028111199 None] Lock "cinder-quobyte-577a7a32-8d80-4510-8033-2ad959da0a3c" acquired by "delete_volume" :: waited 0.059s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:16:06 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[21d86819-01b8-4ff4-b9ce-ad8342ee7e61]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:16:06 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-8f5b845d-5af1-4a09-bb34-ad1ef018eb9e tempest-GroupSnapshotsTest-1028111199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-577a7a32-8d80-4510-8033-2ad959da0a3c {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:16:06 devstack sudo[94385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-577a7a32-8d80-4510-8033-2ad959da0a3c Nov 04 10:16:06 devstack sudo[94385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:16:06 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-31f0fd85-2a2d-460f-a69c-2fb82f92147a tempest-VolumesActionsTest-1242513407 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:16:06 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-31f0fd85-2a2d-460f-a69c-2fb82f92147a tempest-VolumesActionsTest-1242513407 None] Flow 'volume_create_manager' (d2f3585a-f76a-4cad-894e-61669a4b066a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:16:06 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-31f0fd85-2a2d-460f-a69c-2fb82f92147a tempest-VolumesActionsTest-1242513407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7f0fdd6-6790-440d-b3f1-113f5dac31ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:16:06 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-31f0fd85-2a2d-460f-a69c-2fb82f92147a tempest-VolumesActionsTest-1242513407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7f0fdd6-6790-440d-b3f1-113f5dac31ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:16:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-227345587',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d3746f2-cc63-4cb4-8a7e-52558b0aa7c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef09188d1b1d4638b581343b902055a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:16:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:16:06Z,use_quota=True,user_id='fcefba7c587147fa837e6a42a2fc173d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:16:06 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-31f0fd85-2a2d-460f-a69c-2fb82f92147a tempest-VolumesActionsTest-1242513407 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f7dc179-ebdf-46b5-bb4b-585cf6a6046d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:16:06 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-31f0fd85-2a2d-460f-a69c-2fb82f92147a tempest-VolumesActionsTest-1242513407 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f7dc179-ebdf-46b5-bb4b-585cf6a6046d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:16:06 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-31f0fd85-2a2d-460f-a69c-2fb82f92147a tempest-VolumesActionsTest-1242513407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58a68b6e-1cbd-4b14-ab37-d18ebfb1cc75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:16:06 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-31f0fd85-2a2d-460f-a69c-2fb82f92147a tempest-VolumesActionsTest-1242513407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58a68b6e-1cbd-4b14-ab37-d18ebfb1cc75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d3746f2-cc63-4cb4-8a7e-52558b0aa7c9', 'volume_name': 'volume-9d3746f2-cc63-4cb4-8a7e-52558b0aa7c9', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:16:06 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-31f0fd85-2a2d-460f-a69c-2fb82f92147a tempest-VolumesActionsTest-1242513407 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7041a88-fbe9-4d3d-815b-682a578e1664) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:16:06 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-31f0fd85-2a2d-460f-a69c-2fb82f92147a tempest-VolumesActionsTest-1242513407 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7041a88-fbe9-4d3d-815b-682a578e1664) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:16:06 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-31f0fd85-2a2d-460f-a69c-2fb82f92147a tempest-VolumesActionsTest-1242513407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2aafed8c-0b30-4621-983d-8eb949da9d60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:16:06 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-31f0fd85-2a2d-460f-a69c-2fb82f92147a tempest-VolumesActionsTest-1242513407 None] Volume 9d3746f2-cc63-4cb4-8a7e-52558b0aa7c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d3746f2-cc63-4cb4-8a7e-52558b0aa7c9', 'volume_size': 1} Nov 04 10:16:06 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-31f0fd85-2a2d-460f-a69c-2fb82f92147a tempest-VolumesActionsTest-1242513407 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:16:06 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-31f0fd85-2a2d-460f-a69c-2fb82f92147a tempest-VolumesActionsTest-1242513407 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:16:06 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-31f0fd85-2a2d-460f-a69c-2fb82f92147a tempest-VolumesActionsTest-1242513407 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:16:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-227345587',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d3746f2-cc63-4cb4-8a7e-52558b0aa7c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef09188d1b1d4638b581343b902055a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:16:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:16:06Z,use_quota=True,user_id='fcefba7c587147fa837e6a42a2fc173d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 10:16:06 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-31f0fd85-2a2d-460f-a69c-2fb82f92147a tempest-VolumesActionsTest-1242513407 None] Creating volume 9d3746f2-cc63-4cb4-8a7e-52558b0aa7c9 {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:16:06 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-31f0fd85-2a2d-460f-a69c-2fb82f92147a tempest-VolumesActionsTest-1242513407 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:16:06 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-31f0fd85-2a2d-460f-a69c-2fb82f92147a tempest-VolumesActionsTest-1242513407 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:16:06 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-31f0fd85-2a2d-460f-a69c-2fb82f92147a tempest-VolumesActionsTest-1242513407 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:16:06 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-31f0fd85-2a2d-460f-a69c-2fb82f92147a tempest-VolumesActionsTest-1242513407 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:16:06 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-31f0fd85-2a2d-460f-a69c-2fb82f92147a tempest-VolumesActionsTest-1242513407 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:16:06 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-31f0fd85-2a2d-460f-a69c-2fb82f92147a tempest-VolumesActionsTest-1242513407 None] Selected osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:16:06 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-31f0fd85-2a2d-460f-a69c-2fb82f92147a tempest-VolumesActionsTest-1242513407 None] casted to osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 Nov 04 10:16:06 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-31f0fd85-2a2d-460f-a69c-2fb82f92147a tempest-VolumesActionsTest-1242513407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-9d3746f2-cc63-4cb4-8a7e-52558b0aa7c9 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:16:06 devstack sudo[94385]: pam_unix(sudo:session): session closed for user root Nov 04 10:16:06 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-8f5b845d-5af1-4a09-bb34-ad1ef018eb9e tempest-GroupSnapshotsTest-1028111199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-577a7a32-8d80-4510-8033-2ad959da0a3c" returned: 0 in 0.673s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:16:06 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-8f5b845d-5af1-4a09-bb34-ad1ef018eb9e tempest-GroupSnapshotsTest-1028111199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-577a7a32-8d80-4510-8033-2ad959da0a3c {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:16:06 devstack sudo[94398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-9d3746f2-cc63-4cb4-8a7e-52558b0aa7c9 1073741824 Nov 04 10:16:06 devstack sudo[94398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:16:06 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [req-2d7fdb6c-0646-4209-9127-dc6d7b2ab499 req-c8dddce6-d01a-4684-9b0f-c658e4deef8e tempest-AttachVolumeTestJSON-152907179 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:16:06 devstack sudo[94400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-577a7a32-8d80-4510-8033-2ad959da0a3c Nov 04 10:16:06 devstack sudo[94400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:16:06 devstack sudo[94400]: pam_unix(sudo:session): session closed for user root Nov 04 10:16:06 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-8f5b845d-5af1-4a09-bb34-ad1ef018eb9e tempest-GroupSnapshotsTest-1028111199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-577a7a32-8d80-4510-8033-2ad959da0a3c" returned: 0 in 0.288s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:16:07 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-8f5b845d-5af1-4a09-bb34-ad1ef018eb9e tempest-GroupSnapshotsTest-1028111199 None] Lock "cinder-quobyte-577a7a32-8d80-4510-8033-2ad959da0a3c" released by "delete_volume" :: held 1.068s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:16:07 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-8f5b845d-5af1-4a09-bb34-ad1ef018eb9e tempest-GroupSnapshotsTest-1028111199 None] Created reservations ['2a463a76-2a47-4d0e-b124-d4f84f1b638f'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:16:07 devstack cinder-volume[87068]: WARNING cinder.db.api [None req-8f5b845d-5af1-4a09-bb34-ad1ef018eb9e tempest-GroupSnapshotsTest-1028111199 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-540268563'] Nov 04 10:16:07 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-8f5b845d-5af1-4a09-bb34-ad1ef018eb9e tempest-GroupSnapshotsTest-1028111199 None] Created reservations ['615b6350-5aa9-4182-82f9-ef7d31eb6147', 'ca481d29-543c-4121-a0e3-ab6baf02773d', '6e0140df-f31c-4268-a2d9-d03243ab13d6', 'c2bd463a-9c22-496c-a4d0-70621747b173'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:16:07 devstack sudo[94398]: pam_unix(sudo:session): session closed for user root Nov 04 10:16:07 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-31f0fd85-2a2d-460f-a69c-2fb82f92147a tempest-VolumesActionsTest-1242513407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-9d3746f2-cc63-4cb4-8a7e-52558b0aa7c9 1073741824" returned: 0 in 0.518s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:16:07 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-31f0fd85-2a2d-460f-a69c-2fb82f92147a tempest-VolumesActionsTest-1242513407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-9d3746f2-cc63-4cb4-8a7e-52558b0aa7c9 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:16:07 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-8f5b845d-5af1-4a09-bb34-ad1ef018eb9e tempest-GroupSnapshotsTest-1028111199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:16:07 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-8f5b845d-5af1-4a09-bb34-ad1ef018eb9e tempest-GroupSnapshotsTest-1028111199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:16:07 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-8f5b845d-5af1-4a09-bb34-ad1ef018eb9e tempest-GroupSnapshotsTest-1028111199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:16:07 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-8f5b845d-5af1-4a09-bb34-ad1ef018eb9e tempest-GroupSnapshotsTest-1028111199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:16:07 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-8f5b845d-5af1-4a09-bb34-ad1ef018eb9e tempest-GroupSnapshotsTest-1028111199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:16:07 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-8f5b845d-5af1-4a09-bb34-ad1ef018eb9e tempest-GroupSnapshotsTest-1028111199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:16:07 devstack sudo[94406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-9d3746f2-cc63-4cb4-8a7e-52558b0aa7c9 Nov 04 10:16:07 devstack sudo[94406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:16:07 devstack sudo[94407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:16:07 devstack sudo[94407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:16:07 devstack sudo[94406]: pam_unix(sudo:session): session closed for user root Nov 04 10:16:07 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-31f0fd85-2a2d-460f-a69c-2fb82f92147a tempest-VolumesActionsTest-1242513407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-9d3746f2-cc63-4cb4-8a7e-52558b0aa7c9" returned: 0 in 0.273s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:16:07 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-31f0fd85-2a2d-460f-a69c-2fb82f92147a tempest-VolumesActionsTest-1242513407 None] <== create_volume: return (863ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 10:16:07 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-31f0fd85-2a2d-460f-a69c-2fb82f92147a tempest-VolumesActionsTest-1242513407 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.866s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:16:07 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [req-2d7fdb6c-0646-4209-9127-dc6d7b2ab499 req-c8dddce6-d01a-4684-9b0f-c658e4deef8e tempest-AttachVolumeTestJSON-152907179 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.802s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:16:07 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [req-2d7fdb6c-0646-4209-9127-dc6d7b2ab499 req-c8dddce6-d01a-4684-9b0f-c658e4deef8e tempest-AttachVolumeTestJSON-152907179 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:16:07 devstack sudo[94407]: pam_unix(sudo:session): session closed for user root Nov 04 10:16:07 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-8f5b845d-5af1-4a09-bb34-ad1ef018eb9e tempest-GroupSnapshotsTest-1028111199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.288s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:16:07 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-8f5b845d-5af1-4a09-bb34-ad1ef018eb9e tempest-GroupSnapshotsTest-1028111199 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:16:07 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-31f0fd85-2a2d-460f-a69c-2fb82f92147a tempest-VolumesActionsTest-1242513407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2aafed8c-0b30-4621-983d-8eb949da9d60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d3746f2-cc63-4cb4-8a7e-52558b0aa7c9', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:16:07 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-31f0fd85-2a2d-460f-a69c-2fb82f92147a tempest-VolumesActionsTest-1242513407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (399c5335-eefd-41da-a4a5-8d251e47d1b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:16:07 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-8f5b845d-5af1-4a09-bb34-ad1ef018eb9e tempest-GroupSnapshotsTest-1028111199 None] Delete group completed successfully. Nov 04 10:16:07 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [req-2d7fdb6c-0646-4209-9127-dc6d7b2ab499 req-c8dddce6-d01a-4684-9b0f-c658e4deef8e tempest-AttachVolumeTestJSON-152907179 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034', 'name': 'volume-3f2e2647-d693-4698-9345-00f275612bbd', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '66d6da74-9789-4f45-9fe0-6863001ca7f2', 'enforce_multipath': True} {{(pid=87068) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 04 10:16:07 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-31f0fd85-2a2d-460f-a69c-2fb82f92147a tempest-VolumesActionsTest-1242513407 None] Volume volume-9d3746f2-cc63-4cb4-8a7e-52558b0aa7c9 (9d3746f2-cc63-4cb4-8a7e-52558b0aa7c9): created successfully Nov 04 10:16:07 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-31f0fd85-2a2d-460f-a69c-2fb82f92147a tempest-VolumesActionsTest-1242513407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (399c5335-eefd-41da-a4a5-8d251e47d1b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:16:07 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-31f0fd85-2a2d-460f-a69c-2fb82f92147a tempest-VolumesActionsTest-1242513407 None] Flow 'volume_create_manager' (d2f3585a-f76a-4cad-894e-61669a4b066a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:16:07 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-31f0fd85-2a2d-460f-a69c-2fb82f92147a tempest-VolumesActionsTest-1242513407 None] Created volume successfully. Nov 04 10:16:07 devstack cinder-volume[87068]: INFO cinder.volume.manager [req-2d7fdb6c-0646-4209-9127-dc6d7b2ab499 req-c8dddce6-d01a-4684-9b0f-c658e4deef8e tempest-AttachVolumeTestJSON-152907179 None] attachment_update completed successfully. Nov 04 10:16:08 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-93ba218e-365b-4a4b-a5e2-fd6961e16c75 tempest-VolumesActionsTest-2097549633 None] Acquiring lock "cinder-9d3746f2-cc63-4cb4-8a7e-52558b0aa7c9-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:16:08 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-93ba218e-365b-4a4b-a5e2-fd6961e16c75 tempest-VolumesActionsTest-2097549633 None] Lock "cinder-9d3746f2-cc63-4cb4-8a7e-52558b0aa7c9-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:16:08 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-bedfb8f3-ea79-4737-b605-3b2712e7325c tempest-GroupSnapshotsTest-1028111199 None] Group tempest-GroupSnapshotsTest-Group-422238961: creating Nov 04 10:16:08 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-bedfb8f3-ea79-4737-b605-3b2712e7325c tempest-GroupSnapshotsTest-1028111199 None] Group tempest-GroupSnapshotsTest-Group-422238961: created successfully Nov 04 10:16:08 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-bedfb8f3-ea79-4737-b605-3b2712e7325c tempest-GroupSnapshotsTest-1028111199 None] Create group completed successfully. Nov 04 10:16:09 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-93ba218e-365b-4a4b-a5e2-fd6961e16c75 tempest-VolumesActionsTest-2097549633 None] Acquiring lock "cinder-quobyte-9d3746f2-cc63-4cb4-8a7e-52558b0aa7c9" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:16:09 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-93ba218e-365b-4a4b-a5e2-fd6961e16c75 tempest-VolumesActionsTest-2097549633 None] Lock "cinder-quobyte-9d3746f2-cc63-4cb4-8a7e-52558b0aa7c9" acquired by "delete_volume" :: waited 0.024s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:16:09 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[252de439-8577-4204-9c9e-1cd55c42227b]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:16:09 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-93ba218e-365b-4a4b-a5e2-fd6961e16c75 tempest-VolumesActionsTest-2097549633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-9d3746f2-cc63-4cb4-8a7e-52558b0aa7c9 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:16:09 devstack sudo[94414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-9d3746f2-cc63-4cb4-8a7e-52558b0aa7c9 Nov 04 10:16:09 devstack sudo[94414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:16:09 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-1eb8d259-7cd1-4da1-b216-556104014525 tempest-AttachVolumeTestJSON-152907179 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:16:09 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1eb8d259-7cd1-4da1-b216-556104014525 tempest-AttachVolumeTestJSON-152907179 None] Flow 'volume_create_manager' (8974e4f5-9dda-44ed-97d5-b0688a3e712c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:16:09 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1eb8d259-7cd1-4da1-b216-556104014525 tempest-AttachVolumeTestJSON-152907179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0b2ea6e-0f03-4275-b6d0-5005c2a8ec15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:16:09 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1eb8d259-7cd1-4da1-b216-556104014525 tempest-AttachVolumeTestJSON-152907179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0b2ea6e-0f03-4275-b6d0-5005c2a8ec15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:16:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-853598836',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=796990cb-45e8-4fc4-bb98-6f55b2ccf5a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a8a9cd1b4ed496491452baf69cf02b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:16:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:16:09Z,use_quota=True,user_id='91d767ee1a344503861fa899e9ccf9ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:16:09 devstack sudo[94414]: pam_unix(sudo:session): session closed for user root Nov 04 10:16:09 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1eb8d259-7cd1-4da1-b216-556104014525 tempest-AttachVolumeTestJSON-152907179 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e56007a7-d496-4356-bee3-58cfcf1b83ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:16:09 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1eb8d259-7cd1-4da1-b216-556104014525 tempest-AttachVolumeTestJSON-152907179 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e56007a7-d496-4356-bee3-58cfcf1b83ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:16:09 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1eb8d259-7cd1-4da1-b216-556104014525 tempest-AttachVolumeTestJSON-152907179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0898ad86-a5da-43e2-916f-47ff5be02d0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:16:09 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1eb8d259-7cd1-4da1-b216-556104014525 tempest-AttachVolumeTestJSON-152907179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0898ad86-a5da-43e2-916f-47ff5be02d0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '796990cb-45e8-4fc4-bb98-6f55b2ccf5a4', 'volume_name': 'volume-796990cb-45e8-4fc4-bb98-6f55b2ccf5a4', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:16:09 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1eb8d259-7cd1-4da1-b216-556104014525 tempest-AttachVolumeTestJSON-152907179 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15187a01-3cc8-4baa-92c5-7421a4e9cddb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:16:09 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1eb8d259-7cd1-4da1-b216-556104014525 tempest-AttachVolumeTestJSON-152907179 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15187a01-3cc8-4baa-92c5-7421a4e9cddb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:16:09 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1eb8d259-7cd1-4da1-b216-556104014525 tempest-AttachVolumeTestJSON-152907179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc9110bc-398a-49ee-8118-77ece4147d4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:16:09 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-1eb8d259-7cd1-4da1-b216-556104014525 tempest-AttachVolumeTestJSON-152907179 None] Volume 796990cb-45e8-4fc4-bb98-6f55b2ccf5a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-796990cb-45e8-4fc4-bb98-6f55b2ccf5a4', 'volume_size': 1} Nov 04 10:16:09 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-1eb8d259-7cd1-4da1-b216-556104014525 tempest-AttachVolumeTestJSON-152907179 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:16:09 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-1eb8d259-7cd1-4da1-b216-556104014525 tempest-AttachVolumeTestJSON-152907179 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:16:09 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-1eb8d259-7cd1-4da1-b216-556104014525 tempest-AttachVolumeTestJSON-152907179 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:16:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-853598836',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=796990cb-45e8-4fc4-bb98-6f55b2ccf5a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a8a9cd1b4ed496491452baf69cf02b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:16:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:16:09Z,use_quota=True,user_id='91d767ee1a344503861fa899e9ccf9ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 10:16:09 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-1eb8d259-7cd1-4da1-b216-556104014525 tempest-AttachVolumeTestJSON-152907179 None] Creating volume 796990cb-45e8-4fc4-bb98-6f55b2ccf5a4 {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:16:09 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-1eb8d259-7cd1-4da1-b216-556104014525 tempest-AttachVolumeTestJSON-152907179 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:16:09 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-1eb8d259-7cd1-4da1-b216-556104014525 tempest-AttachVolumeTestJSON-152907179 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:16:09 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-1eb8d259-7cd1-4da1-b216-556104014525 tempest-AttachVolumeTestJSON-152907179 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:16:09 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-1eb8d259-7cd1-4da1-b216-556104014525 tempest-AttachVolumeTestJSON-152907179 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:16:09 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-1eb8d259-7cd1-4da1-b216-556104014525 tempest-AttachVolumeTestJSON-152907179 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:16:09 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-1eb8d259-7cd1-4da1-b216-556104014525 tempest-AttachVolumeTestJSON-152907179 None] Selected osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:16:09 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-1eb8d259-7cd1-4da1-b216-556104014525 tempest-AttachVolumeTestJSON-152907179 None] casted to osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 Nov 04 10:16:09 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-1eb8d259-7cd1-4da1-b216-556104014525 tempest-AttachVolumeTestJSON-152907179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-796990cb-45e8-4fc4-bb98-6f55b2ccf5a4 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:16:09 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-93ba218e-365b-4a4b-a5e2-fd6961e16c75 tempest-VolumesActionsTest-2097549633 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-9d3746f2-cc63-4cb4-8a7e-52558b0aa7c9" returned: 0 in 0.515s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:16:09 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-93ba218e-365b-4a4b-a5e2-fd6961e16c75 tempest-VolumesActionsTest-2097549633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-9d3746f2-cc63-4cb4-8a7e-52558b0aa7c9 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:16:09 devstack sudo[94419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-796990cb-45e8-4fc4-bb98-6f55b2ccf5a4 1073741824 Nov 04 10:16:09 devstack sudo[94419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:16:09 devstack sudo[94420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-9d3746f2-cc63-4cb4-8a7e-52558b0aa7c9 Nov 04 10:16:09 devstack sudo[94420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:16:09 devstack sudo[94420]: pam_unix(sudo:session): session closed for user root Nov 04 10:16:09 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-93ba218e-365b-4a4b-a5e2-fd6961e16c75 tempest-VolumesActionsTest-2097549633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-9d3746f2-cc63-4cb4-8a7e-52558b0aa7c9" returned: 0 in 0.270s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:16:09 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-93ba218e-365b-4a4b-a5e2-fd6961e16c75 tempest-VolumesActionsTest-2097549633 None] Lock "cinder-quobyte-9d3746f2-cc63-4cb4-8a7e-52558b0aa7c9" released by "delete_volume" :: held 0.844s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:16:09 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-93ba218e-365b-4a4b-a5e2-fd6961e16c75 tempest-VolumesActionsTest-2097549633 None] Created reservations ['172f5650-6d9b-4948-8bce-6fbb0cb82e3e', 'da7c2bfa-418f-4e68-ad3a-e19cc5597ff2', 'e768dd0e-9006-45a2-98da-c3bb047423c9', '49bc2842-a97a-4e37-89e5-bcbcb04fd23e'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:16:10 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-93ba218e-365b-4a4b-a5e2-fd6961e16c75 tempest-VolumesActionsTest-2097549633 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:16:10 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-93ba218e-365b-4a4b-a5e2-fd6961e16c75 tempest-VolumesActionsTest-2097549633 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:16:10 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-93ba218e-365b-4a4b-a5e2-fd6961e16c75 tempest-VolumesActionsTest-2097549633 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:16:10 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-93ba218e-365b-4a4b-a5e2-fd6961e16c75 tempest-VolumesActionsTest-2097549633 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:16:10 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-93ba218e-365b-4a4b-a5e2-fd6961e16c75 tempest-VolumesActionsTest-2097549633 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:16:10 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-93ba218e-365b-4a4b-a5e2-fd6961e16c75 tempest-VolumesActionsTest-2097549633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:16:10 devstack sudo[94428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:16:10 devstack sudo[94428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:16:10 devstack sudo[94419]: pam_unix(sudo:session): session closed for user root Nov 04 10:16:10 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-1eb8d259-7cd1-4da1-b216-556104014525 tempest-AttachVolumeTestJSON-152907179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-796990cb-45e8-4fc4-bb98-6f55b2ccf5a4 1073741824" returned: 0 in 0.637s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:16:10 devstack sudo[94428]: pam_unix(sudo:session): session closed for user root Nov 04 10:16:10 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-93ba218e-365b-4a4b-a5e2-fd6961e16c75 tempest-VolumesActionsTest-2097549633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.387s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:16:10 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-93ba218e-365b-4a4b-a5e2-fd6961e16c75 tempest-VolumesActionsTest-2097549633 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:16:10 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-93ba218e-365b-4a4b-a5e2-fd6961e16c75 tempest-VolumesActionsTest-2097549633 None] Deleted volume successfully. Nov 04 10:16:10 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-1eb8d259-7cd1-4da1-b216-556104014525 tempest-AttachVolumeTestJSON-152907179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-796990cb-45e8-4fc4-bb98-6f55b2ccf5a4 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:16:10 devstack sudo[94431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-796990cb-45e8-4fc4-bb98-6f55b2ccf5a4 Nov 04 10:16:10 devstack sudo[94431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:16:10 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-93ba218e-365b-4a4b-a5e2-fd6961e16c75 tempest-VolumesActionsTest-2097549633 None] Lock "cinder-9d3746f2-cc63-4cb4-8a7e-52558b0aa7c9-delete_volume" released by "delete_volume" :: held 1.639s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:16:10 devstack sudo[94431]: pam_unix(sudo:session): session closed for user root Nov 04 10:16:10 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-1eb8d259-7cd1-4da1-b216-556104014525 tempest-AttachVolumeTestJSON-152907179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-796990cb-45e8-4fc4-bb98-6f55b2ccf5a4" returned: 0 in 0.316s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:16:10 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-1eb8d259-7cd1-4da1-b216-556104014525 tempest-AttachVolumeTestJSON-152907179 None] <== create_volume: return (1236ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 10:16:10 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-1eb8d259-7cd1-4da1-b216-556104014525 tempest-AttachVolumeTestJSON-152907179 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.239s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:16:10 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1eb8d259-7cd1-4da1-b216-556104014525 tempest-AttachVolumeTestJSON-152907179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc9110bc-398a-49ee-8118-77ece4147d4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-796990cb-45e8-4fc4-bb98-6f55b2ccf5a4', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:16:10 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1eb8d259-7cd1-4da1-b216-556104014525 tempest-AttachVolumeTestJSON-152907179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fab2341-ffc9-4cb1-a544-4eab420c70dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:16:10 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-1eb8d259-7cd1-4da1-b216-556104014525 tempest-AttachVolumeTestJSON-152907179 None] Volume volume-796990cb-45e8-4fc4-bb98-6f55b2ccf5a4 (796990cb-45e8-4fc4-bb98-6f55b2ccf5a4): created successfully Nov 04 10:16:10 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1eb8d259-7cd1-4da1-b216-556104014525 tempest-AttachVolumeTestJSON-152907179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fab2341-ffc9-4cb1-a544-4eab420c70dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:16:10 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1eb8d259-7cd1-4da1-b216-556104014525 tempest-AttachVolumeTestJSON-152907179 None] Flow 'volume_create_manager' (8974e4f5-9dda-44ed-97d5-b0688a3e712c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:16:10 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-1eb8d259-7cd1-4da1-b216-556104014525 tempest-AttachVolumeTestJSON-152907179 None] Created volume successfully. Nov 04 10:16:11 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-f70e8ac9-9530-4aba-9d9a-a3aa93e8df59 tempest-VolumesActionsTest-1242513407 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:16:11 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-f70e8ac9-9530-4aba-9d9a-a3aa93e8df59 tempest-VolumesActionsTest-1242513407 None] Flow 'volume_create_manager' (abbaa74b-d5c3-4da6-8236-b8927fb8c93d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:16:11 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-f70e8ac9-9530-4aba-9d9a-a3aa93e8df59 tempest-VolumesActionsTest-1242513407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fe60f5c-46f1-47e2-9664-f64ef9714c07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:16:11 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-f70e8ac9-9530-4aba-9d9a-a3aa93e8df59 tempest-VolumesActionsTest-1242513407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fe60f5c-46f1-47e2-9664-f64ef9714c07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:16:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1360241331',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=903726c8-90a4-4c46-81fd-1cb6a9f9a750,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef09188d1b1d4638b581343b902055a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:16:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:16:11Z,use_quota=True,user_id='fcefba7c587147fa837e6a42a2fc173d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:16:11 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-f70e8ac9-9530-4aba-9d9a-a3aa93e8df59 tempest-VolumesActionsTest-1242513407 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86156396-3734-4706-ba75-be93c48fc2be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:16:11 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-f70e8ac9-9530-4aba-9d9a-a3aa93e8df59 tempest-VolumesActionsTest-1242513407 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86156396-3734-4706-ba75-be93c48fc2be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:16:11 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-f70e8ac9-9530-4aba-9d9a-a3aa93e8df59 tempest-VolumesActionsTest-1242513407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61172025-5de6-4797-a318-cfb733e0342a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:16:11 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-f70e8ac9-9530-4aba-9d9a-a3aa93e8df59 tempest-VolumesActionsTest-1242513407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61172025-5de6-4797-a318-cfb733e0342a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '903726c8-90a4-4c46-81fd-1cb6a9f9a750', 'volume_name': 'volume-903726c8-90a4-4c46-81fd-1cb6a9f9a750', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:16:11 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-f70e8ac9-9530-4aba-9d9a-a3aa93e8df59 tempest-VolumesActionsTest-1242513407 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00b3d297-07a8-443d-8ad8-46f45b926e43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:16:11 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-f70e8ac9-9530-4aba-9d9a-a3aa93e8df59 tempest-VolumesActionsTest-1242513407 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00b3d297-07a8-443d-8ad8-46f45b926e43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:16:11 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-f70e8ac9-9530-4aba-9d9a-a3aa93e8df59 tempest-VolumesActionsTest-1242513407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4e0945e-ff73-46ec-b9df-fad1fd701fc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:16:11 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-f70e8ac9-9530-4aba-9d9a-a3aa93e8df59 tempest-VolumesActionsTest-1242513407 None] Volume 903726c8-90a4-4c46-81fd-1cb6a9f9a750: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-903726c8-90a4-4c46-81fd-1cb6a9f9a750', 'volume_size': 1} Nov 04 10:16:11 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-f70e8ac9-9530-4aba-9d9a-a3aa93e8df59 tempest-VolumesActionsTest-1242513407 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:16:11 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-f70e8ac9-9530-4aba-9d9a-a3aa93e8df59 tempest-VolumesActionsTest-1242513407 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:16:11 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-f70e8ac9-9530-4aba-9d9a-a3aa93e8df59 tempest-VolumesActionsTest-1242513407 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:16:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1360241331',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=903726c8-90a4-4c46-81fd-1cb6a9f9a750,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef09188d1b1d4638b581343b902055a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:16:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:16:11Z,use_quota=True,user_id='fcefba7c587147fa837e6a42a2fc173d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 10:16:11 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-f70e8ac9-9530-4aba-9d9a-a3aa93e8df59 tempest-VolumesActionsTest-1242513407 None] Creating volume 903726c8-90a4-4c46-81fd-1cb6a9f9a750 {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:16:11 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-f70e8ac9-9530-4aba-9d9a-a3aa93e8df59 tempest-VolumesActionsTest-1242513407 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:16:11 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-f70e8ac9-9530-4aba-9d9a-a3aa93e8df59 tempest-VolumesActionsTest-1242513407 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:16:11 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-f70e8ac9-9530-4aba-9d9a-a3aa93e8df59 tempest-VolumesActionsTest-1242513407 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:16:11 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-f70e8ac9-9530-4aba-9d9a-a3aa93e8df59 tempest-VolumesActionsTest-1242513407 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:16:11 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-f70e8ac9-9530-4aba-9d9a-a3aa93e8df59 tempest-VolumesActionsTest-1242513407 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:16:11 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-f70e8ac9-9530-4aba-9d9a-a3aa93e8df59 tempest-VolumesActionsTest-1242513407 None] Selected osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:16:11 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-f70e8ac9-9530-4aba-9d9a-a3aa93e8df59 tempest-VolumesActionsTest-1242513407 None] casted to osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 Nov 04 10:16:11 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f70e8ac9-9530-4aba-9d9a-a3aa93e8df59 tempest-VolumesActionsTest-1242513407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-903726c8-90a4-4c46-81fd-1cb6a9f9a750 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:16:11 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-0feb8b63-4563-430e-992f-e3f8ce3aa59c tempest-GroupSnapshotsTest-1028111199 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:16:11 devstack sudo[94435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-903726c8-90a4-4c46-81fd-1cb6a9f9a750 1073741824 Nov 04 10:16:11 devstack sudo[94435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:16:11 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-0feb8b63-4563-430e-992f-e3f8ce3aa59c tempest-GroupSnapshotsTest-1028111199 None] Flow 'volume_create_manager' (b51e4dfe-7df3-4a3d-b2c4-30319403ce34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:16:11 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-0feb8b63-4563-430e-992f-e3f8ce3aa59c tempest-GroupSnapshotsTest-1028111199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c108d93-4fdd-47f3-b426-f3f6f7eb738c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:16:11 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-0feb8b63-4563-430e-992f-e3f8ce3aa59c tempest-GroupSnapshotsTest-1028111199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c108d93-4fdd-47f3-b426-f3f6f7eb738c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:16:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1009668664',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=59b4de25-d3d3-4e02-9a5d-b1f363e113d6,host='devstack@QuobyteHD#QuobyteHD',id=790e3c38-f282-4486-be49-6f7a65b64119,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b61be80679f440578895f93704afd709',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:16:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:16:11Z,use_quota=True,user_id='709c13bc9e734b63b1ccb2dfaf37dc3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58effc26-215e-4bac-aaf0-9a83236f213f),volume_type_id=58effc26-215e-4bac-aaf0-9a83236f213f)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:16:11 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-0feb8b63-4563-430e-992f-e3f8ce3aa59c tempest-GroupSnapshotsTest-1028111199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bf682f6-2605-408f-8a70-cc48f466ceed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:16:11 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-0feb8b63-4563-430e-992f-e3f8ce3aa59c tempest-GroupSnapshotsTest-1028111199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bf682f6-2605-408f-8a70-cc48f466ceed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:16:11 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-0feb8b63-4563-430e-992f-e3f8ce3aa59c tempest-GroupSnapshotsTest-1028111199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ed7bbd3-d5a8-498b-874e-aa7d78ea1989) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:16:11 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-0feb8b63-4563-430e-992f-e3f8ce3aa59c tempest-GroupSnapshotsTest-1028111199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ed7bbd3-d5a8-498b-874e-aa7d78ea1989) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '790e3c38-f282-4486-be49-6f7a65b64119', 'volume_name': 'volume-790e3c38-f282-4486-be49-6f7a65b64119', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:16:11 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-0feb8b63-4563-430e-992f-e3f8ce3aa59c tempest-GroupSnapshotsTest-1028111199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e177724-cde9-4add-b128-c590b8deab9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:16:11 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-0feb8b63-4563-430e-992f-e3f8ce3aa59c tempest-GroupSnapshotsTest-1028111199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e177724-cde9-4add-b128-c590b8deab9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:16:11 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-0feb8b63-4563-430e-992f-e3f8ce3aa59c tempest-GroupSnapshotsTest-1028111199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (781351b1-d7b8-4155-9e44-f87fe6b511ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:16:11 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-0feb8b63-4563-430e-992f-e3f8ce3aa59c tempest-GroupSnapshotsTest-1028111199 None] Volume 790e3c38-f282-4486-be49-6f7a65b64119: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-790e3c38-f282-4486-be49-6f7a65b64119', 'volume_size': 1} Nov 04 10:16:11 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-0feb8b63-4563-430e-992f-e3f8ce3aa59c tempest-GroupSnapshotsTest-1028111199 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:16:11 devstack sudo[94435]: pam_unix(sudo:session): session closed for user root Nov 04 10:16:11 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f70e8ac9-9530-4aba-9d9a-a3aa93e8df59 tempest-VolumesActionsTest-1242513407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-903726c8-90a4-4c46-81fd-1cb6a9f9a750 1073741824" returned: 0 in 0.427s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:16:11 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f70e8ac9-9530-4aba-9d9a-a3aa93e8df59 tempest-VolumesActionsTest-1242513407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-903726c8-90a4-4c46-81fd-1cb6a9f9a750 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:16:11 devstack sudo[94440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-903726c8-90a4-4c46-81fd-1cb6a9f9a750 Nov 04 10:16:11 devstack sudo[94440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:16:12 devstack sudo[94440]: pam_unix(sudo:session): session closed for user root Nov 04 10:16:12 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f70e8ac9-9530-4aba-9d9a-a3aa93e8df59 tempest-VolumesActionsTest-1242513407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-903726c8-90a4-4c46-81fd-1cb6a9f9a750" returned: 0 in 0.304s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:16:12 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-f70e8ac9-9530-4aba-9d9a-a3aa93e8df59 tempest-VolumesActionsTest-1242513407 None] <== create_volume: return (769ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 10:16:12 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-f70e8ac9-9530-4aba-9d9a-a3aa93e8df59 tempest-VolumesActionsTest-1242513407 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.771s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:16:12 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-0feb8b63-4563-430e-992f-e3f8ce3aa59c tempest-GroupSnapshotsTest-1028111199 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.659s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:16:12 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-0feb8b63-4563-430e-992f-e3f8ce3aa59c tempest-GroupSnapshotsTest-1028111199 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=59b4de25-d3d3-4e02-9a5d-b1f363e113d6,created_at=2026-11-04T09:16:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1009668664',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=59b4de25-d3d3-4e02-9a5d-b1f363e113d6,host='devstack@QuobyteHD#QuobyteHD',id=790e3c38-f282-4486-be49-6f7a65b64119,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b61be80679f440578895f93704afd709',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:16:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:16:11Z,use_quota=True,user_id='709c13bc9e734b63b1ccb2dfaf37dc3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58effc26-215e-4bac-aaf0-9a83236f213f),volume_type_id=58effc26-215e-4bac-aaf0-9a83236f213f)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 10:16:12 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-0feb8b63-4563-430e-992f-e3f8ce3aa59c tempest-GroupSnapshotsTest-1028111199 None] Creating volume 790e3c38-f282-4486-be49-6f7a65b64119 {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:16:12 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-0feb8b63-4563-430e-992f-e3f8ce3aa59c tempest-GroupSnapshotsTest-1028111199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:16:12 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-0feb8b63-4563-430e-992f-e3f8ce3aa59c tempest-GroupSnapshotsTest-1028111199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:16:12 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-0feb8b63-4563-430e-992f-e3f8ce3aa59c tempest-GroupSnapshotsTest-1028111199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:16:12 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-0feb8b63-4563-430e-992f-e3f8ce3aa59c tempest-GroupSnapshotsTest-1028111199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:16:12 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-0feb8b63-4563-430e-992f-e3f8ce3aa59c tempest-GroupSnapshotsTest-1028111199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:16:12 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-0feb8b63-4563-430e-992f-e3f8ce3aa59c tempest-GroupSnapshotsTest-1028111199 None] Selected osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:16:12 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-0feb8b63-4563-430e-992f-e3f8ce3aa59c tempest-GroupSnapshotsTest-1028111199 None] casted to osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 Nov 04 10:16:12 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-0feb8b63-4563-430e-992f-e3f8ce3aa59c tempest-GroupSnapshotsTest-1028111199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-790e3c38-f282-4486-be49-6f7a65b64119 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:16:12 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-f70e8ac9-9530-4aba-9d9a-a3aa93e8df59 tempest-VolumesActionsTest-1242513407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4e0945e-ff73-46ec-b9df-fad1fd701fc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-903726c8-90a4-4c46-81fd-1cb6a9f9a750', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:16:12 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-f70e8ac9-9530-4aba-9d9a-a3aa93e8df59 tempest-VolumesActionsTest-1242513407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecd64b88-754c-4eb7-84d4-ef0c7c5aa744) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:16:12 devstack sudo[94448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-790e3c38-f282-4486-be49-6f7a65b64119 1073741824 Nov 04 10:16:12 devstack sudo[94448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:16:12 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-f70e8ac9-9530-4aba-9d9a-a3aa93e8df59 tempest-VolumesActionsTest-1242513407 None] Volume volume-903726c8-90a4-4c46-81fd-1cb6a9f9a750 (903726c8-90a4-4c46-81fd-1cb6a9f9a750): created successfully Nov 04 10:16:12 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-f70e8ac9-9530-4aba-9d9a-a3aa93e8df59 tempest-VolumesActionsTest-1242513407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecd64b88-754c-4eb7-84d4-ef0c7c5aa744) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:16:12 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-f70e8ac9-9530-4aba-9d9a-a3aa93e8df59 tempest-VolumesActionsTest-1242513407 None] Flow 'volume_create_manager' (abbaa74b-d5c3-4da6-8236-b8927fb8c93d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:16:12 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-f70e8ac9-9530-4aba-9d9a-a3aa93e8df59 tempest-VolumesActionsTest-1242513407 None] Created volume successfully. Nov 04 10:16:12 devstack sudo[94448]: pam_unix(sudo:session): session closed for user root Nov 04 10:16:12 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-0feb8b63-4563-430e-992f-e3f8ce3aa59c tempest-GroupSnapshotsTest-1028111199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-790e3c38-f282-4486-be49-6f7a65b64119 1073741824" returned: 0 in 0.689s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:16:12 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-0feb8b63-4563-430e-992f-e3f8ce3aa59c tempest-GroupSnapshotsTest-1028111199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-790e3c38-f282-4486-be49-6f7a65b64119 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:16:12 devstack sudo[94463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-790e3c38-f282-4486-be49-6f7a65b64119 Nov 04 10:16:12 devstack sudo[94463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:16:12 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [req-5ec5ba44-a0ff-46f1-b234-e76347a08809 req-eba00d84-6dcd-40be-b939-727dc17de6c3 tempest-AttachVolumeTestJSON-152907179 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:16:13 devstack sudo[94463]: pam_unix(sudo:session): session closed for user root Nov 04 10:16:13 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-0feb8b63-4563-430e-992f-e3f8ce3aa59c tempest-GroupSnapshotsTest-1028111199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-790e3c38-f282-4486-be49-6f7a65b64119" returned: 0 in 0.293s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:16:13 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-0feb8b63-4563-430e-992f-e3f8ce3aa59c tempest-GroupSnapshotsTest-1028111199 None] <== create_volume: return (1030ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 10:16:13 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-0feb8b63-4563-430e-992f-e3f8ce3aa59c tempest-GroupSnapshotsTest-1028111199 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.033s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:16:13 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [req-5ec5ba44-a0ff-46f1-b234-e76347a08809 req-eba00d84-6dcd-40be-b939-727dc17de6c3 tempest-AttachVolumeTestJSON-152907179 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.214s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:16:13 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-0feb8b63-4563-430e-992f-e3f8ce3aa59c tempest-GroupSnapshotsTest-1028111199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (781351b1-d7b8-4155-9e44-f87fe6b511ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-790e3c38-f282-4486-be49-6f7a65b64119', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:16:13 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-0feb8b63-4563-430e-992f-e3f8ce3aa59c tempest-GroupSnapshotsTest-1028111199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ea9ba5d-7773-481b-aa80-28ff65c18eb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:16:13 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [req-5ec5ba44-a0ff-46f1-b234-e76347a08809 req-eba00d84-6dcd-40be-b939-727dc17de6c3 tempest-AttachVolumeTestJSON-152907179 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.035s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:16:13 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-0feb8b63-4563-430e-992f-e3f8ce3aa59c tempest-GroupSnapshotsTest-1028111199 None] Volume volume-790e3c38-f282-4486-be49-6f7a65b64119 (790e3c38-f282-4486-be49-6f7a65b64119): created successfully Nov 04 10:16:13 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-0feb8b63-4563-430e-992f-e3f8ce3aa59c tempest-GroupSnapshotsTest-1028111199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ea9ba5d-7773-481b-aa80-28ff65c18eb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:16:13 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-0feb8b63-4563-430e-992f-e3f8ce3aa59c tempest-GroupSnapshotsTest-1028111199 None] Flow 'volume_create_manager' (b51e4dfe-7df3-4a3d-b2c4-30319403ce34) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:16:13 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-0feb8b63-4563-430e-992f-e3f8ce3aa59c tempest-GroupSnapshotsTest-1028111199 None] Created volume successfully. Nov 04 10:16:13 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-423b354e-37f7-43e8-9bb0-b576bcc188ad tempest-VolumesActionsTest-2097549633 None] Acquiring lock "cinder-903726c8-90a4-4c46-81fd-1cb6a9f9a750-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:16:13 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [req-5ec5ba44-a0ff-46f1-b234-e76347a08809 req-eba00d84-6dcd-40be-b939-727dc17de6c3 tempest-AttachVolumeTestJSON-152907179 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034', 'name': 'volume-796990cb-45e8-4fc4-bb98-6f55b2ccf5a4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5d765e18-bbfe-47c3-bb6f-43e77dab8e1b', 'enforce_multipath': True} {{(pid=87068) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 04 10:16:13 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-423b354e-37f7-43e8-9bb0-b576bcc188ad tempest-VolumesActionsTest-2097549633 None] Lock "cinder-903726c8-90a4-4c46-81fd-1cb6a9f9a750-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:16:13 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-423b354e-37f7-43e8-9bb0-b576bcc188ad tempest-VolumesActionsTest-2097549633 None] Acquiring lock "cinder-quobyte-903726c8-90a4-4c46-81fd-1cb6a9f9a750" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:16:13 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-423b354e-37f7-43e8-9bb0-b576bcc188ad tempest-VolumesActionsTest-2097549633 None] Lock "cinder-quobyte-903726c8-90a4-4c46-81fd-1cb6a9f9a750" acquired by "delete_volume" :: waited 0.019s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:16:13 devstack cinder-volume[87068]: INFO cinder.volume.manager [req-5ec5ba44-a0ff-46f1-b234-e76347a08809 req-eba00d84-6dcd-40be-b939-727dc17de6c3 tempest-AttachVolumeTestJSON-152907179 None] attachment_update completed successfully. Nov 04 10:16:13 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[d23cb343-e85b-4cef-8726-afd37c374c2c]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:16:13 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-423b354e-37f7-43e8-9bb0-b576bcc188ad tempest-VolumesActionsTest-2097549633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-903726c8-90a4-4c46-81fd-1cb6a9f9a750 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:16:13 devstack sudo[94466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-903726c8-90a4-4c46-81fd-1cb6a9f9a750 Nov 04 10:16:13 devstack sudo[94466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:16:13 devstack sudo[94466]: pam_unix(sudo:session): session closed for user root Nov 04 10:16:13 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-423b354e-37f7-43e8-9bb0-b576bcc188ad tempest-VolumesActionsTest-2097549633 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-903726c8-90a4-4c46-81fd-1cb6a9f9a750" returned: 0 in 0.588s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:16:13 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-423b354e-37f7-43e8-9bb0-b576bcc188ad tempest-VolumesActionsTest-2097549633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-903726c8-90a4-4c46-81fd-1cb6a9f9a750 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:16:13 devstack sudo[94474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-903726c8-90a4-4c46-81fd-1cb6a9f9a750 Nov 04 10:16:13 devstack sudo[94474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:16:14 devstack sudo[94474]: pam_unix(sudo:session): session closed for user root Nov 04 10:16:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-423b354e-37f7-43e8-9bb0-b576bcc188ad tempest-VolumesActionsTest-2097549633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-903726c8-90a4-4c46-81fd-1cb6a9f9a750" returned: 0 in 0.367s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:16:14 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-423b354e-37f7-43e8-9bb0-b576bcc188ad tempest-VolumesActionsTest-2097549633 None] Lock "cinder-quobyte-903726c8-90a4-4c46-81fd-1cb6a9f9a750" released by "delete_volume" :: held 1.030s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:16:14 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-423b354e-37f7-43e8-9bb0-b576bcc188ad tempest-VolumesActionsTest-2097549633 None] Created reservations ['d63cce70-2c5c-4788-a568-cfcbd0b82aeb', '160347c6-55ea-4d2b-ac25-84f267a19f8f', 'b4cfef65-1edb-473e-8a55-9531736a7605', 'ff6d3961-7cd9-492b-ab67-e636aa27d2c3'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:16:14 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-120f12f8-cd63-4d4e-ad65-dc2dfe078ea1 tempest-GroupSnapshotsTest-1028111199 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:16:14 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-120f12f8-cd63-4d4e-ad65-dc2dfe078ea1 tempest-GroupSnapshotsTest-1028111199 None] Flow 'volume_create_manager' (c793d784-8623-480b-8b79-35469550804b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:16:14 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-120f12f8-cd63-4d4e-ad65-dc2dfe078ea1 tempest-GroupSnapshotsTest-1028111199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86fa9c98-b14b-4c53-99ba-ec3abee50444) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:16:14 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-120f12f8-cd63-4d4e-ad65-dc2dfe078ea1 tempest-GroupSnapshotsTest-1028111199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86fa9c98-b14b-4c53-99ba-ec3abee50444) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:16:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1516965517',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=59b4de25-d3d3-4e02-9a5d-b1f363e113d6,host='devstack@QuobyteHD#QuobyteHD',id=ebd3f411-ee98-4ddb-8de2-4edc7cc6e559,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b61be80679f440578895f93704afd709',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:16:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:16:14Z,use_quota=True,user_id='709c13bc9e734b63b1ccb2dfaf37dc3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58effc26-215e-4bac-aaf0-9a83236f213f),volume_type_id=58effc26-215e-4bac-aaf0-9a83236f213f)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:16:14 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-120f12f8-cd63-4d4e-ad65-dc2dfe078ea1 tempest-GroupSnapshotsTest-1028111199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bfce363-253d-44f2-803d-ccb973bc9092) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:16:14 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-120f12f8-cd63-4d4e-ad65-dc2dfe078ea1 tempest-GroupSnapshotsTest-1028111199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bfce363-253d-44f2-803d-ccb973bc9092) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:16:14 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-120f12f8-cd63-4d4e-ad65-dc2dfe078ea1 tempest-GroupSnapshotsTest-1028111199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab40c772-5d62-4b07-af1a-481f2664ff23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:16:14 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-120f12f8-cd63-4d4e-ad65-dc2dfe078ea1 tempest-GroupSnapshotsTest-1028111199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab40c772-5d62-4b07-af1a-481f2664ff23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ebd3f411-ee98-4ddb-8de2-4edc7cc6e559', 'volume_name': 'volume-ebd3f411-ee98-4ddb-8de2-4edc7cc6e559', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:16:14 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-120f12f8-cd63-4d4e-ad65-dc2dfe078ea1 tempest-GroupSnapshotsTest-1028111199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (681acd61-2b0d-4c70-8f23-e679d2101ec6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:16:14 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-120f12f8-cd63-4d4e-ad65-dc2dfe078ea1 tempest-GroupSnapshotsTest-1028111199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (681acd61-2b0d-4c70-8f23-e679d2101ec6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:16:14 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-120f12f8-cd63-4d4e-ad65-dc2dfe078ea1 tempest-GroupSnapshotsTest-1028111199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2748849-3e66-4bf3-a432-3b8574a5e475) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:16:14 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-120f12f8-cd63-4d4e-ad65-dc2dfe078ea1 tempest-GroupSnapshotsTest-1028111199 None] Volume ebd3f411-ee98-4ddb-8de2-4edc7cc6e559: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ebd3f411-ee98-4ddb-8de2-4edc7cc6e559', 'volume_size': 1} Nov 04 10:16:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-120f12f8-cd63-4d4e-ad65-dc2dfe078ea1 tempest-GroupSnapshotsTest-1028111199 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:16:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-120f12f8-cd63-4d4e-ad65-dc2dfe078ea1 tempest-GroupSnapshotsTest-1028111199 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:16:14 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-120f12f8-cd63-4d4e-ad65-dc2dfe078ea1 tempest-GroupSnapshotsTest-1028111199 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=59b4de25-d3d3-4e02-9a5d-b1f363e113d6,created_at=2026-11-04T09:16:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1516965517',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=59b4de25-d3d3-4e02-9a5d-b1f363e113d6,host='devstack@QuobyteHD#QuobyteHD',id=ebd3f411-ee98-4ddb-8de2-4edc7cc6e559,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b61be80679f440578895f93704afd709',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:16:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:16:14Z,use_quota=True,user_id='709c13bc9e734b63b1ccb2dfaf37dc3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58effc26-215e-4bac-aaf0-9a83236f213f),volume_type_id=58effc26-215e-4bac-aaf0-9a83236f213f)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 10:16:14 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-120f12f8-cd63-4d4e-ad65-dc2dfe078ea1 tempest-GroupSnapshotsTest-1028111199 None] Creating volume ebd3f411-ee98-4ddb-8de2-4edc7cc6e559 {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:16:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-120f12f8-cd63-4d4e-ad65-dc2dfe078ea1 tempest-GroupSnapshotsTest-1028111199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:16:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-120f12f8-cd63-4d4e-ad65-dc2dfe078ea1 tempest-GroupSnapshotsTest-1028111199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:16:14 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-120f12f8-cd63-4d4e-ad65-dc2dfe078ea1 tempest-GroupSnapshotsTest-1028111199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:16:14 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-120f12f8-cd63-4d4e-ad65-dc2dfe078ea1 tempest-GroupSnapshotsTest-1028111199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:16:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-120f12f8-cd63-4d4e-ad65-dc2dfe078ea1 tempest-GroupSnapshotsTest-1028111199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:16:14 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-120f12f8-cd63-4d4e-ad65-dc2dfe078ea1 tempest-GroupSnapshotsTest-1028111199 None] Selected osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:16:14 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-120f12f8-cd63-4d4e-ad65-dc2dfe078ea1 tempest-GroupSnapshotsTest-1028111199 None] casted to osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 Nov 04 10:16:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-120f12f8-cd63-4d4e-ad65-dc2dfe078ea1 tempest-GroupSnapshotsTest-1028111199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-ebd3f411-ee98-4ddb-8de2-4edc7cc6e559 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:16:14 devstack sudo[94477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-ebd3f411-ee98-4ddb-8de2-4edc7cc6e559 1073741824 Nov 04 10:16:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-423b354e-37f7-43e8-9bb0-b576bcc188ad tempest-VolumesActionsTest-2097549633 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:16:14 devstack sudo[94477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:16:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-423b354e-37f7-43e8-9bb0-b576bcc188ad tempest-VolumesActionsTest-2097549633 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:16:14 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-423b354e-37f7-43e8-9bb0-b576bcc188ad tempest-VolumesActionsTest-2097549633 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:16:14 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-423b354e-37f7-43e8-9bb0-b576bcc188ad tempest-VolumesActionsTest-2097549633 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:16:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-423b354e-37f7-43e8-9bb0-b576bcc188ad tempest-VolumesActionsTest-2097549633 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:16:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-423b354e-37f7-43e8-9bb0-b576bcc188ad tempest-VolumesActionsTest-2097549633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:16:14 devstack sudo[94479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:16:14 devstack sudo[94479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:16:15 devstack sudo[94479]: pam_unix(sudo:session): session closed for user root Nov 04 10:16:15 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-423b354e-37f7-43e8-9bb0-b576bcc188ad tempest-VolumesActionsTest-2097549633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.348s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:16:15 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-423b354e-37f7-43e8-9bb0-b576bcc188ad tempest-VolumesActionsTest-2097549633 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:16:15 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-423b354e-37f7-43e8-9bb0-b576bcc188ad tempest-VolumesActionsTest-2097549633 None] Deleted volume successfully. Nov 04 10:16:15 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-423b354e-37f7-43e8-9bb0-b576bcc188ad tempest-VolumesActionsTest-2097549633 None] Lock "cinder-903726c8-90a4-4c46-81fd-1cb6a9f9a750-delete_volume" released by "delete_volume" :: held 1.838s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:16:15 devstack sudo[94477]: pam_unix(sudo:session): session closed for user root Nov 04 10:16:15 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-120f12f8-cd63-4d4e-ad65-dc2dfe078ea1 tempest-GroupSnapshotsTest-1028111199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-ebd3f411-ee98-4ddb-8de2-4edc7cc6e559 1073741824" returned: 0 in 0.658s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:16:15 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-120f12f8-cd63-4d4e-ad65-dc2dfe078ea1 tempest-GroupSnapshotsTest-1028111199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-ebd3f411-ee98-4ddb-8de2-4edc7cc6e559 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:16:15 devstack sudo[94488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-ebd3f411-ee98-4ddb-8de2-4edc7cc6e559 Nov 04 10:16:15 devstack sudo[94488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:16:15 devstack sudo[94488]: pam_unix(sudo:session): session closed for user root Nov 04 10:16:15 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-120f12f8-cd63-4d4e-ad65-dc2dfe078ea1 tempest-GroupSnapshotsTest-1028111199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-ebd3f411-ee98-4ddb-8de2-4edc7cc6e559" returned: 0 in 0.365s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:16:15 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-120f12f8-cd63-4d4e-ad65-dc2dfe078ea1 tempest-GroupSnapshotsTest-1028111199 None] <== create_volume: return (1162ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 10:16:15 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-120f12f8-cd63-4d4e-ad65-dc2dfe078ea1 tempest-GroupSnapshotsTest-1028111199 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.175s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:16:15 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-120f12f8-cd63-4d4e-ad65-dc2dfe078ea1 tempest-GroupSnapshotsTest-1028111199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2748849-3e66-4bf3-a432-3b8574a5e475) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ebd3f411-ee98-4ddb-8de2-4edc7cc6e559', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:16:15 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-120f12f8-cd63-4d4e-ad65-dc2dfe078ea1 tempest-GroupSnapshotsTest-1028111199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9267ecd2-ba7a-409c-aa54-9a6e89f27dce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:16:15 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-120f12f8-cd63-4d4e-ad65-dc2dfe078ea1 tempest-GroupSnapshotsTest-1028111199 None] Volume volume-ebd3f411-ee98-4ddb-8de2-4edc7cc6e559 (ebd3f411-ee98-4ddb-8de2-4edc7cc6e559): created successfully Nov 04 10:16:15 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-120f12f8-cd63-4d4e-ad65-dc2dfe078ea1 tempest-GroupSnapshotsTest-1028111199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9267ecd2-ba7a-409c-aa54-9a6e89f27dce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:16:15 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-120f12f8-cd63-4d4e-ad65-dc2dfe078ea1 tempest-GroupSnapshotsTest-1028111199 None] Flow 'volume_create_manager' (c793d784-8623-480b-8b79-35469550804b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:16:15 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-120f12f8-cd63-4d4e-ad65-dc2dfe078ea1 tempest-GroupSnapshotsTest-1028111199 None] Created volume successfully. Nov 04 10:16:16 devstack cinder-volume[87068]: INFO cinder.volume.manager [req-633625fd-012f-48d9-825f-4e16f1ac1857 req-b2e47d50-1068-4dc7-9d70-d6b6ec64fe81 tempest-AttachVolumeTestJSON-152907179 None] Terminate volume connection completed successfully. Nov 04 10:16:16 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [req-633625fd-012f-48d9-825f-4e16f1ac1857 req-b2e47d50-1068-4dc7-9d70-d6b6ec64fe81 tempest-AttachVolumeTestJSON-152907179 None] Deleting attachment 66d6da74-9789-4f45-9fe0-6863001ca7f2. {{(pid=87068) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 04 10:16:16 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa6ba094-8dfc-4d5c-a3c6-61a089fbd118 tempest-VolumesActionsTest-1242513407 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:16:16 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-aa6ba094-8dfc-4d5c-a3c6-61a089fbd118 tempest-VolumesActionsTest-1242513407 None] Flow 'volume_create_manager' (7571445a-0de3-4ec2-8eb3-124a101f3ce1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:16:16 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-aa6ba094-8dfc-4d5c-a3c6-61a089fbd118 tempest-VolumesActionsTest-1242513407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e4d117c-c634-4cf1-8349-d83cf124b9f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:16:16 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-aa6ba094-8dfc-4d5c-a3c6-61a089fbd118 tempest-VolumesActionsTest-1242513407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e4d117c-c634-4cf1-8349-d83cf124b9f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:16:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-233522995',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db26a8bb-9d90-4942-8684-54c2f260246f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef09188d1b1d4638b581343b902055a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:16:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:16:16Z,use_quota=True,user_id='fcefba7c587147fa837e6a42a2fc173d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:16:16 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-aa6ba094-8dfc-4d5c-a3c6-61a089fbd118 tempest-VolumesActionsTest-1242513407 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b7c8dcc-c445-45e4-bc84-e91508ca4c6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:16:16 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-aa6ba094-8dfc-4d5c-a3c6-61a089fbd118 tempest-VolumesActionsTest-1242513407 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b7c8dcc-c445-45e4-bc84-e91508ca4c6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:16:16 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-aa6ba094-8dfc-4d5c-a3c6-61a089fbd118 tempest-VolumesActionsTest-1242513407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8d73fbc-2d01-4876-8576-1617868f72c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:16:16 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-aa6ba094-8dfc-4d5c-a3c6-61a089fbd118 tempest-VolumesActionsTest-1242513407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8d73fbc-2d01-4876-8576-1617868f72c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db26a8bb-9d90-4942-8684-54c2f260246f', 'volume_name': 'volume-db26a8bb-9d90-4942-8684-54c2f260246f', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:16:16 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-aa6ba094-8dfc-4d5c-a3c6-61a089fbd118 tempest-VolumesActionsTest-1242513407 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3971f9e7-d05c-4df4-93c5-c3cab77a4f28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:16:16 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-aa6ba094-8dfc-4d5c-a3c6-61a089fbd118 tempest-VolumesActionsTest-1242513407 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3971f9e7-d05c-4df4-93c5-c3cab77a4f28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:16:16 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-aa6ba094-8dfc-4d5c-a3c6-61a089fbd118 tempest-VolumesActionsTest-1242513407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d25a7e07-a7e9-4e0b-94ad-008c48b4d64f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:16:16 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-aa6ba094-8dfc-4d5c-a3c6-61a089fbd118 tempest-VolumesActionsTest-1242513407 None] Volume db26a8bb-9d90-4942-8684-54c2f260246f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db26a8bb-9d90-4942-8684-54c2f260246f', 'volume_size': 1} Nov 04 10:16:16 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-aa6ba094-8dfc-4d5c-a3c6-61a089fbd118 tempest-VolumesActionsTest-1242513407 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:16:16 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-aa6ba094-8dfc-4d5c-a3c6-61a089fbd118 tempest-VolumesActionsTest-1242513407 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:16:16 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-aa6ba094-8dfc-4d5c-a3c6-61a089fbd118 tempest-VolumesActionsTest-1242513407 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:16:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-233522995',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db26a8bb-9d90-4942-8684-54c2f260246f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef09188d1b1d4638b581343b902055a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:16:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:16:16Z,use_quota=True,user_id='fcefba7c587147fa837e6a42a2fc173d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 10:16:16 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-aa6ba094-8dfc-4d5c-a3c6-61a089fbd118 tempest-VolumesActionsTest-1242513407 None] Creating volume db26a8bb-9d90-4942-8684-54c2f260246f {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:16:16 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-aa6ba094-8dfc-4d5c-a3c6-61a089fbd118 tempest-VolumesActionsTest-1242513407 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:16:16 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-aa6ba094-8dfc-4d5c-a3c6-61a089fbd118 tempest-VolumesActionsTest-1242513407 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:16:16 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-aa6ba094-8dfc-4d5c-a3c6-61a089fbd118 tempest-VolumesActionsTest-1242513407 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:16:16 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-aa6ba094-8dfc-4d5c-a3c6-61a089fbd118 tempest-VolumesActionsTest-1242513407 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:16:16 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-aa6ba094-8dfc-4d5c-a3c6-61a089fbd118 tempest-VolumesActionsTest-1242513407 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:16:16 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-aa6ba094-8dfc-4d5c-a3c6-61a089fbd118 tempest-VolumesActionsTest-1242513407 None] Selected osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:16:16 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-aa6ba094-8dfc-4d5c-a3c6-61a089fbd118 tempest-VolumesActionsTest-1242513407 None] casted to osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 Nov 04 10:16:16 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-aa6ba094-8dfc-4d5c-a3c6-61a089fbd118 tempest-VolumesActionsTest-1242513407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-db26a8bb-9d90-4942-8684-54c2f260246f 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:16:16 devstack sudo[94495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-db26a8bb-9d90-4942-8684-54c2f260246f 1073741824 Nov 04 10:16:16 devstack sudo[94495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:16:17 devstack sudo[94495]: pam_unix(sudo:session): session closed for user root Nov 04 10:16:17 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-aa6ba094-8dfc-4d5c-a3c6-61a089fbd118 tempest-VolumesActionsTest-1242513407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-db26a8bb-9d90-4942-8684-54c2f260246f 1073741824" returned: 0 in 0.542s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:16:17 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-aa6ba094-8dfc-4d5c-a3c6-61a089fbd118 tempest-VolumesActionsTest-1242513407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-db26a8bb-9d90-4942-8684-54c2f260246f {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:16:17 devstack sudo[94501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-db26a8bb-9d90-4942-8684-54c2f260246f Nov 04 10:16:17 devstack sudo[94501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:16:17 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-8d043513-c15a-4bc2-b985-0f6c7aef321e tempest-GroupSnapshotsTest-1028111199 None] Update group completed successfully. Nov 04 10:16:17 devstack sudo[94501]: pam_unix(sudo:session): session closed for user root Nov 04 10:16:17 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-aa6ba094-8dfc-4d5c-a3c6-61a089fbd118 tempest-VolumesActionsTest-1242513407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-db26a8bb-9d90-4942-8684-54c2f260246f" returned: 0 in 0.298s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:16:17 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-aa6ba094-8dfc-4d5c-a3c6-61a089fbd118 tempest-VolumesActionsTest-1242513407 None] <== create_volume: return (904ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 10:16:17 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-aa6ba094-8dfc-4d5c-a3c6-61a089fbd118 tempest-VolumesActionsTest-1242513407 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.907s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:16:17 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-aa6ba094-8dfc-4d5c-a3c6-61a089fbd118 tempest-VolumesActionsTest-1242513407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d25a7e07-a7e9-4e0b-94ad-008c48b4d64f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db26a8bb-9d90-4942-8684-54c2f260246f', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:16:17 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-aa6ba094-8dfc-4d5c-a3c6-61a089fbd118 tempest-VolumesActionsTest-1242513407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e26d850-153b-473e-916f-c4ddc3e37bbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:16:17 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-aa6ba094-8dfc-4d5c-a3c6-61a089fbd118 tempest-VolumesActionsTest-1242513407 None] Volume volume-db26a8bb-9d90-4942-8684-54c2f260246f (db26a8bb-9d90-4942-8684-54c2f260246f): created successfully Nov 04 10:16:17 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-aa6ba094-8dfc-4d5c-a3c6-61a089fbd118 tempest-VolumesActionsTest-1242513407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e26d850-153b-473e-916f-c4ddc3e37bbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:16:17 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-aa6ba094-8dfc-4d5c-a3c6-61a089fbd118 tempest-VolumesActionsTest-1242513407 None] Flow 'volume_create_manager' (7571445a-0de3-4ec2-8eb3-124a101f3ce1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:16:17 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-aa6ba094-8dfc-4d5c-a3c6-61a089fbd118 tempest-VolumesActionsTest-1242513407 None] Created volume successfully. Nov 04 10:16:17 devstack cinder-volume[87068]: INFO cinder.volume.manager [req-993ac163-a1d6-4f83-a3ad-0e4e81dc6740 req-661ce584-0099-4021-a379-752a4c0152fe tempest-AttachVolumeTestJSON-152907179 None] Terminate volume connection completed successfully. Nov 04 10:16:17 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [req-993ac163-a1d6-4f83-a3ad-0e4e81dc6740 req-661ce584-0099-4021-a379-752a4c0152fe tempest-AttachVolumeTestJSON-152907179 None] Deleting attachment 5d765e18-bbfe-47c3-bb6f-43e77dab8e1b. {{(pid=87068) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 04 10:16:18 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-15dc1228-4ba8-42b9-8b31-c68a441c7c18 tempest-GroupSnapshotsTest-1028111199 None] Update group completed successfully. Nov 04 10:16:19 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-ab7727bd-bab3-49b6-9f92-1ee1d47439e7 tempest-VolumesActionsTest-1242513407 None] Acquiring lock "cinder-db26a8bb-9d90-4942-8684-54c2f260246f-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:16:19 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-ab7727bd-bab3-49b6-9f92-1ee1d47439e7 tempest-VolumesActionsTest-1242513407 None] Lock "cinder-db26a8bb-9d90-4942-8684-54c2f260246f-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:16:19 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-ab7727bd-bab3-49b6-9f92-1ee1d47439e7 tempest-VolumesActionsTest-1242513407 None] Acquiring lock "cinder-quobyte-db26a8bb-9d90-4942-8684-54c2f260246f" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:16:19 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-ab7727bd-bab3-49b6-9f92-1ee1d47439e7 tempest-VolumesActionsTest-1242513407 None] Lock "cinder-quobyte-db26a8bb-9d90-4942-8684-54c2f260246f" acquired by "delete_volume" :: waited 0.024s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:16:19 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d0b4092-674a-4c0c-aed5-3ff713a58d4a]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:16:19 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ab7727bd-bab3-49b6-9f92-1ee1d47439e7 tempest-VolumesActionsTest-1242513407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-db26a8bb-9d90-4942-8684-54c2f260246f {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:16:19 devstack sudo[94543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-db26a8bb-9d90-4942-8684-54c2f260246f Nov 04 10:16:19 devstack sudo[94543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:16:19 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-69cd40bc-1e1a-425d-8c50-534f304f4e7a tempest-GroupSnapshotsTest-1028111199 None] Update group completed successfully. Nov 04 10:16:19 devstack sudo[94543]: pam_unix(sudo:session): session closed for user root Nov 04 10:16:19 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ab7727bd-bab3-49b6-9f92-1ee1d47439e7 tempest-VolumesActionsTest-1242513407 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-db26a8bb-9d90-4942-8684-54c2f260246f" returned: 0 in 0.571s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:16:19 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ab7727bd-bab3-49b6-9f92-1ee1d47439e7 tempest-VolumesActionsTest-1242513407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-db26a8bb-9d90-4942-8684-54c2f260246f {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:16:20 devstack sudo[94568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-db26a8bb-9d90-4942-8684-54c2f260246f Nov 04 10:16:20 devstack sudo[94568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:16:20 devstack sudo[94568]: pam_unix(sudo:session): session closed for user root Nov 04 10:16:20 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ab7727bd-bab3-49b6-9f92-1ee1d47439e7 tempest-VolumesActionsTest-1242513407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-db26a8bb-9d90-4942-8684-54c2f260246f" returned: 0 in 0.254s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:16:20 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-ab7727bd-bab3-49b6-9f92-1ee1d47439e7 tempest-VolumesActionsTest-1242513407 None] Lock "cinder-quobyte-db26a8bb-9d90-4942-8684-54c2f260246f" released by "delete_volume" :: held 0.883s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:16:20 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-ab7727bd-bab3-49b6-9f92-1ee1d47439e7 tempest-VolumesActionsTest-1242513407 None] Created reservations ['6ea0b2f3-cdff-44b4-b277-34f2c4221ee9', '7c84f5cd-c63b-4ffb-b2b1-70eb24d499c3', '63f9bc9f-9839-48a7-acce-b84789fb2f2a', '8e953687-2cbc-4e53-b420-fde92d10c39d'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:16:20 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-ab7727bd-bab3-49b6-9f92-1ee1d47439e7 tempest-VolumesActionsTest-1242513407 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:16:20 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-ab7727bd-bab3-49b6-9f92-1ee1d47439e7 tempest-VolumesActionsTest-1242513407 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:16:20 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-ab7727bd-bab3-49b6-9f92-1ee1d47439e7 tempest-VolumesActionsTest-1242513407 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:16:20 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-ab7727bd-bab3-49b6-9f92-1ee1d47439e7 tempest-VolumesActionsTest-1242513407 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:16:20 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-ab7727bd-bab3-49b6-9f92-1ee1d47439e7 tempest-VolumesActionsTest-1242513407 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:16:20 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ab7727bd-bab3-49b6-9f92-1ee1d47439e7 tempest-VolumesActionsTest-1242513407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:16:20 devstack sudo[94571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:16:20 devstack sudo[94571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:16:20 devstack sudo[94571]: pam_unix(sudo:session): session closed for user root Nov 04 10:16:20 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ab7727bd-bab3-49b6-9f92-1ee1d47439e7 tempest-VolumesActionsTest-1242513407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.279s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:16:20 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-ab7727bd-bab3-49b6-9f92-1ee1d47439e7 tempest-VolumesActionsTest-1242513407 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:16:20 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-ab7727bd-bab3-49b6-9f92-1ee1d47439e7 tempest-VolumesActionsTest-1242513407 None] Deleted volume successfully. Nov 04 10:16:20 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-ab7727bd-bab3-49b6-9f92-1ee1d47439e7 tempest-VolumesActionsTest-1242513407 None] Lock "cinder-db26a8bb-9d90-4942-8684-54c2f260246f-delete_volume" released by "delete_volume" :: held 1.425s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:16:20 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-674b1f3a-e8a9-4ae5-9431-06782de382dd tempest-GroupSnapshotsTest-1028111199 None] Update group completed successfully. Nov 04 10:16:22 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-675889fc-b9e6-45dc-aab7-2540aaea49ec tempest-GroupSnapshotsTest-1028111199 None] GroupSnapshot b9fceb0f-f888-417c-9d81-0e2f58c2bd1c: creating. Nov 04 10:16:22 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-675889fc-b9e6-45dc-aab7-2540aaea49ec tempest-GroupSnapshotsTest-1028111199 None] Group snapshot b9fceb0f-f888-417c-9d81-0e2f58c2bd1c: creating. {{(pid=87068) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 04 10:16:22 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-675889fc-b9e6-45dc-aab7-2540aaea49ec tempest-GroupSnapshotsTest-1028111199 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:16:22 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-675889fc-b9e6-45dc-aab7-2540aaea49ec tempest-GroupSnapshotsTest-1028111199 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:16:22 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-675889fc-b9e6-45dc-aab7-2540aaea49ec tempest-GroupSnapshotsTest-1028111199 None] Creating offline snapshot 2938585c-c6ee-4d14-8afd-d5892e9a84da of volume ebd3f411-ee98-4ddb-8de2-4edc7cc6e559 {{(pid=87068) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 10:16:22 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[8175defb-4407-49af-ba53-a2aef5d972cd]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:16:22 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-675889fc-b9e6-45dc-aab7-2540aaea49ec tempest-GroupSnapshotsTest-1028111199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-ebd3f411-ee98-4ddb-8de2-4edc7cc6e559 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:16:22 devstack sudo[94580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-ebd3f411-ee98-4ddb-8de2-4edc7cc6e559 Nov 04 10:16:22 devstack sudo[94580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:16:23 devstack sudo[94580]: pam_unix(sudo:session): session closed for user root Nov 04 10:16:23 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-675889fc-b9e6-45dc-aab7-2540aaea49ec tempest-GroupSnapshotsTest-1028111199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-ebd3f411-ee98-4ddb-8de2-4edc7cc6e559" returned: 0 in 0.429s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:16:23 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-675889fc-b9e6-45dc-aab7-2540aaea49ec tempest-GroupSnapshotsTest-1028111199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-ebd3f411-ee98-4ddb-8de2-4edc7cc6e559,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-ebd3f411-ee98-4ddb-8de2-4edc7cc6e559.2938585c-c6ee-4d14-8afd-d5892e9a84da 1G {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:16:23 devstack sudo[94585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-ebd3f411-ee98-4ddb-8de2-4edc7cc6e559,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-ebd3f411-ee98-4ddb-8de2-4edc7cc6e559.2938585c-c6ee-4d14-8afd-d5892e9a84da 1G Nov 04 10:16:23 devstack sudo[94585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:16:23 devstack sudo[94585]: pam_unix(sudo:session): session closed for user root Nov 04 10:16:23 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-675889fc-b9e6-45dc-aab7-2540aaea49ec tempest-GroupSnapshotsTest-1028111199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-ebd3f411-ee98-4ddb-8de2-4edc7cc6e559,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-ebd3f411-ee98-4ddb-8de2-4edc7cc6e559.2938585c-c6ee-4d14-8afd-d5892e9a84da 1G" returned: 0 in 0.514s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:16:23 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-675889fc-b9e6-45dc-aab7-2540aaea49ec tempest-GroupSnapshotsTest-1028111199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ebd3f411-ee98-4ddb-8de2-4edc7cc6e559 -F qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-ebd3f411-ee98-4ddb-8de2-4edc7cc6e559.2938585c-c6ee-4d14-8afd-d5892e9a84da {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:16:23 devstack sudo[94591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ebd3f411-ee98-4ddb-8de2-4edc7cc6e559 -F qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-ebd3f411-ee98-4ddb-8de2-4edc7cc6e559.2938585c-c6ee-4d14-8afd-d5892e9a84da Nov 04 10:16:23 devstack sudo[94591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:16:23 devstack sudo[94591]: pam_unix(sudo:session): session closed for user root Nov 04 10:16:23 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-675889fc-b9e6-45dc-aab7-2540aaea49ec tempest-GroupSnapshotsTest-1028111199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ebd3f411-ee98-4ddb-8de2-4edc7cc6e559 -F qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-ebd3f411-ee98-4ddb-8de2-4edc7cc6e559.2938585c-c6ee-4d14-8afd-d5892e9a84da" returned: 0 in 0.355s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:16:23 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-675889fc-b9e6-45dc-aab7-2540aaea49ec tempest-GroupSnapshotsTest-1028111199 None] /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-ebd3f411-ee98-4ddb-8de2-4edc7cc6e559.2938585c-c6ee-4d14-8afd-d5892e9a84da is being set with open permissions: ugo+rw: NotImplementedError Nov 04 10:16:23 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-675889fc-b9e6-45dc-aab7-2540aaea49ec tempest-GroupSnapshotsTest-1028111199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-ebd3f411-ee98-4ddb-8de2-4edc7cc6e559.2938585c-c6ee-4d14-8afd-d5892e9a84da {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:16:23 devstack sudo[94596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-ebd3f411-ee98-4ddb-8de2-4edc7cc6e559.2938585c-c6ee-4d14-8afd-d5892e9a84da Nov 04 10:16:23 devstack sudo[94596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:16:24 devstack sudo[94596]: pam_unix(sudo:session): session closed for user root Nov 04 10:16:24 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-675889fc-b9e6-45dc-aab7-2540aaea49ec tempest-GroupSnapshotsTest-1028111199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-ebd3f411-ee98-4ddb-8de2-4edc7cc6e559.2938585c-c6ee-4d14-8afd-d5892e9a84da" returned: 0 in 0.272s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:16:24 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-675889fc-b9e6-45dc-aab7-2540aaea49ec tempest-GroupSnapshotsTest-1028111199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-ebd3f411-ee98-4ddb-8de2-4edc7cc6e559.info {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:16:24 devstack sudo[94599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-ebd3f411-ee98-4ddb-8de2-4edc7cc6e559.info Nov 04 10:16:24 devstack sudo[94599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:16:24 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-11e8ddcc-49ee-471a-826d-99ea1e04cce5 tempest-AttachVolumeTestJSON-152907179 None] Acquiring lock "cinder-796990cb-45e8-4fc4-bb98-6f55b2ccf5a4-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:16:24 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-11e8ddcc-49ee-471a-826d-99ea1e04cce5 tempest-AttachVolumeTestJSON-152907179 None] Lock "cinder-796990cb-45e8-4fc4-bb98-6f55b2ccf5a4-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:16:24 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-11e8ddcc-49ee-471a-826d-99ea1e04cce5 tempest-AttachVolumeTestJSON-152907179 None] Acquiring lock "cinder-quobyte-796990cb-45e8-4fc4-bb98-6f55b2ccf5a4" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:16:24 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-11e8ddcc-49ee-471a-826d-99ea1e04cce5 tempest-AttachVolumeTestJSON-152907179 None] Lock "cinder-quobyte-796990cb-45e8-4fc4-bb98-6f55b2ccf5a4" acquired by "delete_volume" :: waited 0.027s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:16:24 devstack sudo[94599]: pam_unix(sudo:session): session closed for user root Nov 04 10:16:24 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-675889fc-b9e6-45dc-aab7-2540aaea49ec tempest-GroupSnapshotsTest-1028111199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-ebd3f411-ee98-4ddb-8de2-4edc7cc6e559.info" returned: 0 in 0.394s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:16:24 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-675889fc-b9e6-45dc-aab7-2540aaea49ec tempest-GroupSnapshotsTest-1028111199 None] /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-ebd3f411-ee98-4ddb-8de2-4edc7cc6e559.info is being set with open permissions: ugo+rw: NotImplementedError Nov 04 10:16:24 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-675889fc-b9e6-45dc-aab7-2540aaea49ec tempest-GroupSnapshotsTest-1028111199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-ebd3f411-ee98-4ddb-8de2-4edc7cc6e559.info {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:16:24 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7f6cdb1-94be-42a5-9f48-c27f26805c43]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:16:24 devstack sudo[94602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-ebd3f411-ee98-4ddb-8de2-4edc7cc6e559.info Nov 04 10:16:24 devstack sudo[94602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:16:24 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-11e8ddcc-49ee-471a-826d-99ea1e04cce5 tempest-AttachVolumeTestJSON-152907179 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-796990cb-45e8-4fc4-bb98-6f55b2ccf5a4 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:16:24 devstack sudo[94604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-796990cb-45e8-4fc4-bb98-6f55b2ccf5a4 Nov 04 10:16:24 devstack sudo[94604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:16:24 devstack sudo[94602]: pam_unix(sudo:session): session closed for user root Nov 04 10:16:24 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-675889fc-b9e6-45dc-aab7-2540aaea49ec tempest-GroupSnapshotsTest-1028111199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-ebd3f411-ee98-4ddb-8de2-4edc7cc6e559.info" returned: 0 in 0.289s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:16:24 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-675889fc-b9e6-45dc-aab7-2540aaea49ec tempest-GroupSnapshotsTest-1028111199 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.369s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:16:24 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-675889fc-b9e6-45dc-aab7-2540aaea49ec tempest-GroupSnapshotsTest-1028111199 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:16:24 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-675889fc-b9e6-45dc-aab7-2540aaea49ec tempest-GroupSnapshotsTest-1028111199 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:16:24 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-675889fc-b9e6-45dc-aab7-2540aaea49ec tempest-GroupSnapshotsTest-1028111199 None] Creating offline snapshot dcc37698-805f-469f-a82f-d3d1a301c6d2 of volume 790e3c38-f282-4486-be49-6f7a65b64119 {{(pid=87068) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 10:16:25 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[94e4098b-e097-4aee-be68-89afb1848a97]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:16:25 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-675889fc-b9e6-45dc-aab7-2540aaea49ec tempest-GroupSnapshotsTest-1028111199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-790e3c38-f282-4486-be49-6f7a65b64119 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:16:25 devstack sudo[94608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-790e3c38-f282-4486-be49-6f7a65b64119 Nov 04 10:16:25 devstack sudo[94608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:16:25 devstack sudo[94604]: pam_unix(sudo:session): session closed for user root Nov 04 10:16:25 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-11e8ddcc-49ee-471a-826d-99ea1e04cce5 tempest-AttachVolumeTestJSON-152907179 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-796990cb-45e8-4fc4-bb98-6f55b2ccf5a4" returned: 0 in 0.456s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:16:25 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-11e8ddcc-49ee-471a-826d-99ea1e04cce5 tempest-AttachVolumeTestJSON-152907179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-796990cb-45e8-4fc4-bb98-6f55b2ccf5a4 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:16:25 devstack sudo[94613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-796990cb-45e8-4fc4-bb98-6f55b2ccf5a4 Nov 04 10:16:25 devstack sudo[94613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:16:25 devstack sudo[94608]: pam_unix(sudo:session): session closed for user root Nov 04 10:16:25 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-675889fc-b9e6-45dc-aab7-2540aaea49ec tempest-GroupSnapshotsTest-1028111199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-790e3c38-f282-4486-be49-6f7a65b64119" returned: 0 in 0.487s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:16:25 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-675889fc-b9e6-45dc-aab7-2540aaea49ec tempest-GroupSnapshotsTest-1028111199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-790e3c38-f282-4486-be49-6f7a65b64119,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-790e3c38-f282-4486-be49-6f7a65b64119.dcc37698-805f-469f-a82f-d3d1a301c6d2 1G {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:16:25 devstack sudo[94613]: pam_unix(sudo:session): session closed for user root Nov 04 10:16:25 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-11e8ddcc-49ee-471a-826d-99ea1e04cce5 tempest-AttachVolumeTestJSON-152907179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-796990cb-45e8-4fc4-bb98-6f55b2ccf5a4" returned: 0 in 0.364s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:16:25 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-11e8ddcc-49ee-471a-826d-99ea1e04cce5 tempest-AttachVolumeTestJSON-152907179 None] Lock "cinder-quobyte-796990cb-45e8-4fc4-bb98-6f55b2ccf5a4" released by "delete_volume" :: held 0.923s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:16:25 devstack sudo[94619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-790e3c38-f282-4486-be49-6f7a65b64119,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-790e3c38-f282-4486-be49-6f7a65b64119.dcc37698-805f-469f-a82f-d3d1a301c6d2 1G Nov 04 10:16:25 devstack sudo[94619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:16:25 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-11e8ddcc-49ee-471a-826d-99ea1e04cce5 tempest-AttachVolumeTestJSON-152907179 None] Created reservations ['efb063c2-1458-4ced-b3f0-13c8a752f655', '939dcece-7d8e-4dc6-8985-a8b14525b0db', 'e894a517-a209-4a59-ab21-6c18d80f21f1', '2ccb4c2a-5fbc-4727-9b8e-33f9c4ce9f73'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:16:25 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-11e8ddcc-49ee-471a-826d-99ea1e04cce5 tempest-AttachVolumeTestJSON-152907179 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:16:25 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-11e8ddcc-49ee-471a-826d-99ea1e04cce5 tempest-AttachVolumeTestJSON-152907179 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:16:25 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-11e8ddcc-49ee-471a-826d-99ea1e04cce5 tempest-AttachVolumeTestJSON-152907179 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:16:25 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-11e8ddcc-49ee-471a-826d-99ea1e04cce5 tempest-AttachVolumeTestJSON-152907179 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:16:25 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-11e8ddcc-49ee-471a-826d-99ea1e04cce5 tempest-AttachVolumeTestJSON-152907179 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:16:25 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-11e8ddcc-49ee-471a-826d-99ea1e04cce5 tempest-AttachVolumeTestJSON-152907179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:16:25 devstack sudo[94622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:16:25 devstack sudo[94622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:16:26 devstack sudo[94622]: pam_unix(sudo:session): session closed for user root Nov 04 10:16:26 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-11e8ddcc-49ee-471a-826d-99ea1e04cce5 tempest-AttachVolumeTestJSON-152907179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.465s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:16:26 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-11e8ddcc-49ee-471a-826d-99ea1e04cce5 tempest-AttachVolumeTestJSON-152907179 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:16:26 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-11e8ddcc-49ee-471a-826d-99ea1e04cce5 tempest-AttachVolumeTestJSON-152907179 None] Deleted volume successfully. Nov 04 10:16:26 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-11e8ddcc-49ee-471a-826d-99ea1e04cce5 tempest-AttachVolumeTestJSON-152907179 None] Lock "cinder-796990cb-45e8-4fc4-bb98-6f55b2ccf5a4-delete_volume" released by "delete_volume" :: held 1.779s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:16:26 devstack sudo[94619]: pam_unix(sudo:session): session closed for user root Nov 04 10:16:26 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-675889fc-b9e6-45dc-aab7-2540aaea49ec tempest-GroupSnapshotsTest-1028111199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-790e3c38-f282-4486-be49-6f7a65b64119,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-790e3c38-f282-4486-be49-6f7a65b64119.dcc37698-805f-469f-a82f-d3d1a301c6d2 1G" returned: 0 in 0.813s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:16:26 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-675889fc-b9e6-45dc-aab7-2540aaea49ec tempest-GroupSnapshotsTest-1028111199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-790e3c38-f282-4486-be49-6f7a65b64119 -F qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-790e3c38-f282-4486-be49-6f7a65b64119.dcc37698-805f-469f-a82f-d3d1a301c6d2 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:16:26 devstack sudo[94629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-790e3c38-f282-4486-be49-6f7a65b64119 -F qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-790e3c38-f282-4486-be49-6f7a65b64119.dcc37698-805f-469f-a82f-d3d1a301c6d2 Nov 04 10:16:26 devstack sudo[94629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:16:26 devstack sudo[94629]: pam_unix(sudo:session): session closed for user root Nov 04 10:16:26 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-675889fc-b9e6-45dc-aab7-2540aaea49ec tempest-GroupSnapshotsTest-1028111199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-790e3c38-f282-4486-be49-6f7a65b64119 -F qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-790e3c38-f282-4486-be49-6f7a65b64119.dcc37698-805f-469f-a82f-d3d1a301c6d2" returned: 0 in 0.372s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:16:26 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-675889fc-b9e6-45dc-aab7-2540aaea49ec tempest-GroupSnapshotsTest-1028111199 None] /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-790e3c38-f282-4486-be49-6f7a65b64119.dcc37698-805f-469f-a82f-d3d1a301c6d2 is being set with open permissions: ugo+rw: NotImplementedError Nov 04 10:16:26 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-675889fc-b9e6-45dc-aab7-2540aaea49ec tempest-GroupSnapshotsTest-1028111199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-790e3c38-f282-4486-be49-6f7a65b64119.dcc37698-805f-469f-a82f-d3d1a301c6d2 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:16:26 devstack sudo[94634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-790e3c38-f282-4486-be49-6f7a65b64119.dcc37698-805f-469f-a82f-d3d1a301c6d2 Nov 04 10:16:26 devstack sudo[94634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:16:27 devstack sudo[94634]: pam_unix(sudo:session): session closed for user root Nov 04 10:16:27 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-675889fc-b9e6-45dc-aab7-2540aaea49ec tempest-GroupSnapshotsTest-1028111199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-790e3c38-f282-4486-be49-6f7a65b64119.dcc37698-805f-469f-a82f-d3d1a301c6d2" returned: 0 in 0.345s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:16:27 devstack cinder-volume[87068]: DEBUG dbcounter [-] [87068] Writing DB stats cinder:SELECT=134,cinder:UPDATE=124,cinder:INSERT=28,cinder:DELETE=12 {{(pid=87068) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 10:16:27 devstack cinder-volume[87068]: DEBUG dbcounter [-] [87068] Writing DB stats cinder:SELECT=141,cinder:UPDATE=148,cinder:INSERT=30,cinder:DELETE=6 {{(pid=87068) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 10:16:27 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-675889fc-b9e6-45dc-aab7-2540aaea49ec tempest-GroupSnapshotsTest-1028111199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-790e3c38-f282-4486-be49-6f7a65b64119.info {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:16:27 devstack sudo[94637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-790e3c38-f282-4486-be49-6f7a65b64119.info Nov 04 10:16:27 devstack sudo[94637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:16:27 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-67b4676b-a608-47cf-a18a-7ab131e64bcb tempest-AttachVolumeTestJSON-152907179 None] Acquiring lock "cinder-3f2e2647-d693-4698-9345-00f275612bbd-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:16:27 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-67b4676b-a608-47cf-a18a-7ab131e64bcb tempest-AttachVolumeTestJSON-152907179 None] Lock "cinder-3f2e2647-d693-4698-9345-00f275612bbd-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:16:27 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-67b4676b-a608-47cf-a18a-7ab131e64bcb tempest-AttachVolumeTestJSON-152907179 None] Acquiring lock "cinder-quobyte-3f2e2647-d693-4698-9345-00f275612bbd" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:16:27 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-67b4676b-a608-47cf-a18a-7ab131e64bcb tempest-AttachVolumeTestJSON-152907179 None] Lock "cinder-quobyte-3f2e2647-d693-4698-9345-00f275612bbd" acquired by "delete_volume" :: waited 0.018s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:16:27 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[6538e642-ccc5-4e02-be17-fe7ee42551f2]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:16:27 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-67b4676b-a608-47cf-a18a-7ab131e64bcb tempest-AttachVolumeTestJSON-152907179 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-3f2e2647-d693-4698-9345-00f275612bbd {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:16:27 devstack sudo[94639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-3f2e2647-d693-4698-9345-00f275612bbd Nov 04 10:16:27 devstack sudo[94639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:16:27 devstack sudo[94637]: pam_unix(sudo:session): session closed for user root Nov 04 10:16:27 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-675889fc-b9e6-45dc-aab7-2540aaea49ec tempest-GroupSnapshotsTest-1028111199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-790e3c38-f282-4486-be49-6f7a65b64119.info" returned: 0 in 0.382s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:16:27 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-675889fc-b9e6-45dc-aab7-2540aaea49ec tempest-GroupSnapshotsTest-1028111199 None] /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-790e3c38-f282-4486-be49-6f7a65b64119.info is being set with open permissions: ugo+rw: NotImplementedError Nov 04 10:16:27 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-675889fc-b9e6-45dc-aab7-2540aaea49ec tempest-GroupSnapshotsTest-1028111199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-790e3c38-f282-4486-be49-6f7a65b64119.info {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:16:27 devstack sudo[94642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-790e3c38-f282-4486-be49-6f7a65b64119.info Nov 04 10:16:27 devstack sudo[94642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:16:27 devstack sudo[94639]: pam_unix(sudo:session): session closed for user root Nov 04 10:16:27 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-67b4676b-a608-47cf-a18a-7ab131e64bcb tempest-AttachVolumeTestJSON-152907179 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-3f2e2647-d693-4698-9345-00f275612bbd" returned: 0 in 0.427s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:16:27 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-67b4676b-a608-47cf-a18a-7ab131e64bcb tempest-AttachVolumeTestJSON-152907179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-3f2e2647-d693-4698-9345-00f275612bbd {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:16:27 devstack sudo[94648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-3f2e2647-d693-4698-9345-00f275612bbd Nov 04 10:16:27 devstack sudo[94648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:16:27 devstack sudo[94642]: pam_unix(sudo:session): session closed for user root Nov 04 10:16:27 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-675889fc-b9e6-45dc-aab7-2540aaea49ec tempest-GroupSnapshotsTest-1028111199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-790e3c38-f282-4486-be49-6f7a65b64119.info" returned: 0 in 0.316s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:16:27 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-675889fc-b9e6-45dc-aab7-2540aaea49ec tempest-GroupSnapshotsTest-1028111199 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.841s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:16:28 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-675889fc-b9e6-45dc-aab7-2540aaea49ec tempest-GroupSnapshotsTest-1028111199 None] group_snapshot b9fceb0f-f888-417c-9d81-0e2f58c2bd1c: created successfully Nov 04 10:16:28 devstack sudo[94648]: pam_unix(sudo:session): session closed for user root Nov 04 10:16:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-67b4676b-a608-47cf-a18a-7ab131e64bcb tempest-AttachVolumeTestJSON-152907179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-3f2e2647-d693-4698-9345-00f275612bbd" returned: 0 in 0.421s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:16:28 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-67b4676b-a608-47cf-a18a-7ab131e64bcb tempest-AttachVolumeTestJSON-152907179 None] Lock "cinder-quobyte-3f2e2647-d693-4698-9345-00f275612bbd" released by "delete_volume" :: held 0.903s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:16:28 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-67b4676b-a608-47cf-a18a-7ab131e64bcb tempest-AttachVolumeTestJSON-152907179 None] Created reservations ['a52ead6e-2a54-42fd-add4-362e928fddcc', '0a1288ff-7d7c-4aa3-99be-483a93fd7a5d', 'a9837639-15aa-4da3-b6e5-1331060bf37b', '716a46a8-37b1-4eea-900e-291ee886142b'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:16:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-67b4676b-a608-47cf-a18a-7ab131e64bcb tempest-AttachVolumeTestJSON-152907179 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:16:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-67b4676b-a608-47cf-a18a-7ab131e64bcb tempest-AttachVolumeTestJSON-152907179 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:16:28 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-67b4676b-a608-47cf-a18a-7ab131e64bcb tempest-AttachVolumeTestJSON-152907179 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:16:28 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-67b4676b-a608-47cf-a18a-7ab131e64bcb tempest-AttachVolumeTestJSON-152907179 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:16:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-67b4676b-a608-47cf-a18a-7ab131e64bcb tempest-AttachVolumeTestJSON-152907179 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:16:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-67b4676b-a608-47cf-a18a-7ab131e64bcb tempest-AttachVolumeTestJSON-152907179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:16:28 devstack sudo[94663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:16:28 devstack sudo[94663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:16:28 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-9f6a2967-264d-4457-ba49-bf62e5316dc4 tempest-AttachVolumeTestJSON-152907179 None] Acquiring lock "cinder-4a09f06d-1aa0-4400-84ed-9c2b7ff8cc68-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:16:28 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-9f6a2967-264d-4457-ba49-bf62e5316dc4 tempest-AttachVolumeTestJSON-152907179 None] Lock "cinder-4a09f06d-1aa0-4400-84ed-9c2b7ff8cc68-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:16:28 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-9f6a2967-264d-4457-ba49-bf62e5316dc4 tempest-AttachVolumeTestJSON-152907179 None] Acquiring lock "cinder-quobyte-4a09f06d-1aa0-4400-84ed-9c2b7ff8cc68" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:16:28 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-9f6a2967-264d-4457-ba49-bf62e5316dc4 tempest-AttachVolumeTestJSON-152907179 None] Lock "cinder-quobyte-4a09f06d-1aa0-4400-84ed-9c2b7ff8cc68" acquired by "delete_volume" :: waited 0.025s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:16:28 devstack sudo[94663]: pam_unix(sudo:session): session closed for user root Nov 04 10:16:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-67b4676b-a608-47cf-a18a-7ab131e64bcb tempest-AttachVolumeTestJSON-152907179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.380s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:16:28 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-67b4676b-a608-47cf-a18a-7ab131e64bcb tempest-AttachVolumeTestJSON-152907179 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:16:28 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-67b4676b-a608-47cf-a18a-7ab131e64bcb tempest-AttachVolumeTestJSON-152907179 None] Deleted volume successfully. Nov 04 10:16:28 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[931071df-3900-4495-9ec8-cb323ebf51c5]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:16:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-9f6a2967-264d-4457-ba49-bf62e5316dc4 tempest-AttachVolumeTestJSON-152907179 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-4a09f06d-1aa0-4400-84ed-9c2b7ff8cc68 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:16:28 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-67b4676b-a608-47cf-a18a-7ab131e64bcb tempest-AttachVolumeTestJSON-152907179 None] Lock "cinder-3f2e2647-d693-4698-9345-00f275612bbd-delete_volume" released by "delete_volume" :: held 1.592s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:16:28 devstack sudo[94666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-4a09f06d-1aa0-4400-84ed-9c2b7ff8cc68 Nov 04 10:16:28 devstack sudo[94666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:16:29 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-1bb66eca-a11c-49cc-afc9-44f1c9b2ca6d tempest-GroupSnapshotsTest-1028111199 None] group_snapshot b9fceb0f-f888-417c-9d81-0e2f58c2bd1c: deleting Nov 04 10:16:29 devstack sudo[94666]: pam_unix(sudo:session): session closed for user root Nov 04 10:16:29 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1bb66eca-a11c-49cc-afc9-44f1c9b2ca6d tempest-GroupSnapshotsTest-1028111199 None] group_snapshot b9fceb0f-f888-417c-9d81-0e2f58c2bd1c: deleting {{(pid=87068) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 04 10:16:29 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-9f6a2967-264d-4457-ba49-bf62e5316dc4 tempest-AttachVolumeTestJSON-152907179 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-4a09f06d-1aa0-4400-84ed-9c2b7ff8cc68" returned: 0 in 0.562s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:16:29 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-9f6a2967-264d-4457-ba49-bf62e5316dc4 tempest-AttachVolumeTestJSON-152907179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-4a09f06d-1aa0-4400-84ed-9c2b7ff8cc68 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:16:29 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-1bb66eca-a11c-49cc-afc9-44f1c9b2ca6d tempest-GroupSnapshotsTest-1028111199 None] Acquiring lock "cinder-quobyte-ebd3f411-ee98-4ddb-8de2-4edc7cc6e559" by "delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:16:29 devstack sudo[94673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-4a09f06d-1aa0-4400-84ed-9c2b7ff8cc68 Nov 04 10:16:29 devstack sudo[94673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:16:29 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-1bb66eca-a11c-49cc-afc9-44f1c9b2ca6d tempest-GroupSnapshotsTest-1028111199 None] Lock "cinder-quobyte-ebd3f411-ee98-4ddb-8de2-4edc7cc6e559" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:16:29 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-1bb66eca-a11c-49cc-afc9-44f1c9b2ca6d tempest-GroupSnapshotsTest-1028111199 None] Acquiring lock "cinder-quobyte-2938585c-c6ee-4d14-8afd-d5892e9a84da" by "_delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:16:29 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-1bb66eca-a11c-49cc-afc9-44f1c9b2ca6d tempest-GroupSnapshotsTest-1028111199 None] Lock "cinder-quobyte-2938585c-c6ee-4d14-8afd-d5892e9a84da" acquired by "_delete_snapshot" :: waited 0.039s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:16:29 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-1bb66eca-a11c-49cc-afc9-44f1c9b2ca6d tempest-GroupSnapshotsTest-1028111199 None] Deleting offline snapshot 2938585c-c6ee-4d14-8afd-d5892e9a84da of volume ebd3f411-ee98-4ddb-8de2-4edc7cc6e559 {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 10:16:29 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-1bb66eca-a11c-49cc-afc9-44f1c9b2ca6d tempest-GroupSnapshotsTest-1028111199 None] snapshot_file for this snap is: volume-ebd3f411-ee98-4ddb-8de2-4edc7cc6e559.2938585c-c6ee-4d14-8afd-d5892e9a84da {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 10:16:29 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[2343a6a3-40da-45e6-af05-795d8be4f60c]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:16:29 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-1bb66eca-a11c-49cc-afc9-44f1c9b2ca6d tempest-GroupSnapshotsTest-1028111199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-ebd3f411-ee98-4ddb-8de2-4edc7cc6e559.2938585c-c6ee-4d14-8afd-d5892e9a84da {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:16:29 devstack sudo[94676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-ebd3f411-ee98-4ddb-8de2-4edc7cc6e559.2938585c-c6ee-4d14-8afd-d5892e9a84da Nov 04 10:16:29 devstack sudo[94676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:16:29 devstack sudo[94673]: pam_unix(sudo:session): session closed for user root Nov 04 10:16:29 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-9f6a2967-264d-4457-ba49-bf62e5316dc4 tempest-AttachVolumeTestJSON-152907179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-4a09f06d-1aa0-4400-84ed-9c2b7ff8cc68" returned: 0 in 0.434s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:16:29 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-9f6a2967-264d-4457-ba49-bf62e5316dc4 tempest-AttachVolumeTestJSON-152907179 None] Lock "cinder-quobyte-4a09f06d-1aa0-4400-84ed-9c2b7ff8cc68" released by "delete_volume" :: held 1.142s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:16:29 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-9f6a2967-264d-4457-ba49-bf62e5316dc4 tempest-AttachVolumeTestJSON-152907179 None] Created reservations ['a16ac1e5-79da-4d5d-8b62-1198679cba65', '93b96882-6b31-4887-86f4-6c14ce001e1f', '483149c8-cce4-43bb-8fcb-2d475a378d1f', '75e85a7c-565f-499e-afb0-cb3d4409e76d'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:16:30 devstack sudo[94676]: pam_unix(sudo:session): session closed for user root Nov 04 10:16:30 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-1bb66eca-a11c-49cc-afc9-44f1c9b2ca6d tempest-GroupSnapshotsTest-1028111199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-ebd3f411-ee98-4ddb-8de2-4edc7cc6e559.2938585c-c6ee-4d14-8afd-d5892e9a84da" returned: 0 in 0.641s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:16:30 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-1bb66eca-a11c-49cc-afc9-44f1c9b2ca6d tempest-GroupSnapshotsTest-1028111199 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ebd3f411-ee98-4ddb-8de2-4edc7cc6e559(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87068) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 10:16:30 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-9f6a2967-264d-4457-ba49-bf62e5316dc4 tempest-AttachVolumeTestJSON-152907179 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:16:30 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-9f6a2967-264d-4457-ba49-bf62e5316dc4 tempest-AttachVolumeTestJSON-152907179 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:16:30 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-9f6a2967-264d-4457-ba49-bf62e5316dc4 tempest-AttachVolumeTestJSON-152907179 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:16:30 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-9f6a2967-264d-4457-ba49-bf62e5316dc4 tempest-AttachVolumeTestJSON-152907179 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:16:30 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-9f6a2967-264d-4457-ba49-bf62e5316dc4 tempest-AttachVolumeTestJSON-152907179 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:16:30 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-9f6a2967-264d-4457-ba49-bf62e5316dc4 tempest-AttachVolumeTestJSON-152907179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:16:30 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c700f5a-9527-4321-b5d3-3a203a86813b]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:16:30 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-1bb66eca-a11c-49cc-afc9-44f1c9b2ca6d tempest-GroupSnapshotsTest-1028111199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-ebd3f411-ee98-4ddb-8de2-4edc7cc6e559 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:16:30 devstack sudo[94700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:16:30 devstack sudo[94700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:16:30 devstack sudo[94702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-ebd3f411-ee98-4ddb-8de2-4edc7cc6e559 Nov 04 10:16:30 devstack sudo[94702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:16:30 devstack sudo[94700]: pam_unix(sudo:session): session closed for user root Nov 04 10:16:30 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-9f6a2967-264d-4457-ba49-bf62e5316dc4 tempest-AttachVolumeTestJSON-152907179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.347s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:16:30 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-9f6a2967-264d-4457-ba49-bf62e5316dc4 tempest-AttachVolumeTestJSON-152907179 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:16:30 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-9f6a2967-264d-4457-ba49-bf62e5316dc4 tempest-AttachVolumeTestJSON-152907179 None] Deleted volume successfully. Nov 04 10:16:30 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-9f6a2967-264d-4457-ba49-bf62e5316dc4 tempest-AttachVolumeTestJSON-152907179 None] Lock "cinder-4a09f06d-1aa0-4400-84ed-9c2b7ff8cc68-delete_volume" released by "delete_volume" :: held 1.976s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:16:30 devstack sudo[94702]: pam_unix(sudo:session): session closed for user root Nov 04 10:16:30 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-1bb66eca-a11c-49cc-afc9-44f1c9b2ca6d tempest-GroupSnapshotsTest-1028111199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-ebd3f411-ee98-4ddb-8de2-4edc7cc6e559" returned: 0 in 0.483s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:16:30 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-1bb66eca-a11c-49cc-afc9-44f1c9b2ca6d tempest-GroupSnapshotsTest-1028111199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-ebd3f411-ee98-4ddb-8de2-4edc7cc6e559.2938585c-c6ee-4d14-8afd-d5892e9a84da {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:16:30 devstack sudo[94713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-ebd3f411-ee98-4ddb-8de2-4edc7cc6e559.2938585c-c6ee-4d14-8afd-d5892e9a84da Nov 04 10:16:30 devstack sudo[94713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:16:31 devstack sudo[94713]: pam_unix(sudo:session): session closed for user root Nov 04 10:16:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-1bb66eca-a11c-49cc-afc9-44f1c9b2ca6d tempest-GroupSnapshotsTest-1028111199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-ebd3f411-ee98-4ddb-8de2-4edc7cc6e559.2938585c-c6ee-4d14-8afd-d5892e9a84da" returned: 0 in 0.493s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:16:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-1bb66eca-a11c-49cc-afc9-44f1c9b2ca6d tempest-GroupSnapshotsTest-1028111199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-ebd3f411-ee98-4ddb-8de2-4edc7cc6e559.2938585c-c6ee-4d14-8afd-d5892e9a84da {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:16:31 devstack sudo[94718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-ebd3f411-ee98-4ddb-8de2-4edc7cc6e559.2938585c-c6ee-4d14-8afd-d5892e9a84da Nov 04 10:16:31 devstack sudo[94718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:16:31 devstack sudo[94718]: pam_unix(sudo:session): session closed for user root Nov 04 10:16:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-1bb66eca-a11c-49cc-afc9-44f1c9b2ca6d tempest-GroupSnapshotsTest-1028111199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-ebd3f411-ee98-4ddb-8de2-4edc7cc6e559.2938585c-c6ee-4d14-8afd-d5892e9a84da" returned: 0 in 0.324s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:16:31 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-1bb66eca-a11c-49cc-afc9-44f1c9b2ca6d tempest-GroupSnapshotsTest-1028111199 None] Lock "cinder-quobyte-2938585c-c6ee-4d14-8afd-d5892e9a84da" released by "_delete_snapshot" :: held 2.142s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:16:31 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-1bb66eca-a11c-49cc-afc9-44f1c9b2ca6d tempest-GroupSnapshotsTest-1028111199 None] Lock "cinder-quobyte-ebd3f411-ee98-4ddb-8de2-4edc7cc6e559" released by "delete_snapshot" :: held 2.193s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:16:31 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-1bb66eca-a11c-49cc-afc9-44f1c9b2ca6d tempest-GroupSnapshotsTest-1028111199 None] Acquiring lock "cinder-quobyte-790e3c38-f282-4486-be49-6f7a65b64119" by "delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:16:31 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-1bb66eca-a11c-49cc-afc9-44f1c9b2ca6d tempest-GroupSnapshotsTest-1028111199 None] Lock "cinder-quobyte-790e3c38-f282-4486-be49-6f7a65b64119" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:16:31 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-1bb66eca-a11c-49cc-afc9-44f1c9b2ca6d tempest-GroupSnapshotsTest-1028111199 None] Acquiring lock "cinder-quobyte-dcc37698-805f-469f-a82f-d3d1a301c6d2" by "_delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:16:31 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-1bb66eca-a11c-49cc-afc9-44f1c9b2ca6d tempest-GroupSnapshotsTest-1028111199 None] Lock "cinder-quobyte-dcc37698-805f-469f-a82f-d3d1a301c6d2" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:16:31 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-1bb66eca-a11c-49cc-afc9-44f1c9b2ca6d tempest-GroupSnapshotsTest-1028111199 None] Deleting offline snapshot dcc37698-805f-469f-a82f-d3d1a301c6d2 of volume 790e3c38-f282-4486-be49-6f7a65b64119 {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 10:16:31 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-1bb66eca-a11c-49cc-afc9-44f1c9b2ca6d tempest-GroupSnapshotsTest-1028111199 None] snapshot_file for this snap is: volume-790e3c38-f282-4486-be49-6f7a65b64119.dcc37698-805f-469f-a82f-d3d1a301c6d2 {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 10:16:31 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9064e20-3c9e-4348-a277-f61a1ad1cc11]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:16:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-1bb66eca-a11c-49cc-afc9-44f1c9b2ca6d tempest-GroupSnapshotsTest-1028111199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-790e3c38-f282-4486-be49-6f7a65b64119.dcc37698-805f-469f-a82f-d3d1a301c6d2 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:16:31 devstack sudo[94723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-790e3c38-f282-4486-be49-6f7a65b64119.dcc37698-805f-469f-a82f-d3d1a301c6d2 Nov 04 10:16:31 devstack sudo[94723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:16:32 devstack cinder-volume[87068]: INFO cinder.volume.manager [req-4d1249cd-e8a7-4dce-913f-24d24cf7e436 req-4318411f-f606-43a9-a470-0f8ebbc7ca54 tempest-ServerActionsTestOtherA-1872812514 None] Terminate volume connection completed successfully. Nov 04 10:16:32 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [req-4d1249cd-e8a7-4dce-913f-24d24cf7e436 req-4318411f-f606-43a9-a470-0f8ebbc7ca54 tempest-ServerActionsTestOtherA-1872812514 None] Deleting attachment e34a013a-3927-4ccc-8f6b-6efe1a8da135. {{(pid=87068) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 04 10:16:32 devstack sudo[94723]: pam_unix(sudo:session): session closed for user root Nov 04 10:16:32 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-1bb66eca-a11c-49cc-afc9-44f1c9b2ca6d tempest-GroupSnapshotsTest-1028111199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-790e3c38-f282-4486-be49-6f7a65b64119.dcc37698-805f-469f-a82f-d3d1a301c6d2" returned: 0 in 0.526s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:16:32 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-1bb66eca-a11c-49cc-afc9-44f1c9b2ca6d tempest-GroupSnapshotsTest-1028111199 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-790e3c38-f282-4486-be49-6f7a65b64119(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87068) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 10:16:32 devstack cinder-volume[87068]: DEBUG cinder.coordination [req-4d1249cd-e8a7-4dce-913f-24d24cf7e436 req-091e5bbc-6760-4bfd-9f26-f692aa6fa686 tempest-ServerActionsTestOtherA-1872812514 None] Acquiring lock "cinder-097433cf-7f53-4f25-8070-c2ac554c6695-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:16:32 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8292b92-9503-4dcb-96bc-a61ffc9b475e]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:16:32 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-1bb66eca-a11c-49cc-afc9-44f1c9b2ca6d tempest-GroupSnapshotsTest-1028111199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-790e3c38-f282-4486-be49-6f7a65b64119 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:16:32 devstack cinder-volume[87068]: DEBUG cinder.coordination [req-4d1249cd-e8a7-4dce-913f-24d24cf7e436 req-091e5bbc-6760-4bfd-9f26-f692aa6fa686 tempest-ServerActionsTestOtherA-1872812514 None] Lock "cinder-097433cf-7f53-4f25-8070-c2ac554c6695-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:16:32 devstack cinder-volume[87068]: DEBUG cinder.coordination [req-4d1249cd-e8a7-4dce-913f-24d24cf7e436 req-091e5bbc-6760-4bfd-9f26-f692aa6fa686 tempest-ServerActionsTestOtherA-1872812514 None] Acquiring lock "cinder-quobyte-097433cf-7f53-4f25-8070-c2ac554c6695" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:16:32 devstack cinder-volume[87068]: DEBUG cinder.coordination [req-4d1249cd-e8a7-4dce-913f-24d24cf7e436 req-091e5bbc-6760-4bfd-9f26-f692aa6fa686 tempest-ServerActionsTestOtherA-1872812514 None] Lock "cinder-quobyte-097433cf-7f53-4f25-8070-c2ac554c6695" acquired by "delete_volume" :: waited 0.038s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:16:32 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[53d8b7d4-2350-43a6-aa3e-9c46a6743e1c]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:16:32 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [req-4d1249cd-e8a7-4dce-913f-24d24cf7e436 req-091e5bbc-6760-4bfd-9f26-f692aa6fa686 tempest-ServerActionsTestOtherA-1872812514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-097433cf-7f53-4f25-8070-c2ac554c6695 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:16:32 devstack sudo[94730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-790e3c38-f282-4486-be49-6f7a65b64119 Nov 04 10:16:32 devstack sudo[94730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:16:32 devstack sudo[94732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-097433cf-7f53-4f25-8070-c2ac554c6695 Nov 04 10:16:32 devstack sudo[94732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:16:32 devstack sudo[94730]: pam_unix(sudo:session): session closed for user root Nov 04 10:16:32 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-1bb66eca-a11c-49cc-afc9-44f1c9b2ca6d tempest-GroupSnapshotsTest-1028111199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-790e3c38-f282-4486-be49-6f7a65b64119" returned: 0 in 0.683s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:16:32 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-1bb66eca-a11c-49cc-afc9-44f1c9b2ca6d tempest-GroupSnapshotsTest-1028111199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-790e3c38-f282-4486-be49-6f7a65b64119.dcc37698-805f-469f-a82f-d3d1a301c6d2 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:16:32 devstack sudo[94739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-790e3c38-f282-4486-be49-6f7a65b64119.dcc37698-805f-469f-a82f-d3d1a301c6d2 Nov 04 10:16:32 devstack sudo[94739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:16:33 devstack sudo[94732]: pam_unix(sudo:session): session closed for user root Nov 04 10:16:33 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [req-4d1249cd-e8a7-4dce-913f-24d24cf7e436 req-091e5bbc-6760-4bfd-9f26-f692aa6fa686 tempest-ServerActionsTestOtherA-1872812514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-097433cf-7f53-4f25-8070-c2ac554c6695" returned: 0 in 0.596s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:16:33 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [req-4d1249cd-e8a7-4dce-913f-24d24cf7e436 req-091e5bbc-6760-4bfd-9f26-f692aa6fa686 tempest-ServerActionsTestOtherA-1872812514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-097433cf-7f53-4f25-8070-c2ac554c6695 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:16:33 devstack sudo[94742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-097433cf-7f53-4f25-8070-c2ac554c6695 Nov 04 10:16:33 devstack sudo[94742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:16:33 devstack sudo[94742]: pam_unix(sudo:session): session closed for user root Nov 04 10:16:33 devstack sudo[94739]: pam_unix(sudo:session): session closed for user root Nov 04 10:16:33 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [req-4d1249cd-e8a7-4dce-913f-24d24cf7e436 req-091e5bbc-6760-4bfd-9f26-f692aa6fa686 tempest-ServerActionsTestOtherA-1872812514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-097433cf-7f53-4f25-8070-c2ac554c6695" returned: 0 in 0.434s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:16:33 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-1bb66eca-a11c-49cc-afc9-44f1c9b2ca6d tempest-GroupSnapshotsTest-1028111199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-790e3c38-f282-4486-be49-6f7a65b64119.dcc37698-805f-469f-a82f-d3d1a301c6d2" returned: 0 in 0.583s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:16:33 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-1bb66eca-a11c-49cc-afc9-44f1c9b2ca6d tempest-GroupSnapshotsTest-1028111199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-790e3c38-f282-4486-be49-6f7a65b64119.dcc37698-805f-469f-a82f-d3d1a301c6d2 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:16:33 devstack cinder-volume[87068]: DEBUG cinder.coordination [req-4d1249cd-e8a7-4dce-913f-24d24cf7e436 req-091e5bbc-6760-4bfd-9f26-f692aa6fa686 tempest-ServerActionsTestOtherA-1872812514 None] Lock "cinder-quobyte-097433cf-7f53-4f25-8070-c2ac554c6695" released by "delete_volume" :: held 1.145s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:16:33 devstack sudo[94749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-790e3c38-f282-4486-be49-6f7a65b64119.dcc37698-805f-469f-a82f-d3d1a301c6d2 Nov 04 10:16:33 devstack sudo[94749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:16:33 devstack cinder-volume[87068]: DEBUG cinder.quota [req-4d1249cd-e8a7-4dce-913f-24d24cf7e436 req-091e5bbc-6760-4bfd-9f26-f692aa6fa686 tempest-ServerActionsTestOtherA-1872812514 None] Created reservations ['040b1f53-5e2e-4db0-b443-7d55ece56d6c', '90002b31-8963-4265-9263-817b2de60c3d', '9117a05a-2b52-41ca-b6c9-bba0841eb2b0', '98f9a0bb-c889-40b6-9f3b-ce03a1550d23'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:16:33 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-4484def0-18da-483a-9a5f-20f6bb3fc4a1 tempest-ServerActionsTestOtherA-1872812514 None] Acquiring lock "cinder-1ff01dc7-7456-48f4-be1c-a362b704062b-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:16:33 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-4484def0-18da-483a-9a5f-20f6bb3fc4a1 tempest-ServerActionsTestOtherA-1872812514 None] Lock "cinder-1ff01dc7-7456-48f4-be1c-a362b704062b-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:16:33 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [req-4d1249cd-e8a7-4dce-913f-24d24cf7e436 req-091e5bbc-6760-4bfd-9f26-f692aa6fa686 tempest-ServerActionsTestOtherA-1872812514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:16:33 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [req-4d1249cd-e8a7-4dce-913f-24d24cf7e436 req-091e5bbc-6760-4bfd-9f26-f692aa6fa686 tempest-ServerActionsTestOtherA-1872812514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:16:33 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [req-4d1249cd-e8a7-4dce-913f-24d24cf7e436 req-091e5bbc-6760-4bfd-9f26-f692aa6fa686 tempest-ServerActionsTestOtherA-1872812514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:16:33 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [req-4d1249cd-e8a7-4dce-913f-24d24cf7e436 req-091e5bbc-6760-4bfd-9f26-f692aa6fa686 tempest-ServerActionsTestOtherA-1872812514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:16:33 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [req-4d1249cd-e8a7-4dce-913f-24d24cf7e436 req-091e5bbc-6760-4bfd-9f26-f692aa6fa686 tempest-ServerActionsTestOtherA-1872812514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:16:33 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [req-4d1249cd-e8a7-4dce-913f-24d24cf7e436 req-091e5bbc-6760-4bfd-9f26-f692aa6fa686 tempest-ServerActionsTestOtherA-1872812514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:16:33 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-4484def0-18da-483a-9a5f-20f6bb3fc4a1 tempest-ServerActionsTestOtherA-1872812514 None] Acquiring lock "cinder-quobyte-1ff01dc7-7456-48f4-be1c-a362b704062b" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:16:33 devstack sudo[94752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:16:33 devstack sudo[94752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:16:33 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-4484def0-18da-483a-9a5f-20f6bb3fc4a1 tempest-ServerActionsTestOtherA-1872812514 None] Lock "cinder-quobyte-1ff01dc7-7456-48f4-be1c-a362b704062b" acquired by "delete_volume" :: waited 0.035s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:16:34 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[042b1d95-f5af-4988-90ad-b28946c9612a]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:16:34 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-4484def0-18da-483a-9a5f-20f6bb3fc4a1 tempest-ServerActionsTestOtherA-1872812514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-1ff01dc7-7456-48f4-be1c-a362b704062b {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:16:34 devstack sudo[94749]: pam_unix(sudo:session): session closed for user root Nov 04 10:16:34 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-1bb66eca-a11c-49cc-afc9-44f1c9b2ca6d tempest-GroupSnapshotsTest-1028111199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-790e3c38-f282-4486-be49-6f7a65b64119.dcc37698-805f-469f-a82f-d3d1a301c6d2" returned: 0 in 0.588s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:16:34 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-1bb66eca-a11c-49cc-afc9-44f1c9b2ca6d tempest-GroupSnapshotsTest-1028111199 None] Lock "cinder-quobyte-dcc37698-805f-469f-a82f-d3d1a301c6d2" released by "_delete_snapshot" :: held 2.572s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:16:34 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-1bb66eca-a11c-49cc-afc9-44f1c9b2ca6d tempest-GroupSnapshotsTest-1028111199 None] Lock "cinder-quobyte-790e3c38-f282-4486-be49-6f7a65b64119" released by "delete_snapshot" :: held 2.604s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:16:34 devstack sudo[94755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-1ff01dc7-7456-48f4-be1c-a362b704062b Nov 04 10:16:34 devstack sudo[94755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:16:34 devstack cinder-volume[87068]: WARNING cinder.quota [None req-1bb66eca-a11c-49cc-afc9-44f1c9b2ca6d tempest-GroupSnapshotsTest-1028111199 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1773150771 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1773150771, it is now deprecated. Please use the default quota class for default quota. Nov 04 10:16:34 devstack cinder-volume[87068]: WARNING cinder.quota [None req-1bb66eca-a11c-49cc-afc9-44f1c9b2ca6d tempest-GroupSnapshotsTest-1028111199 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1773150771 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1773150771, it is now deprecated. Please use the default quota class for default quota. Nov 04 10:16:34 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-1bb66eca-a11c-49cc-afc9-44f1c9b2ca6d tempest-GroupSnapshotsTest-1028111199 None] Created reservations ['93e1464d-003c-4d7b-9afc-fa6d5710c593', 'd35f4717-4186-48d5-b2bc-61e390e3c244', '478666c9-9976-4175-aba0-e2b54d68a33a', '7ac13f64-63da-4760-b227-932a548c635e'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:16:34 devstack sudo[94752]: pam_unix(sudo:session): session closed for user root Nov 04 10:16:34 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [req-4d1249cd-e8a7-4dce-913f-24d24cf7e436 req-091e5bbc-6760-4bfd-9f26-f692aa6fa686 tempest-ServerActionsTestOtherA-1872812514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.490s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:16:34 devstack cinder-volume[87068]: DEBUG cinder.manager [req-4d1249cd-e8a7-4dce-913f-24d24cf7e436 req-091e5bbc-6760-4bfd-9f26-f692aa6fa686 tempest-ServerActionsTestOtherA-1872812514 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:16:34 devstack cinder-volume[87068]: INFO cinder.volume.manager [req-4d1249cd-e8a7-4dce-913f-24d24cf7e436 req-091e5bbc-6760-4bfd-9f26-f692aa6fa686 tempest-ServerActionsTestOtherA-1872812514 None] Deleted volume successfully. Nov 04 10:16:34 devstack cinder-volume[87068]: DEBUG cinder.coordination [req-4d1249cd-e8a7-4dce-913f-24d24cf7e436 req-091e5bbc-6760-4bfd-9f26-f692aa6fa686 tempest-ServerActionsTestOtherA-1872812514 None] Lock "cinder-097433cf-7f53-4f25-8070-c2ac554c6695-delete_volume" released by "delete_volume" :: held 2.103s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:16:34 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-1bb66eca-a11c-49cc-afc9-44f1c9b2ca6d tempest-GroupSnapshotsTest-1028111199 None] Created reservations ['55cee756-8e05-40a5-afc9-c2e3b395706f', '7200b540-8e7c-46ee-a56a-3e66f2dc03e7', 'a0753ccf-43a7-4351-8804-ee483e761d5e', 'a04ad79c-63c1-40b4-beea-9de406776bbd'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:16:34 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-1bb66eca-a11c-49cc-afc9-44f1c9b2ca6d tempest-GroupSnapshotsTest-1028111199 None] group_snapshot b9fceb0f-f888-417c-9d81-0e2f58c2bd1c: deleted successfully Nov 04 10:16:34 devstack sudo[94755]: pam_unix(sudo:session): session closed for user root Nov 04 10:16:34 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-4484def0-18da-483a-9a5f-20f6bb3fc4a1 tempest-ServerActionsTestOtherA-1872812514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-1ff01dc7-7456-48f4-be1c-a362b704062b" returned: 0 in 0.611s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:16:34 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-4484def0-18da-483a-9a5f-20f6bb3fc4a1 tempest-ServerActionsTestOtherA-1872812514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-1ff01dc7-7456-48f4-be1c-a362b704062b {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:16:34 devstack sudo[94762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-1ff01dc7-7456-48f4-be1c-a362b704062b Nov 04 10:16:34 devstack sudo[94762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:16:34 devstack sudo[94762]: pam_unix(sudo:session): session closed for user root Nov 04 10:16:34 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-4484def0-18da-483a-9a5f-20f6bb3fc4a1 tempest-ServerActionsTestOtherA-1872812514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-1ff01dc7-7456-48f4-be1c-a362b704062b" returned: 0 in 0.320s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:16:34 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-4484def0-18da-483a-9a5f-20f6bb3fc4a1 tempest-ServerActionsTestOtherA-1872812514 None] Lock "cinder-quobyte-1ff01dc7-7456-48f4-be1c-a362b704062b" released by "delete_volume" :: held 1.051s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:16:35 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-4484def0-18da-483a-9a5f-20f6bb3fc4a1 tempest-ServerActionsTestOtherA-1872812514 None] Created reservations ['9f052b8e-cfe5-46dc-bd61-5cb50ed4e479', '76a8b022-d543-4aae-ac74-1e4f8193f78b', '93515011-bb94-4a16-9c11-3866b5d06441', '76afba04-136e-4e54-8aaa-290bb0ba91e2'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:16:35 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-4484def0-18da-483a-9a5f-20f6bb3fc4a1 tempest-ServerActionsTestOtherA-1872812514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:16:35 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-4484def0-18da-483a-9a5f-20f6bb3fc4a1 tempest-ServerActionsTestOtherA-1872812514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:16:35 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-4484def0-18da-483a-9a5f-20f6bb3fc4a1 tempest-ServerActionsTestOtherA-1872812514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:16:35 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-4484def0-18da-483a-9a5f-20f6bb3fc4a1 tempest-ServerActionsTestOtherA-1872812514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:16:35 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-4484def0-18da-483a-9a5f-20f6bb3fc4a1 tempest-ServerActionsTestOtherA-1872812514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:16:35 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-4484def0-18da-483a-9a5f-20f6bb3fc4a1 tempest-ServerActionsTestOtherA-1872812514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:16:35 devstack sudo[94766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:16:35 devstack sudo[94766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:16:35 devstack sudo[94766]: pam_unix(sudo:session): session closed for user root Nov 04 10:16:35 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-4484def0-18da-483a-9a5f-20f6bb3fc4a1 tempest-ServerActionsTestOtherA-1872812514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.438s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:16:35 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-4484def0-18da-483a-9a5f-20f6bb3fc4a1 tempest-ServerActionsTestOtherA-1872812514 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:16:35 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-4484def0-18da-483a-9a5f-20f6bb3fc4a1 tempest-ServerActionsTestOtherA-1872812514 None] Deleted volume successfully. Nov 04 10:16:35 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-421fa462-ce4e-4413-bb4a-0e6cfcae73e1 tempest-GroupSnapshotsTest-1028111199 None] Acquiring lock "cinder-quobyte-790e3c38-f282-4486-be49-6f7a65b64119" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:16:35 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-4484def0-18da-483a-9a5f-20f6bb3fc4a1 tempest-ServerActionsTestOtherA-1872812514 None] Lock "cinder-1ff01dc7-7456-48f4-be1c-a362b704062b-delete_volume" released by "delete_volume" :: held 1.975s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:16:35 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-421fa462-ce4e-4413-bb4a-0e6cfcae73e1 tempest-GroupSnapshotsTest-1028111199 None] Lock "cinder-quobyte-790e3c38-f282-4486-be49-6f7a65b64119" acquired by "delete_volume" :: waited 0.035s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:16:35 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[d20cc996-0ee9-469a-8ffa-eec099411f97]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:16:35 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-421fa462-ce4e-4413-bb4a-0e6cfcae73e1 tempest-GroupSnapshotsTest-1028111199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-790e3c38-f282-4486-be49-6f7a65b64119 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:16:35 devstack sudo[94777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-790e3c38-f282-4486-be49-6f7a65b64119 Nov 04 10:16:35 devstack sudo[94777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:16:36 devstack sudo[94777]: pam_unix(sudo:session): session closed for user root Nov 04 10:16:36 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-421fa462-ce4e-4413-bb4a-0e6cfcae73e1 tempest-GroupSnapshotsTest-1028111199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-790e3c38-f282-4486-be49-6f7a65b64119" returned: 0 in 0.650s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:16:36 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-421fa462-ce4e-4413-bb4a-0e6cfcae73e1 tempest-GroupSnapshotsTest-1028111199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-790e3c38-f282-4486-be49-6f7a65b64119 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:16:36 devstack sudo[94818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-790e3c38-f282-4486-be49-6f7a65b64119 Nov 04 10:16:36 devstack sudo[94818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:16:36 devstack sudo[94818]: pam_unix(sudo:session): session closed for user root Nov 04 10:16:36 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-421fa462-ce4e-4413-bb4a-0e6cfcae73e1 tempest-GroupSnapshotsTest-1028111199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-790e3c38-f282-4486-be49-6f7a65b64119" returned: 0 in 0.509s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:16:37 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-421fa462-ce4e-4413-bb4a-0e6cfcae73e1 tempest-GroupSnapshotsTest-1028111199 None] Lock "cinder-quobyte-790e3c38-f282-4486-be49-6f7a65b64119" released by "delete_volume" :: held 1.304s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:16:37 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-421fa462-ce4e-4413-bb4a-0e6cfcae73e1 tempest-GroupSnapshotsTest-1028111199 None] Acquiring lock "cinder-quobyte-ebd3f411-ee98-4ddb-8de2-4edc7cc6e559" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:16:37 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-421fa462-ce4e-4413-bb4a-0e6cfcae73e1 tempest-GroupSnapshotsTest-1028111199 None] Lock "cinder-quobyte-ebd3f411-ee98-4ddb-8de2-4edc7cc6e559" acquired by "delete_volume" :: waited 0.047s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:16:37 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[31377e3b-8312-4414-97a9-215097fe31cc]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:16:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-421fa462-ce4e-4413-bb4a-0e6cfcae73e1 tempest-GroupSnapshotsTest-1028111199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-ebd3f411-ee98-4ddb-8de2-4edc7cc6e559 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:16:37 devstack sudo[94842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-ebd3f411-ee98-4ddb-8de2-4edc7cc6e559 Nov 04 10:16:37 devstack sudo[94842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:16:37 devstack sudo[94842]: pam_unix(sudo:session): session closed for user root Nov 04 10:16:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-421fa462-ce4e-4413-bb4a-0e6cfcae73e1 tempest-GroupSnapshotsTest-1028111199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-ebd3f411-ee98-4ddb-8de2-4edc7cc6e559" returned: 0 in 0.490s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:16:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-421fa462-ce4e-4413-bb4a-0e6cfcae73e1 tempest-GroupSnapshotsTest-1028111199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-ebd3f411-ee98-4ddb-8de2-4edc7cc6e559 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:16:37 devstack sudo[94848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-ebd3f411-ee98-4ddb-8de2-4edc7cc6e559 Nov 04 10:16:37 devstack sudo[94848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:16:38 devstack sudo[94848]: pam_unix(sudo:session): session closed for user root Nov 04 10:16:38 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-421fa462-ce4e-4413-bb4a-0e6cfcae73e1 tempest-GroupSnapshotsTest-1028111199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-ebd3f411-ee98-4ddb-8de2-4edc7cc6e559" returned: 0 in 0.388s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:16:38 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-421fa462-ce4e-4413-bb4a-0e6cfcae73e1 tempest-GroupSnapshotsTest-1028111199 None] Lock "cinder-quobyte-ebd3f411-ee98-4ddb-8de2-4edc7cc6e559" released by "delete_volume" :: held 1.027s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:16:38 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-421fa462-ce4e-4413-bb4a-0e6cfcae73e1 tempest-GroupSnapshotsTest-1028111199 None] Created reservations ['a155bb5e-cde1-4569-adb2-b1ccc796f00f'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:16:38 devstack cinder-volume[87068]: WARNING cinder.quota [None req-421fa462-ce4e-4413-bb4a-0e6cfcae73e1 tempest-GroupSnapshotsTest-1028111199 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1773150771 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1773150771, it is now deprecated. Please use the default quota class for default quota. Nov 04 10:16:38 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-421fa462-ce4e-4413-bb4a-0e6cfcae73e1 tempest-GroupSnapshotsTest-1028111199 None] Created reservations ['44ab2b05-846b-4522-b64c-c0b0be8f12b4', '6a4b2c3f-e446-419a-8720-9fd6a6be8a49', 'a8c5ce4b-2bf7-4e28-a38f-d8387ec1bcec', '0964c1cd-9852-42a7-9b19-cac2f07dd519'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:16:38 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-421fa462-ce4e-4413-bb4a-0e6cfcae73e1 tempest-GroupSnapshotsTest-1028111199 None] Created reservations ['d9aaf469-400b-487b-b478-bb681b996cd0', 'ba6b890d-ef82-4dcb-a17c-cf8e0791149b', 'c7d9fdf2-3d2e-4ff2-bd9d-0f69e3b6920e', '479be923-10a9-434e-91ef-cb6a3d706c6a'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:16:38 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-421fa462-ce4e-4413-bb4a-0e6cfcae73e1 tempest-GroupSnapshotsTest-1028111199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:16:38 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-421fa462-ce4e-4413-bb4a-0e6cfcae73e1 tempest-GroupSnapshotsTest-1028111199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:16:38 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-421fa462-ce4e-4413-bb4a-0e6cfcae73e1 tempest-GroupSnapshotsTest-1028111199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:16:38 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-421fa462-ce4e-4413-bb4a-0e6cfcae73e1 tempest-GroupSnapshotsTest-1028111199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:16:38 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-421fa462-ce4e-4413-bb4a-0e6cfcae73e1 tempest-GroupSnapshotsTest-1028111199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:16:38 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-421fa462-ce4e-4413-bb4a-0e6cfcae73e1 tempest-GroupSnapshotsTest-1028111199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:16:38 devstack sudo[94852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:16:38 devstack sudo[94852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:16:39 devstack sudo[94852]: pam_unix(sudo:session): session closed for user root Nov 04 10:16:39 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-421fa462-ce4e-4413-bb4a-0e6cfcae73e1 tempest-GroupSnapshotsTest-1028111199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.409s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:16:39 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-421fa462-ce4e-4413-bb4a-0e6cfcae73e1 tempest-GroupSnapshotsTest-1028111199 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:16:39 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-421fa462-ce4e-4413-bb4a-0e6cfcae73e1 tempest-GroupSnapshotsTest-1028111199 None] Delete group completed successfully. Nov 04 10:16:40 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-cb2f202c-8752-4174-a73e-a8ee51e39577 tempest-GroupSnapshotsTest-1028111199 None] Group tempest-GroupSnapshotsTest-Group-1954121400: creating Nov 04 10:16:40 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-cb2f202c-8752-4174-a73e-a8ee51e39577 tempest-GroupSnapshotsTest-1028111199 None] Group tempest-GroupSnapshotsTest-Group-1954121400: created successfully Nov 04 10:16:40 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-cb2f202c-8752-4174-a73e-a8ee51e39577 tempest-GroupSnapshotsTest-1028111199 None] Create group completed successfully. Nov 04 10:16:41 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-bfeab389-b283-4b54-8c22-2ef45b56e796 tempest-AbsoluteLimitsTests-506962536 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:16:41 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-bfeab389-b283-4b54-8c22-2ef45b56e796 tempest-AbsoluteLimitsTests-506962536 None] Flow 'volume_create_manager' (3d657158-0919-4a9c-9ce3-b64e91f2946e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:16:41 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-bfeab389-b283-4b54-8c22-2ef45b56e796 tempest-AbsoluteLimitsTests-506962536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c50c061b-91d7-41f3-b727-5500e524e7fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:16:41 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-bfeab389-b283-4b54-8c22-2ef45b56e796 tempest-AbsoluteLimitsTests-506962536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c50c061b-91d7-41f3-b727-5500e524e7fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:16:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-603833870',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e823cd7-cef0-4096-8672-54dd4bcc9d8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='088a13a21955411789613f4ce6b00103',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:16:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:16:41Z,use_quota=True,user_id='0bee3fac72e64e9c9000dcb762a74a7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:16:41 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-bfeab389-b283-4b54-8c22-2ef45b56e796 tempest-AbsoluteLimitsTests-506962536 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d45a669-15fb-49a5-a1d0-953c4df0e695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:16:41 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-bfeab389-b283-4b54-8c22-2ef45b56e796 tempest-AbsoluteLimitsTests-506962536 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d45a669-15fb-49a5-a1d0-953c4df0e695) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:16:41 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-bfeab389-b283-4b54-8c22-2ef45b56e796 tempest-AbsoluteLimitsTests-506962536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (967a9c54-735c-4c10-97da-74a100380dd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:16:41 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-bfeab389-b283-4b54-8c22-2ef45b56e796 tempest-AbsoluteLimitsTests-506962536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (967a9c54-735c-4c10-97da-74a100380dd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e823cd7-cef0-4096-8672-54dd4bcc9d8d', 'volume_name': 'volume-7e823cd7-cef0-4096-8672-54dd4bcc9d8d', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:16:41 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-bfeab389-b283-4b54-8c22-2ef45b56e796 tempest-AbsoluteLimitsTests-506962536 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0031dd97-6105-4142-82d2-8239c74adef0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:16:41 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-bfeab389-b283-4b54-8c22-2ef45b56e796 tempest-AbsoluteLimitsTests-506962536 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0031dd97-6105-4142-82d2-8239c74adef0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:16:41 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-bfeab389-b283-4b54-8c22-2ef45b56e796 tempest-AbsoluteLimitsTests-506962536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (618e37c1-4a71-4d39-bf0d-7a6f7e9eb990) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:16:41 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-bfeab389-b283-4b54-8c22-2ef45b56e796 tempest-AbsoluteLimitsTests-506962536 None] Volume 7e823cd7-cef0-4096-8672-54dd4bcc9d8d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e823cd7-cef0-4096-8672-54dd4bcc9d8d', 'volume_size': 1} Nov 04 10:16:41 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-bfeab389-b283-4b54-8c22-2ef45b56e796 tempest-AbsoluteLimitsTests-506962536 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:16:41 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-bfeab389-b283-4b54-8c22-2ef45b56e796 tempest-AbsoluteLimitsTests-506962536 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:16:41 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-bfeab389-b283-4b54-8c22-2ef45b56e796 tempest-AbsoluteLimitsTests-506962536 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:16:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-603833870',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e823cd7-cef0-4096-8672-54dd4bcc9d8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='088a13a21955411789613f4ce6b00103',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:16:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:16:41Z,use_quota=True,user_id='0bee3fac72e64e9c9000dcb762a74a7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 10:16:41 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-bfeab389-b283-4b54-8c22-2ef45b56e796 tempest-AbsoluteLimitsTests-506962536 None] Creating volume 7e823cd7-cef0-4096-8672-54dd4bcc9d8d {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:16:41 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-bfeab389-b283-4b54-8c22-2ef45b56e796 tempest-AbsoluteLimitsTests-506962536 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:16:41 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-bfeab389-b283-4b54-8c22-2ef45b56e796 tempest-AbsoluteLimitsTests-506962536 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:16:41 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-bfeab389-b283-4b54-8c22-2ef45b56e796 tempest-AbsoluteLimitsTests-506962536 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:16:41 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-bfeab389-b283-4b54-8c22-2ef45b56e796 tempest-AbsoluteLimitsTests-506962536 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:16:41 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-bfeab389-b283-4b54-8c22-2ef45b56e796 tempest-AbsoluteLimitsTests-506962536 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:16:41 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-bfeab389-b283-4b54-8c22-2ef45b56e796 tempest-AbsoluteLimitsTests-506962536 None] Selected osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:16:41 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-bfeab389-b283-4b54-8c22-2ef45b56e796 tempest-AbsoluteLimitsTests-506962536 None] casted to osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 Nov 04 10:16:41 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-bfeab389-b283-4b54-8c22-2ef45b56e796 tempest-AbsoluteLimitsTests-506962536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-7e823cd7-cef0-4096-8672-54dd4bcc9d8d 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:16:41 devstack sudo[94858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-7e823cd7-cef0-4096-8672-54dd4bcc9d8d 1073741824 Nov 04 10:16:41 devstack sudo[94858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:16:42 devstack sudo[94858]: pam_unix(sudo:session): session closed for user root Nov 04 10:16:42 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-bfeab389-b283-4b54-8c22-2ef45b56e796 tempest-AbsoluteLimitsTests-506962536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-7e823cd7-cef0-4096-8672-54dd4bcc9d8d 1073741824" returned: 0 in 0.623s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:16:42 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-bfeab389-b283-4b54-8c22-2ef45b56e796 tempest-AbsoluteLimitsTests-506962536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-7e823cd7-cef0-4096-8672-54dd4bcc9d8d {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:16:42 devstack sudo[94865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-7e823cd7-cef0-4096-8672-54dd4bcc9d8d Nov 04 10:16:42 devstack sudo[94865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:16:42 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-317d5ec2-bc8d-4016-acb3-b16f0cd804b0 tempest-GroupSnapshotsTest-1028111199 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:16:42 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-317d5ec2-bc8d-4016-acb3-b16f0cd804b0 tempest-GroupSnapshotsTest-1028111199 None] Flow 'volume_create_manager' (c7c68b86-122c-4fef-a935-362cc8ec25ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:16:42 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-317d5ec2-bc8d-4016-acb3-b16f0cd804b0 tempest-GroupSnapshotsTest-1028111199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1aaca240-275e-4157-97bc-019b25f9cac2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:16:42 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-317d5ec2-bc8d-4016-acb3-b16f0cd804b0 tempest-GroupSnapshotsTest-1028111199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1aaca240-275e-4157-97bc-019b25f9cac2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:16:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1864223274',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0d705e91-aaff-466c-8720-7854b539a4fa,host='devstack@QuobyteHD#QuobyteHD',id=9c4f14b0-8619-4d1f-a45c-6140264d84d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b61be80679f440578895f93704afd709',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:16:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:16:42Z,use_quota=True,user_id='709c13bc9e734b63b1ccb2dfaf37dc3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b58b3ce9-c608-4acf-948d-6e7ca2663b2c),volume_type_id=b58b3ce9-c608-4acf-948d-6e7ca2663b2c)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:16:42 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-317d5ec2-bc8d-4016-acb3-b16f0cd804b0 tempest-GroupSnapshotsTest-1028111199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea16d4e1-b9a4-4404-80f8-d66ad053c126) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:16:42 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-317d5ec2-bc8d-4016-acb3-b16f0cd804b0 tempest-GroupSnapshotsTest-1028111199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea16d4e1-b9a4-4404-80f8-d66ad053c126) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:16:42 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-317d5ec2-bc8d-4016-acb3-b16f0cd804b0 tempest-GroupSnapshotsTest-1028111199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a716791-ac9e-4a70-89fa-b3fed96c14e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:16:42 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-317d5ec2-bc8d-4016-acb3-b16f0cd804b0 tempest-GroupSnapshotsTest-1028111199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a716791-ac9e-4a70-89fa-b3fed96c14e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c4f14b0-8619-4d1f-a45c-6140264d84d0', 'volume_name': 'volume-9c4f14b0-8619-4d1f-a45c-6140264d84d0', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:16:42 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-317d5ec2-bc8d-4016-acb3-b16f0cd804b0 tempest-GroupSnapshotsTest-1028111199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (745c5dc1-1716-4ce9-9218-5a2723a35c89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:16:42 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-317d5ec2-bc8d-4016-acb3-b16f0cd804b0 tempest-GroupSnapshotsTest-1028111199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (745c5dc1-1716-4ce9-9218-5a2723a35c89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:16:42 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-317d5ec2-bc8d-4016-acb3-b16f0cd804b0 tempest-GroupSnapshotsTest-1028111199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49cf6d31-4fe8-4688-8430-8ed1d38c24c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:16:42 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-317d5ec2-bc8d-4016-acb3-b16f0cd804b0 tempest-GroupSnapshotsTest-1028111199 None] Volume 9c4f14b0-8619-4d1f-a45c-6140264d84d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c4f14b0-8619-4d1f-a45c-6140264d84d0', 'volume_size': 1} Nov 04 10:16:42 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-317d5ec2-bc8d-4016-acb3-b16f0cd804b0 tempest-GroupSnapshotsTest-1028111199 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:16:42 devstack sudo[94865]: pam_unix(sudo:session): session closed for user root Nov 04 10:16:42 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-bfeab389-b283-4b54-8c22-2ef45b56e796 tempest-AbsoluteLimitsTests-506962536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-7e823cd7-cef0-4096-8672-54dd4bcc9d8d" returned: 0 in 0.419s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:16:42 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-bfeab389-b283-4b54-8c22-2ef45b56e796 tempest-AbsoluteLimitsTests-506962536 None] <== create_volume: return (1109ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 10:16:42 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-bfeab389-b283-4b54-8c22-2ef45b56e796 tempest-AbsoluteLimitsTests-506962536 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.111s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:16:42 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-317d5ec2-bc8d-4016-acb3-b16f0cd804b0 tempest-GroupSnapshotsTest-1028111199 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.235s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:16:42 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-317d5ec2-bc8d-4016-acb3-b16f0cd804b0 tempest-GroupSnapshotsTest-1028111199 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=0d705e91-aaff-466c-8720-7854b539a4fa,created_at=2026-11-04T09:16:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1864223274',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0d705e91-aaff-466c-8720-7854b539a4fa,host='devstack@QuobyteHD#QuobyteHD',id=9c4f14b0-8619-4d1f-a45c-6140264d84d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b61be80679f440578895f93704afd709',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:16:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:16:42Z,use_quota=True,user_id='709c13bc9e734b63b1ccb2dfaf37dc3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b58b3ce9-c608-4acf-948d-6e7ca2663b2c),volume_type_id=b58b3ce9-c608-4acf-948d-6e7ca2663b2c)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 10:16:42 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-317d5ec2-bc8d-4016-acb3-b16f0cd804b0 tempest-GroupSnapshotsTest-1028111199 None] Creating volume 9c4f14b0-8619-4d1f-a45c-6140264d84d0 {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:16:42 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-317d5ec2-bc8d-4016-acb3-b16f0cd804b0 tempest-GroupSnapshotsTest-1028111199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:16:42 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-317d5ec2-bc8d-4016-acb3-b16f0cd804b0 tempest-GroupSnapshotsTest-1028111199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:16:42 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-317d5ec2-bc8d-4016-acb3-b16f0cd804b0 tempest-GroupSnapshotsTest-1028111199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:16:42 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-317d5ec2-bc8d-4016-acb3-b16f0cd804b0 tempest-GroupSnapshotsTest-1028111199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:16:42 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-317d5ec2-bc8d-4016-acb3-b16f0cd804b0 tempest-GroupSnapshotsTest-1028111199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:16:42 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-317d5ec2-bc8d-4016-acb3-b16f0cd804b0 tempest-GroupSnapshotsTest-1028111199 None] Selected osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:16:42 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-317d5ec2-bc8d-4016-acb3-b16f0cd804b0 tempest-GroupSnapshotsTest-1028111199 None] casted to osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 Nov 04 10:16:42 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-317d5ec2-bc8d-4016-acb3-b16f0cd804b0 tempest-GroupSnapshotsTest-1028111199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-9c4f14b0-8619-4d1f-a45c-6140264d84d0 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:16:42 devstack sudo[94868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-9c4f14b0-8619-4d1f-a45c-6140264d84d0 1073741824 Nov 04 10:16:42 devstack sudo[94868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:16:42 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-bfeab389-b283-4b54-8c22-2ef45b56e796 tempest-AbsoluteLimitsTests-506962536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (618e37c1-4a71-4d39-bf0d-7a6f7e9eb990) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e823cd7-cef0-4096-8672-54dd4bcc9d8d', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:16:42 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-bfeab389-b283-4b54-8c22-2ef45b56e796 tempest-AbsoluteLimitsTests-506962536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12c57c24-2432-4b79-8808-d7fba3602517) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:16:42 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-bfeab389-b283-4b54-8c22-2ef45b56e796 tempest-AbsoluteLimitsTests-506962536 None] Volume volume-7e823cd7-cef0-4096-8672-54dd4bcc9d8d (7e823cd7-cef0-4096-8672-54dd4bcc9d8d): created successfully Nov 04 10:16:42 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-bfeab389-b283-4b54-8c22-2ef45b56e796 tempest-AbsoluteLimitsTests-506962536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12c57c24-2432-4b79-8808-d7fba3602517) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:16:42 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-bfeab389-b283-4b54-8c22-2ef45b56e796 tempest-AbsoluteLimitsTests-506962536 None] Flow 'volume_create_manager' (3d657158-0919-4a9c-9ce3-b64e91f2946e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:16:42 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-bfeab389-b283-4b54-8c22-2ef45b56e796 tempest-AbsoluteLimitsTests-506962536 None] Created volume successfully. Nov 04 10:16:43 devstack sudo[94868]: pam_unix(sudo:session): session closed for user root Nov 04 10:16:43 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-317d5ec2-bc8d-4016-acb3-b16f0cd804b0 tempest-GroupSnapshotsTest-1028111199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-9c4f14b0-8619-4d1f-a45c-6140264d84d0 1073741824" returned: 0 in 0.535s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:16:43 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-317d5ec2-bc8d-4016-acb3-b16f0cd804b0 tempest-GroupSnapshotsTest-1028111199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-9c4f14b0-8619-4d1f-a45c-6140264d84d0 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:16:43 devstack sudo[94875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-9c4f14b0-8619-4d1f-a45c-6140264d84d0 Nov 04 10:16:43 devstack sudo[94875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:16:43 devstack sudo[94875]: pam_unix(sudo:session): session closed for user root Nov 04 10:16:43 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-317d5ec2-bc8d-4016-acb3-b16f0cd804b0 tempest-GroupSnapshotsTest-1028111199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-9c4f14b0-8619-4d1f-a45c-6140264d84d0" returned: 0 in 0.350s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:16:43 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-317d5ec2-bc8d-4016-acb3-b16f0cd804b0 tempest-GroupSnapshotsTest-1028111199 None] <== create_volume: return (969ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 10:16:43 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-317d5ec2-bc8d-4016-acb3-b16f0cd804b0 tempest-GroupSnapshotsTest-1028111199 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.974s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:16:43 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-317d5ec2-bc8d-4016-acb3-b16f0cd804b0 tempest-GroupSnapshotsTest-1028111199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49cf6d31-4fe8-4688-8430-8ed1d38c24c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c4f14b0-8619-4d1f-a45c-6140264d84d0', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:16:43 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-317d5ec2-bc8d-4016-acb3-b16f0cd804b0 tempest-GroupSnapshotsTest-1028111199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2029f9a-8efb-454d-92f8-396fefa302f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:16:43 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-317d5ec2-bc8d-4016-acb3-b16f0cd804b0 tempest-GroupSnapshotsTest-1028111199 None] Volume volume-9c4f14b0-8619-4d1f-a45c-6140264d84d0 (9c4f14b0-8619-4d1f-a45c-6140264d84d0): created successfully Nov 04 10:16:43 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-317d5ec2-bc8d-4016-acb3-b16f0cd804b0 tempest-GroupSnapshotsTest-1028111199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2029f9a-8efb-454d-92f8-396fefa302f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:16:43 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-317d5ec2-bc8d-4016-acb3-b16f0cd804b0 tempest-GroupSnapshotsTest-1028111199 None] Flow 'volume_create_manager' (c7c68b86-122c-4fef-a935-362cc8ec25ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:16:43 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [req-c9dd179c-92b9-4d20-84e7-a45167bc0c78 req-f1dff510-84f2-4ea2-a1a2-317cd44c3bb9 tempest-VolumesGetTestJSON-319276323 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:16:43 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [req-c9dd179c-92b9-4d20-84e7-a45167bc0c78 req-f1dff510-84f2-4ea2-a1a2-317cd44c3bb9 tempest-VolumesGetTestJSON-319276323 None] Flow 'volume_create_manager' (0e605095-2e7a-46af-b878-2fead7f2ff61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:16:43 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [req-c9dd179c-92b9-4d20-84e7-a45167bc0c78 req-f1dff510-84f2-4ea2-a1a2-317cd44c3bb9 tempest-VolumesGetTestJSON-319276323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3dfa8210-6337-41f6-a170-9ab6089a227c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:16:43 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-317d5ec2-bc8d-4016-acb3-b16f0cd804b0 tempest-GroupSnapshotsTest-1028111199 None] Created volume successfully. Nov 04 10:16:43 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [req-c9dd179c-92b9-4d20-84e7-a45167bc0c78 req-f1dff510-84f2-4ea2-a1a2-317cd44c3bb9 tempest-VolumesGetTestJSON-319276323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3dfa8210-6337-41f6-a170-9ab6089a227c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:16:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-862621742',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48fe4b96-7be0-4ac2-b3d5-251a026ff6d9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='44cb92f71f9b416499275943fda8d6ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:16:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:16:44Z,use_quota=True,user_id='f84ad258e6ef49b8b6ee2c2d1f51853d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:16:43 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [req-c9dd179c-92b9-4d20-84e7-a45167bc0c78 req-f1dff510-84f2-4ea2-a1a2-317cd44c3bb9 tempest-VolumesGetTestJSON-319276323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf946ba8-0c2c-4803-ae20-aac2628b8916) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:16:43 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [req-c9dd179c-92b9-4d20-84e7-a45167bc0c78 req-f1dff510-84f2-4ea2-a1a2-317cd44c3bb9 tempest-VolumesGetTestJSON-319276323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf946ba8-0c2c-4803-ae20-aac2628b8916) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:16:43 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [req-c9dd179c-92b9-4d20-84e7-a45167bc0c78 req-f1dff510-84f2-4ea2-a1a2-317cd44c3bb9 tempest-VolumesGetTestJSON-319276323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1701e39d-1f82-41cb-a6f3-6e8ff699b9fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:16:43 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [req-c9dd179c-92b9-4d20-84e7-a45167bc0c78 req-f1dff510-84f2-4ea2-a1a2-317cd44c3bb9 tempest-VolumesGetTestJSON-319276323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1701e39d-1f82-41cb-a6f3-6e8ff699b9fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48fe4b96-7be0-4ac2-b3d5-251a026ff6d9', 'volume_name': 'volume-48fe4b96-7be0-4ac2-b3d5-251a026ff6d9', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:16:43 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [req-c9dd179c-92b9-4d20-84e7-a45167bc0c78 req-f1dff510-84f2-4ea2-a1a2-317cd44c3bb9 tempest-VolumesGetTestJSON-319276323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b1da8da-db03-49a2-a681-9cefc39034cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:16:43 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [req-c9dd179c-92b9-4d20-84e7-a45167bc0c78 req-f1dff510-84f2-4ea2-a1a2-317cd44c3bb9 tempest-VolumesGetTestJSON-319276323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b1da8da-db03-49a2-a681-9cefc39034cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:16:43 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [req-c9dd179c-92b9-4d20-84e7-a45167bc0c78 req-f1dff510-84f2-4ea2-a1a2-317cd44c3bb9 tempest-VolumesGetTestJSON-319276323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c370577-19ee-4828-97d7-611b1589e8b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:16:43 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [req-c9dd179c-92b9-4d20-84e7-a45167bc0c78 req-f1dff510-84f2-4ea2-a1a2-317cd44c3bb9 tempest-VolumesGetTestJSON-319276323 None] Volume 48fe4b96-7be0-4ac2-b3d5-251a026ff6d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48fe4b96-7be0-4ac2-b3d5-251a026ff6d9', 'volume_size': 1} Nov 04 10:16:43 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [req-c9dd179c-92b9-4d20-84e7-a45167bc0c78 req-f1dff510-84f2-4ea2-a1a2-317cd44c3bb9 tempest-VolumesGetTestJSON-319276323 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:16:43 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [req-c9dd179c-92b9-4d20-84e7-a45167bc0c78 req-f1dff510-84f2-4ea2-a1a2-317cd44c3bb9 tempest-VolumesGetTestJSON-319276323 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:16:43 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [req-c9dd179c-92b9-4d20-84e7-a45167bc0c78 req-f1dff510-84f2-4ea2-a1a2-317cd44c3bb9 tempest-VolumesGetTestJSON-319276323 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:16:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-862621742',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48fe4b96-7be0-4ac2-b3d5-251a026ff6d9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='44cb92f71f9b416499275943fda8d6ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:16:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:16:44Z,use_quota=True,user_id='f84ad258e6ef49b8b6ee2c2d1f51853d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 10:16:43 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [req-c9dd179c-92b9-4d20-84e7-a45167bc0c78 req-f1dff510-84f2-4ea2-a1a2-317cd44c3bb9 tempest-VolumesGetTestJSON-319276323 None] Creating volume 48fe4b96-7be0-4ac2-b3d5-251a026ff6d9 {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:16:43 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [req-c9dd179c-92b9-4d20-84e7-a45167bc0c78 req-f1dff510-84f2-4ea2-a1a2-317cd44c3bb9 tempest-VolumesGetTestJSON-319276323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:16:43 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [req-c9dd179c-92b9-4d20-84e7-a45167bc0c78 req-f1dff510-84f2-4ea2-a1a2-317cd44c3bb9 tempest-VolumesGetTestJSON-319276323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:16:43 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [req-c9dd179c-92b9-4d20-84e7-a45167bc0c78 req-f1dff510-84f2-4ea2-a1a2-317cd44c3bb9 tempest-VolumesGetTestJSON-319276323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:16:43 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [req-c9dd179c-92b9-4d20-84e7-a45167bc0c78 req-f1dff510-84f2-4ea2-a1a2-317cd44c3bb9 tempest-VolumesGetTestJSON-319276323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:16:43 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [req-c9dd179c-92b9-4d20-84e7-a45167bc0c78 req-f1dff510-84f2-4ea2-a1a2-317cd44c3bb9 tempest-VolumesGetTestJSON-319276323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:16:43 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [req-c9dd179c-92b9-4d20-84e7-a45167bc0c78 req-f1dff510-84f2-4ea2-a1a2-317cd44c3bb9 tempest-VolumesGetTestJSON-319276323 None] Selected osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:16:43 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [req-c9dd179c-92b9-4d20-84e7-a45167bc0c78 req-f1dff510-84f2-4ea2-a1a2-317cd44c3bb9 tempest-VolumesGetTestJSON-319276323 None] casted to osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 Nov 04 10:16:43 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [req-c9dd179c-92b9-4d20-84e7-a45167bc0c78 req-f1dff510-84f2-4ea2-a1a2-317cd44c3bb9 tempest-VolumesGetTestJSON-319276323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-48fe4b96-7be0-4ac2-b3d5-251a026ff6d9 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:16:43 devstack sudo[94878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-48fe4b96-7be0-4ac2-b3d5-251a026ff6d9 1073741824 Nov 04 10:16:43 devstack sudo[94878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:16:44 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-26be3d54-0454-480e-9195-235b5472d92a tempest-AbsoluteLimitsTests-506962536 None] Acquiring lock "cinder-7e823cd7-cef0-4096-8672-54dd4bcc9d8d-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:16:44 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-26be3d54-0454-480e-9195-235b5472d92a tempest-AbsoluteLimitsTests-506962536 None] Lock "cinder-7e823cd7-cef0-4096-8672-54dd4bcc9d8d-delete_volume" acquired by "delete_volume" :: waited 0.084s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:16:44 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-26be3d54-0454-480e-9195-235b5472d92a tempest-AbsoluteLimitsTests-506962536 None] Acquiring lock "cinder-quobyte-7e823cd7-cef0-4096-8672-54dd4bcc9d8d" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:16:44 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-26be3d54-0454-480e-9195-235b5472d92a tempest-AbsoluteLimitsTests-506962536 None] Lock "cinder-quobyte-7e823cd7-cef0-4096-8672-54dd4bcc9d8d" acquired by "delete_volume" :: waited 0.019s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:16:44 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[003cfaa7-363d-4a71-97f0-a37c189cbafc]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:16:44 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-26be3d54-0454-480e-9195-235b5472d92a tempest-AbsoluteLimitsTests-506962536 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-7e823cd7-cef0-4096-8672-54dd4bcc9d8d {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:16:44 devstack sudo[94878]: pam_unix(sudo:session): session closed for user root Nov 04 10:16:44 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [req-c9dd179c-92b9-4d20-84e7-a45167bc0c78 req-f1dff510-84f2-4ea2-a1a2-317cd44c3bb9 tempest-VolumesGetTestJSON-319276323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-48fe4b96-7be0-4ac2-b3d5-251a026ff6d9 1073741824" returned: 0 in 0.537s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:16:44 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [req-c9dd179c-92b9-4d20-84e7-a45167bc0c78 req-f1dff510-84f2-4ea2-a1a2-317cd44c3bb9 tempest-VolumesGetTestJSON-319276323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-48fe4b96-7be0-4ac2-b3d5-251a026ff6d9 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:16:44 devstack sudo[94883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-7e823cd7-cef0-4096-8672-54dd4bcc9d8d Nov 04 10:16:44 devstack sudo[94883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:16:44 devstack sudo[94886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-48fe4b96-7be0-4ac2-b3d5-251a026ff6d9 Nov 04 10:16:44 devstack sudo[94886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:16:44 devstack sudo[94883]: pam_unix(sudo:session): session closed for user root Nov 04 10:16:44 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-26be3d54-0454-480e-9195-235b5472d92a tempest-AbsoluteLimitsTests-506962536 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-7e823cd7-cef0-4096-8672-54dd4bcc9d8d" returned: 0 in 0.457s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:16:44 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-26be3d54-0454-480e-9195-235b5472d92a tempest-AbsoluteLimitsTests-506962536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-7e823cd7-cef0-4096-8672-54dd4bcc9d8d {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:16:44 devstack sudo[94886]: pam_unix(sudo:session): session closed for user root Nov 04 10:16:44 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [req-c9dd179c-92b9-4d20-84e7-a45167bc0c78 req-f1dff510-84f2-4ea2-a1a2-317cd44c3bb9 tempest-VolumesGetTestJSON-319276323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-48fe4b96-7be0-4ac2-b3d5-251a026ff6d9" returned: 0 in 0.345s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:16:44 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [req-c9dd179c-92b9-4d20-84e7-a45167bc0c78 req-f1dff510-84f2-4ea2-a1a2-317cd44c3bb9 tempest-VolumesGetTestJSON-319276323 None] <== create_volume: return (932ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 10:16:44 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [req-c9dd179c-92b9-4d20-84e7-a45167bc0c78 req-f1dff510-84f2-4ea2-a1a2-317cd44c3bb9 tempest-VolumesGetTestJSON-319276323 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.935s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:16:44 devstack sudo[94892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-7e823cd7-cef0-4096-8672-54dd4bcc9d8d Nov 04 10:16:44 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [req-c9dd179c-92b9-4d20-84e7-a45167bc0c78 req-f1dff510-84f2-4ea2-a1a2-317cd44c3bb9 tempest-VolumesGetTestJSON-319276323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c370577-19ee-4828-97d7-611b1589e8b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48fe4b96-7be0-4ac2-b3d5-251a026ff6d9', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:16:44 devstack sudo[94892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:16:44 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [req-c9dd179c-92b9-4d20-84e7-a45167bc0c78 req-f1dff510-84f2-4ea2-a1a2-317cd44c3bb9 tempest-VolumesGetTestJSON-319276323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b240ecef-ac30-4503-86c2-a233bd9b8101) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:16:44 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [req-c9dd179c-92b9-4d20-84e7-a45167bc0c78 req-f1dff510-84f2-4ea2-a1a2-317cd44c3bb9 tempest-VolumesGetTestJSON-319276323 None] Volume volume-48fe4b96-7be0-4ac2-b3d5-251a026ff6d9 (48fe4b96-7be0-4ac2-b3d5-251a026ff6d9): created successfully Nov 04 10:16:44 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [req-c9dd179c-92b9-4d20-84e7-a45167bc0c78 req-f1dff510-84f2-4ea2-a1a2-317cd44c3bb9 tempest-VolumesGetTestJSON-319276323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b240ecef-ac30-4503-86c2-a233bd9b8101) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:16:44 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [req-c9dd179c-92b9-4d20-84e7-a45167bc0c78 req-f1dff510-84f2-4ea2-a1a2-317cd44c3bb9 tempest-VolumesGetTestJSON-319276323 None] Flow 'volume_create_manager' (0e605095-2e7a-46af-b878-2fead7f2ff61) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:16:44 devstack cinder-volume[87068]: INFO cinder.volume.manager [req-c9dd179c-92b9-4d20-84e7-a45167bc0c78 req-f1dff510-84f2-4ea2-a1a2-317cd44c3bb9 tempest-VolumesGetTestJSON-319276323 None] Created volume successfully. Nov 04 10:16:44 devstack sudo[94892]: pam_unix(sudo:session): session closed for user root Nov 04 10:16:44 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-26be3d54-0454-480e-9195-235b5472d92a tempest-AbsoluteLimitsTests-506962536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-7e823cd7-cef0-4096-8672-54dd4bcc9d8d" returned: 0 in 0.295s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:16:44 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-26be3d54-0454-480e-9195-235b5472d92a tempest-AbsoluteLimitsTests-506962536 None] Lock "cinder-quobyte-7e823cd7-cef0-4096-8672-54dd4bcc9d8d" released by "delete_volume" :: held 0.812s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:16:44 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-2323c466-9700-494f-a1a5-212fcdf93c1e tempest-GroupSnapshotsTest-1028111199 None] GroupSnapshot 569a5a18-f8c1-4c95-9cce-7e85d90c714b: creating. Nov 04 10:16:45 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-2323c466-9700-494f-a1a5-212fcdf93c1e tempest-GroupSnapshotsTest-1028111199 None] Group snapshot 569a5a18-f8c1-4c95-9cce-7e85d90c714b: creating. {{(pid=87068) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 04 10:16:45 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-2323c466-9700-494f-a1a5-212fcdf93c1e tempest-GroupSnapshotsTest-1028111199 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:16:45 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-2323c466-9700-494f-a1a5-212fcdf93c1e tempest-GroupSnapshotsTest-1028111199 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:16:45 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-2323c466-9700-494f-a1a5-212fcdf93c1e tempest-GroupSnapshotsTest-1028111199 None] Creating offline snapshot a191f8e5-79a2-40cf-b091-e0dc40fe404c of volume 9c4f14b0-8619-4d1f-a45c-6140264d84d0 {{(pid=87068) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 10:16:45 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-26be3d54-0454-480e-9195-235b5472d92a tempest-AbsoluteLimitsTests-506962536 None] Created reservations ['2b41f21f-f97d-4dee-a4f8-608bc82afbbb', 'd5c7c12a-74ff-4af8-85de-3c9906905ebe', 'c2b24642-a1af-4d4b-ab6d-2ffc84c08491', '7a083bc7-8e44-414d-83b6-e32fad2884fe'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:16:45 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[edbf6bf3-a5a1-44fa-aade-0beba1a1028a]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:16:45 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-2323c466-9700-494f-a1a5-212fcdf93c1e tempest-GroupSnapshotsTest-1028111199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-9c4f14b0-8619-4d1f-a45c-6140264d84d0 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:16:45 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-26be3d54-0454-480e-9195-235b5472d92a tempest-AbsoluteLimitsTests-506962536 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:16:45 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-26be3d54-0454-480e-9195-235b5472d92a tempest-AbsoluteLimitsTests-506962536 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:16:45 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-26be3d54-0454-480e-9195-235b5472d92a tempest-AbsoluteLimitsTests-506962536 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:16:45 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-26be3d54-0454-480e-9195-235b5472d92a tempest-AbsoluteLimitsTests-506962536 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:16:45 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-26be3d54-0454-480e-9195-235b5472d92a tempest-AbsoluteLimitsTests-506962536 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:16:45 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-26be3d54-0454-480e-9195-235b5472d92a tempest-AbsoluteLimitsTests-506962536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:16:45 devstack sudo[94896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:16:45 devstack sudo[94896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:16:45 devstack sudo[94895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-9c4f14b0-8619-4d1f-a45c-6140264d84d0 Nov 04 10:16:45 devstack sudo[94895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:16:45 devstack sudo[94896]: pam_unix(sudo:session): session closed for user root Nov 04 10:16:45 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-26be3d54-0454-480e-9195-235b5472d92a tempest-AbsoluteLimitsTests-506962536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.417s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:16:45 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-26be3d54-0454-480e-9195-235b5472d92a tempest-AbsoluteLimitsTests-506962536 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:16:45 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-26be3d54-0454-480e-9195-235b5472d92a tempest-AbsoluteLimitsTests-506962536 None] Deleted volume successfully. Nov 04 10:16:45 devstack sudo[94895]: pam_unix(sudo:session): session closed for user root Nov 04 10:16:45 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-2323c466-9700-494f-a1a5-212fcdf93c1e tempest-GroupSnapshotsTest-1028111199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-9c4f14b0-8619-4d1f-a45c-6140264d84d0" returned: 0 in 0.531s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:16:45 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-2323c466-9700-494f-a1a5-212fcdf93c1e tempest-GroupSnapshotsTest-1028111199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-9c4f14b0-8619-4d1f-a45c-6140264d84d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-9c4f14b0-8619-4d1f-a45c-6140264d84d0.a191f8e5-79a2-40cf-b091-e0dc40fe404c 1G {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:16:45 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-26be3d54-0454-480e-9195-235b5472d92a tempest-AbsoluteLimitsTests-506962536 None] Lock "cinder-7e823cd7-cef0-4096-8672-54dd4bcc9d8d-delete_volume" released by "delete_volume" :: held 1.536s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:16:45 devstack sudo[94903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-9c4f14b0-8619-4d1f-a45c-6140264d84d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-9c4f14b0-8619-4d1f-a45c-6140264d84d0.a191f8e5-79a2-40cf-b091-e0dc40fe404c 1G Nov 04 10:16:45 devstack sudo[94903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:16:46 devstack sudo[94903]: pam_unix(sudo:session): session closed for user root Nov 04 10:16:46 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-2323c466-9700-494f-a1a5-212fcdf93c1e tempest-GroupSnapshotsTest-1028111199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-9c4f14b0-8619-4d1f-a45c-6140264d84d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-9c4f14b0-8619-4d1f-a45c-6140264d84d0.a191f8e5-79a2-40cf-b091-e0dc40fe404c 1G" returned: 0 in 0.538s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:16:46 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-2323c466-9700-494f-a1a5-212fcdf93c1e tempest-GroupSnapshotsTest-1028111199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c4f14b0-8619-4d1f-a45c-6140264d84d0 -F qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-9c4f14b0-8619-4d1f-a45c-6140264d84d0.a191f8e5-79a2-40cf-b091-e0dc40fe404c {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:16:46 devstack sudo[94909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c4f14b0-8619-4d1f-a45c-6140264d84d0 -F qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-9c4f14b0-8619-4d1f-a45c-6140264d84d0.a191f8e5-79a2-40cf-b091-e0dc40fe404c Nov 04 10:16:46 devstack sudo[94909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:16:46 devstack sudo[94909]: pam_unix(sudo:session): session closed for user root Nov 04 10:16:46 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-2323c466-9700-494f-a1a5-212fcdf93c1e tempest-GroupSnapshotsTest-1028111199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c4f14b0-8619-4d1f-a45c-6140264d84d0 -F qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-9c4f14b0-8619-4d1f-a45c-6140264d84d0.a191f8e5-79a2-40cf-b091-e0dc40fe404c" returned: 0 in 0.390s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:16:46 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-2323c466-9700-494f-a1a5-212fcdf93c1e tempest-GroupSnapshotsTest-1028111199 None] /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-9c4f14b0-8619-4d1f-a45c-6140264d84d0.a191f8e5-79a2-40cf-b091-e0dc40fe404c is being set with open permissions: ugo+rw: NotImplementedError Nov 04 10:16:46 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-2323c466-9700-494f-a1a5-212fcdf93c1e tempest-GroupSnapshotsTest-1028111199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-9c4f14b0-8619-4d1f-a45c-6140264d84d0.a191f8e5-79a2-40cf-b091-e0dc40fe404c {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:16:46 devstack sudo[94921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-9c4f14b0-8619-4d1f-a45c-6140264d84d0.a191f8e5-79a2-40cf-b091-e0dc40fe404c Nov 04 10:16:46 devstack sudo[94921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:16:46 devstack cinder-volume[87068]: DEBUG cinder.coordination [req-72acdb01-d33e-49be-b300-ad3e216f7c12 req-440ae5b5-4a98-42b4-89b1-54fe8e209d80 tempest-VolumesGetTestJSON-319276323 None] Acquiring lock "cinder-48fe4b96-7be0-4ac2-b3d5-251a026ff6d9-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:16:46 devstack cinder-volume[87068]: DEBUG cinder.coordination [req-72acdb01-d33e-49be-b300-ad3e216f7c12 req-440ae5b5-4a98-42b4-89b1-54fe8e209d80 tempest-VolumesGetTestJSON-319276323 None] Lock "cinder-48fe4b96-7be0-4ac2-b3d5-251a026ff6d9-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:16:46 devstack cinder-volume[87068]: DEBUG cinder.coordination [req-72acdb01-d33e-49be-b300-ad3e216f7c12 req-440ae5b5-4a98-42b4-89b1-54fe8e209d80 tempest-VolumesGetTestJSON-319276323 None] Acquiring lock "cinder-quobyte-48fe4b96-7be0-4ac2-b3d5-251a026ff6d9" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:16:46 devstack cinder-volume[87068]: DEBUG cinder.coordination [req-72acdb01-d33e-49be-b300-ad3e216f7c12 req-440ae5b5-4a98-42b4-89b1-54fe8e209d80 tempest-VolumesGetTestJSON-319276323 None] Lock "cinder-quobyte-48fe4b96-7be0-4ac2-b3d5-251a026ff6d9" acquired by "delete_volume" :: waited 0.024s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:16:46 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[17f8a701-3a38-4b1b-9e26-c32bd6a852d9]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:16:46 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [req-72acdb01-d33e-49be-b300-ad3e216f7c12 req-440ae5b5-4a98-42b4-89b1-54fe8e209d80 tempest-VolumesGetTestJSON-319276323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-48fe4b96-7be0-4ac2-b3d5-251a026ff6d9 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:16:46 devstack sudo[94921]: pam_unix(sudo:session): session closed for user root Nov 04 10:16:46 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-2323c466-9700-494f-a1a5-212fcdf93c1e tempest-GroupSnapshotsTest-1028111199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-9c4f14b0-8619-4d1f-a45c-6140264d84d0.a191f8e5-79a2-40cf-b091-e0dc40fe404c" returned: 0 in 0.382s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:16:46 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-2323c466-9700-494f-a1a5-212fcdf93c1e tempest-GroupSnapshotsTest-1028111199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-9c4f14b0-8619-4d1f-a45c-6140264d84d0.info {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:16:46 devstack sudo[94923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-48fe4b96-7be0-4ac2-b3d5-251a026ff6d9 Nov 04 10:16:46 devstack sudo[94923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:16:47 devstack sudo[94926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-9c4f14b0-8619-4d1f-a45c-6140264d84d0.info Nov 04 10:16:47 devstack sudo[94926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:16:47 devstack sudo[94926]: pam_unix(sudo:session): session closed for user root Nov 04 10:16:47 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-2323c466-9700-494f-a1a5-212fcdf93c1e tempest-GroupSnapshotsTest-1028111199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-9c4f14b0-8619-4d1f-a45c-6140264d84d0.info" returned: 0 in 0.297s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:16:47 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-2323c466-9700-494f-a1a5-212fcdf93c1e tempest-GroupSnapshotsTest-1028111199 None] /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-9c4f14b0-8619-4d1f-a45c-6140264d84d0.info is being set with open permissions: ugo+rw: NotImplementedError Nov 04 10:16:47 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-2323c466-9700-494f-a1a5-212fcdf93c1e tempest-GroupSnapshotsTest-1028111199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-9c4f14b0-8619-4d1f-a45c-6140264d84d0.info {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:16:47 devstack sudo[94930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-9c4f14b0-8619-4d1f-a45c-6140264d84d0.info Nov 04 10:16:47 devstack sudo[94930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:16:47 devstack sudo[94923]: pam_unix(sudo:session): session closed for user root Nov 04 10:16:47 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [req-72acdb01-d33e-49be-b300-ad3e216f7c12 req-440ae5b5-4a98-42b4-89b1-54fe8e209d80 tempest-VolumesGetTestJSON-319276323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-48fe4b96-7be0-4ac2-b3d5-251a026ff6d9" returned: 0 in 0.636s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:16:47 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [req-72acdb01-d33e-49be-b300-ad3e216f7c12 req-440ae5b5-4a98-42b4-89b1-54fe8e209d80 tempest-VolumesGetTestJSON-319276323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-48fe4b96-7be0-4ac2-b3d5-251a026ff6d9 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:16:47 devstack sudo[94934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-48fe4b96-7be0-4ac2-b3d5-251a026ff6d9 Nov 04 10:16:47 devstack sudo[94934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:16:47 devstack sudo[94930]: pam_unix(sudo:session): session closed for user root Nov 04 10:16:47 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-2323c466-9700-494f-a1a5-212fcdf93c1e tempest-GroupSnapshotsTest-1028111199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-9c4f14b0-8619-4d1f-a45c-6140264d84d0.info" returned: 0 in 0.300s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:16:47 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-2323c466-9700-494f-a1a5-212fcdf93c1e tempest-GroupSnapshotsTest-1028111199 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.553s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:16:47 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-2323c466-9700-494f-a1a5-212fcdf93c1e tempest-GroupSnapshotsTest-1028111199 None] group_snapshot 569a5a18-f8c1-4c95-9cce-7e85d90c714b: created successfully Nov 04 10:16:47 devstack sudo[94934]: pam_unix(sudo:session): session closed for user root Nov 04 10:16:47 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [req-72acdb01-d33e-49be-b300-ad3e216f7c12 req-440ae5b5-4a98-42b4-89b1-54fe8e209d80 tempest-VolumesGetTestJSON-319276323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-48fe4b96-7be0-4ac2-b3d5-251a026ff6d9" returned: 0 in 0.326s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:16:47 devstack cinder-volume[87068]: DEBUG cinder.coordination [req-72acdb01-d33e-49be-b300-ad3e216f7c12 req-440ae5b5-4a98-42b4-89b1-54fe8e209d80 tempest-VolumesGetTestJSON-319276323 None] Lock "cinder-quobyte-48fe4b96-7be0-4ac2-b3d5-251a026ff6d9" released by "delete_volume" :: held 1.025s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:16:47 devstack cinder-volume[87068]: DEBUG cinder.quota [req-72acdb01-d33e-49be-b300-ad3e216f7c12 req-440ae5b5-4a98-42b4-89b1-54fe8e209d80 tempest-VolumesGetTestJSON-319276323 None] Created reservations ['2307db7f-4968-4cad-83be-866d5c0b4a8b', 'e2d1943a-ab1f-4062-baf8-c6ee40509703', '7bfa630d-977e-4232-9ae8-f38707fd21fa', '7c2a6a83-4720-41fa-87ad-f30126563591'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:16:47 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [req-72acdb01-d33e-49be-b300-ad3e216f7c12 req-440ae5b5-4a98-42b4-89b1-54fe8e209d80 tempest-VolumesGetTestJSON-319276323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:16:47 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [req-72acdb01-d33e-49be-b300-ad3e216f7c12 req-440ae5b5-4a98-42b4-89b1-54fe8e209d80 tempest-VolumesGetTestJSON-319276323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:16:47 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [req-72acdb01-d33e-49be-b300-ad3e216f7c12 req-440ae5b5-4a98-42b4-89b1-54fe8e209d80 tempest-VolumesGetTestJSON-319276323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:16:47 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [req-72acdb01-d33e-49be-b300-ad3e216f7c12 req-440ae5b5-4a98-42b4-89b1-54fe8e209d80 tempest-VolumesGetTestJSON-319276323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:16:47 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [req-72acdb01-d33e-49be-b300-ad3e216f7c12 req-440ae5b5-4a98-42b4-89b1-54fe8e209d80 tempest-VolumesGetTestJSON-319276323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:16:47 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [req-72acdb01-d33e-49be-b300-ad3e216f7c12 req-440ae5b5-4a98-42b4-89b1-54fe8e209d80 tempest-VolumesGetTestJSON-319276323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:16:47 devstack sudo[94938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:16:47 devstack sudo[94938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:16:48 devstack sudo[94938]: pam_unix(sudo:session): session closed for user root Nov 04 10:16:48 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [req-72acdb01-d33e-49be-b300-ad3e216f7c12 req-440ae5b5-4a98-42b4-89b1-54fe8e209d80 tempest-VolumesGetTestJSON-319276323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.279s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:16:48 devstack cinder-volume[87068]: DEBUG cinder.manager [req-72acdb01-d33e-49be-b300-ad3e216f7c12 req-440ae5b5-4a98-42b4-89b1-54fe8e209d80 tempest-VolumesGetTestJSON-319276323 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:16:48 devstack cinder-volume[87068]: INFO cinder.volume.manager [req-72acdb01-d33e-49be-b300-ad3e216f7c12 req-440ae5b5-4a98-42b4-89b1-54fe8e209d80 tempest-VolumesGetTestJSON-319276323 None] Deleted volume successfully. Nov 04 10:16:48 devstack cinder-volume[87068]: DEBUG cinder.coordination [req-72acdb01-d33e-49be-b300-ad3e216f7c12 req-440ae5b5-4a98-42b4-89b1-54fe8e209d80 tempest-VolumesGetTestJSON-319276323 None] Lock "cinder-48fe4b96-7be0-4ac2-b3d5-251a026ff6d9-delete_volume" released by "delete_volume" :: held 1.609s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:16:48 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-57351161-a96d-4efe-a4a0-12eda901b112 tempest-GroupSnapshotsTest-1028111199 None] group_snapshot 569a5a18-f8c1-4c95-9cce-7e85d90c714b: deleting Nov 04 10:16:48 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-57351161-a96d-4efe-a4a0-12eda901b112 tempest-GroupSnapshotsTest-1028111199 None] group_snapshot 569a5a18-f8c1-4c95-9cce-7e85d90c714b: deleting {{(pid=87068) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 04 10:16:48 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-57351161-a96d-4efe-a4a0-12eda901b112 tempest-GroupSnapshotsTest-1028111199 None] Acquiring lock "cinder-quobyte-9c4f14b0-8619-4d1f-a45c-6140264d84d0" by "delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:16:48 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-57351161-a96d-4efe-a4a0-12eda901b112 tempest-GroupSnapshotsTest-1028111199 None] Lock "cinder-quobyte-9c4f14b0-8619-4d1f-a45c-6140264d84d0" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:16:48 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-57351161-a96d-4efe-a4a0-12eda901b112 tempest-GroupSnapshotsTest-1028111199 None] Acquiring lock "cinder-quobyte-a191f8e5-79a2-40cf-b091-e0dc40fe404c" by "_delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:16:48 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-57351161-a96d-4efe-a4a0-12eda901b112 tempest-GroupSnapshotsTest-1028111199 None] Lock "cinder-quobyte-a191f8e5-79a2-40cf-b091-e0dc40fe404c" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:16:48 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-57351161-a96d-4efe-a4a0-12eda901b112 tempest-GroupSnapshotsTest-1028111199 None] Deleting offline snapshot a191f8e5-79a2-40cf-b091-e0dc40fe404c of volume 9c4f14b0-8619-4d1f-a45c-6140264d84d0 {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 10:16:48 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-57351161-a96d-4efe-a4a0-12eda901b112 tempest-GroupSnapshotsTest-1028111199 None] snapshot_file for this snap is: volume-9c4f14b0-8619-4d1f-a45c-6140264d84d0.a191f8e5-79a2-40cf-b091-e0dc40fe404c {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 10:16:48 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8b6edd5-b56c-4ce3-b375-5c73e380d917]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:16:48 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-57351161-a96d-4efe-a4a0-12eda901b112 tempest-GroupSnapshotsTest-1028111199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-9c4f14b0-8619-4d1f-a45c-6140264d84d0.a191f8e5-79a2-40cf-b091-e0dc40fe404c {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:16:48 devstack sudo[94941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-9c4f14b0-8619-4d1f-a45c-6140264d84d0.a191f8e5-79a2-40cf-b091-e0dc40fe404c Nov 04 10:16:48 devstack sudo[94941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:16:49 devstack sudo[94941]: pam_unix(sudo:session): session closed for user root Nov 04 10:16:49 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-57351161-a96d-4efe-a4a0-12eda901b112 tempest-GroupSnapshotsTest-1028111199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-9c4f14b0-8619-4d1f-a45c-6140264d84d0.a191f8e5-79a2-40cf-b091-e0dc40fe404c" returned: 0 in 0.590s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:16:49 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-57351161-a96d-4efe-a4a0-12eda901b112 tempest-GroupSnapshotsTest-1028111199 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9c4f14b0-8619-4d1f-a45c-6140264d84d0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87068) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 10:16:49 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[0199b8e8-60ee-405f-b854-78d35b5e0d4a]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:16:49 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-57351161-a96d-4efe-a4a0-12eda901b112 tempest-GroupSnapshotsTest-1028111199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-9c4f14b0-8619-4d1f-a45c-6140264d84d0 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:16:49 devstack sudo[94948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-9c4f14b0-8619-4d1f-a45c-6140264d84d0 Nov 04 10:16:49 devstack sudo[94948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:16:49 devstack sudo[94948]: pam_unix(sudo:session): session closed for user root Nov 04 10:16:49 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-57351161-a96d-4efe-a4a0-12eda901b112 tempest-GroupSnapshotsTest-1028111199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-9c4f14b0-8619-4d1f-a45c-6140264d84d0" returned: 0 in 0.404s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:16:49 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-57351161-a96d-4efe-a4a0-12eda901b112 tempest-GroupSnapshotsTest-1028111199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-9c4f14b0-8619-4d1f-a45c-6140264d84d0.a191f8e5-79a2-40cf-b091-e0dc40fe404c {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:16:49 devstack sudo[94953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-9c4f14b0-8619-4d1f-a45c-6140264d84d0.a191f8e5-79a2-40cf-b091-e0dc40fe404c Nov 04 10:16:49 devstack sudo[94953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:16:50 devstack sudo[94953]: pam_unix(sudo:session): session closed for user root Nov 04 10:16:50 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-57351161-a96d-4efe-a4a0-12eda901b112 tempest-GroupSnapshotsTest-1028111199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-9c4f14b0-8619-4d1f-a45c-6140264d84d0.a191f8e5-79a2-40cf-b091-e0dc40fe404c" returned: 0 in 0.517s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:16:50 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-57351161-a96d-4efe-a4a0-12eda901b112 tempest-GroupSnapshotsTest-1028111199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-9c4f14b0-8619-4d1f-a45c-6140264d84d0.a191f8e5-79a2-40cf-b091-e0dc40fe404c {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:16:50 devstack sudo[94958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-9c4f14b0-8619-4d1f-a45c-6140264d84d0.a191f8e5-79a2-40cf-b091-e0dc40fe404c Nov 04 10:16:50 devstack sudo[94958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:16:50 devstack sudo[94958]: pam_unix(sudo:session): session closed for user root Nov 04 10:16:50 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-57351161-a96d-4efe-a4a0-12eda901b112 tempest-GroupSnapshotsTest-1028111199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-9c4f14b0-8619-4d1f-a45c-6140264d84d0.a191f8e5-79a2-40cf-b091-e0dc40fe404c" returned: 0 in 0.320s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:16:50 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-57351161-a96d-4efe-a4a0-12eda901b112 tempest-GroupSnapshotsTest-1028111199 None] Lock "cinder-quobyte-a191f8e5-79a2-40cf-b091-e0dc40fe404c" released by "_delete_snapshot" :: held 2.012s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:16:50 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-57351161-a96d-4efe-a4a0-12eda901b112 tempest-GroupSnapshotsTest-1028111199 None] Lock "cinder-quobyte-9c4f14b0-8619-4d1f-a45c-6140264d84d0" released by "delete_snapshot" :: held 2.050s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:16:50 devstack cinder-volume[87068]: WARNING cinder.quota [None req-57351161-a96d-4efe-a4a0-12eda901b112 tempest-GroupSnapshotsTest-1028111199 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-620534455 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-620534455, it is now deprecated. Please use the default quota class for default quota. Nov 04 10:16:50 devstack cinder-volume[87068]: WARNING cinder.quota [None req-57351161-a96d-4efe-a4a0-12eda901b112 tempest-GroupSnapshotsTest-1028111199 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-620534455 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-620534455, it is now deprecated. Please use the default quota class for default quota. Nov 04 10:16:50 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-57351161-a96d-4efe-a4a0-12eda901b112 tempest-GroupSnapshotsTest-1028111199 None] Created reservations ['5fb6b940-0b20-4f99-aaf9-6bcb95a71fcf', 'd24f48e2-96f4-49d8-8959-d6395842de4d', '646d9082-6dbd-4864-ad2c-ff8e6038f177', '8e2c0799-db52-412a-a19c-9033c7ec66c9'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:16:50 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-57351161-a96d-4efe-a4a0-12eda901b112 tempest-GroupSnapshotsTest-1028111199 None] group_snapshot 569a5a18-f8c1-4c95-9cce-7e85d90c714b: deleted successfully Nov 04 10:16:51 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-3908faa5-f5fe-4702-bf8c-4c2c77a808c6 tempest-GroupSnapshotsTest-1028111199 None] Acquiring lock "cinder-quobyte-9c4f14b0-8619-4d1f-a45c-6140264d84d0" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:16:51 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-3908faa5-f5fe-4702-bf8c-4c2c77a808c6 tempest-GroupSnapshotsTest-1028111199 None] Lock "cinder-quobyte-9c4f14b0-8619-4d1f-a45c-6140264d84d0" acquired by "delete_volume" :: waited 0.022s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:16:51 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cfd3576-ec85-44cd-858c-9537c74f95a1]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:16:51 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-3908faa5-f5fe-4702-bf8c-4c2c77a808c6 tempest-GroupSnapshotsTest-1028111199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-9c4f14b0-8619-4d1f-a45c-6140264d84d0 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:16:51 devstack sudo[94961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-9c4f14b0-8619-4d1f-a45c-6140264d84d0 Nov 04 10:16:51 devstack sudo[94961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:16:52 devstack sudo[94961]: pam_unix(sudo:session): session closed for user root Nov 04 10:16:52 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-3908faa5-f5fe-4702-bf8c-4c2c77a808c6 tempest-GroupSnapshotsTest-1028111199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-9c4f14b0-8619-4d1f-a45c-6140264d84d0" returned: 0 in 0.512s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:16:52 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-3908faa5-f5fe-4702-bf8c-4c2c77a808c6 tempest-GroupSnapshotsTest-1028111199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-9c4f14b0-8619-4d1f-a45c-6140264d84d0 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:16:52 devstack sudo[94967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-9c4f14b0-8619-4d1f-a45c-6140264d84d0 Nov 04 10:16:52 devstack sudo[94967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:16:52 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-db24ffe9-7303-42e8-9350-a1f0f37ce056 tempest-VolumesMetadataTest-485406255 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:16:52 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-db24ffe9-7303-42e8-9350-a1f0f37ce056 tempest-VolumesMetadataTest-485406255 None] Flow 'volume_create_manager' (050f3da0-5f55-4b0f-ba3f-be9c9e3b09ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:16:52 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-db24ffe9-7303-42e8-9350-a1f0f37ce056 tempest-VolumesMetadataTest-485406255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (629a6c18-01de-4a6e-a1d2-0fccb53c5b55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:16:52 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-db24ffe9-7303-42e8-9350-a1f0f37ce056 tempest-VolumesMetadataTest-485406255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (629a6c18-01de-4a6e-a1d2-0fccb53c5b55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:16:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-871945642',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e24b8b8c-98f1-4f34-9673-9ecdabe71c03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4155a9bd011a46e4a7d441b091798361',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:16:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:16:53Z,use_quota=True,user_id='a3a43b9b98ae4c19b0c0029a34992c95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:16:52 devstack sudo[94967]: pam_unix(sudo:session): session closed for user root Nov 04 10:16:52 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-db24ffe9-7303-42e8-9350-a1f0f37ce056 tempest-VolumesMetadataTest-485406255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c9c8a7c-6360-4ce5-8aff-95702fb1b771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:16:52 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-db24ffe9-7303-42e8-9350-a1f0f37ce056 tempest-VolumesMetadataTest-485406255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c9c8a7c-6360-4ce5-8aff-95702fb1b771) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:16:52 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-db24ffe9-7303-42e8-9350-a1f0f37ce056 tempest-VolumesMetadataTest-485406255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (878dd04b-d31c-4b9c-af44-f2c4dc03dcda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:16:52 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-db24ffe9-7303-42e8-9350-a1f0f37ce056 tempest-VolumesMetadataTest-485406255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (878dd04b-d31c-4b9c-af44-f2c4dc03dcda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e24b8b8c-98f1-4f34-9673-9ecdabe71c03', 'volume_name': 'volume-e24b8b8c-98f1-4f34-9673-9ecdabe71c03', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:16:52 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-db24ffe9-7303-42e8-9350-a1f0f37ce056 tempest-VolumesMetadataTest-485406255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b779503a-544f-4d46-8902-c59def4a6c1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:16:52 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-db24ffe9-7303-42e8-9350-a1f0f37ce056 tempest-VolumesMetadataTest-485406255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b779503a-544f-4d46-8902-c59def4a6c1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:16:52 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-db24ffe9-7303-42e8-9350-a1f0f37ce056 tempest-VolumesMetadataTest-485406255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d86f101c-6ce4-4814-8b89-ec3222bed562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:16:52 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-db24ffe9-7303-42e8-9350-a1f0f37ce056 tempest-VolumesMetadataTest-485406255 None] Volume e24b8b8c-98f1-4f34-9673-9ecdabe71c03: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e24b8b8c-98f1-4f34-9673-9ecdabe71c03', 'volume_size': 1} Nov 04 10:16:52 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-db24ffe9-7303-42e8-9350-a1f0f37ce056 tempest-VolumesMetadataTest-485406255 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:16:52 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-db24ffe9-7303-42e8-9350-a1f0f37ce056 tempest-VolumesMetadataTest-485406255 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:16:52 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-db24ffe9-7303-42e8-9350-a1f0f37ce056 tempest-VolumesMetadataTest-485406255 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:16:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-871945642',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e24b8b8c-98f1-4f34-9673-9ecdabe71c03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4155a9bd011a46e4a7d441b091798361',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:16:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:16:53Z,use_quota=True,user_id='a3a43b9b98ae4c19b0c0029a34992c95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 10:16:52 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-db24ffe9-7303-42e8-9350-a1f0f37ce056 tempest-VolumesMetadataTest-485406255 None] Creating volume e24b8b8c-98f1-4f34-9673-9ecdabe71c03 {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:16:52 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-db24ffe9-7303-42e8-9350-a1f0f37ce056 tempest-VolumesMetadataTest-485406255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:16:52 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-db24ffe9-7303-42e8-9350-a1f0f37ce056 tempest-VolumesMetadataTest-485406255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:16:52 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-db24ffe9-7303-42e8-9350-a1f0f37ce056 tempest-VolumesMetadataTest-485406255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:16:52 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-db24ffe9-7303-42e8-9350-a1f0f37ce056 tempest-VolumesMetadataTest-485406255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:16:52 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-db24ffe9-7303-42e8-9350-a1f0f37ce056 tempest-VolumesMetadataTest-485406255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:16:52 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-db24ffe9-7303-42e8-9350-a1f0f37ce056 tempest-VolumesMetadataTest-485406255 None] Selected osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:16:52 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-db24ffe9-7303-42e8-9350-a1f0f37ce056 tempest-VolumesMetadataTest-485406255 None] casted to osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 Nov 04 10:16:52 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-db24ffe9-7303-42e8-9350-a1f0f37ce056 tempest-VolumesMetadataTest-485406255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-e24b8b8c-98f1-4f34-9673-9ecdabe71c03 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:16:52 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-3908faa5-f5fe-4702-bf8c-4c2c77a808c6 tempest-GroupSnapshotsTest-1028111199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-9c4f14b0-8619-4d1f-a45c-6140264d84d0" returned: 0 in 0.366s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:16:52 devstack sudo[94970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-e24b8b8c-98f1-4f34-9673-9ecdabe71c03 1073741824 Nov 04 10:16:52 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-3908faa5-f5fe-4702-bf8c-4c2c77a808c6 tempest-GroupSnapshotsTest-1028111199 None] Lock "cinder-quobyte-9c4f14b0-8619-4d1f-a45c-6140264d84d0" released by "delete_volume" :: held 0.965s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:16:52 devstack sudo[94970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:16:52 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-3908faa5-f5fe-4702-bf8c-4c2c77a808c6 tempest-GroupSnapshotsTest-1028111199 None] Created reservations ['acddf6e2-6c6b-4a9f-920a-f7b598490cc5'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:16:52 devstack cinder-volume[87068]: WARNING cinder.quota [None req-3908faa5-f5fe-4702-bf8c-4c2c77a808c6 tempest-GroupSnapshotsTest-1028111199 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-620534455 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-620534455, it is now deprecated. Please use the default quota class for default quota. Nov 04 10:16:52 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-3908faa5-f5fe-4702-bf8c-4c2c77a808c6 tempest-GroupSnapshotsTest-1028111199 None] Created reservations ['cf08ffee-71f7-41fa-befb-3af64f8b166b', '1fda7ccb-2eb3-4216-b711-e54b080d3638', '13723824-53d3-4695-b287-50fc655dedc7', '2f5001e9-5137-45bb-9648-f42c52a060e4'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:16:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-3908faa5-f5fe-4702-bf8c-4c2c77a808c6 tempest-GroupSnapshotsTest-1028111199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:16:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-3908faa5-f5fe-4702-bf8c-4c2c77a808c6 tempest-GroupSnapshotsTest-1028111199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:16:53 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-3908faa5-f5fe-4702-bf8c-4c2c77a808c6 tempest-GroupSnapshotsTest-1028111199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:16:53 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-3908faa5-f5fe-4702-bf8c-4c2c77a808c6 tempest-GroupSnapshotsTest-1028111199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:16:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-3908faa5-f5fe-4702-bf8c-4c2c77a808c6 tempest-GroupSnapshotsTest-1028111199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:16:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-3908faa5-f5fe-4702-bf8c-4c2c77a808c6 tempest-GroupSnapshotsTest-1028111199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:16:53 devstack sudo[94974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:16:53 devstack sudo[94974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:16:53 devstack sudo[94970]: pam_unix(sudo:session): session closed for user root Nov 04 10:16:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-db24ffe9-7303-42e8-9350-a1f0f37ce056 tempest-VolumesMetadataTest-485406255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-e24b8b8c-98f1-4f34-9673-9ecdabe71c03 1073741824" returned: 0 in 0.715s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:16:53 devstack sudo[94974]: pam_unix(sudo:session): session closed for user root Nov 04 10:16:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-3908faa5-f5fe-4702-bf8c-4c2c77a808c6 tempest-GroupSnapshotsTest-1028111199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.346s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:16:53 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-3908faa5-f5fe-4702-bf8c-4c2c77a808c6 tempest-GroupSnapshotsTest-1028111199 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:16:53 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-3908faa5-f5fe-4702-bf8c-4c2c77a808c6 tempest-GroupSnapshotsTest-1028111199 None] Delete group completed successfully. Nov 04 10:16:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-db24ffe9-7303-42e8-9350-a1f0f37ce056 tempest-VolumesMetadataTest-485406255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-e24b8b8c-98f1-4f34-9673-9ecdabe71c03 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:16:53 devstack sudo[94979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-e24b8b8c-98f1-4f34-9673-9ecdabe71c03 Nov 04 10:16:53 devstack sudo[94979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:16:53 devstack cinder-volume[87068]: DEBUG oslo_service.periodic_task [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87068) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 10:16:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:16:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:16:53 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:16:53 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:16:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:16:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:16:53 devstack sudo[94981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:16:53 devstack sudo[94981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:16:53 devstack sudo[94979]: pam_unix(sudo:session): session closed for user root Nov 04 10:16:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-db24ffe9-7303-42e8-9350-a1f0f37ce056 tempest-VolumesMetadataTest-485406255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-e24b8b8c-98f1-4f34-9673-9ecdabe71c03" returned: 0 in 0.300s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:16:53 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-db24ffe9-7303-42e8-9350-a1f0f37ce056 tempest-VolumesMetadataTest-485406255 None] <== create_volume: return (1096ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 10:16:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-db24ffe9-7303-42e8-9350-a1f0f37ce056 tempest-VolumesMetadataTest-485406255 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.098s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:16:53 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-db24ffe9-7303-42e8-9350-a1f0f37ce056 tempest-VolumesMetadataTest-485406255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d86f101c-6ce4-4814-8b89-ec3222bed562) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e24b8b8c-98f1-4f34-9673-9ecdabe71c03', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:16:53 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-db24ffe9-7303-42e8-9350-a1f0f37ce056 tempest-VolumesMetadataTest-485406255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40184c0e-416f-48c9-9aa5-399c689aeb8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:16:53 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-db24ffe9-7303-42e8-9350-a1f0f37ce056 tempest-VolumesMetadataTest-485406255 None] Volume volume-e24b8b8c-98f1-4f34-9673-9ecdabe71c03 (e24b8b8c-98f1-4f34-9673-9ecdabe71c03): created successfully Nov 04 10:16:53 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-db24ffe9-7303-42e8-9350-a1f0f37ce056 tempest-VolumesMetadataTest-485406255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40184c0e-416f-48c9-9aa5-399c689aeb8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:16:53 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-db24ffe9-7303-42e8-9350-a1f0f37ce056 tempest-VolumesMetadataTest-485406255 None] Flow 'volume_create_manager' (050f3da0-5f55-4b0f-ba3f-be9c9e3b09ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:16:53 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-db24ffe9-7303-42e8-9350-a1f0f37ce056 tempest-VolumesMetadataTest-485406255 None] Created volume successfully. Nov 04 10:16:53 devstack sudo[94981]: pam_unix(sudo:session): session closed for user root Nov 04 10:16:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.301s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:16:53 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:16:53 devstack cinder-volume[87068]: DEBUG oslo_service.periodic_task [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Running periodic task VolumeManager._thread_info {{(pid=87068) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 10:16:53 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] thread count: 28 {{(pid=87068) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 04 10:16:53 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] thread info: [<_MainThread(MainThread, started 126275656192128)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87068) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 04 10:16:54 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-0f1fc867-1ee1-4ca7-982d-93e429279a54 tempest-BackendsCapabilitiesAdminTestsJSON-1630449007 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.62748336792, 'free_capacity_gb': 1773.62748336792, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87068) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Nov 04 10:16:54 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-26f155ac-e0bd-4831-9f9a-e44f85d0c96c tempest-BackendsCapabilitiesAdminTestsJSON-1630449007 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.62748336792, 'free_capacity_gb': 1773.62748336792, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87068) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Nov 04 10:16:55 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-8090e9c3-cad0-429f-9bb4-687f322723ad tempest-VolumesMetadataTest-485406255 None] Acquiring lock "cinder-e24b8b8c-98f1-4f34-9673-9ecdabe71c03-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:16:55 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-8090e9c3-cad0-429f-9bb4-687f322723ad tempest-VolumesMetadataTest-485406255 None] Lock "cinder-e24b8b8c-98f1-4f34-9673-9ecdabe71c03-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:16:56 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-8090e9c3-cad0-429f-9bb4-687f322723ad tempest-VolumesMetadataTest-485406255 None] Acquiring lock "cinder-quobyte-e24b8b8c-98f1-4f34-9673-9ecdabe71c03" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:16:56 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-8090e9c3-cad0-429f-9bb4-687f322723ad tempest-VolumesMetadataTest-485406255 None] Lock "cinder-quobyte-e24b8b8c-98f1-4f34-9673-9ecdabe71c03" acquired by "delete_volume" :: waited 0.022s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:16:56 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[985e8f9e-b25d-44da-b8b6-02dfc933fbe9]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:16:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-8090e9c3-cad0-429f-9bb4-687f322723ad tempest-VolumesMetadataTest-485406255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-e24b8b8c-98f1-4f34-9673-9ecdabe71c03 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:16:56 devstack sudo[94985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-e24b8b8c-98f1-4f34-9673-9ecdabe71c03 Nov 04 10:16:56 devstack sudo[94985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:16:56 devstack sudo[94985]: pam_unix(sudo:session): session closed for user root Nov 04 10:16:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-8090e9c3-cad0-429f-9bb4-687f322723ad tempest-VolumesMetadataTest-485406255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-e24b8b8c-98f1-4f34-9673-9ecdabe71c03" returned: 0 in 0.444s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:16:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-8090e9c3-cad0-429f-9bb4-687f322723ad tempest-VolumesMetadataTest-485406255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-e24b8b8c-98f1-4f34-9673-9ecdabe71c03 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:16:56 devstack sudo[94990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-e24b8b8c-98f1-4f34-9673-9ecdabe71c03 Nov 04 10:16:56 devstack sudo[94990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:16:56 devstack sudo[94990]: pam_unix(sudo:session): session closed for user root Nov 04 10:16:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-8090e9c3-cad0-429f-9bb4-687f322723ad tempest-VolumesMetadataTest-485406255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-e24b8b8c-98f1-4f34-9673-9ecdabe71c03" returned: 0 in 0.288s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:16:56 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-8090e9c3-cad0-429f-9bb4-687f322723ad tempest-VolumesMetadataTest-485406255 None] Lock "cinder-quobyte-e24b8b8c-98f1-4f34-9673-9ecdabe71c03" released by "delete_volume" :: held 0.798s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:16:56 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-8090e9c3-cad0-429f-9bb4-687f322723ad tempest-VolumesMetadataTest-485406255 None] Created reservations ['d37ca9dd-f913-45e0-8fd7-fcc6912f44aa', '1d92b6ed-bdcb-44c9-8a16-0eb9c232baa0', 'fe2c8822-84f2-4cac-befe-f6d975bc0f3e', '3eec65a1-3b84-4de9-9538-940bed870836'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:16:57 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-8090e9c3-cad0-429f-9bb4-687f322723ad tempest-VolumesMetadataTest-485406255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:16:57 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-8090e9c3-cad0-429f-9bb4-687f322723ad tempest-VolumesMetadataTest-485406255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:16:57 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-8090e9c3-cad0-429f-9bb4-687f322723ad tempest-VolumesMetadataTest-485406255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:16:57 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-8090e9c3-cad0-429f-9bb4-687f322723ad tempest-VolumesMetadataTest-485406255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:16:57 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-8090e9c3-cad0-429f-9bb4-687f322723ad tempest-VolumesMetadataTest-485406255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:16:57 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-8090e9c3-cad0-429f-9bb4-687f322723ad tempest-VolumesMetadataTest-485406255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:16:57 devstack sudo[94993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:16:57 devstack sudo[94993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:16:57 devstack sudo[94993]: pam_unix(sudo:session): session closed for user root Nov 04 10:16:57 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-8090e9c3-cad0-429f-9bb4-687f322723ad tempest-VolumesMetadataTest-485406255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.423s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:16:57 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-8090e9c3-cad0-429f-9bb4-687f322723ad tempest-VolumesMetadataTest-485406255 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:16:57 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-8090e9c3-cad0-429f-9bb4-687f322723ad tempest-VolumesMetadataTest-485406255 None] Deleted volume successfully. Nov 04 10:16:57 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-8090e9c3-cad0-429f-9bb4-687f322723ad tempest-VolumesMetadataTest-485406255 None] Lock "cinder-e24b8b8c-98f1-4f34-9673-9ecdabe71c03-delete_volume" released by "delete_volume" :: held 1.543s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:17:07 devstack cinder-volume[87068]: DEBUG dbcounter [-] [87068] Writing DB stats cinder:SELECT=90,cinder:UPDATE=125,cinder:INSERT=28,cinder:DELETE=5 {{(pid=87068) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 10:17:07 devstack cinder-volume[87068]: DEBUG dbcounter [-] [87068] Writing DB stats cinder:SELECT=101,cinder:INSERT=32,cinder:UPDATE=118,cinder:DELETE=6 {{(pid=87068) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 10:17:14 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-0139ab23-0b7c-4534-bffa-56571ec055bb tempest-VolumeQuotasNegativeTestJSON-2078642996 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:17:14 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-0139ab23-0b7c-4534-bffa-56571ec055bb tempest-VolumeQuotasNegativeTestJSON-2078642996 None] Flow 'volume_create_manager' (55885087-f4e9-4266-ad10-685699a3804e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:17:14 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-0139ab23-0b7c-4534-bffa-56571ec055bb tempest-VolumeQuotasNegativeTestJSON-2078642996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df0248de-8ad4-4a7f-aed7-778b1816913b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:17:14 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-0139ab23-0b7c-4534-bffa-56571ec055bb tempest-VolumeQuotasNegativeTestJSON-2078642996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df0248de-8ad4-4a7f-aed7-778b1816913b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:17:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-676175961',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e4af1ae-2011-407d-81b9-141b677d42e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68eebd9881fe4941a4d7cfa66f7a6540',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:17:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:17:14Z,use_quota=True,user_id='f0ff1ddb2b2f40ebb0c05d9939185bc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:17:14 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-0139ab23-0b7c-4534-bffa-56571ec055bb tempest-VolumeQuotasNegativeTestJSON-2078642996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a81eedfd-f7f0-4cb0-8d15-d373e55b3644) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:17:14 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-0139ab23-0b7c-4534-bffa-56571ec055bb tempest-VolumeQuotasNegativeTestJSON-2078642996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a81eedfd-f7f0-4cb0-8d15-d373e55b3644) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:17:14 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-0139ab23-0b7c-4534-bffa-56571ec055bb tempest-VolumeQuotasNegativeTestJSON-2078642996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e49e34a-b306-4521-ac67-ca4800685139) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:17:14 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-0139ab23-0b7c-4534-bffa-56571ec055bb tempest-VolumeQuotasNegativeTestJSON-2078642996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e49e34a-b306-4521-ac67-ca4800685139) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e4af1ae-2011-407d-81b9-141b677d42e1', 'volume_name': 'volume-2e4af1ae-2011-407d-81b9-141b677d42e1', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:17:14 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-0139ab23-0b7c-4534-bffa-56571ec055bb tempest-VolumeQuotasNegativeTestJSON-2078642996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96fb79e4-77e6-4723-8630-06d96e6eb9df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:17:14 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-0139ab23-0b7c-4534-bffa-56571ec055bb tempest-VolumeQuotasNegativeTestJSON-2078642996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96fb79e4-77e6-4723-8630-06d96e6eb9df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:17:14 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-0139ab23-0b7c-4534-bffa-56571ec055bb tempest-VolumeQuotasNegativeTestJSON-2078642996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dccc834e-8c84-4c8e-b68e-8210b04d7b3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:17:14 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-0139ab23-0b7c-4534-bffa-56571ec055bb tempest-VolumeQuotasNegativeTestJSON-2078642996 None] Volume 2e4af1ae-2011-407d-81b9-141b677d42e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e4af1ae-2011-407d-81b9-141b677d42e1', 'volume_size': 1} Nov 04 10:17:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-0139ab23-0b7c-4534-bffa-56571ec055bb tempest-VolumeQuotasNegativeTestJSON-2078642996 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:17:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-0139ab23-0b7c-4534-bffa-56571ec055bb tempest-VolumeQuotasNegativeTestJSON-2078642996 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:17:14 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-0139ab23-0b7c-4534-bffa-56571ec055bb tempest-VolumeQuotasNegativeTestJSON-2078642996 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:17:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-676175961',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e4af1ae-2011-407d-81b9-141b677d42e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68eebd9881fe4941a4d7cfa66f7a6540',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:17:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:17:14Z,use_quota=True,user_id='f0ff1ddb2b2f40ebb0c05d9939185bc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 10:17:14 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-0139ab23-0b7c-4534-bffa-56571ec055bb tempest-VolumeQuotasNegativeTestJSON-2078642996 None] Creating volume 2e4af1ae-2011-407d-81b9-141b677d42e1 {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:17:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-0139ab23-0b7c-4534-bffa-56571ec055bb tempest-VolumeQuotasNegativeTestJSON-2078642996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:17:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-0139ab23-0b7c-4534-bffa-56571ec055bb tempest-VolumeQuotasNegativeTestJSON-2078642996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:17:14 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-0139ab23-0b7c-4534-bffa-56571ec055bb tempest-VolumeQuotasNegativeTestJSON-2078642996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:17:14 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-0139ab23-0b7c-4534-bffa-56571ec055bb tempest-VolumeQuotasNegativeTestJSON-2078642996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:17:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-0139ab23-0b7c-4534-bffa-56571ec055bb tempest-VolumeQuotasNegativeTestJSON-2078642996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:17:14 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-0139ab23-0b7c-4534-bffa-56571ec055bb tempest-VolumeQuotasNegativeTestJSON-2078642996 None] Selected osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:17:14 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-0139ab23-0b7c-4534-bffa-56571ec055bb tempest-VolumeQuotasNegativeTestJSON-2078642996 None] casted to osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 Nov 04 10:17:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-0139ab23-0b7c-4534-bffa-56571ec055bb tempest-VolumeQuotasNegativeTestJSON-2078642996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-2e4af1ae-2011-407d-81b9-141b677d42e1 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:17:14 devstack sudo[95099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-2e4af1ae-2011-407d-81b9-141b677d42e1 1073741824 Nov 04 10:17:14 devstack sudo[95099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:17:16 devstack sudo[95099]: pam_unix(sudo:session): session closed for user root Nov 04 10:17:16 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-0139ab23-0b7c-4534-bffa-56571ec055bb tempest-VolumeQuotasNegativeTestJSON-2078642996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-2e4af1ae-2011-407d-81b9-141b677d42e1 1073741824" returned: 0 in 1.345s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:17:16 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-0139ab23-0b7c-4534-bffa-56571ec055bb tempest-VolumeQuotasNegativeTestJSON-2078642996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-2e4af1ae-2011-407d-81b9-141b677d42e1 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:17:16 devstack sudo[95116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-2e4af1ae-2011-407d-81b9-141b677d42e1 Nov 04 10:17:16 devstack sudo[95116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:17:16 devstack sudo[95116]: pam_unix(sudo:session): session closed for user root Nov 04 10:17:16 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-0139ab23-0b7c-4534-bffa-56571ec055bb tempest-VolumeQuotasNegativeTestJSON-2078642996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-2e4af1ae-2011-407d-81b9-141b677d42e1" returned: 0 in 0.479s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:17:16 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-0139ab23-0b7c-4534-bffa-56571ec055bb tempest-VolumeQuotasNegativeTestJSON-2078642996 None] <== create_volume: return (1946ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 10:17:16 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-0139ab23-0b7c-4534-bffa-56571ec055bb tempest-VolumeQuotasNegativeTestJSON-2078642996 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.955s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:17:16 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-0139ab23-0b7c-4534-bffa-56571ec055bb tempest-VolumeQuotasNegativeTestJSON-2078642996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dccc834e-8c84-4c8e-b68e-8210b04d7b3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e4af1ae-2011-407d-81b9-141b677d42e1', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:17:16 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-0139ab23-0b7c-4534-bffa-56571ec055bb tempest-VolumeQuotasNegativeTestJSON-2078642996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6446361-0f53-4dc9-ba7b-d26845f76309) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:17:16 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-0139ab23-0b7c-4534-bffa-56571ec055bb tempest-VolumeQuotasNegativeTestJSON-2078642996 None] Volume volume-2e4af1ae-2011-407d-81b9-141b677d42e1 (2e4af1ae-2011-407d-81b9-141b677d42e1): created successfully Nov 04 10:17:16 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-0139ab23-0b7c-4534-bffa-56571ec055bb tempest-VolumeQuotasNegativeTestJSON-2078642996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6446361-0f53-4dc9-ba7b-d26845f76309) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:17:16 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-0139ab23-0b7c-4534-bffa-56571ec055bb tempest-VolumeQuotasNegativeTestJSON-2078642996 None] Flow 'volume_create_manager' (55885087-f4e9-4266-ad10-685699a3804e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:17:16 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-0139ab23-0b7c-4534-bffa-56571ec055bb tempest-VolumeQuotasNegativeTestJSON-2078642996 None] Created volume successfully. Nov 04 10:17:17 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-42b063fd-4948-433f-808b-fe643b1e9565 tempest-VolumesTransfersV355Test-1480344052 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:17:17 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-42b063fd-4948-433f-808b-fe643b1e9565 tempest-VolumesTransfersV355Test-1480344052 None] Flow 'volume_create_manager' (ed42fadc-45c3-4f22-a1d1-1d63e7d0d35e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:17:17 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-42b063fd-4948-433f-808b-fe643b1e9565 tempest-VolumesTransfersV355Test-1480344052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae755537-64b6-4c66-bba0-5d0bc9aeae31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:17:17 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-42b063fd-4948-433f-808b-fe643b1e9565 tempest-VolumesTransfersV355Test-1480344052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae755537-64b6-4c66-bba0-5d0bc9aeae31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:17:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-308385812',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e401b36b-9f26-461e-b888-2349d08b57e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f71caffb7d6249f189335c54b79604de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:17:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:17:18Z,use_quota=True,user_id='8f32c2cb07444d7780340465af35b061',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:17:17 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-42b063fd-4948-433f-808b-fe643b1e9565 tempest-VolumesTransfersV355Test-1480344052 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c73a3891-ed1d-48af-9ebd-b030b5a67f0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:17:17 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-42b063fd-4948-433f-808b-fe643b1e9565 tempest-VolumesTransfersV355Test-1480344052 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c73a3891-ed1d-48af-9ebd-b030b5a67f0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:17:17 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-42b063fd-4948-433f-808b-fe643b1e9565 tempest-VolumesTransfersV355Test-1480344052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74bff28d-0c6a-434c-9495-8045d675c254) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:17:17 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-42b063fd-4948-433f-808b-fe643b1e9565 tempest-VolumesTransfersV355Test-1480344052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74bff28d-0c6a-434c-9495-8045d675c254) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e401b36b-9f26-461e-b888-2349d08b57e9', 'volume_name': 'volume-e401b36b-9f26-461e-b888-2349d08b57e9', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:17:17 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-42b063fd-4948-433f-808b-fe643b1e9565 tempest-VolumesTransfersV355Test-1480344052 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f7c871f-50de-48a3-9873-6a535d0b0c0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:17:17 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-42b063fd-4948-433f-808b-fe643b1e9565 tempest-VolumesTransfersV355Test-1480344052 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f7c871f-50de-48a3-9873-6a535d0b0c0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:17:17 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-42b063fd-4948-433f-808b-fe643b1e9565 tempest-VolumesTransfersV355Test-1480344052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2020dab8-2199-4092-88b3-4c5577cc2923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:17:17 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-42b063fd-4948-433f-808b-fe643b1e9565 tempest-VolumesTransfersV355Test-1480344052 None] Volume e401b36b-9f26-461e-b888-2349d08b57e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e401b36b-9f26-461e-b888-2349d08b57e9', 'volume_size': 1} Nov 04 10:17:17 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-42b063fd-4948-433f-808b-fe643b1e9565 tempest-VolumesTransfersV355Test-1480344052 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:17:17 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-42b063fd-4948-433f-808b-fe643b1e9565 tempest-VolumesTransfersV355Test-1480344052 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:17:17 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-42b063fd-4948-433f-808b-fe643b1e9565 tempest-VolumesTransfersV355Test-1480344052 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:17:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-308385812',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e401b36b-9f26-461e-b888-2349d08b57e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f71caffb7d6249f189335c54b79604de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:17:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:17:18Z,use_quota=True,user_id='8f32c2cb07444d7780340465af35b061',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 10:17:17 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-42b063fd-4948-433f-808b-fe643b1e9565 tempest-VolumesTransfersV355Test-1480344052 None] Creating volume e401b36b-9f26-461e-b888-2349d08b57e9 {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:17:17 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-42b063fd-4948-433f-808b-fe643b1e9565 tempest-VolumesTransfersV355Test-1480344052 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:17:17 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-42b063fd-4948-433f-808b-fe643b1e9565 tempest-VolumesTransfersV355Test-1480344052 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:17:17 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-42b063fd-4948-433f-808b-fe643b1e9565 tempest-VolumesTransfersV355Test-1480344052 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:17:17 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-42b063fd-4948-433f-808b-fe643b1e9565 tempest-VolumesTransfersV355Test-1480344052 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:17:17 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-42b063fd-4948-433f-808b-fe643b1e9565 tempest-VolumesTransfersV355Test-1480344052 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:17:17 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-42b063fd-4948-433f-808b-fe643b1e9565 tempest-VolumesTransfersV355Test-1480344052 None] Selected osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:17:17 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-42b063fd-4948-433f-808b-fe643b1e9565 tempest-VolumesTransfersV355Test-1480344052 None] casted to osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 Nov 04 10:17:17 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-42b063fd-4948-433f-808b-fe643b1e9565 tempest-VolumesTransfersV355Test-1480344052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-e401b36b-9f26-461e-b888-2349d08b57e9 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:17:17 devstack sudo[95120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-e401b36b-9f26-461e-b888-2349d08b57e9 1073741824 Nov 04 10:17:17 devstack sudo[95120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:17:19 devstack sudo[95120]: pam_unix(sudo:session): session closed for user root Nov 04 10:17:19 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-42b063fd-4948-433f-808b-fe643b1e9565 tempest-VolumesTransfersV355Test-1480344052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-e401b36b-9f26-461e-b888-2349d08b57e9 1073741824" returned: 0 in 1.220s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:17:19 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-42b063fd-4948-433f-808b-fe643b1e9565 tempest-VolumesTransfersV355Test-1480344052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-e401b36b-9f26-461e-b888-2349d08b57e9 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:17:19 devstack sudo[95155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-e401b36b-9f26-461e-b888-2349d08b57e9 Nov 04 10:17:19 devstack sudo[95155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:17:19 devstack sudo[95155]: pam_unix(sudo:session): session closed for user root Nov 04 10:17:19 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-42b063fd-4948-433f-808b-fe643b1e9565 tempest-VolumesTransfersV355Test-1480344052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-e401b36b-9f26-461e-b888-2349d08b57e9" returned: 0 in 0.624s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:17:19 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-42b063fd-4948-433f-808b-fe643b1e9565 tempest-VolumesTransfersV355Test-1480344052 None] <== create_volume: return (1979ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 10:17:19 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-42b063fd-4948-433f-808b-fe643b1e9565 tempest-VolumesTransfersV355Test-1480344052 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.982s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:17:19 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-42b063fd-4948-433f-808b-fe643b1e9565 tempest-VolumesTransfersV355Test-1480344052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2020dab8-2199-4092-88b3-4c5577cc2923) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e401b36b-9f26-461e-b888-2349d08b57e9', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:17:19 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-42b063fd-4948-433f-808b-fe643b1e9565 tempest-VolumesTransfersV355Test-1480344052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (947fe6b7-0419-4923-bc90-b199c80116ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:17:19 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-42b063fd-4948-433f-808b-fe643b1e9565 tempest-VolumesTransfersV355Test-1480344052 None] Volume volume-e401b36b-9f26-461e-b888-2349d08b57e9 (e401b36b-9f26-461e-b888-2349d08b57e9): created successfully Nov 04 10:17:19 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-42b063fd-4948-433f-808b-fe643b1e9565 tempest-VolumesTransfersV355Test-1480344052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (947fe6b7-0419-4923-bc90-b199c80116ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:17:20 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-42b063fd-4948-433f-808b-fe643b1e9565 tempest-VolumesTransfersV355Test-1480344052 None] Flow 'volume_create_manager' (ed42fadc-45c3-4f22-a1d1-1d63e7d0d35e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:17:20 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-42b063fd-4948-433f-808b-fe643b1e9565 tempest-VolumesTransfersV355Test-1480344052 None] Created volume successfully. Nov 04 10:17:20 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-19487c84-2d1a-445f-aade-d7e41b559955 tempest-VolumeQuotasNegativeTestJSON-2078642996 None] Acquiring lock "cinder-2e4af1ae-2011-407d-81b9-141b677d42e1-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:17:21 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-19487c84-2d1a-445f-aade-d7e41b559955 tempest-VolumeQuotasNegativeTestJSON-2078642996 None] Lock "cinder-2e4af1ae-2011-407d-81b9-141b677d42e1-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:17:21 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-19487c84-2d1a-445f-aade-d7e41b559955 tempest-VolumeQuotasNegativeTestJSON-2078642996 None] Acquiring lock "cinder-quobyte-2e4af1ae-2011-407d-81b9-141b677d42e1" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:17:21 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-19487c84-2d1a-445f-aade-d7e41b559955 tempest-VolumeQuotasNegativeTestJSON-2078642996 None] Lock "cinder-quobyte-2e4af1ae-2011-407d-81b9-141b677d42e1" acquired by "delete_volume" :: waited 0.034s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:17:21 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa5c440b-2d2d-4662-9e3c-7fec2dc8a754]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:17:21 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-19487c84-2d1a-445f-aade-d7e41b559955 tempest-VolumeQuotasNegativeTestJSON-2078642996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-2e4af1ae-2011-407d-81b9-141b677d42e1 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:17:21 devstack sudo[95170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-2e4af1ae-2011-407d-81b9-141b677d42e1 Nov 04 10:17:21 devstack sudo[95170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:17:22 devstack sudo[95170]: pam_unix(sudo:session): session closed for user root Nov 04 10:17:22 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-19487c84-2d1a-445f-aade-d7e41b559955 tempest-VolumeQuotasNegativeTestJSON-2078642996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-2e4af1ae-2011-407d-81b9-141b677d42e1" returned: 0 in 0.766s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:17:22 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-19487c84-2d1a-445f-aade-d7e41b559955 tempest-VolumeQuotasNegativeTestJSON-2078642996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-2e4af1ae-2011-407d-81b9-141b677d42e1 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:17:22 devstack sudo[95176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-2e4af1ae-2011-407d-81b9-141b677d42e1 Nov 04 10:17:22 devstack sudo[95176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:17:22 devstack sudo[95176]: pam_unix(sudo:session): session closed for user root Nov 04 10:17:22 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-19487c84-2d1a-445f-aade-d7e41b559955 tempest-VolumeQuotasNegativeTestJSON-2078642996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-2e4af1ae-2011-407d-81b9-141b677d42e1" returned: 0 in 0.596s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:17:22 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-19487c84-2d1a-445f-aade-d7e41b559955 tempest-VolumeQuotasNegativeTestJSON-2078642996 None] Lock "cinder-quobyte-2e4af1ae-2011-407d-81b9-141b677d42e1" released by "delete_volume" :: held 1.552s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:17:22 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-19487c84-2d1a-445f-aade-d7e41b559955 tempest-VolumeQuotasNegativeTestJSON-2078642996 None] Created reservations ['8782b1ca-692e-4f08-b8b8-92602b8c2818', 'bb12ceda-ff49-42ba-b429-130de9162a11', 'a00eabbf-80d4-4298-843b-ab2f946007c3', 'e8800dd6-ceb7-44bc-b6e6-8a857f911ca2'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:17:23 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-19487c84-2d1a-445f-aade-d7e41b559955 tempest-VolumeQuotasNegativeTestJSON-2078642996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:17:23 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-19487c84-2d1a-445f-aade-d7e41b559955 tempest-VolumeQuotasNegativeTestJSON-2078642996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:17:23 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-19487c84-2d1a-445f-aade-d7e41b559955 tempest-VolumeQuotasNegativeTestJSON-2078642996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:17:23 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-19487c84-2d1a-445f-aade-d7e41b559955 tempest-VolumeQuotasNegativeTestJSON-2078642996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:17:23 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-19487c84-2d1a-445f-aade-d7e41b559955 tempest-VolumeQuotasNegativeTestJSON-2078642996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:17:23 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-19487c84-2d1a-445f-aade-d7e41b559955 tempest-VolumeQuotasNegativeTestJSON-2078642996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:17:23 devstack sudo[95181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:17:23 devstack sudo[95181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:17:23 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-f3142a7a-8eb8-48da-83c3-5d5a77b6954e tempest-VolumesTransfersV355Test-1097624020 None] Transfer volume completed successfully. Nov 04 10:17:23 devstack sudo[95181]: pam_unix(sudo:session): session closed for user root Nov 04 10:17:23 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-19487c84-2d1a-445f-aade-d7e41b559955 tempest-VolumeQuotasNegativeTestJSON-2078642996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.509s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:17:23 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-19487c84-2d1a-445f-aade-d7e41b559955 tempest-VolumeQuotasNegativeTestJSON-2078642996 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:17:23 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-19487c84-2d1a-445f-aade-d7e41b559955 tempest-VolumeQuotasNegativeTestJSON-2078642996 None] Deleted volume successfully. Nov 04 10:17:23 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-19487c84-2d1a-445f-aade-d7e41b559955 tempest-VolumeQuotasNegativeTestJSON-2078642996 None] Lock "cinder-2e4af1ae-2011-407d-81b9-141b677d42e1-delete_volume" released by "delete_volume" :: held 2.643s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:17:24 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-8584a8a7-add3-42b6-8af3-3df37cb2766f tempest-VolumesTransfersV355Test-1946404979 None] Acquiring lock "cinder-e401b36b-9f26-461e-b888-2349d08b57e9-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:17:24 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-8584a8a7-add3-42b6-8af3-3df37cb2766f tempest-VolumesTransfersV355Test-1946404979 None] Lock "cinder-e401b36b-9f26-461e-b888-2349d08b57e9-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:17:25 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-8584a8a7-add3-42b6-8af3-3df37cb2766f tempest-VolumesTransfersV355Test-1946404979 None] Acquiring lock "cinder-quobyte-e401b36b-9f26-461e-b888-2349d08b57e9" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:17:25 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-8584a8a7-add3-42b6-8af3-3df37cb2766f tempest-VolumesTransfersV355Test-1946404979 None] Lock "cinder-quobyte-e401b36b-9f26-461e-b888-2349d08b57e9" acquired by "delete_volume" :: waited 0.033s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:17:25 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[654009f7-daf0-4ef1-8d51-83e25517c5d4]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:17:25 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-8584a8a7-add3-42b6-8af3-3df37cb2766f tempest-VolumesTransfersV355Test-1946404979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-e401b36b-9f26-461e-b888-2349d08b57e9 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:17:25 devstack sudo[95184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-e401b36b-9f26-461e-b888-2349d08b57e9 Nov 04 10:17:25 devstack sudo[95184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:17:26 devstack sudo[95184]: pam_unix(sudo:session): session closed for user root Nov 04 10:17:26 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-8584a8a7-add3-42b6-8af3-3df37cb2766f tempest-VolumesTransfersV355Test-1946404979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-e401b36b-9f26-461e-b888-2349d08b57e9" returned: 0 in 1.166s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:17:26 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-8584a8a7-add3-42b6-8af3-3df37cb2766f tempest-VolumesTransfersV355Test-1946404979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-e401b36b-9f26-461e-b888-2349d08b57e9 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:17:26 devstack sudo[95190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-e401b36b-9f26-461e-b888-2349d08b57e9 Nov 04 10:17:26 devstack sudo[95190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:17:26 devstack sudo[95190]: pam_unix(sudo:session): session closed for user root Nov 04 10:17:26 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-8584a8a7-add3-42b6-8af3-3df37cb2766f tempest-VolumesTransfersV355Test-1946404979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-e401b36b-9f26-461e-b888-2349d08b57e9" returned: 0 in 0.305s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:17:26 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-8584a8a7-add3-42b6-8af3-3df37cb2766f tempest-VolumesTransfersV355Test-1946404979 None] Lock "cinder-quobyte-e401b36b-9f26-461e-b888-2349d08b57e9" released by "delete_volume" :: held 1.589s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:17:26 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-8584a8a7-add3-42b6-8af3-3df37cb2766f tempest-VolumesTransfersV355Test-1946404979 None] Created reservations ['a3786cfb-8cbf-4935-bb73-ea2a7f6898a7', 'f71b94a7-2da4-471f-b70c-32702af4b145', '9e72b1a4-bb35-4e8c-a108-acba02f9eed7', '0b8b3088-c960-4986-9fba-e5ac11de6e4c'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:17:26 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-8584a8a7-add3-42b6-8af3-3df37cb2766f tempest-VolumesTransfersV355Test-1946404979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:17:26 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-8584a8a7-add3-42b6-8af3-3df37cb2766f tempest-VolumesTransfersV355Test-1946404979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:17:26 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-8584a8a7-add3-42b6-8af3-3df37cb2766f tempest-VolumesTransfersV355Test-1946404979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:17:26 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-8584a8a7-add3-42b6-8af3-3df37cb2766f tempest-VolumesTransfersV355Test-1946404979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:17:26 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-8584a8a7-add3-42b6-8af3-3df37cb2766f tempest-VolumesTransfersV355Test-1946404979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:17:26 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-8584a8a7-add3-42b6-8af3-3df37cb2766f tempest-VolumesTransfersV355Test-1946404979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:17:27 devstack sudo[95193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:17:27 devstack sudo[95193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:17:27 devstack sudo[95193]: pam_unix(sudo:session): session closed for user root Nov 04 10:17:27 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-8584a8a7-add3-42b6-8af3-3df37cb2766f tempest-VolumesTransfersV355Test-1946404979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.574s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:17:27 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-8584a8a7-add3-42b6-8af3-3df37cb2766f tempest-VolumesTransfersV355Test-1946404979 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:17:27 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-8584a8a7-add3-42b6-8af3-3df37cb2766f tempest-VolumesTransfersV355Test-1946404979 None] Deleted volume successfully. Nov 04 10:17:27 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-8584a8a7-add3-42b6-8af3-3df37cb2766f tempest-VolumesTransfersV355Test-1946404979 None] Lock "cinder-e401b36b-9f26-461e-b888-2349d08b57e9-delete_volume" released by "delete_volume" :: held 2.655s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:17:28 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-372c6957-a6e6-4afb-8a0f-7bc54d3912c1 tempest-VolumesTransfersV355Test-1480344052 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:17:28 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-372c6957-a6e6-4afb-8a0f-7bc54d3912c1 tempest-VolumesTransfersV355Test-1480344052 None] Flow 'volume_create_manager' (3791261f-3295-4b18-80e6-f1f36938af29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:17:28 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-372c6957-a6e6-4afb-8a0f-7bc54d3912c1 tempest-VolumesTransfersV355Test-1480344052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d697502-0e26-4caf-a27e-24ac7ed6fd40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:17:28 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-372c6957-a6e6-4afb-8a0f-7bc54d3912c1 tempest-VolumesTransfersV355Test-1480344052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d697502-0e26-4caf-a27e-24ac7ed6fd40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:17:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1668781370',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d2eb21e-8606-4b8d-8204-ee8dfed22cf1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f71caffb7d6249f189335c54b79604de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:17:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:17:28Z,use_quota=True,user_id='8f32c2cb07444d7780340465af35b061',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:17:28 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-372c6957-a6e6-4afb-8a0f-7bc54d3912c1 tempest-VolumesTransfersV355Test-1480344052 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c49ff5e5-9640-42c4-b33d-b8121d17db9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:17:28 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-372c6957-a6e6-4afb-8a0f-7bc54d3912c1 tempest-VolumesTransfersV355Test-1480344052 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c49ff5e5-9640-42c4-b33d-b8121d17db9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:17:28 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-372c6957-a6e6-4afb-8a0f-7bc54d3912c1 tempest-VolumesTransfersV355Test-1480344052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b8855a9-0303-47eb-be4c-8c5c7f4e33fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:17:28 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-372c6957-a6e6-4afb-8a0f-7bc54d3912c1 tempest-VolumesTransfersV355Test-1480344052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b8855a9-0303-47eb-be4c-8c5c7f4e33fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d2eb21e-8606-4b8d-8204-ee8dfed22cf1', 'volume_name': 'volume-5d2eb21e-8606-4b8d-8204-ee8dfed22cf1', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:17:28 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-372c6957-a6e6-4afb-8a0f-7bc54d3912c1 tempest-VolumesTransfersV355Test-1480344052 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (642d18ba-32cd-4bdf-9cde-9563d0de2862) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:17:28 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-372c6957-a6e6-4afb-8a0f-7bc54d3912c1 tempest-VolumesTransfersV355Test-1480344052 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (642d18ba-32cd-4bdf-9cde-9563d0de2862) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:17:28 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-372c6957-a6e6-4afb-8a0f-7bc54d3912c1 tempest-VolumesTransfersV355Test-1480344052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de3abd4e-5882-4770-a524-abfc465702ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:17:28 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-372c6957-a6e6-4afb-8a0f-7bc54d3912c1 tempest-VolumesTransfersV355Test-1480344052 None] Volume 5d2eb21e-8606-4b8d-8204-ee8dfed22cf1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d2eb21e-8606-4b8d-8204-ee8dfed22cf1', 'volume_size': 1} Nov 04 10:17:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-372c6957-a6e6-4afb-8a0f-7bc54d3912c1 tempest-VolumesTransfersV355Test-1480344052 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:17:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-372c6957-a6e6-4afb-8a0f-7bc54d3912c1 tempest-VolumesTransfersV355Test-1480344052 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:17:28 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-372c6957-a6e6-4afb-8a0f-7bc54d3912c1 tempest-VolumesTransfersV355Test-1480344052 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:17:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1668781370',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d2eb21e-8606-4b8d-8204-ee8dfed22cf1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f71caffb7d6249f189335c54b79604de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:17:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:17:28Z,use_quota=True,user_id='8f32c2cb07444d7780340465af35b061',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 10:17:28 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-372c6957-a6e6-4afb-8a0f-7bc54d3912c1 tempest-VolumesTransfersV355Test-1480344052 None] Creating volume 5d2eb21e-8606-4b8d-8204-ee8dfed22cf1 {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:17:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-372c6957-a6e6-4afb-8a0f-7bc54d3912c1 tempest-VolumesTransfersV355Test-1480344052 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:17:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-372c6957-a6e6-4afb-8a0f-7bc54d3912c1 tempest-VolumesTransfersV355Test-1480344052 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:17:28 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-372c6957-a6e6-4afb-8a0f-7bc54d3912c1 tempest-VolumesTransfersV355Test-1480344052 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:17:28 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-372c6957-a6e6-4afb-8a0f-7bc54d3912c1 tempest-VolumesTransfersV355Test-1480344052 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:17:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-372c6957-a6e6-4afb-8a0f-7bc54d3912c1 tempest-VolumesTransfersV355Test-1480344052 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:17:28 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-372c6957-a6e6-4afb-8a0f-7bc54d3912c1 tempest-VolumesTransfersV355Test-1480344052 None] Selected osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:17:28 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-372c6957-a6e6-4afb-8a0f-7bc54d3912c1 tempest-VolumesTransfersV355Test-1480344052 None] casted to osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 Nov 04 10:17:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-372c6957-a6e6-4afb-8a0f-7bc54d3912c1 tempest-VolumesTransfersV355Test-1480344052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-5d2eb21e-8606-4b8d-8204-ee8dfed22cf1 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:17:28 devstack sudo[95211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-5d2eb21e-8606-4b8d-8204-ee8dfed22cf1 1073741824 Nov 04 10:17:28 devstack sudo[95211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:17:29 devstack sudo[95211]: pam_unix(sudo:session): session closed for user root Nov 04 10:17:29 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-372c6957-a6e6-4afb-8a0f-7bc54d3912c1 tempest-VolumesTransfersV355Test-1480344052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-5d2eb21e-8606-4b8d-8204-ee8dfed22cf1 1073741824" returned: 0 in 1.123s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:17:29 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-372c6957-a6e6-4afb-8a0f-7bc54d3912c1 tempest-VolumesTransfersV355Test-1480344052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-5d2eb21e-8606-4b8d-8204-ee8dfed22cf1 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:17:29 devstack sudo[95265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-5d2eb21e-8606-4b8d-8204-ee8dfed22cf1 Nov 04 10:17:29 devstack sudo[95265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:17:30 devstack sudo[95265]: pam_unix(sudo:session): session closed for user root Nov 04 10:17:30 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-372c6957-a6e6-4afb-8a0f-7bc54d3912c1 tempest-VolumesTransfersV355Test-1480344052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-5d2eb21e-8606-4b8d-8204-ee8dfed22cf1" returned: 0 in 0.299s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:17:30 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-372c6957-a6e6-4afb-8a0f-7bc54d3912c1 tempest-VolumesTransfersV355Test-1480344052 None] <== create_volume: return (1524ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 10:17:30 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-372c6957-a6e6-4afb-8a0f-7bc54d3912c1 tempest-VolumesTransfersV355Test-1480344052 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.527s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:17:30 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-372c6957-a6e6-4afb-8a0f-7bc54d3912c1 tempest-VolumesTransfersV355Test-1480344052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de3abd4e-5882-4770-a524-abfc465702ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d2eb21e-8606-4b8d-8204-ee8dfed22cf1', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:17:30 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-372c6957-a6e6-4afb-8a0f-7bc54d3912c1 tempest-VolumesTransfersV355Test-1480344052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33d94985-2232-49df-97b2-076b0cf9686e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:17:30 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-372c6957-a6e6-4afb-8a0f-7bc54d3912c1 tempest-VolumesTransfersV355Test-1480344052 None] Volume volume-5d2eb21e-8606-4b8d-8204-ee8dfed22cf1 (5d2eb21e-8606-4b8d-8204-ee8dfed22cf1): created successfully Nov 04 10:17:30 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-372c6957-a6e6-4afb-8a0f-7bc54d3912c1 tempest-VolumesTransfersV355Test-1480344052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33d94985-2232-49df-97b2-076b0cf9686e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:17:30 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-372c6957-a6e6-4afb-8a0f-7bc54d3912c1 tempest-VolumesTransfersV355Test-1480344052 None] Flow 'volume_create_manager' (3791261f-3295-4b18-80e6-f1f36938af29) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:17:30 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-372c6957-a6e6-4afb-8a0f-7bc54d3912c1 tempest-VolumesTransfersV355Test-1480344052 None] Created volume successfully. Nov 04 10:17:31 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-c6d9971f-f1fa-4dae-a2e0-041c3ba2b026 tempest-VolumesTransfersV355Test-1946404979 None] Acquiring lock "cinder-5d2eb21e-8606-4b8d-8204-ee8dfed22cf1-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:17:31 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-c6d9971f-f1fa-4dae-a2e0-041c3ba2b026 tempest-VolumesTransfersV355Test-1946404979 None] Lock "cinder-5d2eb21e-8606-4b8d-8204-ee8dfed22cf1-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:17:31 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-c6d9971f-f1fa-4dae-a2e0-041c3ba2b026 tempest-VolumesTransfersV355Test-1946404979 None] Acquiring lock "cinder-quobyte-5d2eb21e-8606-4b8d-8204-ee8dfed22cf1" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:17:31 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-c6d9971f-f1fa-4dae-a2e0-041c3ba2b026 tempest-VolumesTransfersV355Test-1946404979 None] Lock "cinder-quobyte-5d2eb21e-8606-4b8d-8204-ee8dfed22cf1" acquired by "delete_volume" :: waited 0.036s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:17:31 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3e99434-d966-4969-af8a-860e5e8423f8]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:17:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c6d9971f-f1fa-4dae-a2e0-041c3ba2b026 tempest-VolumesTransfersV355Test-1946404979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-5d2eb21e-8606-4b8d-8204-ee8dfed22cf1 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:17:31 devstack sudo[95269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-5d2eb21e-8606-4b8d-8204-ee8dfed22cf1 Nov 04 10:17:31 devstack sudo[95269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:17:32 devstack sudo[95269]: pam_unix(sudo:session): session closed for user root Nov 04 10:17:32 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c6d9971f-f1fa-4dae-a2e0-041c3ba2b026 tempest-VolumesTransfersV355Test-1946404979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-5d2eb21e-8606-4b8d-8204-ee8dfed22cf1" returned: 0 in 0.633s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:17:32 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c6d9971f-f1fa-4dae-a2e0-041c3ba2b026 tempest-VolumesTransfersV355Test-1946404979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-5d2eb21e-8606-4b8d-8204-ee8dfed22cf1 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:17:32 devstack sudo[95275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-5d2eb21e-8606-4b8d-8204-ee8dfed22cf1 Nov 04 10:17:32 devstack sudo[95275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:17:32 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-1442cd51-2892-4035-84be-ae4140e2c0e8 tempest-ServerRescueNegativeTestJSON-1843749401 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:17:32 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1442cd51-2892-4035-84be-ae4140e2c0e8 tempest-ServerRescueNegativeTestJSON-1843749401 None] Flow 'volume_create_manager' (b5d107c9-a8ef-4cfb-862f-d25f3a3c33c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:17:32 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1442cd51-2892-4035-84be-ae4140e2c0e8 tempest-ServerRescueNegativeTestJSON-1843749401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdf8223a-0f72-4511-ac9e-26abf980154e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:17:32 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1442cd51-2892-4035-84be-ae4140e2c0e8 tempest-ServerRescueNegativeTestJSON-1843749401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdf8223a-0f72-4511-ac9e-26abf980154e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:17:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1583987506',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b4116a7-e268-4e54-9d89-7c901d214a96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2406749842b4ae18d52740efef087eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:17:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:17:32Z,use_quota=True,user_id='1be7d8b1c91240e981e9fd8a27365a09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:17:32 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1442cd51-2892-4035-84be-ae4140e2c0e8 tempest-ServerRescueNegativeTestJSON-1843749401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8884a10-04d2-46be-a6be-2ba6b3e34ce0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:17:32 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1442cd51-2892-4035-84be-ae4140e2c0e8 tempest-ServerRescueNegativeTestJSON-1843749401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8884a10-04d2-46be-a6be-2ba6b3e34ce0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:17:32 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1442cd51-2892-4035-84be-ae4140e2c0e8 tempest-ServerRescueNegativeTestJSON-1843749401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fea4a1ad-a8ff-40c5-bf7f-749c5e8da4b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:17:32 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1442cd51-2892-4035-84be-ae4140e2c0e8 tempest-ServerRescueNegativeTestJSON-1843749401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fea4a1ad-a8ff-40c5-bf7f-749c5e8da4b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b4116a7-e268-4e54-9d89-7c901d214a96', 'volume_name': 'volume-7b4116a7-e268-4e54-9d89-7c901d214a96', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:17:32 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1442cd51-2892-4035-84be-ae4140e2c0e8 tempest-ServerRescueNegativeTestJSON-1843749401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbb6841e-a16d-45d9-8739-b3e8d3b83aae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:17:32 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1442cd51-2892-4035-84be-ae4140e2c0e8 tempest-ServerRescueNegativeTestJSON-1843749401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbb6841e-a16d-45d9-8739-b3e8d3b83aae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:17:32 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1442cd51-2892-4035-84be-ae4140e2c0e8 tempest-ServerRescueNegativeTestJSON-1843749401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9191d63-a440-4ed7-9c63-c95c581ca3d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:17:32 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-1442cd51-2892-4035-84be-ae4140e2c0e8 tempest-ServerRescueNegativeTestJSON-1843749401 None] Volume 7b4116a7-e268-4e54-9d89-7c901d214a96: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b4116a7-e268-4e54-9d89-7c901d214a96', 'volume_size': 1} Nov 04 10:17:32 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-1442cd51-2892-4035-84be-ae4140e2c0e8 tempest-ServerRescueNegativeTestJSON-1843749401 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:17:32 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-1442cd51-2892-4035-84be-ae4140e2c0e8 tempest-ServerRescueNegativeTestJSON-1843749401 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:17:32 devstack sudo[95275]: pam_unix(sudo:session): session closed for user root Nov 04 10:17:32 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-1442cd51-2892-4035-84be-ae4140e2c0e8 tempest-ServerRescueNegativeTestJSON-1843749401 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:17:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1583987506',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b4116a7-e268-4e54-9d89-7c901d214a96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2406749842b4ae18d52740efef087eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:17:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:17:32Z,use_quota=True,user_id='1be7d8b1c91240e981e9fd8a27365a09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 10:17:32 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-1442cd51-2892-4035-84be-ae4140e2c0e8 tempest-ServerRescueNegativeTestJSON-1843749401 None] Creating volume 7b4116a7-e268-4e54-9d89-7c901d214a96 {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:17:32 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-1442cd51-2892-4035-84be-ae4140e2c0e8 tempest-ServerRescueNegativeTestJSON-1843749401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:17:32 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-1442cd51-2892-4035-84be-ae4140e2c0e8 tempest-ServerRescueNegativeTestJSON-1843749401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:17:32 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-1442cd51-2892-4035-84be-ae4140e2c0e8 tempest-ServerRescueNegativeTestJSON-1843749401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:17:32 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-1442cd51-2892-4035-84be-ae4140e2c0e8 tempest-ServerRescueNegativeTestJSON-1843749401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:17:32 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-1442cd51-2892-4035-84be-ae4140e2c0e8 tempest-ServerRescueNegativeTestJSON-1843749401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:17:32 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-1442cd51-2892-4035-84be-ae4140e2c0e8 tempest-ServerRescueNegativeTestJSON-1843749401 None] Selected osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:17:32 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-1442cd51-2892-4035-84be-ae4140e2c0e8 tempest-ServerRescueNegativeTestJSON-1843749401 None] casted to osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 Nov 04 10:17:32 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-1442cd51-2892-4035-84be-ae4140e2c0e8 tempest-ServerRescueNegativeTestJSON-1843749401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-7b4116a7-e268-4e54-9d89-7c901d214a96 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:17:32 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c6d9971f-f1fa-4dae-a2e0-041c3ba2b026 tempest-VolumesTransfersV355Test-1946404979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-5d2eb21e-8606-4b8d-8204-ee8dfed22cf1" returned: 0 in 0.609s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:17:32 devstack sudo[95278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-7b4116a7-e268-4e54-9d89-7c901d214a96 1073741824 Nov 04 10:17:32 devstack sudo[95278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:17:32 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-c6d9971f-f1fa-4dae-a2e0-041c3ba2b026 tempest-VolumesTransfersV355Test-1946404979 None] Lock "cinder-quobyte-5d2eb21e-8606-4b8d-8204-ee8dfed22cf1" released by "delete_volume" :: held 1.380s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:17:33 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-c6d9971f-f1fa-4dae-a2e0-041c3ba2b026 tempest-VolumesTransfersV355Test-1946404979 None] Created reservations ['d7e5910e-9cc8-46ce-bdc0-b63b24c4f33d', '9938c849-ea04-432d-8c1d-d4720b19ec50', '4d72605c-ac39-46fb-8b2e-f48d30f51771', '74b9cca8-8f40-46bd-86b5-1d8b16c86b05'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:17:33 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-c6d9971f-f1fa-4dae-a2e0-041c3ba2b026 tempest-VolumesTransfersV355Test-1946404979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:17:33 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-c6d9971f-f1fa-4dae-a2e0-041c3ba2b026 tempest-VolumesTransfersV355Test-1946404979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:17:33 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-c6d9971f-f1fa-4dae-a2e0-041c3ba2b026 tempest-VolumesTransfersV355Test-1946404979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:17:33 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-c6d9971f-f1fa-4dae-a2e0-041c3ba2b026 tempest-VolumesTransfersV355Test-1946404979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:17:33 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-c6d9971f-f1fa-4dae-a2e0-041c3ba2b026 tempest-VolumesTransfersV355Test-1946404979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:17:33 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c6d9971f-f1fa-4dae-a2e0-041c3ba2b026 tempest-VolumesTransfersV355Test-1946404979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:17:33 devstack sudo[95282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:17:33 devstack sudo[95282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:17:33 devstack sudo[95282]: pam_unix(sudo:session): session closed for user root Nov 04 10:17:33 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c6d9971f-f1fa-4dae-a2e0-041c3ba2b026 tempest-VolumesTransfersV355Test-1946404979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.423s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:17:33 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-c6d9971f-f1fa-4dae-a2e0-041c3ba2b026 tempest-VolumesTransfersV355Test-1946404979 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:17:33 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-c6d9971f-f1fa-4dae-a2e0-041c3ba2b026 tempest-VolumesTransfersV355Test-1946404979 None] Deleted volume successfully. Nov 04 10:17:33 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-c6d9971f-f1fa-4dae-a2e0-041c3ba2b026 tempest-VolumesTransfersV355Test-1946404979 None] Lock "cinder-5d2eb21e-8606-4b8d-8204-ee8dfed22cf1-delete_volume" released by "delete_volume" :: held 2.298s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:17:33 devstack sudo[95278]: pam_unix(sudo:session): session closed for user root Nov 04 10:17:33 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-1442cd51-2892-4035-84be-ae4140e2c0e8 tempest-ServerRescueNegativeTestJSON-1843749401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-7b4116a7-e268-4e54-9d89-7c901d214a96 1073741824" returned: 0 in 0.948s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:17:33 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-1442cd51-2892-4035-84be-ae4140e2c0e8 tempest-ServerRescueNegativeTestJSON-1843749401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-7b4116a7-e268-4e54-9d89-7c901d214a96 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:17:33 devstack sudo[95286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-7b4116a7-e268-4e54-9d89-7c901d214a96 Nov 04 10:17:33 devstack sudo[95286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:17:34 devstack sudo[95286]: pam_unix(sudo:session): session closed for user root Nov 04 10:17:34 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-1442cd51-2892-4035-84be-ae4140e2c0e8 tempest-ServerRescueNegativeTestJSON-1843749401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-7b4116a7-e268-4e54-9d89-7c901d214a96" returned: 0 in 0.375s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:17:34 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-1442cd51-2892-4035-84be-ae4140e2c0e8 tempest-ServerRescueNegativeTestJSON-1843749401 None] <== create_volume: return (1418ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 10:17:34 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-1442cd51-2892-4035-84be-ae4140e2c0e8 tempest-ServerRescueNegativeTestJSON-1843749401 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.425s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:17:34 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1442cd51-2892-4035-84be-ae4140e2c0e8 tempest-ServerRescueNegativeTestJSON-1843749401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9191d63-a440-4ed7-9c63-c95c581ca3d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b4116a7-e268-4e54-9d89-7c901d214a96', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:17:34 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1442cd51-2892-4035-84be-ae4140e2c0e8 tempest-ServerRescueNegativeTestJSON-1843749401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2d331e1-a7bb-40fd-b9b0-6e20bd67d2a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:17:34 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-1442cd51-2892-4035-84be-ae4140e2c0e8 tempest-ServerRescueNegativeTestJSON-1843749401 None] Volume volume-7b4116a7-e268-4e54-9d89-7c901d214a96 (7b4116a7-e268-4e54-9d89-7c901d214a96): created successfully Nov 04 10:17:34 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1442cd51-2892-4035-84be-ae4140e2c0e8 tempest-ServerRescueNegativeTestJSON-1843749401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2d331e1-a7bb-40fd-b9b0-6e20bd67d2a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:17:34 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1442cd51-2892-4035-84be-ae4140e2c0e8 tempest-ServerRescueNegativeTestJSON-1843749401 None] Flow 'volume_create_manager' (b5d107c9-a8ef-4cfb-862f-d25f3a3c33c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:17:34 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-1442cd51-2892-4035-84be-ae4140e2c0e8 tempest-ServerRescueNegativeTestJSON-1843749401 None] Created volume successfully. Nov 04 10:17:44 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d202233-beb3-48fb-b156-38bd60dec2e1 tempest-VolumesServicesTestJSON-666871190 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:17:44 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-8d202233-beb3-48fb-b156-38bd60dec2e1 tempest-VolumesServicesTestJSON-666871190 None] Flow 'volume_create_manager' (18b54186-be36-467a-aadd-5a602e6169f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:17:44 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-8d202233-beb3-48fb-b156-38bd60dec2e1 tempest-VolumesServicesTestJSON-666871190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7e50a4a-7585-4a91-baa0-16ecc00cd137) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:17:44 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-8d202233-beb3-48fb-b156-38bd60dec2e1 tempest-VolumesServicesTestJSON-666871190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7e50a4a-7585-4a91-baa0-16ecc00cd137) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:17:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-529085904',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3da237cd-c3ab-463f-825c-342e5e0769df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a885579ae7e44cfaeab74e9344c88cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:17:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:17:44Z,use_quota=True,user_id='dd804449e8034455bec10f6a3f624492',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:17:44 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-8d202233-beb3-48fb-b156-38bd60dec2e1 tempest-VolumesServicesTestJSON-666871190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3450002-326e-4990-bb3d-b15758d28b92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:17:44 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-8d202233-beb3-48fb-b156-38bd60dec2e1 tempest-VolumesServicesTestJSON-666871190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3450002-326e-4990-bb3d-b15758d28b92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:17:44 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-8d202233-beb3-48fb-b156-38bd60dec2e1 tempest-VolumesServicesTestJSON-666871190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e25e9283-9b00-40bd-a31a-feeb86121f04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:17:44 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-8d202233-beb3-48fb-b156-38bd60dec2e1 tempest-VolumesServicesTestJSON-666871190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e25e9283-9b00-40bd-a31a-feeb86121f04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3da237cd-c3ab-463f-825c-342e5e0769df', 'volume_name': 'volume-3da237cd-c3ab-463f-825c-342e5e0769df', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:17:44 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-8d202233-beb3-48fb-b156-38bd60dec2e1 tempest-VolumesServicesTestJSON-666871190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63f01030-60f6-4ed0-92a1-43f63b45bdc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:17:44 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-8d202233-beb3-48fb-b156-38bd60dec2e1 tempest-VolumesServicesTestJSON-666871190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63f01030-60f6-4ed0-92a1-43f63b45bdc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:17:44 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-8d202233-beb3-48fb-b156-38bd60dec2e1 tempest-VolumesServicesTestJSON-666871190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fecd87b2-41b7-4f5f-bb0f-425e303938fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:17:44 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-8d202233-beb3-48fb-b156-38bd60dec2e1 tempest-VolumesServicesTestJSON-666871190 None] Volume 3da237cd-c3ab-463f-825c-342e5e0769df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3da237cd-c3ab-463f-825c-342e5e0769df', 'volume_size': 1} Nov 04 10:17:44 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-8d202233-beb3-48fb-b156-38bd60dec2e1 tempest-VolumesServicesTestJSON-666871190 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:17:44 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-8d202233-beb3-48fb-b156-38bd60dec2e1 tempest-VolumesServicesTestJSON-666871190 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:17:44 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-8d202233-beb3-48fb-b156-38bd60dec2e1 tempest-VolumesServicesTestJSON-666871190 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:17:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-529085904',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3da237cd-c3ab-463f-825c-342e5e0769df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a885579ae7e44cfaeab74e9344c88cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:17:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:17:44Z,use_quota=True,user_id='dd804449e8034455bec10f6a3f624492',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 10:17:44 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-8d202233-beb3-48fb-b156-38bd60dec2e1 tempest-VolumesServicesTestJSON-666871190 None] Creating volume 3da237cd-c3ab-463f-825c-342e5e0769df {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:17:44 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-8d202233-beb3-48fb-b156-38bd60dec2e1 tempest-VolumesServicesTestJSON-666871190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:17:44 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-8d202233-beb3-48fb-b156-38bd60dec2e1 tempest-VolumesServicesTestJSON-666871190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:17:44 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-8d202233-beb3-48fb-b156-38bd60dec2e1 tempest-VolumesServicesTestJSON-666871190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:17:44 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-8d202233-beb3-48fb-b156-38bd60dec2e1 tempest-VolumesServicesTestJSON-666871190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:17:44 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-8d202233-beb3-48fb-b156-38bd60dec2e1 tempest-VolumesServicesTestJSON-666871190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:17:44 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-8d202233-beb3-48fb-b156-38bd60dec2e1 tempest-VolumesServicesTestJSON-666871190 None] Selected osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:17:44 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-8d202233-beb3-48fb-b156-38bd60dec2e1 tempest-VolumesServicesTestJSON-666871190 None] casted to osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 Nov 04 10:17:44 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-8d202233-beb3-48fb-b156-38bd60dec2e1 tempest-VolumesServicesTestJSON-666871190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-3da237cd-c3ab-463f-825c-342e5e0769df 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:17:44 devstack sudo[95409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-3da237cd-c3ab-463f-825c-342e5e0769df 1073741824 Nov 04 10:17:44 devstack sudo[95409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:17:45 devstack sudo[95409]: pam_unix(sudo:session): session closed for user root Nov 04 10:17:45 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-8d202233-beb3-48fb-b156-38bd60dec2e1 tempest-VolumesServicesTestJSON-666871190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-3da237cd-c3ab-463f-825c-342e5e0769df 1073741824" returned: 0 in 0.743s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:17:45 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-8d202233-beb3-48fb-b156-38bd60dec2e1 tempest-VolumesServicesTestJSON-666871190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-3da237cd-c3ab-463f-825c-342e5e0769df {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:17:45 devstack sudo[95417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-3da237cd-c3ab-463f-825c-342e5e0769df Nov 04 10:17:45 devstack sudo[95417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:17:45 devstack sudo[95417]: pam_unix(sudo:session): session closed for user root Nov 04 10:17:45 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-8d202233-beb3-48fb-b156-38bd60dec2e1 tempest-VolumesServicesTestJSON-666871190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-3da237cd-c3ab-463f-825c-342e5e0769df" returned: 0 in 0.282s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:17:45 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-8d202233-beb3-48fb-b156-38bd60dec2e1 tempest-VolumesServicesTestJSON-666871190 None] <== create_volume: return (1083ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 10:17:45 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-8d202233-beb3-48fb-b156-38bd60dec2e1 tempest-VolumesServicesTestJSON-666871190 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.087s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:17:45 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-8d202233-beb3-48fb-b156-38bd60dec2e1 tempest-VolumesServicesTestJSON-666871190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fecd87b2-41b7-4f5f-bb0f-425e303938fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3da237cd-c3ab-463f-825c-342e5e0769df', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:17:45 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-8d202233-beb3-48fb-b156-38bd60dec2e1 tempest-VolumesServicesTestJSON-666871190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (883619f2-fcf3-4706-abe0-236c287c270d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:17:45 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-8d202233-beb3-48fb-b156-38bd60dec2e1 tempest-VolumesServicesTestJSON-666871190 None] Volume volume-3da237cd-c3ab-463f-825c-342e5e0769df (3da237cd-c3ab-463f-825c-342e5e0769df): created successfully Nov 04 10:17:45 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-8d202233-beb3-48fb-b156-38bd60dec2e1 tempest-VolumesServicesTestJSON-666871190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (883619f2-fcf3-4706-abe0-236c287c270d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:17:45 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-8d202233-beb3-48fb-b156-38bd60dec2e1 tempest-VolumesServicesTestJSON-666871190 None] Flow 'volume_create_manager' (18b54186-be36-467a-aadd-5a602e6169f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:17:45 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-8d202233-beb3-48fb-b156-38bd60dec2e1 tempest-VolumesServicesTestJSON-666871190 None] Created volume successfully. Nov 04 10:17:46 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-96515756-772b-4108-9c3d-044bc2663647 tempest-VolumesServicesTestJSON-666871190 None] Acquiring lock "cinder-3da237cd-c3ab-463f-825c-342e5e0769df-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:17:46 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-96515756-772b-4108-9c3d-044bc2663647 tempest-VolumesServicesTestJSON-666871190 None] Lock "cinder-3da237cd-c3ab-463f-825c-342e5e0769df-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:17:46 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-96515756-772b-4108-9c3d-044bc2663647 tempest-VolumesServicesTestJSON-666871190 None] Acquiring lock "cinder-quobyte-3da237cd-c3ab-463f-825c-342e5e0769df" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:17:46 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-96515756-772b-4108-9c3d-044bc2663647 tempest-VolumesServicesTestJSON-666871190 None] Lock "cinder-quobyte-3da237cd-c3ab-463f-825c-342e5e0769df" acquired by "delete_volume" :: waited 0.024s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:17:47 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[96675924-d78a-430b-856e-e05d9156f958]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:17:47 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-96515756-772b-4108-9c3d-044bc2663647 tempest-VolumesServicesTestJSON-666871190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-3da237cd-c3ab-463f-825c-342e5e0769df {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:17:47 devstack sudo[95454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-3da237cd-c3ab-463f-825c-342e5e0769df Nov 04 10:17:47 devstack sudo[95454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:17:47 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-acc8b0dc-3bec-4247-a86a-59dc3fe7596a tempest-VolumesCloneTest-261554110 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:17:47 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-acc8b0dc-3bec-4247-a86a-59dc3fe7596a tempest-VolumesCloneTest-261554110 None] Flow 'volume_create_manager' (09caf8c4-fbd8-49e0-b76b-73211fad4a42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:17:47 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-acc8b0dc-3bec-4247-a86a-59dc3fe7596a tempest-VolumesCloneTest-261554110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49460dff-e5fe-4f03-a8df-af92236c94ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:17:47 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-acc8b0dc-3bec-4247-a86a-59dc3fe7596a tempest-VolumesCloneTest-261554110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49460dff-e5fe-4f03-a8df-af92236c94ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:17:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-965996356',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01c26169-4b13-45cb-821c-2883b395e934,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e16350fc411349439ee95c19dec922eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:17:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:17:47Z,use_quota=True,user_id='3d6a84da2b2c43399162d2257b6df4d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:17:47 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-acc8b0dc-3bec-4247-a86a-59dc3fe7596a tempest-VolumesCloneTest-261554110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbc7a24d-f76e-490e-848f-b597d6b34ec3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:17:47 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-acc8b0dc-3bec-4247-a86a-59dc3fe7596a tempest-VolumesCloneTest-261554110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbc7a24d-f76e-490e-848f-b597d6b34ec3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:17:47 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-acc8b0dc-3bec-4247-a86a-59dc3fe7596a tempest-VolumesCloneTest-261554110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e78c7f2a-e7d3-43ef-a49b-c547ca3d701c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:17:47 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-acc8b0dc-3bec-4247-a86a-59dc3fe7596a tempest-VolumesCloneTest-261554110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e78c7f2a-e7d3-43ef-a49b-c547ca3d701c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '01c26169-4b13-45cb-821c-2883b395e934', 'volume_name': 'volume-01c26169-4b13-45cb-821c-2883b395e934', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:17:47 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-acc8b0dc-3bec-4247-a86a-59dc3fe7596a tempest-VolumesCloneTest-261554110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e47e01d8-2853-43ab-8287-050ae944a085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:17:47 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-acc8b0dc-3bec-4247-a86a-59dc3fe7596a tempest-VolumesCloneTest-261554110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e47e01d8-2853-43ab-8287-050ae944a085) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:17:47 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-acc8b0dc-3bec-4247-a86a-59dc3fe7596a tempest-VolumesCloneTest-261554110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a22fd5c-5fa7-42b0-a886-15051df7c159) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:17:47 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-acc8b0dc-3bec-4247-a86a-59dc3fe7596a tempest-VolumesCloneTest-261554110 None] Volume 01c26169-4b13-45cb-821c-2883b395e934: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-01c26169-4b13-45cb-821c-2883b395e934', 'volume_size': 1} Nov 04 10:17:47 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-acc8b0dc-3bec-4247-a86a-59dc3fe7596a tempest-VolumesCloneTest-261554110 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:17:47 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-acc8b0dc-3bec-4247-a86a-59dc3fe7596a tempest-VolumesCloneTest-261554110 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:17:47 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-acc8b0dc-3bec-4247-a86a-59dc3fe7596a tempest-VolumesCloneTest-261554110 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:17:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-965996356',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01c26169-4b13-45cb-821c-2883b395e934,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e16350fc411349439ee95c19dec922eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:17:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:17:47Z,use_quota=True,user_id='3d6a84da2b2c43399162d2257b6df4d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 10:17:47 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-acc8b0dc-3bec-4247-a86a-59dc3fe7596a tempest-VolumesCloneTest-261554110 None] Creating volume 01c26169-4b13-45cb-821c-2883b395e934 {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:17:47 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-acc8b0dc-3bec-4247-a86a-59dc3fe7596a tempest-VolumesCloneTest-261554110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:17:47 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-acc8b0dc-3bec-4247-a86a-59dc3fe7596a tempest-VolumesCloneTest-261554110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:17:47 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-acc8b0dc-3bec-4247-a86a-59dc3fe7596a tempest-VolumesCloneTest-261554110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:17:47 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-acc8b0dc-3bec-4247-a86a-59dc3fe7596a tempest-VolumesCloneTest-261554110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:17:47 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-acc8b0dc-3bec-4247-a86a-59dc3fe7596a tempest-VolumesCloneTest-261554110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:17:47 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-acc8b0dc-3bec-4247-a86a-59dc3fe7596a tempest-VolumesCloneTest-261554110 None] Selected osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:17:47 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-acc8b0dc-3bec-4247-a86a-59dc3fe7596a tempest-VolumesCloneTest-261554110 None] casted to osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 Nov 04 10:17:47 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-acc8b0dc-3bec-4247-a86a-59dc3fe7596a tempest-VolumesCloneTest-261554110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-01c26169-4b13-45cb-821c-2883b395e934 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:17:47 devstack sudo[95456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-01c26169-4b13-45cb-821c-2883b395e934 1073741824 Nov 04 10:17:47 devstack sudo[95456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:17:47 devstack sudo[95454]: pam_unix(sudo:session): session closed for user root Nov 04 10:17:47 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-96515756-772b-4108-9c3d-044bc2663647 tempest-VolumesServicesTestJSON-666871190 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-3da237cd-c3ab-463f-825c-342e5e0769df" returned: 0 in 0.562s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:17:47 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-96515756-772b-4108-9c3d-044bc2663647 tempest-VolumesServicesTestJSON-666871190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-3da237cd-c3ab-463f-825c-342e5e0769df {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:17:47 devstack sudo[95461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-3da237cd-c3ab-463f-825c-342e5e0769df Nov 04 10:17:47 devstack sudo[95461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:17:47 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-8256597e-15ac-459b-b843-bc045ca8f515 tempest-ServerRescueNegativeTestJSON-1843749401 None] Acquiring lock "cinder-7b4116a7-e268-4e54-9d89-7c901d214a96-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:17:47 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-8256597e-15ac-459b-b843-bc045ca8f515 tempest-ServerRescueNegativeTestJSON-1843749401 None] Lock "cinder-7b4116a7-e268-4e54-9d89-7c901d214a96-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:17:47 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-8256597e-15ac-459b-b843-bc045ca8f515 tempest-ServerRescueNegativeTestJSON-1843749401 None] Acquiring lock "cinder-quobyte-7b4116a7-e268-4e54-9d89-7c901d214a96" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:17:47 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-8256597e-15ac-459b-b843-bc045ca8f515 tempest-ServerRescueNegativeTestJSON-1843749401 None] Lock "cinder-quobyte-7b4116a7-e268-4e54-9d89-7c901d214a96" acquired by "delete_volume" :: waited 0.038s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:17:47 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[466d5c56-d290-4545-83c9-e9e53731d7ea]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:17:47 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-8256597e-15ac-459b-b843-bc045ca8f515 tempest-ServerRescueNegativeTestJSON-1843749401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-7b4116a7-e268-4e54-9d89-7c901d214a96 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:17:48 devstack sudo[95466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-7b4116a7-e268-4e54-9d89-7c901d214a96 Nov 04 10:17:48 devstack sudo[95466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:17:48 devstack sudo[95461]: pam_unix(sudo:session): session closed for user root Nov 04 10:17:48 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-96515756-772b-4108-9c3d-044bc2663647 tempest-VolumesServicesTestJSON-666871190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-3da237cd-c3ab-463f-825c-342e5e0769df" returned: 0 in 0.602s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:17:48 devstack sudo[95456]: pam_unix(sudo:session): session closed for user root Nov 04 10:17:48 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-96515756-772b-4108-9c3d-044bc2663647 tempest-VolumesServicesTestJSON-666871190 None] Lock "cinder-quobyte-3da237cd-c3ab-463f-825c-342e5e0769df" released by "delete_volume" :: held 1.273s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:17:48 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-acc8b0dc-3bec-4247-a86a-59dc3fe7596a tempest-VolumesCloneTest-261554110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-01c26169-4b13-45cb-821c-2883b395e934 1073741824" returned: 0 in 0.813s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:17:48 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-acc8b0dc-3bec-4247-a86a-59dc3fe7596a tempest-VolumesCloneTest-261554110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-01c26169-4b13-45cb-821c-2883b395e934 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:17:48 devstack sudo[95469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-01c26169-4b13-45cb-821c-2883b395e934 Nov 04 10:17:48 devstack sudo[95469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:17:48 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-96515756-772b-4108-9c3d-044bc2663647 tempest-VolumesServicesTestJSON-666871190 None] Created reservations ['52ca17b9-0c28-4b1b-8b75-fec91e769d39', '0e640074-4612-4055-a8e4-13af320612bc', 'a4198e85-bfde-43d0-90db-1075ab07eedd', '2c676a68-ba08-4cb3-9d2a-81b75b6ce523'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:17:48 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-96515756-772b-4108-9c3d-044bc2663647 tempest-VolumesServicesTestJSON-666871190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:17:48 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-96515756-772b-4108-9c3d-044bc2663647 tempest-VolumesServicesTestJSON-666871190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:17:48 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-96515756-772b-4108-9c3d-044bc2663647 tempest-VolumesServicesTestJSON-666871190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:17:48 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-96515756-772b-4108-9c3d-044bc2663647 tempest-VolumesServicesTestJSON-666871190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:17:48 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-96515756-772b-4108-9c3d-044bc2663647 tempest-VolumesServicesTestJSON-666871190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:17:48 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-96515756-772b-4108-9c3d-044bc2663647 tempest-VolumesServicesTestJSON-666871190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:17:48 devstack sudo[95466]: pam_unix(sudo:session): session closed for user root Nov 04 10:17:48 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-8256597e-15ac-459b-b843-bc045ca8f515 tempest-ServerRescueNegativeTestJSON-1843749401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-7b4116a7-e268-4e54-9d89-7c901d214a96" returned: 0 in 0.620s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:17:48 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-8256597e-15ac-459b-b843-bc045ca8f515 tempest-ServerRescueNegativeTestJSON-1843749401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-7b4116a7-e268-4e54-9d89-7c901d214a96 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:17:48 devstack sudo[95474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:17:48 devstack sudo[95474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:17:48 devstack sudo[95475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-7b4116a7-e268-4e54-9d89-7c901d214a96 Nov 04 10:17:48 devstack sudo[95475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:17:48 devstack sudo[95469]: pam_unix(sudo:session): session closed for user root Nov 04 10:17:48 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-acc8b0dc-3bec-4247-a86a-59dc3fe7596a tempest-VolumesCloneTest-261554110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-01c26169-4b13-45cb-821c-2883b395e934" returned: 0 in 0.352s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:17:48 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-acc8b0dc-3bec-4247-a86a-59dc3fe7596a tempest-VolumesCloneTest-261554110 None] <== create_volume: return (1267ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 10:17:48 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-acc8b0dc-3bec-4247-a86a-59dc3fe7596a tempest-VolumesCloneTest-261554110 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.270s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:17:48 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-acc8b0dc-3bec-4247-a86a-59dc3fe7596a tempest-VolumesCloneTest-261554110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a22fd5c-5fa7-42b0-a886-15051df7c159) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01c26169-4b13-45cb-821c-2883b395e934', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:17:48 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-acc8b0dc-3bec-4247-a86a-59dc3fe7596a tempest-VolumesCloneTest-261554110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (341599f8-fd63-4bdc-a622-c21fd3f8221f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:17:48 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-acc8b0dc-3bec-4247-a86a-59dc3fe7596a tempest-VolumesCloneTest-261554110 None] Volume volume-01c26169-4b13-45cb-821c-2883b395e934 (01c26169-4b13-45cb-821c-2883b395e934): created successfully Nov 04 10:17:48 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-acc8b0dc-3bec-4247-a86a-59dc3fe7596a tempest-VolumesCloneTest-261554110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (341599f8-fd63-4bdc-a622-c21fd3f8221f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:17:48 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-acc8b0dc-3bec-4247-a86a-59dc3fe7596a tempest-VolumesCloneTest-261554110 None] Flow 'volume_create_manager' (09caf8c4-fbd8-49e0-b76b-73211fad4a42) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:17:48 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-acc8b0dc-3bec-4247-a86a-59dc3fe7596a tempest-VolumesCloneTest-261554110 None] Created volume successfully. Nov 04 10:17:48 devstack sudo[95475]: pam_unix(sudo:session): session closed for user root Nov 04 10:17:48 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-8256597e-15ac-459b-b843-bc045ca8f515 tempest-ServerRescueNegativeTestJSON-1843749401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-7b4116a7-e268-4e54-9d89-7c901d214a96" returned: 0 in 0.420s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:17:48 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-8256597e-15ac-459b-b843-bc045ca8f515 tempest-ServerRescueNegativeTestJSON-1843749401 None] Lock "cinder-quobyte-7b4116a7-e268-4e54-9d89-7c901d214a96" released by "delete_volume" :: held 1.141s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:17:48 devstack sudo[95474]: pam_unix(sudo:session): session closed for user root Nov 04 10:17:48 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-96515756-772b-4108-9c3d-044bc2663647 tempest-VolumesServicesTestJSON-666871190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.483s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:17:48 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-96515756-772b-4108-9c3d-044bc2663647 tempest-VolumesServicesTestJSON-666871190 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:17:49 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-96515756-772b-4108-9c3d-044bc2663647 tempest-VolumesServicesTestJSON-666871190 None] Deleted volume successfully. Nov 04 10:17:49 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-96515756-772b-4108-9c3d-044bc2663647 tempest-VolumesServicesTestJSON-666871190 None] Lock "cinder-3da237cd-c3ab-463f-825c-342e5e0769df-delete_volume" released by "delete_volume" :: held 2.226s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:17:49 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-8256597e-15ac-459b-b843-bc045ca8f515 tempest-ServerRescueNegativeTestJSON-1843749401 None] Created reservations ['defce87f-d86e-4546-90be-ad2fdfc7b78c', '1eecbf27-e0c7-47d7-9cd0-a206e0d7df56', '7b83c028-644f-4210-98b7-1c821084b20c', 'd01a5cae-6102-47f5-aa26-3fdd9f0f1e0d'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:17:49 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-8256597e-15ac-459b-b843-bc045ca8f515 tempest-ServerRescueNegativeTestJSON-1843749401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:17:49 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-8256597e-15ac-459b-b843-bc045ca8f515 tempest-ServerRescueNegativeTestJSON-1843749401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:17:49 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-8256597e-15ac-459b-b843-bc045ca8f515 tempest-ServerRescueNegativeTestJSON-1843749401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:17:49 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-8256597e-15ac-459b-b843-bc045ca8f515 tempest-ServerRescueNegativeTestJSON-1843749401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:17:49 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-8256597e-15ac-459b-b843-bc045ca8f515 tempest-ServerRescueNegativeTestJSON-1843749401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:17:49 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-8256597e-15ac-459b-b843-bc045ca8f515 tempest-ServerRescueNegativeTestJSON-1843749401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:17:49 devstack sudo[95481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:17:49 devstack sudo[95481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:17:49 devstack sudo[95481]: pam_unix(sudo:session): session closed for user root Nov 04 10:17:49 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-8256597e-15ac-459b-b843-bc045ca8f515 tempest-ServerRescueNegativeTestJSON-1843749401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.367s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:17:49 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-8256597e-15ac-459b-b843-bc045ca8f515 tempest-ServerRescueNegativeTestJSON-1843749401 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:17:49 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-8256597e-15ac-459b-b843-bc045ca8f515 tempest-ServerRescueNegativeTestJSON-1843749401 None] Deleted volume successfully. Nov 04 10:17:49 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-8256597e-15ac-459b-b843-bc045ca8f515 tempest-ServerRescueNegativeTestJSON-1843749401 None] Lock "cinder-7b4116a7-e268-4e54-9d89-7c901d214a96-delete_volume" released by "delete_volume" :: held 1.942s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:17:50 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-aaf052c9-9e34-4e9c-aa21-82e271ec5e81 tempest-VolumesCloneTest-261554110 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:17:50 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-aaf052c9-9e34-4e9c-aa21-82e271ec5e81 tempest-VolumesCloneTest-261554110 None] Flow 'volume_create_manager' (51b9d9ef-f604-4446-b69b-7cb5660b14ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:17:50 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-aaf052c9-9e34-4e9c-aa21-82e271ec5e81 tempest-VolumesCloneTest-261554110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9219f60c-f724-48b1-940b-a8689399dee6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:17:50 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-aaf052c9-9e34-4e9c-aa21-82e271ec5e81 tempest-VolumesCloneTest-261554110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9219f60c-f724-48b1-940b-a8689399dee6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:17:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1238300316',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a8484d8-d07f-4c61-a2ec-b8f9860f073f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e16350fc411349439ee95c19dec922eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:17:50Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=01c26169-4b13-45cb-821c-2883b395e934,status='creating',terminated_at=None,updated_at=2026-11-04T09:17:50Z,use_quota=True,user_id='3d6a84da2b2c43399162d2257b6df4d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:17:50 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-aaf052c9-9e34-4e9c-aa21-82e271ec5e81 tempest-VolumesCloneTest-261554110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90e8229a-12fd-4b53-b908-54b4cab09a48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:17:50 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-aaf052c9-9e34-4e9c-aa21-82e271ec5e81 tempest-VolumesCloneTest-261554110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90e8229a-12fd-4b53-b908-54b4cab09a48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:17:50 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-aaf052c9-9e34-4e9c-aa21-82e271ec5e81 tempest-VolumesCloneTest-261554110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bcd19c6-cf9b-4a2f-b797-81748cc4af6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:17:50 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-aaf052c9-9e34-4e9c-aa21-82e271ec5e81 tempest-VolumesCloneTest-261554110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bcd19c6-cf9b-4a2f-b797-81748cc4af6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '0a8484d8-d07f-4c61-a2ec-b8f9860f073f', 'volume_name': 'volume-0a8484d8-d07f-4c61-a2ec-b8f9860f073f', 'volume_size': 2, 'source_volid': '01c26169-4b13-45cb-821c-2883b395e934', 'source_volstatus': 'available'}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:17:50 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-aaf052c9-9e34-4e9c-aa21-82e271ec5e81 tempest-VolumesCloneTest-261554110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (400d43f1-2102-433e-926b-31ccee0d5d9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:17:50 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-aaf052c9-9e34-4e9c-aa21-82e271ec5e81 tempest-VolumesCloneTest-261554110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (400d43f1-2102-433e-926b-31ccee0d5d9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:17:50 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-aaf052c9-9e34-4e9c-aa21-82e271ec5e81 tempest-VolumesCloneTest-261554110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (842bbf75-cd5f-4427-853a-549bdfefd185) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:17:50 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-aaf052c9-9e34-4e9c-aa21-82e271ec5e81 tempest-VolumesCloneTest-261554110 None] Volume 0a8484d8-d07f-4c61-a2ec-b8f9860f073f: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-0a8484d8-d07f-4c61-a2ec-b8f9860f073f', 'volume_size': 2, 'source_volid': '01c26169-4b13-45cb-821c-2883b395e934', 'source_volstatus': 'available'} Nov 04 10:17:50 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-aaf052c9-9e34-4e9c-aa21-82e271ec5e81 tempest-VolumesCloneTest-261554110 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:17:50 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-aaf052c9-9e34-4e9c-aa21-82e271ec5e81 tempest-VolumesCloneTest-261554110 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:17:50 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-aaf052c9-9e34-4e9c-aa21-82e271ec5e81 tempest-VolumesCloneTest-261554110 None] Cloning volume 01c26169-4b13-45cb-821c-2883b395e934 to volume 0a8484d8-d07f-4c61-a2ec-b8f9860f073f Nov 04 10:17:50 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-aaf052c9-9e34-4e9c-aa21-82e271ec5e81 tempest-VolumesCloneTest-261554110 None] Creating offline snapshot 3e35cb9e-5227-4230-b4c8-85163e9666d9 of volume 01c26169-4b13-45cb-821c-2883b395e934 {{(pid=87068) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 10:17:50 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[82fa58f7-7c56-4b13-bea2-67003db06a23]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:17:50 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-aaf052c9-9e34-4e9c-aa21-82e271ec5e81 tempest-VolumesCloneTest-261554110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-01c26169-4b13-45cb-821c-2883b395e934 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:17:50 devstack sudo[95484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-01c26169-4b13-45cb-821c-2883b395e934 Nov 04 10:17:50 devstack sudo[95484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:17:51 devstack sudo[95484]: pam_unix(sudo:session): session closed for user root Nov 04 10:17:51 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-aaf052c9-9e34-4e9c-aa21-82e271ec5e81 tempest-VolumesCloneTest-261554110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-01c26169-4b13-45cb-821c-2883b395e934" returned: 0 in 0.755s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:17:51 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-aaf052c9-9e34-4e9c-aa21-82e271ec5e81 tempest-VolumesCloneTest-261554110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-01c26169-4b13-45cb-821c-2883b395e934,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-01c26169-4b13-45cb-821c-2883b395e934.3e35cb9e-5227-4230-b4c8-85163e9666d9 1G {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:17:51 devstack sudo[95506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-01c26169-4b13-45cb-821c-2883b395e934,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-01c26169-4b13-45cb-821c-2883b395e934.3e35cb9e-5227-4230-b4c8-85163e9666d9 1G Nov 04 10:17:51 devstack sudo[95506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:17:51 devstack sudo[95506]: pam_unix(sudo:session): session closed for user root Nov 04 10:17:51 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-aaf052c9-9e34-4e9c-aa21-82e271ec5e81 tempest-VolumesCloneTest-261554110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-01c26169-4b13-45cb-821c-2883b395e934,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-01c26169-4b13-45cb-821c-2883b395e934.3e35cb9e-5227-4230-b4c8-85163e9666d9 1G" returned: 0 in 0.887s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:17:52 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-aaf052c9-9e34-4e9c-aa21-82e271ec5e81 tempest-VolumesCloneTest-261554110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01c26169-4b13-45cb-821c-2883b395e934 -F qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-01c26169-4b13-45cb-821c-2883b395e934.3e35cb9e-5227-4230-b4c8-85163e9666d9 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:17:52 devstack sudo[95521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01c26169-4b13-45cb-821c-2883b395e934 -F qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-01c26169-4b13-45cb-821c-2883b395e934.3e35cb9e-5227-4230-b4c8-85163e9666d9 Nov 04 10:17:52 devstack sudo[95521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:17:52 devstack sudo[95521]: pam_unix(sudo:session): session closed for user root Nov 04 10:17:52 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-aaf052c9-9e34-4e9c-aa21-82e271ec5e81 tempest-VolumesCloneTest-261554110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01c26169-4b13-45cb-821c-2883b395e934 -F qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-01c26169-4b13-45cb-821c-2883b395e934.3e35cb9e-5227-4230-b4c8-85163e9666d9" returned: 0 in 0.761s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:17:52 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-aaf052c9-9e34-4e9c-aa21-82e271ec5e81 tempest-VolumesCloneTest-261554110 None] /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-01c26169-4b13-45cb-821c-2883b395e934.3e35cb9e-5227-4230-b4c8-85163e9666d9 is being set with open permissions: ugo+rw Nov 04 10:17:52 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-aaf052c9-9e34-4e9c-aa21-82e271ec5e81 tempest-VolumesCloneTest-261554110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-01c26169-4b13-45cb-821c-2883b395e934.3e35cb9e-5227-4230-b4c8-85163e9666d9 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:17:52 devstack sudo[95529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-01c26169-4b13-45cb-821c-2883b395e934.3e35cb9e-5227-4230-b4c8-85163e9666d9 Nov 04 10:17:52 devstack sudo[95529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:17:53 devstack sudo[95529]: pam_unix(sudo:session): session closed for user root Nov 04 10:17:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-aaf052c9-9e34-4e9c-aa21-82e271ec5e81 tempest-VolumesCloneTest-261554110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-01c26169-4b13-45cb-821c-2883b395e934.3e35cb9e-5227-4230-b4c8-85163e9666d9" returned: 0 in 0.471s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:17:53 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd077e93-f0a5-4f71-bec8-971a5513c171 tempest-VolumesListAdminTestJSON-330589987 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:17:53 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-cd077e93-f0a5-4f71-bec8-971a5513c171 tempest-VolumesListAdminTestJSON-330589987 None] Flow 'volume_create_manager' (6349527c-bf09-4ee2-a808-fc50123c4a56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:17:53 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-cd077e93-f0a5-4f71-bec8-971a5513c171 tempest-VolumesListAdminTestJSON-330589987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37c897d2-8bd0-4273-8c9d-0c62d03534ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:17:53 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-cd077e93-f0a5-4f71-bec8-971a5513c171 tempest-VolumesListAdminTestJSON-330589987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37c897d2-8bd0-4273-8c9d-0c62d03534ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:17:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1572569085',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b64e7c90-d951-46bc-af74-f97ab2f8d232,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ff8cd9432af4422b6fa0fca7cab923c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:17:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:17:53Z,use_quota=True,user_id='6cb7131e74e54af38fde68ee2d2d42c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:17:53 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-cd077e93-f0a5-4f71-bec8-971a5513c171 tempest-VolumesListAdminTestJSON-330589987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77c99697-72f3-4e47-9895-e668ae1d0cee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:17:53 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-cd077e93-f0a5-4f71-bec8-971a5513c171 tempest-VolumesListAdminTestJSON-330589987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77c99697-72f3-4e47-9895-e668ae1d0cee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:17:53 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-cd077e93-f0a5-4f71-bec8-971a5513c171 tempest-VolumesListAdminTestJSON-330589987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bb08cc6-508c-4c00-84fa-9ccbfce1aee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:17:53 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-cd077e93-f0a5-4f71-bec8-971a5513c171 tempest-VolumesListAdminTestJSON-330589987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bb08cc6-508c-4c00-84fa-9ccbfce1aee2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b64e7c90-d951-46bc-af74-f97ab2f8d232', 'volume_name': 'volume-b64e7c90-d951-46bc-af74-f97ab2f8d232', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:17:53 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-cd077e93-f0a5-4f71-bec8-971a5513c171 tempest-VolumesListAdminTestJSON-330589987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e1f69e5-3a52-4f41-9164-ad56e17f580e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:17:53 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-cd077e93-f0a5-4f71-bec8-971a5513c171 tempest-VolumesListAdminTestJSON-330589987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e1f69e5-3a52-4f41-9164-ad56e17f580e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:17:53 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-cd077e93-f0a5-4f71-bec8-971a5513c171 tempest-VolumesListAdminTestJSON-330589987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cc2b314-2cb7-4be4-a09c-278fb266e87d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:17:53 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-cd077e93-f0a5-4f71-bec8-971a5513c171 tempest-VolumesListAdminTestJSON-330589987 None] Volume b64e7c90-d951-46bc-af74-f97ab2f8d232: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b64e7c90-d951-46bc-af74-f97ab2f8d232', 'volume_size': 1} Nov 04 10:17:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-cd077e93-f0a5-4f71-bec8-971a5513c171 tempest-VolumesListAdminTestJSON-330589987 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:17:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-aaf052c9-9e34-4e9c-aa21-82e271ec5e81 tempest-VolumesCloneTest-261554110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-01c26169-4b13-45cb-821c-2883b395e934.info {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:17:53 devstack sudo[95532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-01c26169-4b13-45cb-821c-2883b395e934.info Nov 04 10:17:53 devstack sudo[95532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:17:53 devstack cinder-volume[87068]: DEBUG oslo_service.periodic_task [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87068) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 10:17:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:17:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:17:53 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:17:53 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:17:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:17:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:17:53 devstack sudo[95534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:17:53 devstack sudo[95534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:17:53 devstack sudo[95532]: pam_unix(sudo:session): session closed for user root Nov 04 10:17:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-aaf052c9-9e34-4e9c-aa21-82e271ec5e81 tempest-VolumesCloneTest-261554110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-01c26169-4b13-45cb-821c-2883b395e934.info" returned: 0 in 0.512s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:17:53 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-aaf052c9-9e34-4e9c-aa21-82e271ec5e81 tempest-VolumesCloneTest-261554110 None] /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-01c26169-4b13-45cb-821c-2883b395e934.info is being set with open permissions: ugo+rw Nov 04 10:17:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-aaf052c9-9e34-4e9c-aa21-82e271ec5e81 tempest-VolumesCloneTest-261554110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-01c26169-4b13-45cb-821c-2883b395e934.info {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:17:54 devstack sudo[95537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-01c26169-4b13-45cb-821c-2883b395e934.info Nov 04 10:17:54 devstack sudo[95537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:17:54 devstack sudo[95534]: pam_unix(sudo:session): session closed for user root Nov 04 10:17:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.533s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:17:54 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:17:54 devstack cinder-volume[87068]: DEBUG oslo_service.periodic_task [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Running periodic task VolumeManager._thread_info {{(pid=87068) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 10:17:54 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] thread count: 28 {{(pid=87068) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 04 10:17:54 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] thread info: [<_MainThread(MainThread, started 126275656192128)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87068) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 04 10:17:54 devstack sudo[95537]: pam_unix(sudo:session): session closed for user root Nov 04 10:17:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-aaf052c9-9e34-4e9c-aa21-82e271ec5e81 tempest-VolumesCloneTest-261554110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-01c26169-4b13-45cb-821c-2883b395e934.info" returned: 0 in 0.532s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:17:54 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-aaf052c9-9e34-4e9c-aa21-82e271ec5e81 tempest-VolumesCloneTest-261554110 None] Acquiring lock "cinder-quobyte-0a8484d8-d07f-4c61-a2ec-b8f9860f073f" by "_copy_volume_from_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:17:54 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-aaf052c9-9e34-4e9c-aa21-82e271ec5e81 tempest-VolumesCloneTest-261554110 None] Lock "cinder-quobyte-0a8484d8-d07f-4c61-a2ec-b8f9860f073f" acquired by "_copy_volume_from_snapshot" :: waited 0.048s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:17:54 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-aaf052c9-9e34-4e9c-aa21-82e271ec5e81 tempest-VolumesCloneTest-261554110 None] snapshot: 3e35cb9e-5227-4230-b4c8-85163e9666d9, volume: 0a8484d8-d07f-4c61-a2ec-b8f9860f073f, {{(pid=87068) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 04 10:17:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-aaf052c9-9e34-4e9c-aa21-82e271ec5e81 tempest-VolumesCloneTest-261554110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:17:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-aaf052c9-9e34-4e9c-aa21-82e271ec5e81 tempest-VolumesCloneTest-261554110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:17:54 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-aaf052c9-9e34-4e9c-aa21-82e271ec5e81 tempest-VolumesCloneTest-261554110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:17:54 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-aaf052c9-9e34-4e9c-aa21-82e271ec5e81 tempest-VolumesCloneTest-261554110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:17:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-aaf052c9-9e34-4e9c-aa21-82e271ec5e81 tempest-VolumesCloneTest-261554110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:17:54 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[10c31714-d435-4e45-a8ff-cb8f892213fe]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:17:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-aaf052c9-9e34-4e9c-aa21-82e271ec5e81 tempest-VolumesCloneTest-261554110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-01c26169-4b13-45cb-821c-2883b395e934.3e35cb9e-5227-4230-b4c8-85163e9666d9 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:17:54 devstack sudo[95558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-01c26169-4b13-45cb-821c-2883b395e934.3e35cb9e-5227-4230-b4c8-85163e9666d9 Nov 04 10:17:54 devstack sudo[95558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:17:55 devstack sudo[95558]: pam_unix(sudo:session): session closed for user root Nov 04 10:17:55 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-aaf052c9-9e34-4e9c-aa21-82e271ec5e81 tempest-VolumesCloneTest-261554110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-01c26169-4b13-45cb-821c-2883b395e934.3e35cb9e-5227-4230-b4c8-85163e9666d9" returned: 0 in 0.464s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:17:55 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-aaf052c9-9e34-4e9c-aa21-82e271ec5e81 tempest-VolumesCloneTest-261554110 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-01c26169-4b13-45cb-821c-2883b395e934(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87068) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 10:17:55 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[00de756f-9974-4031-83cc-b7870b2a7938]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:17:55 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-aaf052c9-9e34-4e9c-aa21-82e271ec5e81 tempest-VolumesCloneTest-261554110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-01c26169-4b13-45cb-821c-2883b395e934 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:17:55 devstack sudo[95569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-01c26169-4b13-45cb-821c-2883b395e934 Nov 04 10:17:55 devstack sudo[95569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:17:55 devstack sudo[95569]: pam_unix(sudo:session): session closed for user root Nov 04 10:17:55 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-aaf052c9-9e34-4e9c-aa21-82e271ec5e81 tempest-VolumesCloneTest-261554110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-01c26169-4b13-45cb-821c-2883b395e934" returned: 0 in 0.489s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:17:55 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-aaf052c9-9e34-4e9c-aa21-82e271ec5e81 tempest-VolumesCloneTest-261554110 None] will copy from snapshot at /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-01c26169-4b13-45cb-821c-2883b395e934 {{(pid=87068) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 04 10:17:55 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-aaf052c9-9e34-4e9c-aa21-82e271ec5e81 tempest-VolumesCloneTest-261554110 None] Creating direct copy from snapshot {{(pid=87068) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 04 10:17:55 devstack cinder-volume[87068]: DEBUG cinder.utils [None req-aaf052c9-9e34-4e9c-aa21-82e271ec5e81 tempest-VolumesCloneTest-261554110 None] Path /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-0a8484d8-d07f-4c61-a2ec-b8f9860f073f not found in is_blk_device check {{(pid=87068) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 04 10:17:55 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-aaf052c9-9e34-4e9c-aa21-82e271ec5e81 tempest-VolumesCloneTest-261554110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-01c26169-4b13-45cb-821c-2883b395e934 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-0a8484d8-d07f-4c61-a2ec-b8f9860f073f {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:17:55 devstack sudo[95574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-01c26169-4b13-45cb-821c-2883b395e934 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-0a8484d8-d07f-4c61-a2ec-b8f9860f073f Nov 04 10:17:55 devstack sudo[95574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:18:03 devstack cinder-volume[87068]: DEBUG dbcounter [-] [87068] Writing DB stats cinder:SELECT=46,cinder:UPDATE=57,cinder:INSERT=17,cinder:DELETE=6 {{(pid=87068) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 10:18:03 devstack cinder-volume[87068]: DEBUG dbcounter [-] [87068] Writing DB stats cinder:SELECT=40,cinder:UPDATE=63,cinder:DELETE=5,cinder:INSERT=11 {{(pid=87068) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 10:18:03 devstack sudo[95574]: pam_unix(sudo:session): session closed for user root Nov 04 10:18:03 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-aaf052c9-9e34-4e9c-aa21-82e271ec5e81 tempest-VolumesCloneTest-261554110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-01c26169-4b13-45cb-821c-2883b395e934 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-0a8484d8-d07f-4c61-a2ec-b8f9860f073f" returned: 0 in 8.296s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:18:03 devstack cinder-volume[87068]: DEBUG cinder.image.image_utils [None req-aaf052c9-9e34-4e9c-aa21-82e271ec5e81 tempest-VolumesCloneTest-261554110 None] Image conversion details: src /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-01c26169-4b13-45cb-821c-2883b395e934, size 1024.00 MB, duration 8.30 sec, destination /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-0a8484d8-d07f-4c61-a2ec-b8f9860f073f {{(pid=87068) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 04 10:18:03 devstack cinder-volume[87068]: INFO cinder.image.image_utils [None req-aaf052c9-9e34-4e9c-aa21-82e271ec5e81 tempest-VolumesCloneTest-261554110 None] Converted 1024.00 MB image at 123.42 MB/s Nov 04 10:18:03 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-aaf052c9-9e34-4e9c-aa21-82e271ec5e81 tempest-VolumesCloneTest-261554110 None] /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-0a8484d8-d07f-4c61-a2ec-b8f9860f073f is being set with open permissions: ugo+rw Nov 04 10:18:03 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-aaf052c9-9e34-4e9c-aa21-82e271ec5e81 tempest-VolumesCloneTest-261554110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-0a8484d8-d07f-4c61-a2ec-b8f9860f073f {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:18:03 devstack sudo[95594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-0a8484d8-d07f-4c61-a2ec-b8f9860f073f Nov 04 10:18:03 devstack sudo[95594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:18:04 devstack sudo[95594]: pam_unix(sudo:session): session closed for user root Nov 04 10:18:04 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-aaf052c9-9e34-4e9c-aa21-82e271ec5e81 tempest-VolumesCloneTest-261554110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-0a8484d8-d07f-4c61-a2ec-b8f9860f073f" returned: 0 in 0.308s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:18:04 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-aaf052c9-9e34-4e9c-aa21-82e271ec5e81 tempest-VolumesCloneTest-261554110 None] Lock "cinder-quobyte-0a8484d8-d07f-4c61-a2ec-b8f9860f073f" released by "_copy_volume_from_snapshot" :: held 9.724s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:18:04 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-aaf052c9-9e34-4e9c-aa21-82e271ec5e81 tempest-VolumesCloneTest-261554110 None] Acquiring lock "cinder-quobyte-3e35cb9e-5227-4230-b4c8-85163e9666d9" by "_delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:18:04 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-aaf052c9-9e34-4e9c-aa21-82e271ec5e81 tempest-VolumesCloneTest-261554110 None] Lock "cinder-quobyte-3e35cb9e-5227-4230-b4c8-85163e9666d9" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:18:04 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-aaf052c9-9e34-4e9c-aa21-82e271ec5e81 tempest-VolumesCloneTest-261554110 None] Deleting offline snapshot 3e35cb9e-5227-4230-b4c8-85163e9666d9 of volume 01c26169-4b13-45cb-821c-2883b395e934 {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 10:18:04 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-aaf052c9-9e34-4e9c-aa21-82e271ec5e81 tempest-VolumesCloneTest-261554110 None] snapshot_file for this snap is: volume-01c26169-4b13-45cb-821c-2883b395e934.3e35cb9e-5227-4230-b4c8-85163e9666d9 {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 10:18:04 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b9d397f-2828-4577-81eb-790a4e6dd9ed]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:18:04 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-aaf052c9-9e34-4e9c-aa21-82e271ec5e81 tempest-VolumesCloneTest-261554110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-01c26169-4b13-45cb-821c-2883b395e934.3e35cb9e-5227-4230-b4c8-85163e9666d9 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:18:04 devstack sudo[95597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-01c26169-4b13-45cb-821c-2883b395e934.3e35cb9e-5227-4230-b4c8-85163e9666d9 Nov 04 10:18:04 devstack sudo[95597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:18:04 devstack sudo[95597]: pam_unix(sudo:session): session closed for user root Nov 04 10:18:04 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-aaf052c9-9e34-4e9c-aa21-82e271ec5e81 tempest-VolumesCloneTest-261554110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-01c26169-4b13-45cb-821c-2883b395e934.3e35cb9e-5227-4230-b4c8-85163e9666d9" returned: 0 in 0.431s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:18:04 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-aaf052c9-9e34-4e9c-aa21-82e271ec5e81 tempest-VolumesCloneTest-261554110 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-01c26169-4b13-45cb-821c-2883b395e934(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87068) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 10:18:04 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d4965cd-20c8-4450-afa8-0b1e3497e0b0]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:18:04 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-aaf052c9-9e34-4e9c-aa21-82e271ec5e81 tempest-VolumesCloneTest-261554110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-01c26169-4b13-45cb-821c-2883b395e934 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:18:04 devstack sudo[95603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-01c26169-4b13-45cb-821c-2883b395e934 Nov 04 10:18:04 devstack sudo[95603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:18:05 devstack sudo[95603]: pam_unix(sudo:session): session closed for user root Nov 04 10:18:05 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-aaf052c9-9e34-4e9c-aa21-82e271ec5e81 tempest-VolumesCloneTest-261554110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-01c26169-4b13-45cb-821c-2883b395e934" returned: 0 in 0.597s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:18:05 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-aaf052c9-9e34-4e9c-aa21-82e271ec5e81 tempest-VolumesCloneTest-261554110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-01c26169-4b13-45cb-821c-2883b395e934.3e35cb9e-5227-4230-b4c8-85163e9666d9 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:18:05 devstack sudo[95609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-01c26169-4b13-45cb-821c-2883b395e934.3e35cb9e-5227-4230-b4c8-85163e9666d9 Nov 04 10:18:05 devstack sudo[95609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:18:05 devstack sudo[95609]: pam_unix(sudo:session): session closed for user root Nov 04 10:18:05 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-aaf052c9-9e34-4e9c-aa21-82e271ec5e81 tempest-VolumesCloneTest-261554110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-01c26169-4b13-45cb-821c-2883b395e934.3e35cb9e-5227-4230-b4c8-85163e9666d9" returned: 0 in 0.411s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:18:05 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-aaf052c9-9e34-4e9c-aa21-82e271ec5e81 tempest-VolumesCloneTest-261554110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-01c26169-4b13-45cb-821c-2883b395e934.3e35cb9e-5227-4230-b4c8-85163e9666d9 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:18:05 devstack sudo[95614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-01c26169-4b13-45cb-821c-2883b395e934.3e35cb9e-5227-4230-b4c8-85163e9666d9 Nov 04 10:18:05 devstack sudo[95614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:18:06 devstack sudo[95614]: pam_unix(sudo:session): session closed for user root Nov 04 10:18:06 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-aaf052c9-9e34-4e9c-aa21-82e271ec5e81 tempest-VolumesCloneTest-261554110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-01c26169-4b13-45cb-821c-2883b395e934.3e35cb9e-5227-4230-b4c8-85163e9666d9" returned: 0 in 0.270s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:18:06 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-aaf052c9-9e34-4e9c-aa21-82e271ec5e81 tempest-VolumesCloneTest-261554110 None] Lock "cinder-quobyte-3e35cb9e-5227-4230-b4c8-85163e9666d9" released by "_delete_snapshot" :: held 1.868s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:18:06 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-aaf052c9-9e34-4e9c-aa21-82e271ec5e81 tempest-VolumesCloneTest-261554110 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 15.981s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:18:06 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-cd077e93-f0a5-4f71-bec8-971a5513c171 tempest-VolumesListAdminTestJSON-330589987 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.835s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:18:06 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-cd077e93-f0a5-4f71-bec8-971a5513c171 tempest-VolumesListAdminTestJSON-330589987 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:17:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1572569085',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b64e7c90-d951-46bc-af74-f97ab2f8d232,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ff8cd9432af4422b6fa0fca7cab923c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:17:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:17:53Z,use_quota=True,user_id='6cb7131e74e54af38fde68ee2d2d42c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 10:18:06 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-cd077e93-f0a5-4f71-bec8-971a5513c171 tempest-VolumesListAdminTestJSON-330589987 None] Creating volume b64e7c90-d951-46bc-af74-f97ab2f8d232 {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:18:06 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-cd077e93-f0a5-4f71-bec8-971a5513c171 tempest-VolumesListAdminTestJSON-330589987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:18:06 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-cd077e93-f0a5-4f71-bec8-971a5513c171 tempest-VolumesListAdminTestJSON-330589987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:18:06 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-cd077e93-f0a5-4f71-bec8-971a5513c171 tempest-VolumesListAdminTestJSON-330589987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:18:06 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-cd077e93-f0a5-4f71-bec8-971a5513c171 tempest-VolumesListAdminTestJSON-330589987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:18:06 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-cd077e93-f0a5-4f71-bec8-971a5513c171 tempest-VolumesListAdminTestJSON-330589987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:18:06 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-cd077e93-f0a5-4f71-bec8-971a5513c171 tempest-VolumesListAdminTestJSON-330589987 None] Selected osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:18:06 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-cd077e93-f0a5-4f71-bec8-971a5513c171 tempest-VolumesListAdminTestJSON-330589987 None] casted to osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 Nov 04 10:18:06 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-cd077e93-f0a5-4f71-bec8-971a5513c171 tempest-VolumesListAdminTestJSON-330589987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b64e7c90-d951-46bc-af74-f97ab2f8d232 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:18:06 devstack sudo[95617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b64e7c90-d951-46bc-af74-f97ab2f8d232 1073741824 Nov 04 10:18:06 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-aaf052c9-9e34-4e9c-aa21-82e271ec5e81 tempest-VolumesCloneTest-261554110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (842bbf75-cd5f-4427-853a-549bdfefd185) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a8484d8-d07f-4c61-a2ec-b8f9860f073f', 'volume_size': 2, 'source_volid': '01c26169-4b13-45cb-821c-2883b395e934', 'source_volstatus': 'available'}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:18:06 devstack sudo[95617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:18:06 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-aaf052c9-9e34-4e9c-aa21-82e271ec5e81 tempest-VolumesCloneTest-261554110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ca7cb6b-be3e-43dc-9ef8-ff4cfcd115fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:18:06 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-aaf052c9-9e34-4e9c-aa21-82e271ec5e81 tempest-VolumesCloneTest-261554110 None] Volume volume-0a8484d8-d07f-4c61-a2ec-b8f9860f073f (0a8484d8-d07f-4c61-a2ec-b8f9860f073f): created successfully Nov 04 10:18:06 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-aaf052c9-9e34-4e9c-aa21-82e271ec5e81 tempest-VolumesCloneTest-261554110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ca7cb6b-be3e-43dc-9ef8-ff4cfcd115fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:18:06 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-aaf052c9-9e34-4e9c-aa21-82e271ec5e81 tempest-VolumesCloneTest-261554110 None] Flow 'volume_create_manager' (51b9d9ef-f604-4446-b69b-7cb5660b14ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:18:06 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-aaf052c9-9e34-4e9c-aa21-82e271ec5e81 tempest-VolumesCloneTest-261554110 None] Created volume successfully. Nov 04 10:18:06 devstack sudo[95617]: pam_unix(sudo:session): session closed for user root Nov 04 10:18:06 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-cd077e93-f0a5-4f71-bec8-971a5513c171 tempest-VolumesListAdminTestJSON-330589987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b64e7c90-d951-46bc-af74-f97ab2f8d232 1073741824" returned: 0 in 0.583s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:18:06 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-cd077e93-f0a5-4f71-bec8-971a5513c171 tempest-VolumesListAdminTestJSON-330589987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b64e7c90-d951-46bc-af74-f97ab2f8d232 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:18:06 devstack sudo[95623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b64e7c90-d951-46bc-af74-f97ab2f8d232 Nov 04 10:18:06 devstack sudo[95623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:18:07 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-4e525ed8-e2c9-4679-9e69-8fa530a8fb4b tempest-VolumesCloneTest-261554110 None] Acquiring lock "cinder-0a8484d8-d07f-4c61-a2ec-b8f9860f073f-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:18:07 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-4e525ed8-e2c9-4679-9e69-8fa530a8fb4b tempest-VolumesCloneTest-261554110 None] Lock "cinder-0a8484d8-d07f-4c61-a2ec-b8f9860f073f-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:18:07 devstack sudo[95623]: pam_unix(sudo:session): session closed for user root Nov 04 10:18:07 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-cd077e93-f0a5-4f71-bec8-971a5513c171 tempest-VolumesListAdminTestJSON-330589987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b64e7c90-d951-46bc-af74-f97ab2f8d232" returned: 0 in 0.368s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:18:07 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-cd077e93-f0a5-4f71-bec8-971a5513c171 tempest-VolumesListAdminTestJSON-330589987 None] <== create_volume: return (999ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 10:18:07 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-cd077e93-f0a5-4f71-bec8-971a5513c171 tempest-VolumesListAdminTestJSON-330589987 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.002s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:18:07 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-cd077e93-f0a5-4f71-bec8-971a5513c171 tempest-VolumesListAdminTestJSON-330589987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cc2b314-2cb7-4be4-a09c-278fb266e87d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b64e7c90-d951-46bc-af74-f97ab2f8d232', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:18:07 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-cd077e93-f0a5-4f71-bec8-971a5513c171 tempest-VolumesListAdminTestJSON-330589987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b28803a6-acbf-4f78-bdca-1441510e0542) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:18:07 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-cd077e93-f0a5-4f71-bec8-971a5513c171 tempest-VolumesListAdminTestJSON-330589987 None] Volume volume-b64e7c90-d951-46bc-af74-f97ab2f8d232 (b64e7c90-d951-46bc-af74-f97ab2f8d232): created successfully Nov 04 10:18:07 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-cd077e93-f0a5-4f71-bec8-971a5513c171 tempest-VolumesListAdminTestJSON-330589987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b28803a6-acbf-4f78-bdca-1441510e0542) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:18:07 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-cd077e93-f0a5-4f71-bec8-971a5513c171 tempest-VolumesListAdminTestJSON-330589987 None] Flow 'volume_create_manager' (6349527c-bf09-4ee2-a808-fc50123c4a56) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:18:07 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-4e525ed8-e2c9-4679-9e69-8fa530a8fb4b tempest-VolumesCloneTest-261554110 None] Acquiring lock "cinder-quobyte-0a8484d8-d07f-4c61-a2ec-b8f9860f073f" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:18:07 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-cd077e93-f0a5-4f71-bec8-971a5513c171 tempest-VolumesListAdminTestJSON-330589987 None] Created volume successfully. Nov 04 10:18:07 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-4e525ed8-e2c9-4679-9e69-8fa530a8fb4b tempest-VolumesCloneTest-261554110 None] Lock "cinder-quobyte-0a8484d8-d07f-4c61-a2ec-b8f9860f073f" acquired by "delete_volume" :: waited 0.022s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:18:07 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[53581d10-d9a7-41f8-b339-46e9b17f7bed]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:18:07 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-4e525ed8-e2c9-4679-9e69-8fa530a8fb4b tempest-VolumesCloneTest-261554110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-0a8484d8-d07f-4c61-a2ec-b8f9860f073f {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:18:07 devstack sudo[95626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-0a8484d8-d07f-4c61-a2ec-b8f9860f073f Nov 04 10:18:07 devstack sudo[95626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:18:07 devstack sudo[95626]: pam_unix(sudo:session): session closed for user root Nov 04 10:18:07 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-4e525ed8-e2c9-4679-9e69-8fa530a8fb4b tempest-VolumesCloneTest-261554110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-0a8484d8-d07f-4c61-a2ec-b8f9860f073f" returned: 0 in 0.469s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:18:07 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-4e525ed8-e2c9-4679-9e69-8fa530a8fb4b tempest-VolumesCloneTest-261554110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-0a8484d8-d07f-4c61-a2ec-b8f9860f073f {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:18:07 devstack sudo[95631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-0a8484d8-d07f-4c61-a2ec-b8f9860f073f Nov 04 10:18:07 devstack sudo[95631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:18:08 devstack sudo[95631]: pam_unix(sudo:session): session closed for user root Nov 04 10:18:08 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-4e525ed8-e2c9-4679-9e69-8fa530a8fb4b tempest-VolumesCloneTest-261554110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-0a8484d8-d07f-4c61-a2ec-b8f9860f073f" returned: 0 in 0.407s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:18:08 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-4e525ed8-e2c9-4679-9e69-8fa530a8fb4b tempest-VolumesCloneTest-261554110 None] Lock "cinder-quobyte-0a8484d8-d07f-4c61-a2ec-b8f9860f073f" released by "delete_volume" :: held 0.946s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:18:08 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f354c85-e9a6-4ef1-98f7-359c42c06177 tempest-VolumesListAdminTestJSON-330589987 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:18:08 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-5f354c85-e9a6-4ef1-98f7-359c42c06177 tempest-VolumesListAdminTestJSON-330589987 None] Flow 'volume_create_manager' (2eeedf1d-23ca-4805-ac06-4047cfd2152a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:18:08 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-5f354c85-e9a6-4ef1-98f7-359c42c06177 tempest-VolumesListAdminTestJSON-330589987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (482840db-ea08-470b-bae2-268084a64ccc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:18:08 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-5f354c85-e9a6-4ef1-98f7-359c42c06177 tempest-VolumesListAdminTestJSON-330589987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (482840db-ea08-470b-bae2-268084a64ccc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:18:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1352650078',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f364591d-ab6e-4221-85d6-5cfbdcf1b3c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ff8cd9432af4422b6fa0fca7cab923c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:18:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:18:08Z,use_quota=True,user_id='6cb7131e74e54af38fde68ee2d2d42c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:18:08 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-5f354c85-e9a6-4ef1-98f7-359c42c06177 tempest-VolumesListAdminTestJSON-330589987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26aaa3ab-0c2c-491a-a848-d97cac890cbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:18:08 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-5f354c85-e9a6-4ef1-98f7-359c42c06177 tempest-VolumesListAdminTestJSON-330589987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26aaa3ab-0c2c-491a-a848-d97cac890cbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:18:08 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-5f354c85-e9a6-4ef1-98f7-359c42c06177 tempest-VolumesListAdminTestJSON-330589987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c349b50b-a97b-42db-80f4-fbe0faa0d82a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:18:08 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-5f354c85-e9a6-4ef1-98f7-359c42c06177 tempest-VolumesListAdminTestJSON-330589987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c349b50b-a97b-42db-80f4-fbe0faa0d82a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f364591d-ab6e-4221-85d6-5cfbdcf1b3c8', 'volume_name': 'volume-f364591d-ab6e-4221-85d6-5cfbdcf1b3c8', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:18:08 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-5f354c85-e9a6-4ef1-98f7-359c42c06177 tempest-VolumesListAdminTestJSON-330589987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e62733f4-0ba2-4488-a54b-b07b15ffb364) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:18:08 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-5f354c85-e9a6-4ef1-98f7-359c42c06177 tempest-VolumesListAdminTestJSON-330589987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e62733f4-0ba2-4488-a54b-b07b15ffb364) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:18:08 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-5f354c85-e9a6-4ef1-98f7-359c42c06177 tempest-VolumesListAdminTestJSON-330589987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f7a1058-3cb4-4706-973f-6dd5d8c256a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:18:08 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-5f354c85-e9a6-4ef1-98f7-359c42c06177 tempest-VolumesListAdminTestJSON-330589987 None] Volume f364591d-ab6e-4221-85d6-5cfbdcf1b3c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f364591d-ab6e-4221-85d6-5cfbdcf1b3c8', 'volume_size': 1} Nov 04 10:18:08 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-5f354c85-e9a6-4ef1-98f7-359c42c06177 tempest-VolumesListAdminTestJSON-330589987 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:18:08 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-5f354c85-e9a6-4ef1-98f7-359c42c06177 tempest-VolumesListAdminTestJSON-330589987 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:18:08 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-5f354c85-e9a6-4ef1-98f7-359c42c06177 tempest-VolumesListAdminTestJSON-330589987 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:18:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1352650078',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f364591d-ab6e-4221-85d6-5cfbdcf1b3c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ff8cd9432af4422b6fa0fca7cab923c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:18:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:18:08Z,use_quota=True,user_id='6cb7131e74e54af38fde68ee2d2d42c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 10:18:08 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-5f354c85-e9a6-4ef1-98f7-359c42c06177 tempest-VolumesListAdminTestJSON-330589987 None] Creating volume f364591d-ab6e-4221-85d6-5cfbdcf1b3c8 {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:18:08 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-5f354c85-e9a6-4ef1-98f7-359c42c06177 tempest-VolumesListAdminTestJSON-330589987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:18:08 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-5f354c85-e9a6-4ef1-98f7-359c42c06177 tempest-VolumesListAdminTestJSON-330589987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:18:08 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-5f354c85-e9a6-4ef1-98f7-359c42c06177 tempest-VolumesListAdminTestJSON-330589987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:18:08 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-5f354c85-e9a6-4ef1-98f7-359c42c06177 tempest-VolumesListAdminTestJSON-330589987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:18:08 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-5f354c85-e9a6-4ef1-98f7-359c42c06177 tempest-VolumesListAdminTestJSON-330589987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:18:08 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-5f354c85-e9a6-4ef1-98f7-359c42c06177 tempest-VolumesListAdminTestJSON-330589987 None] Selected osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:18:08 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-5f354c85-e9a6-4ef1-98f7-359c42c06177 tempest-VolumesListAdminTestJSON-330589987 None] casted to osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 Nov 04 10:18:08 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-5f354c85-e9a6-4ef1-98f7-359c42c06177 tempest-VolumesListAdminTestJSON-330589987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-f364591d-ab6e-4221-85d6-5cfbdcf1b3c8 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:18:08 devstack sudo[95634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-f364591d-ab6e-4221-85d6-5cfbdcf1b3c8 1073741824 Nov 04 10:18:08 devstack sudo[95634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:18:08 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-4e525ed8-e2c9-4679-9e69-8fa530a8fb4b tempest-VolumesCloneTest-261554110 None] Created reservations ['05505a37-c963-47cc-a928-32bcc58b25f6', '815a976e-1ebf-44d9-8490-5b7173609c91', '56262cc3-ed1f-475f-8293-8d94ecbafd36', '819fea97-ee19-4f52-8cf6-3de9fbf00b70'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:18:08 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-4e525ed8-e2c9-4679-9e69-8fa530a8fb4b tempest-VolumesCloneTest-261554110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:18:08 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-4e525ed8-e2c9-4679-9e69-8fa530a8fb4b tempest-VolumesCloneTest-261554110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:18:08 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-4e525ed8-e2c9-4679-9e69-8fa530a8fb4b tempest-VolumesCloneTest-261554110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:18:08 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-4e525ed8-e2c9-4679-9e69-8fa530a8fb4b tempest-VolumesCloneTest-261554110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:18:08 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-4e525ed8-e2c9-4679-9e69-8fa530a8fb4b tempest-VolumesCloneTest-261554110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:18:08 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-4e525ed8-e2c9-4679-9e69-8fa530a8fb4b tempest-VolumesCloneTest-261554110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:18:08 devstack sudo[95636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:18:08 devstack sudo[95636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:18:08 devstack sudo[95636]: pam_unix(sudo:session): session closed for user root Nov 04 10:18:08 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-4e525ed8-e2c9-4679-9e69-8fa530a8fb4b tempest-VolumesCloneTest-261554110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.337s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:18:08 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-4e525ed8-e2c9-4679-9e69-8fa530a8fb4b tempest-VolumesCloneTest-261554110 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:18:08 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-4e525ed8-e2c9-4679-9e69-8fa530a8fb4b tempest-VolumesCloneTest-261554110 None] Deleted volume successfully. Nov 04 10:18:08 devstack sudo[95634]: pam_unix(sudo:session): session closed for user root Nov 04 10:18:08 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-5f354c85-e9a6-4ef1-98f7-359c42c06177 tempest-VolumesListAdminTestJSON-330589987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-f364591d-ab6e-4221-85d6-5cfbdcf1b3c8 1073741824" returned: 0 in 0.532s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:18:08 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-4e525ed8-e2c9-4679-9e69-8fa530a8fb4b tempest-VolumesCloneTest-261554110 None] Lock "cinder-0a8484d8-d07f-4c61-a2ec-b8f9860f073f-delete_volume" released by "delete_volume" :: held 1.775s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:18:09 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-5f354c85-e9a6-4ef1-98f7-359c42c06177 tempest-VolumesListAdminTestJSON-330589987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-f364591d-ab6e-4221-85d6-5cfbdcf1b3c8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:18:09 devstack sudo[95643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-f364591d-ab6e-4221-85d6-5cfbdcf1b3c8 Nov 04 10:18:09 devstack sudo[95643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:18:09 devstack sudo[95643]: pam_unix(sudo:session): session closed for user root Nov 04 10:18:09 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-5f354c85-e9a6-4ef1-98f7-359c42c06177 tempest-VolumesListAdminTestJSON-330589987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-f364591d-ab6e-4221-85d6-5cfbdcf1b3c8" returned: 0 in 0.322s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:18:09 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-5f354c85-e9a6-4ef1-98f7-359c42c06177 tempest-VolumesListAdminTestJSON-330589987 None] <== create_volume: return (910ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 10:18:09 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-5f354c85-e9a6-4ef1-98f7-359c42c06177 tempest-VolumesListAdminTestJSON-330589987 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.913s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:18:09 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-5f354c85-e9a6-4ef1-98f7-359c42c06177 tempest-VolumesListAdminTestJSON-330589987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f7a1058-3cb4-4706-973f-6dd5d8c256a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f364591d-ab6e-4221-85d6-5cfbdcf1b3c8', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:18:09 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-5f354c85-e9a6-4ef1-98f7-359c42c06177 tempest-VolumesListAdminTestJSON-330589987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a77be768-8907-4605-8021-ea2d2ea9ab14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:18:09 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-5f354c85-e9a6-4ef1-98f7-359c42c06177 tempest-VolumesListAdminTestJSON-330589987 None] Volume volume-f364591d-ab6e-4221-85d6-5cfbdcf1b3c8 (f364591d-ab6e-4221-85d6-5cfbdcf1b3c8): created successfully Nov 04 10:18:09 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-5f354c85-e9a6-4ef1-98f7-359c42c06177 tempest-VolumesListAdminTestJSON-330589987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a77be768-8907-4605-8021-ea2d2ea9ab14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:18:09 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-5f354c85-e9a6-4ef1-98f7-359c42c06177 tempest-VolumesListAdminTestJSON-330589987 None] Flow 'volume_create_manager' (2eeedf1d-23ca-4805-ac06-4047cfd2152a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:18:09 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-5f354c85-e9a6-4ef1-98f7-359c42c06177 tempest-VolumesListAdminTestJSON-330589987 None] Created volume successfully. Nov 04 10:18:09 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-429ac65d-a00e-4056-b950-7d53b923a667 tempest-VolumesCloneTest-261554110 None] Acquiring lock "cinder-01c26169-4b13-45cb-821c-2883b395e934-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:18:09 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-429ac65d-a00e-4056-b950-7d53b923a667 tempest-VolumesCloneTest-261554110 None] Lock "cinder-01c26169-4b13-45cb-821c-2883b395e934-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:18:09 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-429ac65d-a00e-4056-b950-7d53b923a667 tempest-VolumesCloneTest-261554110 None] Acquiring lock "cinder-quobyte-01c26169-4b13-45cb-821c-2883b395e934" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:18:09 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-429ac65d-a00e-4056-b950-7d53b923a667 tempest-VolumesCloneTest-261554110 None] Lock "cinder-quobyte-01c26169-4b13-45cb-821c-2883b395e934" acquired by "delete_volume" :: waited 0.019s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:18:09 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d0f6018-1f2d-4421-91b3-bec0188466cf]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:18:09 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-429ac65d-a00e-4056-b950-7d53b923a667 tempest-VolumesCloneTest-261554110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-01c26169-4b13-45cb-821c-2883b395e934 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:18:09 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-abbcffa4-b550-4168-a4e5-63818be18b03 tempest-VolumeTypesAccessTest-1831233265 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:18:09 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-abbcffa4-b550-4168-a4e5-63818be18b03 tempest-VolumeTypesAccessTest-1831233265 None] Flow 'volume_create_manager' (419c70b6-4b7f-46e1-8ca8-56fb759b2b47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:18:09 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-abbcffa4-b550-4168-a4e5-63818be18b03 tempest-VolumeTypesAccessTest-1831233265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7286228d-4293-4e96-9549-11156700d8db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:18:09 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-abbcffa4-b550-4168-a4e5-63818be18b03 tempest-VolumeTypesAccessTest-1831233265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7286228d-4293-4e96-9549-11156700d8db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:18:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1976137868',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9f59b4e-b8af-41f1-8eb8-7402dc68a9aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cec294c7c08049b6ba928f1199d6d9f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:18:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:18:10Z,use_quota=True,user_id='a76fc45fc10e4e1497deab9e6f45d83b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d95b32b3-614c-4b28-87d7-0b0f046819dc),volume_type_id=d95b32b3-614c-4b28-87d7-0b0f046819dc)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:18:09 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-abbcffa4-b550-4168-a4e5-63818be18b03 tempest-VolumeTypesAccessTest-1831233265 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfe5178c-74e1-4fbe-b720-f0cd2574ccd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:18:09 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-abbcffa4-b550-4168-a4e5-63818be18b03 tempest-VolumeTypesAccessTest-1831233265 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfe5178c-74e1-4fbe-b720-f0cd2574ccd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:18:09 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-abbcffa4-b550-4168-a4e5-63818be18b03 tempest-VolumeTypesAccessTest-1831233265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb024abc-a10e-49f9-afe2-08be01f2a7b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:18:09 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-abbcffa4-b550-4168-a4e5-63818be18b03 tempest-VolumeTypesAccessTest-1831233265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb024abc-a10e-49f9-afe2-08be01f2a7b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9f59b4e-b8af-41f1-8eb8-7402dc68a9aa', 'volume_name': 'volume-b9f59b4e-b8af-41f1-8eb8-7402dc68a9aa', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:18:09 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-abbcffa4-b550-4168-a4e5-63818be18b03 tempest-VolumeTypesAccessTest-1831233265 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (464e0384-b4fc-4c03-8111-5110e889b5af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:18:09 devstack sudo[95646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-01c26169-4b13-45cb-821c-2883b395e934 Nov 04 10:18:09 devstack sudo[95646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:18:09 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-abbcffa4-b550-4168-a4e5-63818be18b03 tempest-VolumeTypesAccessTest-1831233265 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (464e0384-b4fc-4c03-8111-5110e889b5af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:18:09 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-abbcffa4-b550-4168-a4e5-63818be18b03 tempest-VolumeTypesAccessTest-1831233265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32d0a4d9-c778-418a-8546-3ae5766c9c15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:18:09 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-abbcffa4-b550-4168-a4e5-63818be18b03 tempest-VolumeTypesAccessTest-1831233265 None] Volume b9f59b4e-b8af-41f1-8eb8-7402dc68a9aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9f59b4e-b8af-41f1-8eb8-7402dc68a9aa', 'volume_size': 1} Nov 04 10:18:09 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-abbcffa4-b550-4168-a4e5-63818be18b03 tempest-VolumeTypesAccessTest-1831233265 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:18:09 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-abbcffa4-b550-4168-a4e5-63818be18b03 tempest-VolumeTypesAccessTest-1831233265 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:18:09 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-abbcffa4-b550-4168-a4e5-63818be18b03 tempest-VolumeTypesAccessTest-1831233265 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:18:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1976137868',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9f59b4e-b8af-41f1-8eb8-7402dc68a9aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cec294c7c08049b6ba928f1199d6d9f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:18:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:18:10Z,use_quota=True,user_id='a76fc45fc10e4e1497deab9e6f45d83b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d95b32b3-614c-4b28-87d7-0b0f046819dc),volume_type_id=d95b32b3-614c-4b28-87d7-0b0f046819dc)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 10:18:09 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-abbcffa4-b550-4168-a4e5-63818be18b03 tempest-VolumeTypesAccessTest-1831233265 None] Creating volume b9f59b4e-b8af-41f1-8eb8-7402dc68a9aa {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:18:09 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-abbcffa4-b550-4168-a4e5-63818be18b03 tempest-VolumeTypesAccessTest-1831233265 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:18:09 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-abbcffa4-b550-4168-a4e5-63818be18b03 tempest-VolumeTypesAccessTest-1831233265 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:18:09 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-abbcffa4-b550-4168-a4e5-63818be18b03 tempest-VolumeTypesAccessTest-1831233265 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:18:09 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-abbcffa4-b550-4168-a4e5-63818be18b03 tempest-VolumeTypesAccessTest-1831233265 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:18:09 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-abbcffa4-b550-4168-a4e5-63818be18b03 tempest-VolumeTypesAccessTest-1831233265 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:18:09 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-abbcffa4-b550-4168-a4e5-63818be18b03 tempest-VolumeTypesAccessTest-1831233265 None] Selected osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:18:09 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-abbcffa4-b550-4168-a4e5-63818be18b03 tempest-VolumeTypesAccessTest-1831233265 None] casted to osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 Nov 04 10:18:09 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-abbcffa4-b550-4168-a4e5-63818be18b03 tempest-VolumeTypesAccessTest-1831233265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b9f59b4e-b8af-41f1-8eb8-7402dc68a9aa 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:18:09 devstack sudo[95648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b9f59b4e-b8af-41f1-8eb8-7402dc68a9aa 1073741824 Nov 04 10:18:09 devstack sudo[95648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:18:10 devstack sudo[95646]: pam_unix(sudo:session): session closed for user root Nov 04 10:18:10 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-429ac65d-a00e-4056-b950-7d53b923a667 tempest-VolumesCloneTest-261554110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-01c26169-4b13-45cb-821c-2883b395e934" returned: 0 in 0.409s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:18:10 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-429ac65d-a00e-4056-b950-7d53b923a667 tempest-VolumesCloneTest-261554110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-01c26169-4b13-45cb-821c-2883b395e934 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:18:10 devstack sudo[95655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-01c26169-4b13-45cb-821c-2883b395e934 Nov 04 10:18:10 devstack sudo[95655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:18:10 devstack sudo[95648]: pam_unix(sudo:session): session closed for user root Nov 04 10:18:10 devstack sudo[95655]: pam_unix(sudo:session): session closed for user root Nov 04 10:18:10 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-abbcffa4-b550-4168-a4e5-63818be18b03 tempest-VolumeTypesAccessTest-1831233265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b9f59b4e-b8af-41f1-8eb8-7402dc68a9aa 1073741824" returned: 0 in 0.551s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:18:10 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-429ac65d-a00e-4056-b950-7d53b923a667 tempest-VolumesCloneTest-261554110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-01c26169-4b13-45cb-821c-2883b395e934" returned: 0 in 0.306s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:18:10 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-429ac65d-a00e-4056-b950-7d53b923a667 tempest-VolumesCloneTest-261554110 None] Lock "cinder-quobyte-01c26169-4b13-45cb-821c-2883b395e934" released by "delete_volume" :: held 0.817s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:18:10 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-abbcffa4-b550-4168-a4e5-63818be18b03 tempest-VolumeTypesAccessTest-1831233265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b9f59b4e-b8af-41f1-8eb8-7402dc68a9aa {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:18:10 devstack sudo[95660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b9f59b4e-b8af-41f1-8eb8-7402dc68a9aa Nov 04 10:18:10 devstack sudo[95660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:18:10 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-429ac65d-a00e-4056-b950-7d53b923a667 tempest-VolumesCloneTest-261554110 None] Created reservations ['13cff31e-bdb2-43db-a2a0-ea6eaef5fc3b', '10ff5467-da9a-456b-830f-84bd4971a2d8', '19bc23f5-28e3-403c-beb1-16480c7a613b', 'f98f06be-7fe8-4e1e-8032-a8b39c53a991'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:18:10 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-429ac65d-a00e-4056-b950-7d53b923a667 tempest-VolumesCloneTest-261554110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:18:10 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-429ac65d-a00e-4056-b950-7d53b923a667 tempest-VolumesCloneTest-261554110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:18:10 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-429ac65d-a00e-4056-b950-7d53b923a667 tempest-VolumesCloneTest-261554110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:18:10 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-429ac65d-a00e-4056-b950-7d53b923a667 tempest-VolumesCloneTest-261554110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:18:10 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-429ac65d-a00e-4056-b950-7d53b923a667 tempest-VolumesCloneTest-261554110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:18:10 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-429ac65d-a00e-4056-b950-7d53b923a667 tempest-VolumesCloneTest-261554110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:18:10 devstack sudo[95662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:18:10 devstack sudo[95662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:18:10 devstack sudo[95660]: pam_unix(sudo:session): session closed for user root Nov 04 10:18:10 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-abbcffa4-b550-4168-a4e5-63818be18b03 tempest-VolumeTypesAccessTest-1831233265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b9f59b4e-b8af-41f1-8eb8-7402dc68a9aa" returned: 0 in 0.373s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:18:10 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-abbcffa4-b550-4168-a4e5-63818be18b03 tempest-VolumeTypesAccessTest-1831233265 None] <== create_volume: return (997ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 10:18:10 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-abbcffa4-b550-4168-a4e5-63818be18b03 tempest-VolumeTypesAccessTest-1831233265 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:18:10 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-abbcffa4-b550-4168-a4e5-63818be18b03 tempest-VolumeTypesAccessTest-1831233265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32d0a4d9-c778-418a-8546-3ae5766c9c15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9f59b4e-b8af-41f1-8eb8-7402dc68a9aa', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:18:10 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-abbcffa4-b550-4168-a4e5-63818be18b03 tempest-VolumeTypesAccessTest-1831233265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e69bae87-5bf5-4cc7-8846-68821ef513a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:18:10 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-abbcffa4-b550-4168-a4e5-63818be18b03 tempest-VolumeTypesAccessTest-1831233265 None] Volume volume-b9f59b4e-b8af-41f1-8eb8-7402dc68a9aa (b9f59b4e-b8af-41f1-8eb8-7402dc68a9aa): created successfully Nov 04 10:18:10 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-abbcffa4-b550-4168-a4e5-63818be18b03 tempest-VolumeTypesAccessTest-1831233265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e69bae87-5bf5-4cc7-8846-68821ef513a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:18:10 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-abbcffa4-b550-4168-a4e5-63818be18b03 tempest-VolumeTypesAccessTest-1831233265 None] Flow 'volume_create_manager' (419c70b6-4b7f-46e1-8ca8-56fb759b2b47) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:18:11 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-abbcffa4-b550-4168-a4e5-63818be18b03 tempest-VolumeTypesAccessTest-1831233265 None] Created volume successfully. Nov 04 10:18:11 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c8af441-ad40-4ef7-87bd-d0f737b2a35d tempest-VolumesListAdminTestJSON-330589987 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:18:11 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-9c8af441-ad40-4ef7-87bd-d0f737b2a35d tempest-VolumesListAdminTestJSON-330589987 None] Flow 'volume_create_manager' (1cdf9277-648e-4e55-bc18-f4f43f3ef2d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:18:11 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-9c8af441-ad40-4ef7-87bd-d0f737b2a35d tempest-VolumesListAdminTestJSON-330589987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1ddf422-df71-40f7-88b0-7afb4bbcb299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:18:11 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-9c8af441-ad40-4ef7-87bd-d0f737b2a35d tempest-VolumesListAdminTestJSON-330589987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1ddf422-df71-40f7-88b0-7afb4bbcb299) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:18:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1535460482',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae69392b-96c4-4e19-b36b-7af5edcd773b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ff8cd9432af4422b6fa0fca7cab923c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:18:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:18:11Z,use_quota=True,user_id='6cb7131e74e54af38fde68ee2d2d42c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:18:11 devstack sudo[95662]: pam_unix(sudo:session): session closed for user root Nov 04 10:18:11 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-9c8af441-ad40-4ef7-87bd-d0f737b2a35d tempest-VolumesListAdminTestJSON-330589987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (244c6337-367f-4083-a44e-c5be0ec42eb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:18:11 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-9c8af441-ad40-4ef7-87bd-d0f737b2a35d tempest-VolumesListAdminTestJSON-330589987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (244c6337-367f-4083-a44e-c5be0ec42eb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:18:11 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-9c8af441-ad40-4ef7-87bd-d0f737b2a35d tempest-VolumesListAdminTestJSON-330589987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8edea24e-3928-4940-9698-f34693b4dabe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:18:11 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-9c8af441-ad40-4ef7-87bd-d0f737b2a35d tempest-VolumesListAdminTestJSON-330589987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8edea24e-3928-4940-9698-f34693b4dabe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae69392b-96c4-4e19-b36b-7af5edcd773b', 'volume_name': 'volume-ae69392b-96c4-4e19-b36b-7af5edcd773b', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:18:11 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-9c8af441-ad40-4ef7-87bd-d0f737b2a35d tempest-VolumesListAdminTestJSON-330589987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e823c25-226c-4a36-bbc2-5dac1dc313c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:18:11 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-9c8af441-ad40-4ef7-87bd-d0f737b2a35d tempest-VolumesListAdminTestJSON-330589987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e823c25-226c-4a36-bbc2-5dac1dc313c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:18:11 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-9c8af441-ad40-4ef7-87bd-d0f737b2a35d tempest-VolumesListAdminTestJSON-330589987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4922fc1-3278-490b-bd3f-a6bb6a8d5da6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:18:11 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-9c8af441-ad40-4ef7-87bd-d0f737b2a35d tempest-VolumesListAdminTestJSON-330589987 None] Volume ae69392b-96c4-4e19-b36b-7af5edcd773b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae69392b-96c4-4e19-b36b-7af5edcd773b', 'volume_size': 1} Nov 04 10:18:11 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-9c8af441-ad40-4ef7-87bd-d0f737b2a35d tempest-VolumesListAdminTestJSON-330589987 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:18:11 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-9c8af441-ad40-4ef7-87bd-d0f737b2a35d tempest-VolumesListAdminTestJSON-330589987 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:18:11 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-9c8af441-ad40-4ef7-87bd-d0f737b2a35d tempest-VolumesListAdminTestJSON-330589987 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:18:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1535460482',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae69392b-96c4-4e19-b36b-7af5edcd773b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ff8cd9432af4422b6fa0fca7cab923c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:18:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:18:11Z,use_quota=True,user_id='6cb7131e74e54af38fde68ee2d2d42c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 10:18:11 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-9c8af441-ad40-4ef7-87bd-d0f737b2a35d tempest-VolumesListAdminTestJSON-330589987 None] Creating volume ae69392b-96c4-4e19-b36b-7af5edcd773b {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:18:11 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-9c8af441-ad40-4ef7-87bd-d0f737b2a35d tempest-VolumesListAdminTestJSON-330589987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:18:11 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-9c8af441-ad40-4ef7-87bd-d0f737b2a35d tempest-VolumesListAdminTestJSON-330589987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:18:11 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-9c8af441-ad40-4ef7-87bd-d0f737b2a35d tempest-VolumesListAdminTestJSON-330589987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:18:11 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-9c8af441-ad40-4ef7-87bd-d0f737b2a35d tempest-VolumesListAdminTestJSON-330589987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:18:11 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-9c8af441-ad40-4ef7-87bd-d0f737b2a35d tempest-VolumesListAdminTestJSON-330589987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:18:11 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-9c8af441-ad40-4ef7-87bd-d0f737b2a35d tempest-VolumesListAdminTestJSON-330589987 None] Selected osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:18:11 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-9c8af441-ad40-4ef7-87bd-d0f737b2a35d tempest-VolumesListAdminTestJSON-330589987 None] casted to osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 Nov 04 10:18:11 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-9c8af441-ad40-4ef7-87bd-d0f737b2a35d tempest-VolumesListAdminTestJSON-330589987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-ae69392b-96c4-4e19-b36b-7af5edcd773b 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:18:11 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-429ac65d-a00e-4056-b950-7d53b923a667 tempest-VolumesCloneTest-261554110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.412s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:18:11 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-429ac65d-a00e-4056-b950-7d53b923a667 tempest-VolumesCloneTest-261554110 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:18:11 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-429ac65d-a00e-4056-b950-7d53b923a667 tempest-VolumesCloneTest-261554110 None] Deleted volume successfully. Nov 04 10:18:11 devstack sudo[95666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-ae69392b-96c4-4e19-b36b-7af5edcd773b 1073741824 Nov 04 10:18:11 devstack sudo[95666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:18:11 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-429ac65d-a00e-4056-b950-7d53b923a667 tempest-VolumesCloneTest-261554110 None] Lock "cinder-01c26169-4b13-45cb-821c-2883b395e934-delete_volume" released by "delete_volume" :: held 1.604s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:18:11 devstack sudo[95666]: pam_unix(sudo:session): session closed for user root Nov 04 10:18:11 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-9c8af441-ad40-4ef7-87bd-d0f737b2a35d tempest-VolumesListAdminTestJSON-330589987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-ae69392b-96c4-4e19-b36b-7af5edcd773b 1073741824" returned: 0 in 0.502s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:18:11 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-9c8af441-ad40-4ef7-87bd-d0f737b2a35d tempest-VolumesListAdminTestJSON-330589987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-ae69392b-96c4-4e19-b36b-7af5edcd773b {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:18:11 devstack sudo[95672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-ae69392b-96c4-4e19-b36b-7af5edcd773b Nov 04 10:18:11 devstack sudo[95672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:18:11 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-57032ca8-3a8c-42d9-910f-65cec8429d65 tempest-VolumeTypesAccessTest-1831233265 None] Acquiring lock "cinder-b9f59b4e-b8af-41f1-8eb8-7402dc68a9aa-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:18:11 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-57032ca8-3a8c-42d9-910f-65cec8429d65 tempest-VolumeTypesAccessTest-1831233265 None] Lock "cinder-b9f59b4e-b8af-41f1-8eb8-7402dc68a9aa-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:18:12 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-57032ca8-3a8c-42d9-910f-65cec8429d65 tempest-VolumeTypesAccessTest-1831233265 None] Acquiring lock "cinder-quobyte-b9f59b4e-b8af-41f1-8eb8-7402dc68a9aa" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:18:12 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-57032ca8-3a8c-42d9-910f-65cec8429d65 tempest-VolumeTypesAccessTest-1831233265 None] Lock "cinder-quobyte-b9f59b4e-b8af-41f1-8eb8-7402dc68a9aa" acquired by "delete_volume" :: waited 0.028s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:18:12 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[229bda97-d3f9-4088-954e-0a64ff4a283e]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:18:12 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-57032ca8-3a8c-42d9-910f-65cec8429d65 tempest-VolumeTypesAccessTest-1831233265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b9f59b4e-b8af-41f1-8eb8-7402dc68a9aa {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:18:12 devstack sudo[95672]: pam_unix(sudo:session): session closed for user root Nov 04 10:18:12 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-9c8af441-ad40-4ef7-87bd-d0f737b2a35d tempest-VolumesListAdminTestJSON-330589987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-ae69392b-96c4-4e19-b36b-7af5edcd773b" returned: 0 in 0.421s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:18:12 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-9c8af441-ad40-4ef7-87bd-d0f737b2a35d tempest-VolumesListAdminTestJSON-330589987 None] <== create_volume: return (990ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 10:18:12 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-9c8af441-ad40-4ef7-87bd-d0f737b2a35d tempest-VolumesListAdminTestJSON-330589987 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.993s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:18:12 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-9c8af441-ad40-4ef7-87bd-d0f737b2a35d tempest-VolumesListAdminTestJSON-330589987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4922fc1-3278-490b-bd3f-a6bb6a8d5da6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae69392b-96c4-4e19-b36b-7af5edcd773b', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:18:12 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-9c8af441-ad40-4ef7-87bd-d0f737b2a35d tempest-VolumesListAdminTestJSON-330589987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc045bb8-e8b8-47f8-8eb0-7aa537246a28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:18:12 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-9c8af441-ad40-4ef7-87bd-d0f737b2a35d tempest-VolumesListAdminTestJSON-330589987 None] Volume volume-ae69392b-96c4-4e19-b36b-7af5edcd773b (ae69392b-96c4-4e19-b36b-7af5edcd773b): created successfully Nov 04 10:18:12 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-9c8af441-ad40-4ef7-87bd-d0f737b2a35d tempest-VolumesListAdminTestJSON-330589987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc045bb8-e8b8-47f8-8eb0-7aa537246a28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:18:12 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-9c8af441-ad40-4ef7-87bd-d0f737b2a35d tempest-VolumesListAdminTestJSON-330589987 None] Flow 'volume_create_manager' (1cdf9277-648e-4e55-bc18-f4f43f3ef2d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:18:12 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-9c8af441-ad40-4ef7-87bd-d0f737b2a35d tempest-VolumesListAdminTestJSON-330589987 None] Created volume successfully. Nov 04 10:18:12 devstack sudo[95675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b9f59b4e-b8af-41f1-8eb8-7402dc68a9aa Nov 04 10:18:12 devstack sudo[95675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:18:12 devstack sudo[95675]: pam_unix(sudo:session): session closed for user root Nov 04 10:18:12 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-57032ca8-3a8c-42d9-910f-65cec8429d65 tempest-VolumeTypesAccessTest-1831233265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b9f59b4e-b8af-41f1-8eb8-7402dc68a9aa" returned: 0 in 0.436s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:18:12 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-57032ca8-3a8c-42d9-910f-65cec8429d65 tempest-VolumeTypesAccessTest-1831233265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b9f59b4e-b8af-41f1-8eb8-7402dc68a9aa {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:18:12 devstack sudo[95681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b9f59b4e-b8af-41f1-8eb8-7402dc68a9aa Nov 04 10:18:12 devstack sudo[95681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:18:12 devstack sudo[95681]: pam_unix(sudo:session): session closed for user root Nov 04 10:18:12 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-57032ca8-3a8c-42d9-910f-65cec8429d65 tempest-VolumeTypesAccessTest-1831233265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b9f59b4e-b8af-41f1-8eb8-7402dc68a9aa" returned: 0 in 0.285s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:18:12 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-57032ca8-3a8c-42d9-910f-65cec8429d65 tempest-VolumeTypesAccessTest-1831233265 None] Lock "cinder-quobyte-b9f59b4e-b8af-41f1-8eb8-7402dc68a9aa" released by "delete_volume" :: held 0.788s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:18:12 devstack cinder-volume[87068]: WARNING cinder.quota [None req-57032ca8-3a8c-42d9-910f-65cec8429d65 tempest-VolumeTypesAccessTest-1831233265 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1823829495 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1823829495, it is now deprecated. Please use the default quota class for default quota. Nov 04 10:18:12 devstack cinder-volume[87068]: WARNING cinder.quota [None req-57032ca8-3a8c-42d9-910f-65cec8429d65 tempest-VolumeTypesAccessTest-1831233265 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1823829495 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1823829495, it is now deprecated. Please use the default quota class for default quota. Nov 04 10:18:12 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-57032ca8-3a8c-42d9-910f-65cec8429d65 tempest-VolumeTypesAccessTest-1831233265 None] Created reservations ['29b3f40f-c883-4175-8900-983241edf7d6', '01a65189-09d7-472c-9437-0cd23935ea73', '8b15873e-fee4-4bdd-9fe6-b6852cba4d9b', '19ecc311-ba30-432c-99f9-cab88eba213a'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:18:13 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-57032ca8-3a8c-42d9-910f-65cec8429d65 tempest-VolumeTypesAccessTest-1831233265 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:18:13 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-57032ca8-3a8c-42d9-910f-65cec8429d65 tempest-VolumeTypesAccessTest-1831233265 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:18:13 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-57032ca8-3a8c-42d9-910f-65cec8429d65 tempest-VolumeTypesAccessTest-1831233265 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:18:13 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-57032ca8-3a8c-42d9-910f-65cec8429d65 tempest-VolumeTypesAccessTest-1831233265 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:18:13 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-57032ca8-3a8c-42d9-910f-65cec8429d65 tempest-VolumeTypesAccessTest-1831233265 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:18:13 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-57032ca8-3a8c-42d9-910f-65cec8429d65 tempest-VolumeTypesAccessTest-1831233265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:18:13 devstack sudo[95684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:18:13 devstack sudo[95684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:18:13 devstack sudo[95684]: pam_unix(sudo:session): session closed for user root Nov 04 10:18:13 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-57032ca8-3a8c-42d9-910f-65cec8429d65 tempest-VolumeTypesAccessTest-1831233265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.327s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:18:13 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-57032ca8-3a8c-42d9-910f-65cec8429d65 tempest-VolumeTypesAccessTest-1831233265 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:18:13 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-57032ca8-3a8c-42d9-910f-65cec8429d65 tempest-VolumeTypesAccessTest-1831233265 None] Deleted volume successfully. Nov 04 10:18:13 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-57032ca8-3a8c-42d9-910f-65cec8429d65 tempest-VolumeTypesAccessTest-1831233265 None] Lock "cinder-b9f59b4e-b8af-41f1-8eb8-7402dc68a9aa-delete_volume" released by "delete_volume" :: held 1.489s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:18:14 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c754d83-dd85-4b04-aa5e-1affa659c165 tempest-VolumesListAdminTestJSON-1022516783 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:18:14 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-4c754d83-dd85-4b04-aa5e-1affa659c165 tempest-VolumesListAdminTestJSON-1022516783 None] Flow 'volume_create_manager' (4103ebee-fa6a-449a-b6ff-2aa96673d477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:18:14 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-4c754d83-dd85-4b04-aa5e-1affa659c165 tempest-VolumesListAdminTestJSON-1022516783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (405cf0e2-2d0c-40dd-81fe-1fd4da63cb27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:18:14 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-4c754d83-dd85-4b04-aa5e-1affa659c165 tempest-VolumesListAdminTestJSON-1022516783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (405cf0e2-2d0c-40dd-81fe-1fd4da63cb27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:18:14Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d5f84aa-3521-409f-b964-00414e086802,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15106f4cff1d45a79ab77d32b046a2d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:18:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:18:14Z,use_quota=True,user_id='89555b0c31f046718569699cdf844c80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:18:14 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-4c754d83-dd85-4b04-aa5e-1affa659c165 tempest-VolumesListAdminTestJSON-1022516783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f3e225e-bc25-4e57-b299-f5bb0616ead7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:18:14 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-4c754d83-dd85-4b04-aa5e-1affa659c165 tempest-VolumesListAdminTestJSON-1022516783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f3e225e-bc25-4e57-b299-f5bb0616ead7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:18:14 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-4c754d83-dd85-4b04-aa5e-1affa659c165 tempest-VolumesListAdminTestJSON-1022516783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1e3d4da-ec07-42c7-992c-d1d55a0543c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:18:14 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-4c754d83-dd85-4b04-aa5e-1affa659c165 tempest-VolumesListAdminTestJSON-1022516783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1e3d4da-ec07-42c7-992c-d1d55a0543c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d5f84aa-3521-409f-b964-00414e086802', 'volume_name': 'volume-7d5f84aa-3521-409f-b964-00414e086802', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:18:14 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-4c754d83-dd85-4b04-aa5e-1affa659c165 tempest-VolumesListAdminTestJSON-1022516783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e18bdd95-0982-443b-8e63-a1d379bf8643) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:18:14 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-4c754d83-dd85-4b04-aa5e-1affa659c165 tempest-VolumesListAdminTestJSON-1022516783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e18bdd95-0982-443b-8e63-a1d379bf8643) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:18:14 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-4c754d83-dd85-4b04-aa5e-1affa659c165 tempest-VolumesListAdminTestJSON-1022516783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9dec7d7-cb1f-4d4a-bfc4-e0be8d4ec33d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:18:14 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-4c754d83-dd85-4b04-aa5e-1affa659c165 tempest-VolumesListAdminTestJSON-1022516783 None] Volume 7d5f84aa-3521-409f-b964-00414e086802: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d5f84aa-3521-409f-b964-00414e086802', 'volume_size': 1} Nov 04 10:18:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-4c754d83-dd85-4b04-aa5e-1affa659c165 tempest-VolumesListAdminTestJSON-1022516783 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:18:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-4c754d83-dd85-4b04-aa5e-1affa659c165 tempest-VolumesListAdminTestJSON-1022516783 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:18:14 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-4c754d83-dd85-4b04-aa5e-1affa659c165 tempest-VolumesListAdminTestJSON-1022516783 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:18:14Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d5f84aa-3521-409f-b964-00414e086802,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15106f4cff1d45a79ab77d32b046a2d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:18:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:18:14Z,use_quota=True,user_id='89555b0c31f046718569699cdf844c80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 10:18:14 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-4c754d83-dd85-4b04-aa5e-1affa659c165 tempest-VolumesListAdminTestJSON-1022516783 None] Creating volume 7d5f84aa-3521-409f-b964-00414e086802 {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:18:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-4c754d83-dd85-4b04-aa5e-1affa659c165 tempest-VolumesListAdminTestJSON-1022516783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:18:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-4c754d83-dd85-4b04-aa5e-1affa659c165 tempest-VolumesListAdminTestJSON-1022516783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:18:14 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-4c754d83-dd85-4b04-aa5e-1affa659c165 tempest-VolumesListAdminTestJSON-1022516783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:18:14 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-4c754d83-dd85-4b04-aa5e-1affa659c165 tempest-VolumesListAdminTestJSON-1022516783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:18:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-4c754d83-dd85-4b04-aa5e-1affa659c165 tempest-VolumesListAdminTestJSON-1022516783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:18:14 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-4c754d83-dd85-4b04-aa5e-1affa659c165 tempest-VolumesListAdminTestJSON-1022516783 None] Selected osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:18:14 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-4c754d83-dd85-4b04-aa5e-1affa659c165 tempest-VolumesListAdminTestJSON-1022516783 None] casted to osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 Nov 04 10:18:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-4c754d83-dd85-4b04-aa5e-1affa659c165 tempest-VolumesListAdminTestJSON-1022516783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-7d5f84aa-3521-409f-b964-00414e086802 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:18:14 devstack sudo[95687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-7d5f84aa-3521-409f-b964-00414e086802 1073741824 Nov 04 10:18:14 devstack sudo[95687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:18:15 devstack sudo[95687]: pam_unix(sudo:session): session closed for user root Nov 04 10:18:15 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-4c754d83-dd85-4b04-aa5e-1affa659c165 tempest-VolumesListAdminTestJSON-1022516783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-7d5f84aa-3521-409f-b964-00414e086802 1073741824" returned: 0 in 0.735s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:18:15 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-4c754d83-dd85-4b04-aa5e-1affa659c165 tempest-VolumesListAdminTestJSON-1022516783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-7d5f84aa-3521-409f-b964-00414e086802 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:18:15 devstack sudo[95693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-7d5f84aa-3521-409f-b964-00414e086802 Nov 04 10:18:15 devstack sudo[95693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:18:15 devstack sudo[95693]: pam_unix(sudo:session): session closed for user root Nov 04 10:18:15 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-4c754d83-dd85-4b04-aa5e-1affa659c165 tempest-VolumesListAdminTestJSON-1022516783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-7d5f84aa-3521-409f-b964-00414e086802" returned: 0 in 0.318s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:18:15 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-4c754d83-dd85-4b04-aa5e-1affa659c165 tempest-VolumesListAdminTestJSON-1022516783 None] <== create_volume: return (1120ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 10:18:15 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-4c754d83-dd85-4b04-aa5e-1affa659c165 tempest-VolumesListAdminTestJSON-1022516783 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.122s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:18:15 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-4c754d83-dd85-4b04-aa5e-1affa659c165 tempest-VolumesListAdminTestJSON-1022516783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9dec7d7-cb1f-4d4a-bfc4-e0be8d4ec33d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d5f84aa-3521-409f-b964-00414e086802', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:18:15 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-4c754d83-dd85-4b04-aa5e-1affa659c165 tempest-VolumesListAdminTestJSON-1022516783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f98b3c95-c008-4fa9-b93e-e818c5729930) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:18:15 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-4c754d83-dd85-4b04-aa5e-1affa659c165 tempest-VolumesListAdminTestJSON-1022516783 None] Volume volume-7d5f84aa-3521-409f-b964-00414e086802 (7d5f84aa-3521-409f-b964-00414e086802): created successfully Nov 04 10:18:15 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-4c754d83-dd85-4b04-aa5e-1affa659c165 tempest-VolumesListAdminTestJSON-1022516783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f98b3c95-c008-4fa9-b93e-e818c5729930) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:18:15 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-4c754d83-dd85-4b04-aa5e-1affa659c165 tempest-VolumesListAdminTestJSON-1022516783 None] Flow 'volume_create_manager' (4103ebee-fa6a-449a-b6ff-2aa96673d477) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:18:15 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-4c754d83-dd85-4b04-aa5e-1affa659c165 tempest-VolumesListAdminTestJSON-1022516783 None] Created volume successfully. Nov 04 10:18:16 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-e16fd45a-626b-4ae2-9242-b9e8fa14873d tempest-VolumesListAdminTestJSON-1022516783 None] Acquiring lock "cinder-7d5f84aa-3521-409f-b964-00414e086802-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:18:16 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-e16fd45a-626b-4ae2-9242-b9e8fa14873d tempest-VolumesListAdminTestJSON-1022516783 None] Lock "cinder-7d5f84aa-3521-409f-b964-00414e086802-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:18:16 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-e16fd45a-626b-4ae2-9242-b9e8fa14873d tempest-VolumesListAdminTestJSON-1022516783 None] Acquiring lock "cinder-quobyte-7d5f84aa-3521-409f-b964-00414e086802" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:18:16 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-e16fd45a-626b-4ae2-9242-b9e8fa14873d tempest-VolumesListAdminTestJSON-1022516783 None] Lock "cinder-quobyte-7d5f84aa-3521-409f-b964-00414e086802" acquired by "delete_volume" :: waited 0.031s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:18:16 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[a224d46f-7d8e-4d5e-bfd6-196304bf9c64]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:18:16 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-e16fd45a-626b-4ae2-9242-b9e8fa14873d tempest-VolumesListAdminTestJSON-1022516783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-7d5f84aa-3521-409f-b964-00414e086802 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:18:16 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a1cd34a-3012-4b13-9432-051d590ab4a5 tempest-VolumesCloneNegativeTest-325849928 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:18:16 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-0a1cd34a-3012-4b13-9432-051d590ab4a5 tempest-VolumesCloneNegativeTest-325849928 None] Flow 'volume_create_manager' (011e53f0-9035-4f9e-94e4-416b66bf7685) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:18:16 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-0a1cd34a-3012-4b13-9432-051d590ab4a5 tempest-VolumesCloneNegativeTest-325849928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0553f052-49f2-4e3a-8f7e-d05e88500910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:18:16 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-3ed0e42e-9554-40c1-9204-5aef25e31e27 tempest-VolumesListAdminTestJSON-330589987 None] Acquiring lock "cinder-ae69392b-96c4-4e19-b36b-7af5edcd773b-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:18:16 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-0a1cd34a-3012-4b13-9432-051d590ab4a5 tempest-VolumesCloneNegativeTest-325849928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0553f052-49f2-4e3a-8f7e-d05e88500910) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:18:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1604080389',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=adaae1fb-cb47-41c3-9634-ef883f7d69bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9c112afdc5d47cdbc420da1f1bd9f74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:18:17Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:18:17Z,use_quota=True,user_id='db296e8bb33e4175a1af2c8681e73720',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:18:16 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-0a1cd34a-3012-4b13-9432-051d590ab4a5 tempest-VolumesCloneNegativeTest-325849928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66a126e1-33b8-4755-acc4-78b71de34b7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:18:16 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-0a1cd34a-3012-4b13-9432-051d590ab4a5 tempest-VolumesCloneNegativeTest-325849928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66a126e1-33b8-4755-acc4-78b71de34b7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:18:16 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-0a1cd34a-3012-4b13-9432-051d590ab4a5 tempest-VolumesCloneNegativeTest-325849928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2613c0de-248b-4996-88f1-30a45ce7ead7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:18:16 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-0a1cd34a-3012-4b13-9432-051d590ab4a5 tempest-VolumesCloneNegativeTest-325849928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2613c0de-248b-4996-88f1-30a45ce7ead7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'adaae1fb-cb47-41c3-9634-ef883f7d69bc', 'volume_name': 'volume-adaae1fb-cb47-41c3-9634-ef883f7d69bc', 'volume_size': 2}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:18:16 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-0a1cd34a-3012-4b13-9432-051d590ab4a5 tempest-VolumesCloneNegativeTest-325849928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab16a152-ab85-4b51-906c-dd9791dcd230) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:18:16 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-0a1cd34a-3012-4b13-9432-051d590ab4a5 tempest-VolumesCloneNegativeTest-325849928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab16a152-ab85-4b51-906c-dd9791dcd230) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:18:16 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-0a1cd34a-3012-4b13-9432-051d590ab4a5 tempest-VolumesCloneNegativeTest-325849928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae7c6859-afb0-4154-a505-ab5706db5f71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:18:16 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-0a1cd34a-3012-4b13-9432-051d590ab4a5 tempest-VolumesCloneNegativeTest-325849928 None] Volume adaae1fb-cb47-41c3-9634-ef883f7d69bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-adaae1fb-cb47-41c3-9634-ef883f7d69bc', 'volume_size': 2} Nov 04 10:18:16 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-0a1cd34a-3012-4b13-9432-051d590ab4a5 tempest-VolumesCloneNegativeTest-325849928 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:18:16 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-0a1cd34a-3012-4b13-9432-051d590ab4a5 tempest-VolumesCloneNegativeTest-325849928 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:18:16 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-0a1cd34a-3012-4b13-9432-051d590ab4a5 tempest-VolumesCloneNegativeTest-325849928 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:18:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1604080389',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=adaae1fb-cb47-41c3-9634-ef883f7d69bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9c112afdc5d47cdbc420da1f1bd9f74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:18:17Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:18:17Z,use_quota=True,user_id='db296e8bb33e4175a1af2c8681e73720',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 10:18:16 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-0a1cd34a-3012-4b13-9432-051d590ab4a5 tempest-VolumesCloneNegativeTest-325849928 None] Creating volume adaae1fb-cb47-41c3-9634-ef883f7d69bc {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:18:16 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-0a1cd34a-3012-4b13-9432-051d590ab4a5 tempest-VolumesCloneNegativeTest-325849928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:18:16 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-0a1cd34a-3012-4b13-9432-051d590ab4a5 tempest-VolumesCloneNegativeTest-325849928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:18:16 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-0a1cd34a-3012-4b13-9432-051d590ab4a5 tempest-VolumesCloneNegativeTest-325849928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:18:16 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-0a1cd34a-3012-4b13-9432-051d590ab4a5 tempest-VolumesCloneNegativeTest-325849928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:18:16 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-0a1cd34a-3012-4b13-9432-051d590ab4a5 tempest-VolumesCloneNegativeTest-325849928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:18:16 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-0a1cd34a-3012-4b13-9432-051d590ab4a5 tempest-VolumesCloneNegativeTest-325849928 None] Selected osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:18:16 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-0a1cd34a-3012-4b13-9432-051d590ab4a5 tempest-VolumesCloneNegativeTest-325849928 None] casted to osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 Nov 04 10:18:16 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-0a1cd34a-3012-4b13-9432-051d590ab4a5 tempest-VolumesCloneNegativeTest-325849928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-adaae1fb-cb47-41c3-9634-ef883f7d69bc 2147483648 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:18:16 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-3ed0e42e-9554-40c1-9204-5aef25e31e27 tempest-VolumesListAdminTestJSON-330589987 None] Lock "cinder-ae69392b-96c4-4e19-b36b-7af5edcd773b-delete_volume" acquired by "delete_volume" :: waited 0.141s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:18:16 devstack sudo[95696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-7d5f84aa-3521-409f-b964-00414e086802 Nov 04 10:18:16 devstack sudo[95696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:18:16 devstack sudo[95697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-adaae1fb-cb47-41c3-9634-ef883f7d69bc 2147483648 Nov 04 10:18:16 devstack sudo[95697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:18:16 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-3ed0e42e-9554-40c1-9204-5aef25e31e27 tempest-VolumesListAdminTestJSON-330589987 None] Acquiring lock "cinder-quobyte-ae69392b-96c4-4e19-b36b-7af5edcd773b" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:18:16 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-3ed0e42e-9554-40c1-9204-5aef25e31e27 tempest-VolumesListAdminTestJSON-330589987 None] Lock "cinder-quobyte-ae69392b-96c4-4e19-b36b-7af5edcd773b" acquired by "delete_volume" :: waited 0.029s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:18:17 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[f56617ca-2f8c-44d4-be7d-00802fa95fea]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:18:17 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-3ed0e42e-9554-40c1-9204-5aef25e31e27 tempest-VolumesListAdminTestJSON-330589987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-ae69392b-96c4-4e19-b36b-7af5edcd773b {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:18:17 devstack sudo[95700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-ae69392b-96c4-4e19-b36b-7af5edcd773b Nov 04 10:18:17 devstack sudo[95700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:18:17 devstack sudo[95696]: pam_unix(sudo:session): session closed for user root Nov 04 10:18:17 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-e16fd45a-626b-4ae2-9242-b9e8fa14873d tempest-VolumesListAdminTestJSON-1022516783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-7d5f84aa-3521-409f-b964-00414e086802" returned: 0 in 0.716s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:18:17 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-e16fd45a-626b-4ae2-9242-b9e8fa14873d tempest-VolumesListAdminTestJSON-1022516783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-7d5f84aa-3521-409f-b964-00414e086802 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:18:17 devstack sudo[95708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-7d5f84aa-3521-409f-b964-00414e086802 Nov 04 10:18:17 devstack sudo[95708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:18:17 devstack sudo[95697]: pam_unix(sudo:session): session closed for user root Nov 04 10:18:17 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-0a1cd34a-3012-4b13-9432-051d590ab4a5 tempest-VolumesCloneNegativeTest-325849928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-adaae1fb-cb47-41c3-9634-ef883f7d69bc 2147483648" returned: 0 in 0.830s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:18:17 devstack sudo[95700]: pam_unix(sudo:session): session closed for user root Nov 04 10:18:17 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-3ed0e42e-9554-40c1-9204-5aef25e31e27 tempest-VolumesListAdminTestJSON-330589987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-ae69392b-96c4-4e19-b36b-7af5edcd773b" returned: 0 in 0.649s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:18:17 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-3ed0e42e-9554-40c1-9204-5aef25e31e27 tempest-VolumesListAdminTestJSON-330589987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-ae69392b-96c4-4e19-b36b-7af5edcd773b {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:18:17 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-0a1cd34a-3012-4b13-9432-051d590ab4a5 tempest-VolumesCloneNegativeTest-325849928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-adaae1fb-cb47-41c3-9634-ef883f7d69bc {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:18:17 devstack sudo[95714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-ae69392b-96c4-4e19-b36b-7af5edcd773b Nov 04 10:18:17 devstack sudo[95714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:18:17 devstack sudo[95716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-adaae1fb-cb47-41c3-9634-ef883f7d69bc Nov 04 10:18:17 devstack sudo[95716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:18:17 devstack sudo[95708]: pam_unix(sudo:session): session closed for user root Nov 04 10:18:17 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-e16fd45a-626b-4ae2-9242-b9e8fa14873d tempest-VolumesListAdminTestJSON-1022516783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-7d5f84aa-3521-409f-b964-00414e086802" returned: 0 in 0.430s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:18:17 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-e16fd45a-626b-4ae2-9242-b9e8fa14873d tempest-VolumesListAdminTestJSON-1022516783 None] Lock "cinder-quobyte-7d5f84aa-3521-409f-b964-00414e086802" released by "delete_volume" :: held 1.257s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:18:17 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-e16fd45a-626b-4ae2-9242-b9e8fa14873d tempest-VolumesListAdminTestJSON-1022516783 None] Created reservations ['578b52f2-9a31-4641-86bd-b21dbc5baf00', 'ae575c89-37fd-469f-8b0d-e6e6bd8c7084', '61c7ad4b-9022-4e11-9699-17428cfc6e1f', 'fd9507e4-2db3-4e04-8207-612be4658223'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:18:18 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-e16fd45a-626b-4ae2-9242-b9e8fa14873d tempest-VolumesListAdminTestJSON-1022516783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:18:18 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-e16fd45a-626b-4ae2-9242-b9e8fa14873d tempest-VolumesListAdminTestJSON-1022516783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:18:18 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-e16fd45a-626b-4ae2-9242-b9e8fa14873d tempest-VolumesListAdminTestJSON-1022516783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:18:18 devstack sudo[95716]: pam_unix(sudo:session): session closed for user root Nov 04 10:18:18 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-e16fd45a-626b-4ae2-9242-b9e8fa14873d tempest-VolumesListAdminTestJSON-1022516783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:18:18 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-e16fd45a-626b-4ae2-9242-b9e8fa14873d tempest-VolumesListAdminTestJSON-1022516783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:18:18 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-e16fd45a-626b-4ae2-9242-b9e8fa14873d tempest-VolumesListAdminTestJSON-1022516783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:18:18 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-0a1cd34a-3012-4b13-9432-051d590ab4a5 tempest-VolumesCloneNegativeTest-325849928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-adaae1fb-cb47-41c3-9634-ef883f7d69bc" returned: 0 in 0.363s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:18:18 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-0a1cd34a-3012-4b13-9432-051d590ab4a5 tempest-VolumesCloneNegativeTest-325849928 None] <== create_volume: return (1286ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 10:18:18 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-0a1cd34a-3012-4b13-9432-051d590ab4a5 tempest-VolumesCloneNegativeTest-325849928 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.294s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:18:18 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-0a1cd34a-3012-4b13-9432-051d590ab4a5 tempest-VolumesCloneNegativeTest-325849928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae7c6859-afb0-4154-a505-ab5706db5f71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-adaae1fb-cb47-41c3-9634-ef883f7d69bc', 'volume_size': 2}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:18:18 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-0a1cd34a-3012-4b13-9432-051d590ab4a5 tempest-VolumesCloneNegativeTest-325849928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f664cef-3823-4421-8ed9-ccaa0b7ac1b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:18:18 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-0a1cd34a-3012-4b13-9432-051d590ab4a5 tempest-VolumesCloneNegativeTest-325849928 None] Volume volume-adaae1fb-cb47-41c3-9634-ef883f7d69bc (adaae1fb-cb47-41c3-9634-ef883f7d69bc): created successfully Nov 04 10:18:18 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-0a1cd34a-3012-4b13-9432-051d590ab4a5 tempest-VolumesCloneNegativeTest-325849928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f664cef-3823-4421-8ed9-ccaa0b7ac1b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:18:18 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-0a1cd34a-3012-4b13-9432-051d590ab4a5 tempest-VolumesCloneNegativeTest-325849928 None] Flow 'volume_create_manager' (011e53f0-9035-4f9e-94e4-416b66bf7685) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:18:18 devstack sudo[95720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:18:18 devstack sudo[95720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:18:18 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-0a1cd34a-3012-4b13-9432-051d590ab4a5 tempest-VolumesCloneNegativeTest-325849928 None] Created volume successfully. Nov 04 10:18:18 devstack sudo[95714]: pam_unix(sudo:session): session closed for user root Nov 04 10:18:18 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-3ed0e42e-9554-40c1-9204-5aef25e31e27 tempest-VolumesListAdminTestJSON-330589987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-ae69392b-96c4-4e19-b36b-7af5edcd773b" returned: 0 in 0.533s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:18:18 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-3ed0e42e-9554-40c1-9204-5aef25e31e27 tempest-VolumesListAdminTestJSON-330589987 None] Lock "cinder-quobyte-ae69392b-96c4-4e19-b36b-7af5edcd773b" released by "delete_volume" :: held 1.257s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:18:18 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-3ed0e42e-9554-40c1-9204-5aef25e31e27 tempest-VolumesListAdminTestJSON-330589987 None] Created reservations ['3d905dab-823b-4672-9587-639bc04881eb', 'b2e364b8-ba06-4543-bf52-d3e459f0fd22', '784f4689-c64f-44db-80a1-0641552e8e8a', '3437c09f-2e69-4bd7-be43-fe948319364e'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:18:18 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-3ed0e42e-9554-40c1-9204-5aef25e31e27 tempest-VolumesListAdminTestJSON-330589987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:18:18 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-3ed0e42e-9554-40c1-9204-5aef25e31e27 tempest-VolumesListAdminTestJSON-330589987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:18:18 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-3ed0e42e-9554-40c1-9204-5aef25e31e27 tempest-VolumesListAdminTestJSON-330589987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:18:18 devstack sudo[95720]: pam_unix(sudo:session): session closed for user root Nov 04 10:18:18 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-3ed0e42e-9554-40c1-9204-5aef25e31e27 tempest-VolumesListAdminTestJSON-330589987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:18:18 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-3ed0e42e-9554-40c1-9204-5aef25e31e27 tempest-VolumesListAdminTestJSON-330589987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:18:18 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-3ed0e42e-9554-40c1-9204-5aef25e31e27 tempest-VolumesListAdminTestJSON-330589987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:18:18 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-e16fd45a-626b-4ae2-9242-b9e8fa14873d tempest-VolumesListAdminTestJSON-1022516783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.384s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:18:18 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-e16fd45a-626b-4ae2-9242-b9e8fa14873d tempest-VolumesListAdminTestJSON-1022516783 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:18:18 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-e16fd45a-626b-4ae2-9242-b9e8fa14873d tempest-VolumesListAdminTestJSON-1022516783 None] Deleted volume successfully. Nov 04 10:18:18 devstack sudo[95724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:18:18 devstack sudo[95724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:18:18 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-e16fd45a-626b-4ae2-9242-b9e8fa14873d tempest-VolumesListAdminTestJSON-1022516783 None] Lock "cinder-7d5f84aa-3521-409f-b964-00414e086802-delete_volume" released by "delete_volume" :: held 2.035s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:18:18 devstack sudo[95724]: pam_unix(sudo:session): session closed for user root Nov 04 10:18:18 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-3ed0e42e-9554-40c1-9204-5aef25e31e27 tempest-VolumesListAdminTestJSON-330589987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.388s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:18:18 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-3ed0e42e-9554-40c1-9204-5aef25e31e27 tempest-VolumesListAdminTestJSON-330589987 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:18:18 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-3ed0e42e-9554-40c1-9204-5aef25e31e27 tempest-VolumesListAdminTestJSON-330589987 None] Deleted volume successfully. Nov 04 10:18:18 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-3ed0e42e-9554-40c1-9204-5aef25e31e27 tempest-VolumesListAdminTestJSON-330589987 None] Lock "cinder-ae69392b-96c4-4e19-b36b-7af5edcd773b-delete_volume" released by "delete_volume" :: held 2.010s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:18:18 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-70d9433e-c5d9-4a08-9b4f-806a6ce977f9 tempest-VolumesCloneNegativeTest-325849928 None] Acquiring lock "cinder-adaae1fb-cb47-41c3-9634-ef883f7d69bc-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:18:18 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-70d9433e-c5d9-4a08-9b4f-806a6ce977f9 tempest-VolumesCloneNegativeTest-325849928 None] Lock "cinder-adaae1fb-cb47-41c3-9634-ef883f7d69bc-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:18:19 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-70d9433e-c5d9-4a08-9b4f-806a6ce977f9 tempest-VolumesCloneNegativeTest-325849928 None] Acquiring lock "cinder-quobyte-adaae1fb-cb47-41c3-9634-ef883f7d69bc" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:18:19 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-70d9433e-c5d9-4a08-9b4f-806a6ce977f9 tempest-VolumesCloneNegativeTest-325849928 None] Lock "cinder-quobyte-adaae1fb-cb47-41c3-9634-ef883f7d69bc" acquired by "delete_volume" :: waited 0.022s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:18:19 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[dde1037d-1e99-4c0a-9dd1-1a46742f1b90]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:18:19 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-70d9433e-c5d9-4a08-9b4f-806a6ce977f9 tempest-VolumesCloneNegativeTest-325849928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-adaae1fb-cb47-41c3-9634-ef883f7d69bc {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:18:19 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-a9ca6856-9009-4a80-8292-c87adb53aa66 tempest-VolumesListAdminTestJSON-330589987 None] Acquiring lock "cinder-f364591d-ab6e-4221-85d6-5cfbdcf1b3c8-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:18:19 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-a9ca6856-9009-4a80-8292-c87adb53aa66 tempest-VolumesListAdminTestJSON-330589987 None] Lock "cinder-f364591d-ab6e-4221-85d6-5cfbdcf1b3c8-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:18:19 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-a9ca6856-9009-4a80-8292-c87adb53aa66 tempest-VolumesListAdminTestJSON-330589987 None] Acquiring lock "cinder-quobyte-f364591d-ab6e-4221-85d6-5cfbdcf1b3c8" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:18:19 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-a9ca6856-9009-4a80-8292-c87adb53aa66 tempest-VolumesListAdminTestJSON-330589987 None] Lock "cinder-quobyte-f364591d-ab6e-4221-85d6-5cfbdcf1b3c8" acquired by "delete_volume" :: waited 0.018s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:18:19 devstack sudo[95727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-adaae1fb-cb47-41c3-9634-ef883f7d69bc Nov 04 10:18:19 devstack sudo[95727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:18:19 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8f6428a-df33-4dd5-a8ba-dc1b6862aed9]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:18:19 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-a9ca6856-9009-4a80-8292-c87adb53aa66 tempest-VolumesListAdminTestJSON-330589987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-f364591d-ab6e-4221-85d6-5cfbdcf1b3c8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:18:19 devstack sudo[95729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-f364591d-ab6e-4221-85d6-5cfbdcf1b3c8 Nov 04 10:18:19 devstack sudo[95729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:18:19 devstack sudo[95727]: pam_unix(sudo:session): session closed for user root Nov 04 10:18:19 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-70d9433e-c5d9-4a08-9b4f-806a6ce977f9 tempest-VolumesCloneNegativeTest-325849928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-adaae1fb-cb47-41c3-9634-ef883f7d69bc" returned: 0 in 0.599s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:18:19 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-70d9433e-c5d9-4a08-9b4f-806a6ce977f9 tempest-VolumesCloneNegativeTest-325849928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-adaae1fb-cb47-41c3-9634-ef883f7d69bc {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:18:19 devstack sudo[95735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-adaae1fb-cb47-41c3-9634-ef883f7d69bc Nov 04 10:18:19 devstack sudo[95735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:18:19 devstack sudo[95729]: pam_unix(sudo:session): session closed for user root Nov 04 10:18:19 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-a9ca6856-9009-4a80-8292-c87adb53aa66 tempest-VolumesListAdminTestJSON-330589987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-f364591d-ab6e-4221-85d6-5cfbdcf1b3c8" returned: 0 in 0.600s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:18:19 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-a9ca6856-9009-4a80-8292-c87adb53aa66 tempest-VolumesListAdminTestJSON-330589987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-f364591d-ab6e-4221-85d6-5cfbdcf1b3c8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:18:19 devstack sudo[95740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-f364591d-ab6e-4221-85d6-5cfbdcf1b3c8 Nov 04 10:18:19 devstack sudo[95740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:18:20 devstack sudo[95735]: pam_unix(sudo:session): session closed for user root Nov 04 10:18:20 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-70d9433e-c5d9-4a08-9b4f-806a6ce977f9 tempest-VolumesCloneNegativeTest-325849928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-adaae1fb-cb47-41c3-9634-ef883f7d69bc" returned: 0 in 0.388s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:18:20 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-70d9433e-c5d9-4a08-9b4f-806a6ce977f9 tempest-VolumesCloneNegativeTest-325849928 None] Lock "cinder-quobyte-adaae1fb-cb47-41c3-9634-ef883f7d69bc" released by "delete_volume" :: held 1.065s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:18:20 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-70d9433e-c5d9-4a08-9b4f-806a6ce977f9 tempest-VolumesCloneNegativeTest-325849928 None] Created reservations ['0a35ac57-e73c-4f62-979f-36f4f9f2f21e', '745199f2-bc87-4836-8830-ca5a78aba975', 'b159c112-22ba-4d34-926d-438aa42a0b0d', 'f3c106a0-2a1d-47ef-887e-22822b113c73'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:18:20 devstack sudo[95740]: pam_unix(sudo:session): session closed for user root Nov 04 10:18:20 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-a9ca6856-9009-4a80-8292-c87adb53aa66 tempest-VolumesListAdminTestJSON-330589987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-f364591d-ab6e-4221-85d6-5cfbdcf1b3c8" returned: 0 in 0.365s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:18:20 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-a9ca6856-9009-4a80-8292-c87adb53aa66 tempest-VolumesListAdminTestJSON-330589987 None] Lock "cinder-quobyte-f364591d-ab6e-4221-85d6-5cfbdcf1b3c8" released by "delete_volume" :: held 1.063s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:18:20 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-70d9433e-c5d9-4a08-9b4f-806a6ce977f9 tempest-VolumesCloneNegativeTest-325849928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:18:20 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-70d9433e-c5d9-4a08-9b4f-806a6ce977f9 tempest-VolumesCloneNegativeTest-325849928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:18:20 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-70d9433e-c5d9-4a08-9b4f-806a6ce977f9 tempest-VolumesCloneNegativeTest-325849928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:18:20 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-70d9433e-c5d9-4a08-9b4f-806a6ce977f9 tempest-VolumesCloneNegativeTest-325849928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:18:20 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-70d9433e-c5d9-4a08-9b4f-806a6ce977f9 tempest-VolumesCloneNegativeTest-325849928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:18:20 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-70d9433e-c5d9-4a08-9b4f-806a6ce977f9 tempest-VolumesCloneNegativeTest-325849928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:18:20 devstack sudo[95744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:18:20 devstack sudo[95744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:18:20 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-a9ca6856-9009-4a80-8292-c87adb53aa66 tempest-VolumesListAdminTestJSON-330589987 None] Created reservations ['bf8cd7ff-c3d9-4f43-ab56-2f9a47ffa459', '343de67e-12c1-4dda-9607-e7d8b9955f83', '19b80b58-daea-40c7-a0ae-ed6936ff74ed', '33ba8d39-2f25-45d9-bc0e-b0e128736dcf'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:18:20 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-a9ca6856-9009-4a80-8292-c87adb53aa66 tempest-VolumesListAdminTestJSON-330589987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:18:20 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-a9ca6856-9009-4a80-8292-c87adb53aa66 tempest-VolumesListAdminTestJSON-330589987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:18:20 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-a9ca6856-9009-4a80-8292-c87adb53aa66 tempest-VolumesListAdminTestJSON-330589987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:18:20 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-a9ca6856-9009-4a80-8292-c87adb53aa66 tempest-VolumesListAdminTestJSON-330589987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:18:20 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-a9ca6856-9009-4a80-8292-c87adb53aa66 tempest-VolumesListAdminTestJSON-330589987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:18:20 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-a9ca6856-9009-4a80-8292-c87adb53aa66 tempest-VolumesListAdminTestJSON-330589987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:18:20 devstack sudo[95746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:18:20 devstack sudo[95746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:18:20 devstack sudo[95744]: pam_unix(sudo:session): session closed for user root Nov 04 10:18:20 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-70d9433e-c5d9-4a08-9b4f-806a6ce977f9 tempest-VolumesCloneNegativeTest-325849928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.479s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:18:20 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-70d9433e-c5d9-4a08-9b4f-806a6ce977f9 tempest-VolumesCloneNegativeTest-325849928 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:18:20 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-70d9433e-c5d9-4a08-9b4f-806a6ce977f9 tempest-VolumesCloneNegativeTest-325849928 None] Deleted volume successfully. Nov 04 10:18:20 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-70d9433e-c5d9-4a08-9b4f-806a6ce977f9 tempest-VolumesCloneNegativeTest-325849928 None] Lock "cinder-adaae1fb-cb47-41c3-9634-ef883f7d69bc-delete_volume" released by "delete_volume" :: held 1.915s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:18:20 devstack sudo[95746]: pam_unix(sudo:session): session closed for user root Nov 04 10:18:20 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-a9ca6856-9009-4a80-8292-c87adb53aa66 tempest-VolumesListAdminTestJSON-330589987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.338s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:18:20 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-a9ca6856-9009-4a80-8292-c87adb53aa66 tempest-VolumesListAdminTestJSON-330589987 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:18:20 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-a9ca6856-9009-4a80-8292-c87adb53aa66 tempest-VolumesListAdminTestJSON-330589987 None] Deleted volume successfully. Nov 04 10:18:20 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-a9ca6856-9009-4a80-8292-c87adb53aa66 tempest-VolumesListAdminTestJSON-330589987 None] Lock "cinder-f364591d-ab6e-4221-85d6-5cfbdcf1b3c8-delete_volume" released by "delete_volume" :: held 1.761s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:18:21 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-c9b0ab75-c1f2-4c30-8eb9-4c90485e4062 tempest-VolumesListAdminTestJSON-330589987 None] Acquiring lock "cinder-b64e7c90-d951-46bc-af74-f97ab2f8d232-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:18:21 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-c9b0ab75-c1f2-4c30-8eb9-4c90485e4062 tempest-VolumesListAdminTestJSON-330589987 None] Lock "cinder-b64e7c90-d951-46bc-af74-f97ab2f8d232-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:18:21 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-c9b0ab75-c1f2-4c30-8eb9-4c90485e4062 tempest-VolumesListAdminTestJSON-330589987 None] Acquiring lock "cinder-quobyte-b64e7c90-d951-46bc-af74-f97ab2f8d232" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:18:21 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-c9b0ab75-c1f2-4c30-8eb9-4c90485e4062 tempest-VolumesListAdminTestJSON-330589987 None] Lock "cinder-quobyte-b64e7c90-d951-46bc-af74-f97ab2f8d232" acquired by "delete_volume" :: waited 0.031s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:18:21 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[87c27808-49c5-48df-95a3-e0ce8550ba30]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:18:21 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c9b0ab75-c1f2-4c30-8eb9-4c90485e4062 tempest-VolumesListAdminTestJSON-330589987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b64e7c90-d951-46bc-af74-f97ab2f8d232 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:18:21 devstack sudo[95750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b64e7c90-d951-46bc-af74-f97ab2f8d232 Nov 04 10:18:21 devstack sudo[95750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:18:22 devstack sudo[95750]: pam_unix(sudo:session): session closed for user root Nov 04 10:18:22 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c9b0ab75-c1f2-4c30-8eb9-4c90485e4062 tempest-VolumesListAdminTestJSON-330589987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b64e7c90-d951-46bc-af74-f97ab2f8d232" returned: 0 in 0.403s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:18:22 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c9b0ab75-c1f2-4c30-8eb9-4c90485e4062 tempest-VolumesListAdminTestJSON-330589987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b64e7c90-d951-46bc-af74-f97ab2f8d232 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:18:22 devstack sudo[95756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b64e7c90-d951-46bc-af74-f97ab2f8d232 Nov 04 10:18:22 devstack sudo[95756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:18:22 devstack sudo[95756]: pam_unix(sudo:session): session closed for user root Nov 04 10:18:22 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c9b0ab75-c1f2-4c30-8eb9-4c90485e4062 tempest-VolumesListAdminTestJSON-330589987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b64e7c90-d951-46bc-af74-f97ab2f8d232" returned: 0 in 0.301s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:18:22 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-c9b0ab75-c1f2-4c30-8eb9-4c90485e4062 tempest-VolumesListAdminTestJSON-330589987 None] Lock "cinder-quobyte-b64e7c90-d951-46bc-af74-f97ab2f8d232" released by "delete_volume" :: held 0.792s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:18:22 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-c9b0ab75-c1f2-4c30-8eb9-4c90485e4062 tempest-VolumesListAdminTestJSON-330589987 None] Created reservations ['15c7bd32-d69e-4796-bb4c-2f28e6d95a14', '799453b2-00c5-4144-9518-7b5bd5b8324c', '881b92e6-2025-437e-9166-d73c1c3f2ded', '58ea02fe-73f0-4d5f-b825-c20e6428f663'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:18:22 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-c9b0ab75-c1f2-4c30-8eb9-4c90485e4062 tempest-VolumesListAdminTestJSON-330589987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:18:22 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-c9b0ab75-c1f2-4c30-8eb9-4c90485e4062 tempest-VolumesListAdminTestJSON-330589987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:18:22 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-c9b0ab75-c1f2-4c30-8eb9-4c90485e4062 tempest-VolumesListAdminTestJSON-330589987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:18:22 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-c9b0ab75-c1f2-4c30-8eb9-4c90485e4062 tempest-VolumesListAdminTestJSON-330589987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:18:22 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-c9b0ab75-c1f2-4c30-8eb9-4c90485e4062 tempest-VolumesListAdminTestJSON-330589987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:18:22 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c9b0ab75-c1f2-4c30-8eb9-4c90485e4062 tempest-VolumesListAdminTestJSON-330589987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:18:22 devstack sudo[95759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:18:22 devstack sudo[95759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:18:23 devstack sudo[95759]: pam_unix(sudo:session): session closed for user root Nov 04 10:18:23 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c9b0ab75-c1f2-4c30-8eb9-4c90485e4062 tempest-VolumesListAdminTestJSON-330589987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.343s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:18:23 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-c9b0ab75-c1f2-4c30-8eb9-4c90485e4062 tempest-VolumesListAdminTestJSON-330589987 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:18:23 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-c9b0ab75-c1f2-4c30-8eb9-4c90485e4062 tempest-VolumesListAdminTestJSON-330589987 None] Deleted volume successfully. Nov 04 10:18:23 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-c9b0ab75-c1f2-4c30-8eb9-4c90485e4062 tempest-VolumesListAdminTestJSON-330589987 None] Lock "cinder-b64e7c90-d951-46bc-af74-f97ab2f8d232-delete_volume" released by "delete_volume" :: held 1.487s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:18:28 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-e60d6c3b-379b-4638-9db7-2d16d0b9c758 tempest-VolumesExtendTest-204608174 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:18:28 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-e60d6c3b-379b-4638-9db7-2d16d0b9c758 tempest-VolumesExtendTest-204608174 None] Flow 'volume_create_manager' (f3d3d9eb-2f79-4501-ba80-cc03061d28f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:18:28 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-e60d6c3b-379b-4638-9db7-2d16d0b9c758 tempest-VolumesExtendTest-204608174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1bc1d72-7042-4fe4-992d-33393589e9b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:18:28 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-e60d6c3b-379b-4638-9db7-2d16d0b9c758 tempest-VolumesExtendTest-204608174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1bc1d72-7042-4fe4-992d-33393589e9b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:18:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-927187233',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36b0f944-73e9-4e35-963c-6c22fed23c5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7441149c648a4dee9eb8538ac44709e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:18:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:18:29Z,use_quota=True,user_id='f3ed426c0c674a4c81168663c5d04e02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:18:28 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-e60d6c3b-379b-4638-9db7-2d16d0b9c758 tempest-VolumesExtendTest-204608174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (785c1c0f-43da-456c-9190-8440671cda27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:18:28 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-e60d6c3b-379b-4638-9db7-2d16d0b9c758 tempest-VolumesExtendTest-204608174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (785c1c0f-43da-456c-9190-8440671cda27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:18:28 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-e60d6c3b-379b-4638-9db7-2d16d0b9c758 tempest-VolumesExtendTest-204608174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b235591c-2231-429d-80cb-94b547e5dd12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:18:28 devstack cinder-volume[87068]: DEBUG cinder.image.glance [None req-e60d6c3b-379b-4638-9db7-2d16d0b9c758 tempest-VolumesExtendTest-204608174 None] Creating Keystone auth plugin from conf {{(pid=87068) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 04 10:18:29 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-e60d6c3b-379b-4638-9db7-2d16d0b9c758 tempest-VolumesExtendTest-204608174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b235591c-2231-429d-80cb-94b547e5dd12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '36b0f944-73e9-4e35-963c-6c22fed23c5d', 'volume_name': 'volume-36b0f944-73e9-4e35-963c-6c22fed23c5d', 'volume_size': 1, 'image_id': 'c589a328-f3ed-418a-8877-e90bfc4cf133', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c589a328-f3ed-418a-8877-e90bfc4cf133', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '046e78417f874f20873c25a0eb7adc65', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c589a328-f3ed-418a-8877-e90bfc4cf133', 'created_at': datetime.datetime(2026, 11, 4, 9, 4, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 9, 5, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c589a328-f3ed-418a-8877-e90bfc4cf133/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:18:29 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-e60d6c3b-379b-4638-9db7-2d16d0b9c758 tempest-VolumesExtendTest-204608174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17ef879d-7e66-48ee-9eff-7c7535c4b66d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:18:29 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-e60d6c3b-379b-4638-9db7-2d16d0b9c758 tempest-VolumesExtendTest-204608174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17ef879d-7e66-48ee-9eff-7c7535c4b66d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:18:29 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-e60d6c3b-379b-4638-9db7-2d16d0b9c758 tempest-VolumesExtendTest-204608174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a06c58e8-de29-4762-88cc-ae92fc46711d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:18:29 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-e60d6c3b-379b-4638-9db7-2d16d0b9c758 tempest-VolumesExtendTest-204608174 None] Volume 36b0f944-73e9-4e35-963c-6c22fed23c5d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-36b0f944-73e9-4e35-963c-6c22fed23c5d', 'volume_size': 1, 'image_id': 'c589a328-f3ed-418a-8877-e90bfc4cf133', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c589a328-f3ed-418a-8877-e90bfc4cf133', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '046e78417f874f20873c25a0eb7adc65', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c589a328-f3ed-418a-8877-e90bfc4cf133', 'created_at': datetime.datetime(2026, 11, 4, 9, 4, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 9, 5, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c589a328-f3ed-418a-8877-e90bfc4cf133/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 04 10:18:29 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-e60d6c3b-379b-4638-9db7-2d16d0b9c758 tempest-VolumesExtendTest-204608174 None] Trying to clone 36b0f944-73e9-4e35-963c-6c22fed23c5d from image c589a328-f3ed-418a-8877-e90bfc4cf133 at location (None, [{'url': 'file:///opt/stack/data/glance/images/c589a328-f3ed-418a-8877-e90bfc4cf133', 'metadata': {}}]). {{(pid=87068) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 04 10:18:30 devstack cinder-volume[87068]: DEBUG cinder.image.image_utils [None req-e60d6c3b-379b-4638-9db7-2d16d0b9c758 tempest-VolumesExtendTest-204608174 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c589a328-f3ed-418a-8877-e90bfc4cf133_un95ylh_devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87068) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 04 10:18:30 devstack cinder-volume[87068]: INFO cinder.image.image_utils [None req-e60d6c3b-379b-4638-9db7-2d16d0b9c758 tempest-VolumesExtendTest-204608174 None] Image download 20.69 MB at 20.69 MB/s Nov 04 10:18:30 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[12961124-be90-40ea-95f2-e11dcb614a6f]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:18:30 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-e60d6c3b-379b-4638-9db7-2d16d0b9c758 tempest-VolumesExtendTest-204608174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c589a328-f3ed-418a-8877-e90bfc4cf133_un95ylh_devstack@QuobyteHD {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:18:30 devstack sudo[95790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c589a328-f3ed-418a-8877-e90bfc4cf133_un95ylh_devstack@QuobyteHD Nov 04 10:18:30 devstack sudo[95790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:18:30 devstack sudo[95790]: pam_unix(sudo:session): session closed for user root Nov 04 10:18:30 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-e60d6c3b-379b-4638-9db7-2d16d0b9c758 tempest-VolumesExtendTest-204608174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c589a328-f3ed-418a-8877-e90bfc4cf133_un95ylh_devstack@QuobyteHD" returned: 0 in 0.451s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:18:30 devstack cinder-volume[87068]: DEBUG cinder.image.image_utils [None req-e60d6c3b-379b-4638-9db7-2d16d0b9c758 tempest-VolumesExtendTest-204608174 None] Temporary image c589a328-f3ed-418a-8877-e90bfc4cf133 is fetched for user f3ed426c0c674a4c81168663c5d04e02. {{(pid=87068) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 04 10:18:30 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[9119a80f-1626-4588-8358-7d0fe5202101]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:18:30 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-e60d6c3b-379b-4638-9db7-2d16d0b9c758 tempest-VolumesExtendTest-204608174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c589a328-f3ed-418a-8877-e90bfc4cf133_un95ylh_devstack@QuobyteHD {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:18:30 devstack sudo[95796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c589a328-f3ed-418a-8877-e90bfc4cf133_un95ylh_devstack@QuobyteHD Nov 04 10:18:30 devstack sudo[95796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:18:31 devstack sudo[95796]: pam_unix(sudo:session): session closed for user root Nov 04 10:18:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-e60d6c3b-379b-4638-9db7-2d16d0b9c758 tempest-VolumesExtendTest-204608174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c589a328-f3ed-418a-8877-e90bfc4cf133_un95ylh_devstack@QuobyteHD" returned: 0 in 0.429s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:18:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-e60d6c3b-379b-4638-9db7-2d16d0b9c758 tempest-VolumesExtendTest-204608174 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:18:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-e60d6c3b-379b-4638-9db7-2d16d0b9c758 tempest-VolumesExtendTest-204608174 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:18:31 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-e60d6c3b-379b-4638-9db7-2d16d0b9c758 tempest-VolumesExtendTest-204608174 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:18:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-927187233',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36b0f944-73e9-4e35-963c-6c22fed23c5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7441149c648a4dee9eb8538ac44709e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:18:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:18:29Z,use_quota=True,user_id='f3ed426c0c674a4c81168663c5d04e02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 10:18:31 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-e60d6c3b-379b-4638-9db7-2d16d0b9c758 tempest-VolumesExtendTest-204608174 None] Creating volume 36b0f944-73e9-4e35-963c-6c22fed23c5d {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:18:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-e60d6c3b-379b-4638-9db7-2d16d0b9c758 tempest-VolumesExtendTest-204608174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:18:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-e60d6c3b-379b-4638-9db7-2d16d0b9c758 tempest-VolumesExtendTest-204608174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:18:31 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-e60d6c3b-379b-4638-9db7-2d16d0b9c758 tempest-VolumesExtendTest-204608174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:18:31 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-e60d6c3b-379b-4638-9db7-2d16d0b9c758 tempest-VolumesExtendTest-204608174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:18:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-e60d6c3b-379b-4638-9db7-2d16d0b9c758 tempest-VolumesExtendTest-204608174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:18:31 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-e60d6c3b-379b-4638-9db7-2d16d0b9c758 tempest-VolumesExtendTest-204608174 None] Selected osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:18:31 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-e60d6c3b-379b-4638-9db7-2d16d0b9c758 tempest-VolumesExtendTest-204608174 None] casted to osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 Nov 04 10:18:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-e60d6c3b-379b-4638-9db7-2d16d0b9c758 tempest-VolumesExtendTest-204608174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-36b0f944-73e9-4e35-963c-6c22fed23c5d 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:18:31 devstack sudo[95801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-36b0f944-73e9-4e35-963c-6c22fed23c5d 1073741824 Nov 04 10:18:31 devstack sudo[95801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:18:31 devstack sudo[95801]: pam_unix(sudo:session): session closed for user root Nov 04 10:18:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-e60d6c3b-379b-4638-9db7-2d16d0b9c758 tempest-VolumesExtendTest-204608174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-36b0f944-73e9-4e35-963c-6c22fed23c5d 1073741824" returned: 0 in 0.636s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:18:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-e60d6c3b-379b-4638-9db7-2d16d0b9c758 tempest-VolumesExtendTest-204608174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-36b0f944-73e9-4e35-963c-6c22fed23c5d {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:18:31 devstack sudo[95807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-36b0f944-73e9-4e35-963c-6c22fed23c5d Nov 04 10:18:31 devstack sudo[95807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:18:32 devstack sudo[95807]: pam_unix(sudo:session): session closed for user root Nov 04 10:18:32 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-e60d6c3b-379b-4638-9db7-2d16d0b9c758 tempest-VolumesExtendTest-204608174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-36b0f944-73e9-4e35-963c-6c22fed23c5d" returned: 0 in 0.354s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:18:32 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-e60d6c3b-379b-4638-9db7-2d16d0b9c758 tempest-VolumesExtendTest-204608174 None] <== create_volume: return (1077ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 10:18:32 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-e60d6c3b-379b-4638-9db7-2d16d0b9c758 tempest-VolumesExtendTest-204608174 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.081s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:18:32 devstack cinder-volume[87068]: DEBUG cinder.volume.volume_utils [None req-e60d6c3b-379b-4638-9db7-2d16d0b9c758 tempest-VolumesExtendTest-204608174 None] Attempting download of c589a328-f3ed-418a-8877-e90bfc4cf133 ((None, [{'url': 'file:///opt/stack/data/glance/images/c589a328-f3ed-418a-8877-e90bfc4cf133', 'metadata': {}}])) to volume 36b0f944-73e9-4e35-963c-6c22fed23c5d. {{(pid=87068) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 04 10:18:32 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b152917-b9d5-45e9-8e2a-0b42b10ecd0d]: (4, 'raw') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:18:32 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-e60d6c3b-379b-4638-9db7-2d16d0b9c758 tempest-VolumesExtendTest-204608174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c589a328-f3ed-418a-8877-e90bfc4cf133_6obkydrw {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:18:32 devstack sudo[95812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c589a328-f3ed-418a-8877-e90bfc4cf133_6obkydrw Nov 04 10:18:32 devstack sudo[95812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:18:32 devstack sudo[95812]: pam_unix(sudo:session): session closed for user root Nov 04 10:18:32 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-e60d6c3b-379b-4638-9db7-2d16d0b9c758 tempest-VolumesExtendTest-204608174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c589a328-f3ed-418a-8877-e90bfc4cf133_6obkydrw" returned: 0 in 0.421s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:18:32 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-e60d6c3b-379b-4638-9db7-2d16d0b9c758 tempest-VolumesExtendTest-204608174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c589a328-f3ed-418a-8877-e90bfc4cf133_6obkydrw {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:18:32 devstack sudo[95816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c589a328-f3ed-418a-8877-e90bfc4cf133_6obkydrw Nov 04 10:18:32 devstack sudo[95816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:18:33 devstack sudo[95816]: pam_unix(sudo:session): session closed for user root Nov 04 10:18:33 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-e60d6c3b-379b-4638-9db7-2d16d0b9c758 tempest-VolumesExtendTest-204608174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c589a328-f3ed-418a-8877-e90bfc4cf133_6obkydrw" returned: 1 in 0.577s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:18:33 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-e60d6c3b-379b-4638-9db7-2d16d0b9c758 tempest-VolumesExtendTest-204608174 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c589a328-f3ed-418a-8877-e90bfc4cf133_6obkydrw' failed. Not Retrying. {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 04 10:18:33 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[5505aa77-2e9f-4093-b617-8d0477aaa932]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:18:33 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-e60d6c3b-379b-4638-9db7-2d16d0b9c758 tempest-VolumesExtendTest-204608174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c589a328-f3ed-418a-8877-e90bfc4cf133_un95ylh_devstack@QuobyteHD {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:18:33 devstack sudo[95856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c589a328-f3ed-418a-8877-e90bfc4cf133_un95ylh_devstack@QuobyteHD Nov 04 10:18:33 devstack sudo[95856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:18:34 devstack sudo[95856]: pam_unix(sudo:session): session closed for user root Nov 04 10:18:34 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-e60d6c3b-379b-4638-9db7-2d16d0b9c758 tempest-VolumesExtendTest-204608174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c589a328-f3ed-418a-8877-e90bfc4cf133_un95ylh_devstack@QuobyteHD" returned: 0 in 0.605s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:18:34 devstack cinder-volume[87068]: DEBUG cinder.image.image_utils [None req-e60d6c3b-379b-4638-9db7-2d16d0b9c758 tempest-VolumesExtendTest-204608174 None] c589a328-f3ed-418a-8877-e90bfc4cf133 was qcow2, converting to qcow2 {{(pid=87068) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 04 10:18:34 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-e60d6c3b-379b-4638-9db7-2d16d0b9c758 tempest-VolumesExtendTest-204608174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c589a328-f3ed-418a-8877-e90bfc4cf133_un95ylh_devstack@QuobyteHD /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-36b0f944-73e9-4e35-963c-6c22fed23c5d {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:18:34 devstack sudo[95887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c589a328-f3ed-418a-8877-e90bfc4cf133_un95ylh_devstack@QuobyteHD /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-36b0f944-73e9-4e35-963c-6c22fed23c5d Nov 04 10:18:34 devstack sudo[95887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:18:34 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-be2cc4c4-2f5d-4a7a-b6d7-889f00796332 tempest-SnapshotMetadataTestJSON-251614807 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:18:34 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-be2cc4c4-2f5d-4a7a-b6d7-889f00796332 tempest-SnapshotMetadataTestJSON-251614807 None] Flow 'volume_create_manager' (a73e5809-881c-4e04-8a78-c7fc73bedd43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:18:34 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-be2cc4c4-2f5d-4a7a-b6d7-889f00796332 tempest-SnapshotMetadataTestJSON-251614807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c52074f6-4463-4be4-aed9-a88c3efb2a2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:18:34 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-be2cc4c4-2f5d-4a7a-b6d7-889f00796332 tempest-SnapshotMetadataTestJSON-251614807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c52074f6-4463-4be4-aed9-a88c3efb2a2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:18:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1023287353',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4b04dde-6c57-404e-ba54-232f62c8603f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9077e9c79ffe412c88898191dc4209f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:18:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:18:35Z,use_quota=True,user_id='a09f3979a53649f8a04def4ec1a495ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:18:34 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-be2cc4c4-2f5d-4a7a-b6d7-889f00796332 tempest-SnapshotMetadataTestJSON-251614807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f89635a-33e4-414d-88ac-2bab66d4d305) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:18:34 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-be2cc4c4-2f5d-4a7a-b6d7-889f00796332 tempest-SnapshotMetadataTestJSON-251614807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f89635a-33e4-414d-88ac-2bab66d4d305) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:18:34 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-be2cc4c4-2f5d-4a7a-b6d7-889f00796332 tempest-SnapshotMetadataTestJSON-251614807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed320f88-b0d4-4231-9663-f8cf895d6063) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:18:34 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-be2cc4c4-2f5d-4a7a-b6d7-889f00796332 tempest-SnapshotMetadataTestJSON-251614807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed320f88-b0d4-4231-9663-f8cf895d6063) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b4b04dde-6c57-404e-ba54-232f62c8603f', 'volume_name': 'volume-b4b04dde-6c57-404e-ba54-232f62c8603f', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:18:34 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-be2cc4c4-2f5d-4a7a-b6d7-889f00796332 tempest-SnapshotMetadataTestJSON-251614807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85e88698-a6b8-44c7-a1ae-cdfcac6c0a6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:18:34 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-be2cc4c4-2f5d-4a7a-b6d7-889f00796332 tempest-SnapshotMetadataTestJSON-251614807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85e88698-a6b8-44c7-a1ae-cdfcac6c0a6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:18:34 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-be2cc4c4-2f5d-4a7a-b6d7-889f00796332 tempest-SnapshotMetadataTestJSON-251614807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43782576-0185-410d-aaaf-0594def71a4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:18:34 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-be2cc4c4-2f5d-4a7a-b6d7-889f00796332 tempest-SnapshotMetadataTestJSON-251614807 None] Volume b4b04dde-6c57-404e-ba54-232f62c8603f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b4b04dde-6c57-404e-ba54-232f62c8603f', 'volume_size': 1} Nov 04 10:18:34 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-be2cc4c4-2f5d-4a7a-b6d7-889f00796332 tempest-SnapshotMetadataTestJSON-251614807 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:18:34 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-be2cc4c4-2f5d-4a7a-b6d7-889f00796332 tempest-SnapshotMetadataTestJSON-251614807 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:18:34 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-be2cc4c4-2f5d-4a7a-b6d7-889f00796332 tempest-SnapshotMetadataTestJSON-251614807 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:18:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1023287353',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4b04dde-6c57-404e-ba54-232f62c8603f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9077e9c79ffe412c88898191dc4209f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:18:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:18:35Z,use_quota=True,user_id='a09f3979a53649f8a04def4ec1a495ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 10:18:34 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-be2cc4c4-2f5d-4a7a-b6d7-889f00796332 tempest-SnapshotMetadataTestJSON-251614807 None] Creating volume b4b04dde-6c57-404e-ba54-232f62c8603f {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:18:34 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-be2cc4c4-2f5d-4a7a-b6d7-889f00796332 tempest-SnapshotMetadataTestJSON-251614807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:18:34 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-be2cc4c4-2f5d-4a7a-b6d7-889f00796332 tempest-SnapshotMetadataTestJSON-251614807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:18:34 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-be2cc4c4-2f5d-4a7a-b6d7-889f00796332 tempest-SnapshotMetadataTestJSON-251614807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:18:34 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-be2cc4c4-2f5d-4a7a-b6d7-889f00796332 tempest-SnapshotMetadataTestJSON-251614807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:18:34 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-be2cc4c4-2f5d-4a7a-b6d7-889f00796332 tempest-SnapshotMetadataTestJSON-251614807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:18:34 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-be2cc4c4-2f5d-4a7a-b6d7-889f00796332 tempest-SnapshotMetadataTestJSON-251614807 None] Selected osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:18:34 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-be2cc4c4-2f5d-4a7a-b6d7-889f00796332 tempest-SnapshotMetadataTestJSON-251614807 None] casted to osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 Nov 04 10:18:34 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-be2cc4c4-2f5d-4a7a-b6d7-889f00796332 tempest-SnapshotMetadataTestJSON-251614807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b4b04dde-6c57-404e-ba54-232f62c8603f 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:18:34 devstack sudo[95902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b4b04dde-6c57-404e-ba54-232f62c8603f 1073741824 Nov 04 10:18:34 devstack sudo[95902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:18:35 devstack sudo[95902]: pam_unix(sudo:session): session closed for user root Nov 04 10:18:35 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-be2cc4c4-2f5d-4a7a-b6d7-889f00796332 tempest-SnapshotMetadataTestJSON-251614807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b4b04dde-6c57-404e-ba54-232f62c8603f 1073741824" returned: 0 in 1.053s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:18:35 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-be2cc4c4-2f5d-4a7a-b6d7-889f00796332 tempest-SnapshotMetadataTestJSON-251614807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b4b04dde-6c57-404e-ba54-232f62c8603f {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:18:36 devstack sudo[95910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b4b04dde-6c57-404e-ba54-232f62c8603f Nov 04 10:18:36 devstack sudo[95910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:18:36 devstack sudo[95910]: pam_unix(sudo:session): session closed for user root Nov 04 10:18:36 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-be2cc4c4-2f5d-4a7a-b6d7-889f00796332 tempest-SnapshotMetadataTestJSON-251614807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b4b04dde-6c57-404e-ba54-232f62c8603f" returned: 0 in 0.300s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:18:36 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-be2cc4c4-2f5d-4a7a-b6d7-889f00796332 tempest-SnapshotMetadataTestJSON-251614807 None] <== create_volume: return (1436ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 10:18:36 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-be2cc4c4-2f5d-4a7a-b6d7-889f00796332 tempest-SnapshotMetadataTestJSON-251614807 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.443s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:18:36 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-be2cc4c4-2f5d-4a7a-b6d7-889f00796332 tempest-SnapshotMetadataTestJSON-251614807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43782576-0185-410d-aaaf-0594def71a4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4b04dde-6c57-404e-ba54-232f62c8603f', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:18:36 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-be2cc4c4-2f5d-4a7a-b6d7-889f00796332 tempest-SnapshotMetadataTestJSON-251614807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a83b2ebf-e98e-456d-979f-19e83d18e119) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:18:36 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-be2cc4c4-2f5d-4a7a-b6d7-889f00796332 tempest-SnapshotMetadataTestJSON-251614807 None] Volume volume-b4b04dde-6c57-404e-ba54-232f62c8603f (b4b04dde-6c57-404e-ba54-232f62c8603f): created successfully Nov 04 10:18:36 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-be2cc4c4-2f5d-4a7a-b6d7-889f00796332 tempest-SnapshotMetadataTestJSON-251614807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a83b2ebf-e98e-456d-979f-19e83d18e119) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:18:36 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-be2cc4c4-2f5d-4a7a-b6d7-889f00796332 tempest-SnapshotMetadataTestJSON-251614807 None] Flow 'volume_create_manager' (a73e5809-881c-4e04-8a78-c7fc73bedd43) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:18:36 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-be2cc4c4-2f5d-4a7a-b6d7-889f00796332 tempest-SnapshotMetadataTestJSON-251614807 None] Created volume successfully. Nov 04 10:18:37 devstack sudo[95887]: pam_unix(sudo:session): session closed for user root Nov 04 10:18:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-e60d6c3b-379b-4638-9db7-2d16d0b9c758 tempest-VolumesExtendTest-204608174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c589a328-f3ed-418a-8877-e90bfc4cf133_un95ylh_devstack@QuobyteHD /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-36b0f944-73e9-4e35-963c-6c22fed23c5d" returned: 0 in 2.983s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:18:37 devstack cinder-volume[87068]: DEBUG cinder.image.image_utils [None req-e60d6c3b-379b-4638-9db7-2d16d0b9c758 tempest-VolumesExtendTest-204608174 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c589a328-f3ed-418a-8877-e90bfc4cf133_un95ylh_devstack@QuobyteHD, size 112.00 MB, duration 2.98 sec, destination /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-36b0f944-73e9-4e35-963c-6c22fed23c5d {{(pid=87068) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 04 10:18:37 devstack cinder-volume[87068]: INFO cinder.image.image_utils [None req-e60d6c3b-379b-4638-9db7-2d16d0b9c758 tempest-VolumesExtendTest-204608174 None] Converted 112.00 MB image at 37.52 MB/s Nov 04 10:18:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-e60d6c3b-379b-4638-9db7-2d16d0b9c758 tempest-VolumesExtendTest-204608174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-36b0f944-73e9-4e35-963c-6c22fed23c5d 1G {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:18:37 devstack sudo[95913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-36b0f944-73e9-4e35-963c-6c22fed23c5d 1G Nov 04 10:18:37 devstack sudo[95913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:18:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-b793baf0-7c0a-4863-8fe4-1d6b5998a9d3 tempest-SnapshotMetadataTestJSON-251614807 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:18:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-b793baf0-7c0a-4863-8fe4-1d6b5998a9d3 tempest-SnapshotMetadataTestJSON-251614807 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:18:37 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-b793baf0-7c0a-4863-8fe4-1d6b5998a9d3 tempest-SnapshotMetadataTestJSON-251614807 None] Creating offline snapshot dd23197e-7238-43a0-a6e4-402df2303394 of volume b4b04dde-6c57-404e-ba54-232f62c8603f {{(pid=87068) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 10:18:37 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce73e1c7-36b7-4d3a-90b7-7c6ba7b58e3e]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:18:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-b793baf0-7c0a-4863-8fe4-1d6b5998a9d3 tempest-SnapshotMetadataTestJSON-251614807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b4b04dde-6c57-404e-ba54-232f62c8603f {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:18:37 devstack sudo[95917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b4b04dde-6c57-404e-ba54-232f62c8603f Nov 04 10:18:37 devstack sudo[95917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:18:37 devstack sudo[95913]: pam_unix(sudo:session): session closed for user root Nov 04 10:18:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-e60d6c3b-379b-4638-9db7-2d16d0b9c758 tempest-VolumesExtendTest-204608174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-36b0f944-73e9-4e35-963c-6c22fed23c5d 1G" returned: 0 in 0.836s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:18:37 devstack cinder-volume[87068]: DEBUG cinder.volume.volume_utils [None req-e60d6c3b-379b-4638-9db7-2d16d0b9c758 tempest-VolumesExtendTest-204608174 None] Downloaded image c589a328-f3ed-418a-8877-e90bfc4cf133 ((None, [{'url': 'file:///opt/stack/data/glance/images/c589a328-f3ed-418a-8877-e90bfc4cf133', 'metadata': {}}])) to volume 36b0f944-73e9-4e35-963c-6c22fed23c5d successfully. {{(pid=87068) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 04 10:18:37 devstack cinder-volume[87068]: DEBUG cinder.image.image_utils [None req-e60d6c3b-379b-4638-9db7-2d16d0b9c758 tempest-VolumesExtendTest-204608174 None] Temporary image c589a328-f3ed-418a-8877-e90bfc4cf133 for user f3ed426c0c674a4c81168663c5d04e02 is deleted. {{(pid=87068) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 04 10:18:37 devstack cinder-volume[87068]: DEBUG cinder.volume.volume_utils [None req-e60d6c3b-379b-4638-9db7-2d16d0b9c758 tempest-VolumesExtendTest-204608174 None] Marking volume 36b0f944-73e9-4e35-963c-6c22fed23c5d as bootable. {{(pid=87068) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 04 10:18:37 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-e60d6c3b-379b-4638-9db7-2d16d0b9c758 tempest-VolumesExtendTest-204608174 None] Copying metadata from image c589a328-f3ed-418a-8877-e90bfc4cf133 to 36b0f944-73e9-4e35-963c-6c22fed23c5d. {{(pid=87068) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 04 10:18:37 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-e60d6c3b-379b-4638-9db7-2d16d0b9c758 tempest-VolumesExtendTest-204608174 None] Creating volume glance metadata for volume 36b0f944-73e9-4e35-963c-6c22fed23c5d backed by image c589a328-f3ed-418a-8877-e90bfc4cf133 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'c589a328-f3ed-418a-8877-e90bfc4cf133', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87068) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 04 10:18:38 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-e60d6c3b-379b-4638-9db7-2d16d0b9c758 tempest-VolumesExtendTest-204608174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a06c58e8-de29-4762-88cc-ae92fc46711d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36b0f944-73e9-4e35-963c-6c22fed23c5d', 'volume_size': 1, 'image_id': 'c589a328-f3ed-418a-8877-e90bfc4cf133', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c589a328-f3ed-418a-8877-e90bfc4cf133', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '046e78417f874f20873c25a0eb7adc65', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c589a328-f3ed-418a-8877-e90bfc4cf133', 'created_at': datetime.datetime(2026, 11, 4, 9, 4, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 9, 5, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c589a328-f3ed-418a-8877-e90bfc4cf133/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:18:38 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-e60d6c3b-379b-4638-9db7-2d16d0b9c758 tempest-VolumesExtendTest-204608174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25369a8d-e1e7-4b14-ba37-a9e870961703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:18:38 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-e60d6c3b-379b-4638-9db7-2d16d0b9c758 tempest-VolumesExtendTest-204608174 None] Volume volume-36b0f944-73e9-4e35-963c-6c22fed23c5d (36b0f944-73e9-4e35-963c-6c22fed23c5d): created successfully Nov 04 10:18:38 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-e60d6c3b-379b-4638-9db7-2d16d0b9c758 tempest-VolumesExtendTest-204608174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25369a8d-e1e7-4b14-ba37-a9e870961703) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:18:38 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-e60d6c3b-379b-4638-9db7-2d16d0b9c758 tempest-VolumesExtendTest-204608174 None] Flow 'volume_create_manager' (f3d3d9eb-2f79-4501-ba80-cc03061d28f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:18:38 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-e60d6c3b-379b-4638-9db7-2d16d0b9c758 tempest-VolumesExtendTest-204608174 None] Created volume successfully. Nov 04 10:18:38 devstack sudo[95917]: pam_unix(sudo:session): session closed for user root Nov 04 10:18:38 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-b793baf0-7c0a-4863-8fe4-1d6b5998a9d3 tempest-SnapshotMetadataTestJSON-251614807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b4b04dde-6c57-404e-ba54-232f62c8603f" returned: 0 in 0.780s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:18:38 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-b793baf0-7c0a-4863-8fe4-1d6b5998a9d3 tempest-SnapshotMetadataTestJSON-251614807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b4b04dde-6c57-404e-ba54-232f62c8603f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b4b04dde-6c57-404e-ba54-232f62c8603f.dd23197e-7238-43a0-a6e4-402df2303394 1G {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:18:38 devstack sudo[95936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b4b04dde-6c57-404e-ba54-232f62c8603f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b4b04dde-6c57-404e-ba54-232f62c8603f.dd23197e-7238-43a0-a6e4-402df2303394 1G Nov 04 10:18:38 devstack sudo[95936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:18:38 devstack sudo[95936]: pam_unix(sudo:session): session closed for user root Nov 04 10:18:38 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-b793baf0-7c0a-4863-8fe4-1d6b5998a9d3 tempest-SnapshotMetadataTestJSON-251614807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b4b04dde-6c57-404e-ba54-232f62c8603f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b4b04dde-6c57-404e-ba54-232f62c8603f.dd23197e-7238-43a0-a6e4-402df2303394 1G" returned: 0 in 0.755s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:18:39 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-b793baf0-7c0a-4863-8fe4-1d6b5998a9d3 tempest-SnapshotMetadataTestJSON-251614807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b4b04dde-6c57-404e-ba54-232f62c8603f -F qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b4b04dde-6c57-404e-ba54-232f62c8603f.dd23197e-7238-43a0-a6e4-402df2303394 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:18:39 devstack sudo[95976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b4b04dde-6c57-404e-ba54-232f62c8603f -F qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b4b04dde-6c57-404e-ba54-232f62c8603f.dd23197e-7238-43a0-a6e4-402df2303394 Nov 04 10:18:39 devstack sudo[95976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:18:39 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-222e8b9a-34c7-4f72-b007-049aeec8411d tempest-VolumesExtendTest-204608174 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:18:39 devstack sudo[95976]: pam_unix(sudo:session): session closed for user root Nov 04 10:18:39 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-b793baf0-7c0a-4863-8fe4-1d6b5998a9d3 tempest-SnapshotMetadataTestJSON-251614807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b4b04dde-6c57-404e-ba54-232f62c8603f -F qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b4b04dde-6c57-404e-ba54-232f62c8603f.dd23197e-7238-43a0-a6e4-402df2303394" returned: 0 in 0.667s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:18:39 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-b793baf0-7c0a-4863-8fe4-1d6b5998a9d3 tempest-SnapshotMetadataTestJSON-251614807 None] /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b4b04dde-6c57-404e-ba54-232f62c8603f.dd23197e-7238-43a0-a6e4-402df2303394 is being set with open permissions: ugo+rw Nov 04 10:18:39 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-b793baf0-7c0a-4863-8fe4-1d6b5998a9d3 tempest-SnapshotMetadataTestJSON-251614807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b4b04dde-6c57-404e-ba54-232f62c8603f.dd23197e-7238-43a0-a6e4-402df2303394 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:18:39 devstack sudo[95985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b4b04dde-6c57-404e-ba54-232f62c8603f.dd23197e-7238-43a0-a6e4-402df2303394 Nov 04 10:18:39 devstack sudo[95985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:18:40 devstack sudo[95985]: pam_unix(sudo:session): session closed for user root Nov 04 10:18:40 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-b793baf0-7c0a-4863-8fe4-1d6b5998a9d3 tempest-SnapshotMetadataTestJSON-251614807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b4b04dde-6c57-404e-ba54-232f62c8603f.dd23197e-7238-43a0-a6e4-402df2303394" returned: 0 in 0.356s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:18:40 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-b793baf0-7c0a-4863-8fe4-1d6b5998a9d3 tempest-SnapshotMetadataTestJSON-251614807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b4b04dde-6c57-404e-ba54-232f62c8603f.info {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:18:40 devstack sudo[95989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b4b04dde-6c57-404e-ba54-232f62c8603f.info Nov 04 10:18:40 devstack sudo[95989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:18:40 devstack sudo[95989]: pam_unix(sudo:session): session closed for user root Nov 04 10:18:40 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-b793baf0-7c0a-4863-8fe4-1d6b5998a9d3 tempest-SnapshotMetadataTestJSON-251614807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b4b04dde-6c57-404e-ba54-232f62c8603f.info" returned: 0 in 0.371s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:18:40 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-b793baf0-7c0a-4863-8fe4-1d6b5998a9d3 tempest-SnapshotMetadataTestJSON-251614807 None] /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b4b04dde-6c57-404e-ba54-232f62c8603f.info is being set with open permissions: ugo+rw Nov 04 10:18:40 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-b793baf0-7c0a-4863-8fe4-1d6b5998a9d3 tempest-SnapshotMetadataTestJSON-251614807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b4b04dde-6c57-404e-ba54-232f62c8603f.info {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:18:40 devstack sudo[95992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b4b04dde-6c57-404e-ba54-232f62c8603f.info Nov 04 10:18:40 devstack sudo[95992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:18:40 devstack sudo[95992]: pam_unix(sudo:session): session closed for user root Nov 04 10:18:40 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-b793baf0-7c0a-4863-8fe4-1d6b5998a9d3 tempest-SnapshotMetadataTestJSON-251614807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b4b04dde-6c57-404e-ba54-232f62c8603f.info" returned: 0 in 0.334s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:18:40 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-b793baf0-7c0a-4863-8fe4-1d6b5998a9d3 tempest-SnapshotMetadataTestJSON-251614807 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.441s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:18:40 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-222e8b9a-34c7-4f72-b007-049aeec8411d tempest-VolumesExtendTest-204608174 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 1.656s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:18:40 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc23aac8-5f6c-49b3-a46c-7bb53adc98ac]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:18:40 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-222e8b9a-34c7-4f72-b007-049aeec8411d tempest-VolumesExtendTest-204608174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-36b0f944-73e9-4e35-963c-6c22fed23c5d {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:18:40 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-b793baf0-7c0a-4863-8fe4-1d6b5998a9d3 tempest-SnapshotMetadataTestJSON-251614807 None] Create snapshot completed successfully Nov 04 10:18:41 devstack sudo[95995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-36b0f944-73e9-4e35-963c-6c22fed23c5d Nov 04 10:18:41 devstack sudo[95995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:18:41 devstack sudo[95995]: pam_unix(sudo:session): session closed for user root Nov 04 10:18:41 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-222e8b9a-34c7-4f72-b007-049aeec8411d tempest-VolumesExtendTest-204608174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-36b0f944-73e9-4e35-963c-6c22fed23c5d" returned: 0 in 0.492s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:18:41 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-222e8b9a-34c7-4f72-b007-049aeec8411d tempest-VolumesExtendTest-204608174 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-36b0f944-73e9-4e35-963c-6c22fed23c5d 2G {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:18:41 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-222e8b9a-34c7-4f72-b007-049aeec8411d tempest-VolumesExtendTest-204608174 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-36b0f944-73e9-4e35-963c-6c22fed23c5d 2G" returned: 0 in 0.141s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:18:41 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-222e8b9a-34c7-4f72-b007-049aeec8411d tempest-VolumesExtendTest-204608174 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.662s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:18:41 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-222e8b9a-34c7-4f72-b007-049aeec8411d tempest-VolumesExtendTest-204608174 None] Extend volume completed successfully. Nov 04 10:18:42 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-73943a4d-d09b-472c-8c57-d93fc16282fe tempest-SnapshotMetadataTestJSON-251614807 None] Acquiring lock "cinder-dd23197e-7238-43a0-a6e4-402df2303394-delete_snapshot" by "delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:18:42 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-73943a4d-d09b-472c-8c57-d93fc16282fe tempest-SnapshotMetadataTestJSON-251614807 None] Lock "cinder-dd23197e-7238-43a0-a6e4-402df2303394-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:18:42 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-73943a4d-d09b-472c-8c57-d93fc16282fe tempest-SnapshotMetadataTestJSON-251614807 None] Acquiring lock "cinder-quobyte-b4b04dde-6c57-404e-ba54-232f62c8603f" by "delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:18:42 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-73943a4d-d09b-472c-8c57-d93fc16282fe tempest-SnapshotMetadataTestJSON-251614807 None] Lock "cinder-quobyte-b4b04dde-6c57-404e-ba54-232f62c8603f" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:18:42 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-73943a4d-d09b-472c-8c57-d93fc16282fe tempest-SnapshotMetadataTestJSON-251614807 None] Acquiring lock "cinder-quobyte-dd23197e-7238-43a0-a6e4-402df2303394" by "_delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:18:42 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-73943a4d-d09b-472c-8c57-d93fc16282fe tempest-SnapshotMetadataTestJSON-251614807 None] Lock "cinder-quobyte-dd23197e-7238-43a0-a6e4-402df2303394" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:18:42 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-73943a4d-d09b-472c-8c57-d93fc16282fe tempest-SnapshotMetadataTestJSON-251614807 None] Deleting offline snapshot dd23197e-7238-43a0-a6e4-402df2303394 of volume b4b04dde-6c57-404e-ba54-232f62c8603f {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 10:18:42 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-73943a4d-d09b-472c-8c57-d93fc16282fe tempest-SnapshotMetadataTestJSON-251614807 None] snapshot_file for this snap is: volume-b4b04dde-6c57-404e-ba54-232f62c8603f.dd23197e-7238-43a0-a6e4-402df2303394 {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 10:18:42 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[58d8e892-dfd3-4b59-b437-c5d2a2e5125a]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:18:42 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-73943a4d-d09b-472c-8c57-d93fc16282fe tempest-SnapshotMetadataTestJSON-251614807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b4b04dde-6c57-404e-ba54-232f62c8603f.dd23197e-7238-43a0-a6e4-402df2303394 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:18:42 devstack sudo[96004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b4b04dde-6c57-404e-ba54-232f62c8603f.dd23197e-7238-43a0-a6e4-402df2303394 Nov 04 10:18:42 devstack sudo[96004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:18:43 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-c2d45813-9fa3-455a-b2a3-bb8b8548e182 tempest-VolumesExtendTest-204608174 None] Acquiring lock "cinder-36b0f944-73e9-4e35-963c-6c22fed23c5d-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:18:43 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-c2d45813-9fa3-455a-b2a3-bb8b8548e182 tempest-VolumesExtendTest-204608174 None] Lock "cinder-36b0f944-73e9-4e35-963c-6c22fed23c5d-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:18:43 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-c2d45813-9fa3-455a-b2a3-bb8b8548e182 tempest-VolumesExtendTest-204608174 None] Acquiring lock "cinder-quobyte-36b0f944-73e9-4e35-963c-6c22fed23c5d" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:18:43 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-c2d45813-9fa3-455a-b2a3-bb8b8548e182 tempest-VolumesExtendTest-204608174 None] Lock "cinder-quobyte-36b0f944-73e9-4e35-963c-6c22fed23c5d" acquired by "delete_volume" :: waited 0.024s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:18:43 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[729a7472-c066-453f-8aa2-210c151ff4e9]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:18:43 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c2d45813-9fa3-455a-b2a3-bb8b8548e182 tempest-VolumesExtendTest-204608174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-36b0f944-73e9-4e35-963c-6c22fed23c5d {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:18:43 devstack sudo[96004]: pam_unix(sudo:session): session closed for user root Nov 04 10:18:43 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-73943a4d-d09b-472c-8c57-d93fc16282fe tempest-SnapshotMetadataTestJSON-251614807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b4b04dde-6c57-404e-ba54-232f62c8603f.dd23197e-7238-43a0-a6e4-402df2303394" returned: 0 in 0.681s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:18:43 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-73943a4d-d09b-472c-8c57-d93fc16282fe tempest-SnapshotMetadataTestJSON-251614807 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b4b04dde-6c57-404e-ba54-232f62c8603f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87068) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 10:18:43 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[33bdeb52-e603-46ec-a378-05071e002600]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:18:43 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-73943a4d-d09b-472c-8c57-d93fc16282fe tempest-SnapshotMetadataTestJSON-251614807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b4b04dde-6c57-404e-ba54-232f62c8603f {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:18:43 devstack sudo[96009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-36b0f944-73e9-4e35-963c-6c22fed23c5d Nov 04 10:18:43 devstack sudo[96009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:18:43 devstack sudo[96010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b4b04dde-6c57-404e-ba54-232f62c8603f Nov 04 10:18:43 devstack sudo[96010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:18:43 devstack sudo[96010]: pam_unix(sudo:session): session closed for user root Nov 04 10:18:43 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-73943a4d-d09b-472c-8c57-d93fc16282fe tempest-SnapshotMetadataTestJSON-251614807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b4b04dde-6c57-404e-ba54-232f62c8603f" returned: 0 in 0.464s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:18:43 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-73943a4d-d09b-472c-8c57-d93fc16282fe tempest-SnapshotMetadataTestJSON-251614807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b4b04dde-6c57-404e-ba54-232f62c8603f.dd23197e-7238-43a0-a6e4-402df2303394 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:18:43 devstack sudo[96009]: pam_unix(sudo:session): session closed for user root Nov 04 10:18:43 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c2d45813-9fa3-455a-b2a3-bb8b8548e182 tempest-VolumesExtendTest-204608174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-36b0f944-73e9-4e35-963c-6c22fed23c5d" returned: 0 in 0.588s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:18:43 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c2d45813-9fa3-455a-b2a3-bb8b8548e182 tempest-VolumesExtendTest-204608174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-36b0f944-73e9-4e35-963c-6c22fed23c5d {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:18:43 devstack sudo[96020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b4b04dde-6c57-404e-ba54-232f62c8603f.dd23197e-7238-43a0-a6e4-402df2303394 Nov 04 10:18:43 devstack sudo[96020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:18:43 devstack sudo[96021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-36b0f944-73e9-4e35-963c-6c22fed23c5d Nov 04 10:18:43 devstack sudo[96021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:18:44 devstack sudo[96021]: pam_unix(sudo:session): session closed for user root Nov 04 10:18:44 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c2d45813-9fa3-455a-b2a3-bb8b8548e182 tempest-VolumesExtendTest-204608174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-36b0f944-73e9-4e35-963c-6c22fed23c5d" returned: 0 in 0.311s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:18:44 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-c2d45813-9fa3-455a-b2a3-bb8b8548e182 tempest-VolumesExtendTest-204608174 None] Lock "cinder-quobyte-36b0f944-73e9-4e35-963c-6c22fed23c5d" released by "delete_volume" :: held 0.955s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:18:44 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-c2d45813-9fa3-455a-b2a3-bb8b8548e182 tempest-VolumesExtendTest-204608174 None] Created reservations ['aed63588-c56d-445c-b16d-86f75a78dd2d', 'bf9a1d04-62c9-40fc-8099-028b4093c19c', '58010612-2fa8-4b01-906b-f822463c67c3', 'f8857435-55c3-4352-b9b8-b5eb9f410b5d'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:18:44 devstack sudo[96020]: pam_unix(sudo:session): session closed for user root Nov 04 10:18:44 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-73943a4d-d09b-472c-8c57-d93fc16282fe tempest-SnapshotMetadataTestJSON-251614807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b4b04dde-6c57-404e-ba54-232f62c8603f.dd23197e-7238-43a0-a6e4-402df2303394" returned: 0 in 0.497s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:18:44 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-73943a4d-d09b-472c-8c57-d93fc16282fe tempest-SnapshotMetadataTestJSON-251614807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b4b04dde-6c57-404e-ba54-232f62c8603f.dd23197e-7238-43a0-a6e4-402df2303394 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:18:44 devstack sudo[96028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b4b04dde-6c57-404e-ba54-232f62c8603f.dd23197e-7238-43a0-a6e4-402df2303394 Nov 04 10:18:44 devstack sudo[96028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:18:44 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-c2d45813-9fa3-455a-b2a3-bb8b8548e182 tempest-VolumesExtendTest-204608174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:18:44 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-c2d45813-9fa3-455a-b2a3-bb8b8548e182 tempest-VolumesExtendTest-204608174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:18:44 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-c2d45813-9fa3-455a-b2a3-bb8b8548e182 tempest-VolumesExtendTest-204608174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:18:44 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-c2d45813-9fa3-455a-b2a3-bb8b8548e182 tempest-VolumesExtendTest-204608174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:18:44 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-c2d45813-9fa3-455a-b2a3-bb8b8548e182 tempest-VolumesExtendTest-204608174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:18:44 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c2d45813-9fa3-455a-b2a3-bb8b8548e182 tempest-VolumesExtendTest-204608174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:18:44 devstack sudo[96030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:18:44 devstack sudo[96030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:18:44 devstack sudo[96028]: pam_unix(sudo:session): session closed for user root Nov 04 10:18:44 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-73943a4d-d09b-472c-8c57-d93fc16282fe tempest-SnapshotMetadataTestJSON-251614807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b4b04dde-6c57-404e-ba54-232f62c8603f.dd23197e-7238-43a0-a6e4-402df2303394" returned: 0 in 0.298s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:18:44 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-73943a4d-d09b-472c-8c57-d93fc16282fe tempest-SnapshotMetadataTestJSON-251614807 None] Lock "cinder-quobyte-dd23197e-7238-43a0-a6e4-402df2303394" released by "_delete_snapshot" :: held 2.100s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:18:44 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-73943a4d-d09b-472c-8c57-d93fc16282fe tempest-SnapshotMetadataTestJSON-251614807 None] Lock "cinder-quobyte-b4b04dde-6c57-404e-ba54-232f62c8603f" released by "delete_snapshot" :: held 2.131s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:18:44 devstack sudo[96030]: pam_unix(sudo:session): session closed for user root Nov 04 10:18:44 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c2d45813-9fa3-455a-b2a3-bb8b8548e182 tempest-VolumesExtendTest-204608174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.362s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:18:44 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-c2d45813-9fa3-455a-b2a3-bb8b8548e182 tempest-VolumesExtendTest-204608174 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:18:44 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-c2d45813-9fa3-455a-b2a3-bb8b8548e182 tempest-VolumesExtendTest-204608174 None] Deleted volume successfully. Nov 04 10:18:44 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-c2d45813-9fa3-455a-b2a3-bb8b8548e182 tempest-VolumesExtendTest-204608174 None] Lock "cinder-36b0f944-73e9-4e35-963c-6c22fed23c5d-delete_volume" released by "delete_volume" :: held 1.670s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:18:44 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-73943a4d-d09b-472c-8c57-d93fc16282fe tempest-SnapshotMetadataTestJSON-251614807 None] Created reservations ['fc687236-11c2-4a46-8f03-b137b5ff4677', 'a990e945-1bd7-4f25-bac4-271e492f5679', '2cf92478-31b4-434f-b72e-e4216a0d2603', 'f6833ae3-bba8-45a1-8842-a3559fcfaa1b'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:18:44 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-73943a4d-d09b-472c-8c57-d93fc16282fe tempest-SnapshotMetadataTestJSON-251614807 None] Delete snapshot completed successfully. Nov 04 10:18:44 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-73943a4d-d09b-472c-8c57-d93fc16282fe tempest-SnapshotMetadataTestJSON-251614807 None] Lock "cinder-dd23197e-7238-43a0-a6e4-402df2303394-delete_snapshot" released by "delete_snapshot" :: held 2.346s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:18:46 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb8b25b2-dd01-487a-8441-21bf0a0c71dd tempest-VolumesExtendTest-204608174 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:18:46 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-fb8b25b2-dd01-487a-8441-21bf0a0c71dd tempest-VolumesExtendTest-204608174 None] Flow 'volume_create_manager' (b8b43625-8e32-45f0-b8e7-7dac37c3399f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:18:46 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-fb8b25b2-dd01-487a-8441-21bf0a0c71dd tempest-VolumesExtendTest-204608174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c5e27b7-cac7-4489-bb62-f807cf479124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:18:46 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-f526bfed-e609-493a-b1c0-408656a11c0d tempest-SnapshotMetadataTestJSON-251614807 None] Acquiring lock "cinder-b4b04dde-6c57-404e-ba54-232f62c8603f-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:18:46 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-fb8b25b2-dd01-487a-8441-21bf0a0c71dd tempest-VolumesExtendTest-204608174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c5e27b7-cac7-4489-bb62-f807cf479124) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:18:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-806993873',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d90b6a19-2b47-470c-b93e-a80352c0525f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7441149c648a4dee9eb8538ac44709e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:18:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:18:46Z,use_quota=True,user_id='f3ed426c0c674a4c81168663c5d04e02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:18:46 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-fb8b25b2-dd01-487a-8441-21bf0a0c71dd tempest-VolumesExtendTest-204608174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (168b9836-e335-418e-8d4f-25075239d614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:18:46 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-fb8b25b2-dd01-487a-8441-21bf0a0c71dd tempest-VolumesExtendTest-204608174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (168b9836-e335-418e-8d4f-25075239d614) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:18:46 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-fb8b25b2-dd01-487a-8441-21bf0a0c71dd tempest-VolumesExtendTest-204608174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de765600-180f-4535-925c-526d9de05249) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:18:46 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-fb8b25b2-dd01-487a-8441-21bf0a0c71dd tempest-VolumesExtendTest-204608174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de765600-180f-4535-925c-526d9de05249) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd90b6a19-2b47-470c-b93e-a80352c0525f', 'volume_name': 'volume-d90b6a19-2b47-470c-b93e-a80352c0525f', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:18:46 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-fb8b25b2-dd01-487a-8441-21bf0a0c71dd tempest-VolumesExtendTest-204608174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59568d7e-b778-4667-a36f-8b5528ffde05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:18:46 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-fb8b25b2-dd01-487a-8441-21bf0a0c71dd tempest-VolumesExtendTest-204608174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59568d7e-b778-4667-a36f-8b5528ffde05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:18:46 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-fb8b25b2-dd01-487a-8441-21bf0a0c71dd tempest-VolumesExtendTest-204608174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d17317b0-2350-4079-86c5-b717f3176fd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:18:46 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-fb8b25b2-dd01-487a-8441-21bf0a0c71dd tempest-VolumesExtendTest-204608174 None] Volume d90b6a19-2b47-470c-b93e-a80352c0525f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d90b6a19-2b47-470c-b93e-a80352c0525f', 'volume_size': 1} Nov 04 10:18:46 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-fb8b25b2-dd01-487a-8441-21bf0a0c71dd tempest-VolumesExtendTest-204608174 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:18:46 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-fb8b25b2-dd01-487a-8441-21bf0a0c71dd tempest-VolumesExtendTest-204608174 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:18:46 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-fb8b25b2-dd01-487a-8441-21bf0a0c71dd tempest-VolumesExtendTest-204608174 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:18:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-806993873',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d90b6a19-2b47-470c-b93e-a80352c0525f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7441149c648a4dee9eb8538ac44709e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:18:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:18:46Z,use_quota=True,user_id='f3ed426c0c674a4c81168663c5d04e02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 10:18:46 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-fb8b25b2-dd01-487a-8441-21bf0a0c71dd tempest-VolumesExtendTest-204608174 None] Creating volume d90b6a19-2b47-470c-b93e-a80352c0525f {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:18:46 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-fb8b25b2-dd01-487a-8441-21bf0a0c71dd tempest-VolumesExtendTest-204608174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:18:46 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-fb8b25b2-dd01-487a-8441-21bf0a0c71dd tempest-VolumesExtendTest-204608174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:18:46 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-fb8b25b2-dd01-487a-8441-21bf0a0c71dd tempest-VolumesExtendTest-204608174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:18:46 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-fb8b25b2-dd01-487a-8441-21bf0a0c71dd tempest-VolumesExtendTest-204608174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:18:46 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-fb8b25b2-dd01-487a-8441-21bf0a0c71dd tempest-VolumesExtendTest-204608174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:18:46 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-fb8b25b2-dd01-487a-8441-21bf0a0c71dd tempest-VolumesExtendTest-204608174 None] Selected osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:18:46 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-fb8b25b2-dd01-487a-8441-21bf0a0c71dd tempest-VolumesExtendTest-204608174 None] casted to osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 Nov 04 10:18:46 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-fb8b25b2-dd01-487a-8441-21bf0a0c71dd tempest-VolumesExtendTest-204608174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-d90b6a19-2b47-470c-b93e-a80352c0525f 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:18:46 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-f526bfed-e609-493a-b1c0-408656a11c0d tempest-SnapshotMetadataTestJSON-251614807 None] Lock "cinder-b4b04dde-6c57-404e-ba54-232f62c8603f-delete_volume" acquired by "delete_volume" :: waited 0.096s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:18:46 devstack sudo[96034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-d90b6a19-2b47-470c-b93e-a80352c0525f 1073741824 Nov 04 10:18:46 devstack sudo[96034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:18:46 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-f526bfed-e609-493a-b1c0-408656a11c0d tempest-SnapshotMetadataTestJSON-251614807 None] Acquiring lock "cinder-quobyte-b4b04dde-6c57-404e-ba54-232f62c8603f" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:18:46 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-f526bfed-e609-493a-b1c0-408656a11c0d tempest-SnapshotMetadataTestJSON-251614807 None] Lock "cinder-quobyte-b4b04dde-6c57-404e-ba54-232f62c8603f" acquired by "delete_volume" :: waited 0.026s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:18:46 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c57ac58-3aab-437f-90c9-9ea1590b847e]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:18:46 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f526bfed-e609-493a-b1c0-408656a11c0d tempest-SnapshotMetadataTestJSON-251614807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b4b04dde-6c57-404e-ba54-232f62c8603f {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:18:46 devstack sudo[96039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b4b04dde-6c57-404e-ba54-232f62c8603f Nov 04 10:18:46 devstack sudo[96039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:18:46 devstack sudo[96034]: pam_unix(sudo:session): session closed for user root Nov 04 10:18:46 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-fb8b25b2-dd01-487a-8441-21bf0a0c71dd tempest-VolumesExtendTest-204608174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-d90b6a19-2b47-470c-b93e-a80352c0525f 1073741824" returned: 0 in 0.749s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:18:47 devstack sudo[96039]: pam_unix(sudo:session): session closed for user root Nov 04 10:18:47 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f526bfed-e609-493a-b1c0-408656a11c0d tempest-SnapshotMetadataTestJSON-251614807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b4b04dde-6c57-404e-ba54-232f62c8603f" returned: 0 in 0.609s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:18:47 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f526bfed-e609-493a-b1c0-408656a11c0d tempest-SnapshotMetadataTestJSON-251614807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b4b04dde-6c57-404e-ba54-232f62c8603f {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:18:47 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-fb8b25b2-dd01-487a-8441-21bf0a0c71dd tempest-VolumesExtendTest-204608174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-d90b6a19-2b47-470c-b93e-a80352c0525f {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:18:47 devstack sudo[96051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b4b04dde-6c57-404e-ba54-232f62c8603f Nov 04 10:18:47 devstack sudo[96051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:18:47 devstack sudo[96052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-d90b6a19-2b47-470c-b93e-a80352c0525f Nov 04 10:18:47 devstack sudo[96052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:18:47 devstack sudo[96051]: pam_unix(sudo:session): session closed for user root Nov 04 10:18:47 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f526bfed-e609-493a-b1c0-408656a11c0d tempest-SnapshotMetadataTestJSON-251614807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b4b04dde-6c57-404e-ba54-232f62c8603f" returned: 0 in 0.345s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:18:47 devstack sudo[96052]: pam_unix(sudo:session): session closed for user root Nov 04 10:18:47 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-fb8b25b2-dd01-487a-8441-21bf0a0c71dd tempest-VolumesExtendTest-204608174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-d90b6a19-2b47-470c-b93e-a80352c0525f" returned: 0 in 0.348s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:18:47 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-fb8b25b2-dd01-487a-8441-21bf0a0c71dd tempest-VolumesExtendTest-204608174 None] <== create_volume: return (1185ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 10:18:47 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-fb8b25b2-dd01-487a-8441-21bf0a0c71dd tempest-VolumesExtendTest-204608174 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.188s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:18:47 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-f526bfed-e609-493a-b1c0-408656a11c0d tempest-SnapshotMetadataTestJSON-251614807 None] Lock "cinder-quobyte-b4b04dde-6c57-404e-ba54-232f62c8603f" released by "delete_volume" :: held 1.064s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:18:47 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-fb8b25b2-dd01-487a-8441-21bf0a0c71dd tempest-VolumesExtendTest-204608174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d17317b0-2350-4079-86c5-b717f3176fd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d90b6a19-2b47-470c-b93e-a80352c0525f', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:18:47 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-fb8b25b2-dd01-487a-8441-21bf0a0c71dd tempest-VolumesExtendTest-204608174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e265bb3f-58f6-4ae5-a222-789a0ae783db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:18:47 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-f526bfed-e609-493a-b1c0-408656a11c0d tempest-SnapshotMetadataTestJSON-251614807 None] Created reservations ['bb4ae902-73e7-4e01-9d09-b455eb88f208', '3acb5989-263b-41cd-a5e5-6ec0856d30e4', 'bb1d4e98-7fdd-43e5-8e6f-390428c221c2', '90dfaee0-391e-42cf-a22d-17d79b408de0'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:18:47 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-fb8b25b2-dd01-487a-8441-21bf0a0c71dd tempest-VolumesExtendTest-204608174 None] Volume volume-d90b6a19-2b47-470c-b93e-a80352c0525f (d90b6a19-2b47-470c-b93e-a80352c0525f): created successfully Nov 04 10:18:47 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-fb8b25b2-dd01-487a-8441-21bf0a0c71dd tempest-VolumesExtendTest-204608174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e265bb3f-58f6-4ae5-a222-789a0ae783db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:18:47 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-fb8b25b2-dd01-487a-8441-21bf0a0c71dd tempest-VolumesExtendTest-204608174 None] Flow 'volume_create_manager' (b8b43625-8e32-45f0-b8e7-7dac37c3399f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:18:47 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-fb8b25b2-dd01-487a-8441-21bf0a0c71dd tempest-VolumesExtendTest-204608174 None] Created volume successfully. Nov 04 10:18:47 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-f526bfed-e609-493a-b1c0-408656a11c0d tempest-SnapshotMetadataTestJSON-251614807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:18:47 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-f526bfed-e609-493a-b1c0-408656a11c0d tempest-SnapshotMetadataTestJSON-251614807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:18:47 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-f526bfed-e609-493a-b1c0-408656a11c0d tempest-SnapshotMetadataTestJSON-251614807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:18:47 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-f526bfed-e609-493a-b1c0-408656a11c0d tempest-SnapshotMetadataTestJSON-251614807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:18:47 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-f526bfed-e609-493a-b1c0-408656a11c0d tempest-SnapshotMetadataTestJSON-251614807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:18:47 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f526bfed-e609-493a-b1c0-408656a11c0d tempest-SnapshotMetadataTestJSON-251614807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:18:47 devstack sudo[96072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:18:47 devstack sudo[96072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:18:47 devstack sudo[96072]: pam_unix(sudo:session): session closed for user root Nov 04 10:18:47 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f526bfed-e609-493a-b1c0-408656a11c0d tempest-SnapshotMetadataTestJSON-251614807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.298s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:18:47 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-f526bfed-e609-493a-b1c0-408656a11c0d tempest-SnapshotMetadataTestJSON-251614807 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:18:47 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-f526bfed-e609-493a-b1c0-408656a11c0d tempest-SnapshotMetadataTestJSON-251614807 None] Deleted volume successfully. Nov 04 10:18:48 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-f526bfed-e609-493a-b1c0-408656a11c0d tempest-SnapshotMetadataTestJSON-251614807 None] Lock "cinder-b4b04dde-6c57-404e-ba54-232f62c8603f-delete_volume" released by "delete_volume" :: held 1.773s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:18:48 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-be2f3128-4a3a-46a3-9bf2-ae19eec3bbec tempest-VolumesExtendTest-204608174 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:18:48 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-be2f3128-4a3a-46a3-9bf2-ae19eec3bbec tempest-VolumesExtendTest-204608174 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:18:48 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-be2f3128-4a3a-46a3-9bf2-ae19eec3bbec tempest-VolumesExtendTest-204608174 None] Creating offline snapshot 1e879359-adfa-4d66-8bc7-2dcba7bdcab0 of volume d90b6a19-2b47-470c-b93e-a80352c0525f {{(pid=87068) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 10:18:48 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[273d7ec1-e707-4c80-a4c5-2a2b5e0e5a81]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:18:48 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-be2f3128-4a3a-46a3-9bf2-ae19eec3bbec tempest-VolumesExtendTest-204608174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-d90b6a19-2b47-470c-b93e-a80352c0525f {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:18:48 devstack sudo[96075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-d90b6a19-2b47-470c-b93e-a80352c0525f Nov 04 10:18:48 devstack sudo[96075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:18:48 devstack sudo[96075]: pam_unix(sudo:session): session closed for user root Nov 04 10:18:48 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-be2f3128-4a3a-46a3-9bf2-ae19eec3bbec tempest-VolumesExtendTest-204608174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-d90b6a19-2b47-470c-b93e-a80352c0525f" returned: 0 in 0.422s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:18:48 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-be2f3128-4a3a-46a3-9bf2-ae19eec3bbec tempest-VolumesExtendTest-204608174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-d90b6a19-2b47-470c-b93e-a80352c0525f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-d90b6a19-2b47-470c-b93e-a80352c0525f.1e879359-adfa-4d66-8bc7-2dcba7bdcab0 1G {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:18:48 devstack sudo[96080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-d90b6a19-2b47-470c-b93e-a80352c0525f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-d90b6a19-2b47-470c-b93e-a80352c0525f.1e879359-adfa-4d66-8bc7-2dcba7bdcab0 1G Nov 04 10:18:48 devstack sudo[96080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:18:49 devstack sudo[96080]: pam_unix(sudo:session): session closed for user root Nov 04 10:18:49 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-be2f3128-4a3a-46a3-9bf2-ae19eec3bbec tempest-VolumesExtendTest-204608174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-d90b6a19-2b47-470c-b93e-a80352c0525f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-d90b6a19-2b47-470c-b93e-a80352c0525f.1e879359-adfa-4d66-8bc7-2dcba7bdcab0 1G" returned: 0 in 0.491s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:18:49 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-be2f3128-4a3a-46a3-9bf2-ae19eec3bbec tempest-VolumesExtendTest-204608174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d90b6a19-2b47-470c-b93e-a80352c0525f -F qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-d90b6a19-2b47-470c-b93e-a80352c0525f.1e879359-adfa-4d66-8bc7-2dcba7bdcab0 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:18:49 devstack sudo[96086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d90b6a19-2b47-470c-b93e-a80352c0525f -F qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-d90b6a19-2b47-470c-b93e-a80352c0525f.1e879359-adfa-4d66-8bc7-2dcba7bdcab0 Nov 04 10:18:49 devstack sudo[96086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:18:49 devstack sudo[96086]: pam_unix(sudo:session): session closed for user root Nov 04 10:18:49 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-be2f3128-4a3a-46a3-9bf2-ae19eec3bbec tempest-VolumesExtendTest-204608174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d90b6a19-2b47-470c-b93e-a80352c0525f -F qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-d90b6a19-2b47-470c-b93e-a80352c0525f.1e879359-adfa-4d66-8bc7-2dcba7bdcab0" returned: 0 in 0.385s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:18:49 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-be2f3128-4a3a-46a3-9bf2-ae19eec3bbec tempest-VolumesExtendTest-204608174 None] /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-d90b6a19-2b47-470c-b93e-a80352c0525f.1e879359-adfa-4d66-8bc7-2dcba7bdcab0 is being set with open permissions: ugo+rw Nov 04 10:18:49 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-be2f3128-4a3a-46a3-9bf2-ae19eec3bbec tempest-VolumesExtendTest-204608174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-d90b6a19-2b47-470c-b93e-a80352c0525f.1e879359-adfa-4d66-8bc7-2dcba7bdcab0 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:18:49 devstack sudo[96092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-d90b6a19-2b47-470c-b93e-a80352c0525f.1e879359-adfa-4d66-8bc7-2dcba7bdcab0 Nov 04 10:18:49 devstack sudo[96092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:18:50 devstack sudo[96092]: pam_unix(sudo:session): session closed for user root Nov 04 10:18:50 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-be2f3128-4a3a-46a3-9bf2-ae19eec3bbec tempest-VolumesExtendTest-204608174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-d90b6a19-2b47-470c-b93e-a80352c0525f.1e879359-adfa-4d66-8bc7-2dcba7bdcab0" returned: 0 in 0.290s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:18:50 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-be2f3128-4a3a-46a3-9bf2-ae19eec3bbec tempest-VolumesExtendTest-204608174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-d90b6a19-2b47-470c-b93e-a80352c0525f.info {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:18:50 devstack sudo[96095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-d90b6a19-2b47-470c-b93e-a80352c0525f.info Nov 04 10:18:50 devstack sudo[96095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:18:50 devstack sudo[96095]: pam_unix(sudo:session): session closed for user root Nov 04 10:18:50 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-be2f3128-4a3a-46a3-9bf2-ae19eec3bbec tempest-VolumesExtendTest-204608174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-d90b6a19-2b47-470c-b93e-a80352c0525f.info" returned: 0 in 0.287s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:18:50 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-be2f3128-4a3a-46a3-9bf2-ae19eec3bbec tempest-VolumesExtendTest-204608174 None] /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-d90b6a19-2b47-470c-b93e-a80352c0525f.info is being set with open permissions: ugo+rw Nov 04 10:18:50 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-be2f3128-4a3a-46a3-9bf2-ae19eec3bbec tempest-VolumesExtendTest-204608174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-d90b6a19-2b47-470c-b93e-a80352c0525f.info {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:18:50 devstack sudo[96098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-d90b6a19-2b47-470c-b93e-a80352c0525f.info Nov 04 10:18:50 devstack sudo[96098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:18:50 devstack sudo[96098]: pam_unix(sudo:session): session closed for user root Nov 04 10:18:50 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-be2f3128-4a3a-46a3-9bf2-ae19eec3bbec tempest-VolumesExtendTest-204608174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-d90b6a19-2b47-470c-b93e-a80352c0525f.info" returned: 0 in 0.267s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:18:50 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-be2f3128-4a3a-46a3-9bf2-ae19eec3bbec tempest-VolumesExtendTest-204608174 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.274s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:18:50 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-be2f3128-4a3a-46a3-9bf2-ae19eec3bbec tempest-VolumesExtendTest-204608174 None] Create snapshot completed successfully Nov 04 10:18:51 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-8eda7035-f365-4613-a6c3-6fe275e658fe tempest-VolumesExtendTest-204608174 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:18:51 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-8eda7035-f365-4613-a6c3-6fe275e658fe tempest-VolumesExtendTest-204608174 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:18:51 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6978210-cbba-49c6-85be-e354f6a5d158]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:18:51 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-8eda7035-f365-4613-a6c3-6fe275e658fe tempest-VolumesExtendTest-204608174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-d90b6a19-2b47-470c-b93e-a80352c0525f {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:18:51 devstack sudo[96101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-d90b6a19-2b47-470c-b93e-a80352c0525f Nov 04 10:18:51 devstack sudo[96101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:18:52 devstack sudo[96101]: pam_unix(sudo:session): session closed for user root Nov 04 10:18:52 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-8eda7035-f365-4613-a6c3-6fe275e658fe tempest-VolumesExtendTest-204608174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-d90b6a19-2b47-470c-b93e-a80352c0525f" returned: 0 in 0.404s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:18:52 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-8eda7035-f365-4613-a6c3-6fe275e658fe tempest-VolumesExtendTest-204608174 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-d90b6a19-2b47-470c-b93e-a80352c0525f.1e879359-adfa-4d66-8bc7-2dcba7bdcab0 2G {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:18:52 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-8eda7035-f365-4613-a6c3-6fe275e658fe tempest-VolumesExtendTest-204608174 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-d90b6a19-2b47-470c-b93e-a80352c0525f.1e879359-adfa-4d66-8bc7-2dcba7bdcab0 2G" returned: 0 in 0.181s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:18:52 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-8eda7035-f365-4613-a6c3-6fe275e658fe tempest-VolumesExtendTest-204608174 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.639s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:18:52 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-8eda7035-f365-4613-a6c3-6fe275e658fe tempest-VolumesExtendTest-204608174 None] Extend volume completed successfully. Nov 04 10:18:52 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-067e6952-346f-4603-817c-249fdd1c0b77 tempest-VolumesExtendTest-204608174 None] Acquiring lock "cinder-1e879359-adfa-4d66-8bc7-2dcba7bdcab0-delete_snapshot" by "delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:18:53 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-067e6952-346f-4603-817c-249fdd1c0b77 tempest-VolumesExtendTest-204608174 None] Lock "cinder-1e879359-adfa-4d66-8bc7-2dcba7bdcab0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:18:53 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-067e6952-346f-4603-817c-249fdd1c0b77 tempest-VolumesExtendTest-204608174 None] Acquiring lock "cinder-quobyte-d90b6a19-2b47-470c-b93e-a80352c0525f" by "delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:18:53 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-067e6952-346f-4603-817c-249fdd1c0b77 tempest-VolumesExtendTest-204608174 None] Lock "cinder-quobyte-d90b6a19-2b47-470c-b93e-a80352c0525f" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:18:53 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-067e6952-346f-4603-817c-249fdd1c0b77 tempest-VolumesExtendTest-204608174 None] Acquiring lock "cinder-quobyte-1e879359-adfa-4d66-8bc7-2dcba7bdcab0" by "_delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:18:53 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-067e6952-346f-4603-817c-249fdd1c0b77 tempest-VolumesExtendTest-204608174 None] Lock "cinder-quobyte-1e879359-adfa-4d66-8bc7-2dcba7bdcab0" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:18:53 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-067e6952-346f-4603-817c-249fdd1c0b77 tempest-VolumesExtendTest-204608174 None] Deleting offline snapshot 1e879359-adfa-4d66-8bc7-2dcba7bdcab0 of volume d90b6a19-2b47-470c-b93e-a80352c0525f {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 10:18:53 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-067e6952-346f-4603-817c-249fdd1c0b77 tempest-VolumesExtendTest-204608174 None] snapshot_file for this snap is: volume-d90b6a19-2b47-470c-b93e-a80352c0525f.1e879359-adfa-4d66-8bc7-2dcba7bdcab0 {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 10:18:53 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e2a7c7b-bbd2-4f5d-87f9-79b7dfbda924]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:18:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-067e6952-346f-4603-817c-249fdd1c0b77 tempest-VolumesExtendTest-204608174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-d90b6a19-2b47-470c-b93e-a80352c0525f.1e879359-adfa-4d66-8bc7-2dcba7bdcab0 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:18:53 devstack sudo[96112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-d90b6a19-2b47-470c-b93e-a80352c0525f.1e879359-adfa-4d66-8bc7-2dcba7bdcab0 Nov 04 10:18:53 devstack sudo[96112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:18:53 devstack sudo[96112]: pam_unix(sudo:session): session closed for user root Nov 04 10:18:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-067e6952-346f-4603-817c-249fdd1c0b77 tempest-VolumesExtendTest-204608174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-d90b6a19-2b47-470c-b93e-a80352c0525f.1e879359-adfa-4d66-8bc7-2dcba7bdcab0" returned: 0 in 0.450s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:18:53 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-067e6952-346f-4603-817c-249fdd1c0b77 tempest-VolumesExtendTest-204608174 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d90b6a19-2b47-470c-b93e-a80352c0525f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87068) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 10:18:53 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad7ec875-3d55-4f23-a6d4-b25dfc5a51a4]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:18:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-067e6952-346f-4603-817c-249fdd1c0b77 tempest-VolumesExtendTest-204608174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-d90b6a19-2b47-470c-b93e-a80352c0525f {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:18:53 devstack cinder-volume[87068]: DEBUG oslo_service.periodic_task [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87068) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 10:18:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:18:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:18:53 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:18:53 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:18:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:18:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:18:53 devstack sudo[96119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:18:53 devstack sudo[96119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:18:53 devstack sudo[96118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-d90b6a19-2b47-470c-b93e-a80352c0525f Nov 04 10:18:53 devstack sudo[96118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:18:54 devstack sudo[96119]: pam_unix(sudo:session): session closed for user root Nov 04 10:18:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.517s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:18:54 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:18:54 devstack cinder-volume[87068]: DEBUG oslo_service.periodic_task [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Running periodic task VolumeManager._thread_info {{(pid=87068) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 10:18:54 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] thread count: 28 {{(pid=87068) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 04 10:18:54 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] thread info: [<_MainThread(MainThread, started 126275656192128)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87068) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 04 10:18:54 devstack sudo[96118]: pam_unix(sudo:session): session closed for user root Nov 04 10:18:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-067e6952-346f-4603-817c-249fdd1c0b77 tempest-VolumesExtendTest-204608174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-d90b6a19-2b47-470c-b93e-a80352c0525f" returned: 0 in 0.713s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:18:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-067e6952-346f-4603-817c-249fdd1c0b77 tempest-VolumesExtendTest-204608174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-d90b6a19-2b47-470c-b93e-a80352c0525f.1e879359-adfa-4d66-8bc7-2dcba7bdcab0 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:18:54 devstack sudo[96126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-d90b6a19-2b47-470c-b93e-a80352c0525f.1e879359-adfa-4d66-8bc7-2dcba7bdcab0 Nov 04 10:18:54 devstack sudo[96126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:18:54 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-75a0ad45-0e01-47d3-981b-69b9ffa92afa tempest-VolumesTransfersTest-738834495 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:18:54 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-75a0ad45-0e01-47d3-981b-69b9ffa92afa tempest-VolumesTransfersTest-738834495 None] Flow 'volume_create_manager' (b96ea519-b8bd-4a72-baa2-327867c61ae6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:18:54 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-75a0ad45-0e01-47d3-981b-69b9ffa92afa tempest-VolumesTransfersTest-738834495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (979c8db1-1fc2-46be-aabd-1b7ab1ce9e5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:18:54 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-75a0ad45-0e01-47d3-981b-69b9ffa92afa tempest-VolumesTransfersTest-738834495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (979c8db1-1fc2-46be-aabd-1b7ab1ce9e5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:18:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1437309459',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c5fa159-7e1f-4d05-b255-71d1b02819ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f2508be1e9f4a598b58ce6b48549340',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:18:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:18:55Z,use_quota=True,user_id='ef02ea8cab514e5db69a85e48f519d3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:18:54 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-75a0ad45-0e01-47d3-981b-69b9ffa92afa tempest-VolumesTransfersTest-738834495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa9f592e-ee3e-4f29-ab00-ec46b61356fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:18:54 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-75a0ad45-0e01-47d3-981b-69b9ffa92afa tempest-VolumesTransfersTest-738834495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa9f592e-ee3e-4f29-ab00-ec46b61356fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:18:54 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-75a0ad45-0e01-47d3-981b-69b9ffa92afa tempest-VolumesTransfersTest-738834495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ca658d1-f6fa-4d03-82ad-6ba0c81fabbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:18:54 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-75a0ad45-0e01-47d3-981b-69b9ffa92afa tempest-VolumesTransfersTest-738834495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ca658d1-f6fa-4d03-82ad-6ba0c81fabbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c5fa159-7e1f-4d05-b255-71d1b02819ab', 'volume_name': 'volume-1c5fa159-7e1f-4d05-b255-71d1b02819ab', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:18:54 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-75a0ad45-0e01-47d3-981b-69b9ffa92afa tempest-VolumesTransfersTest-738834495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c21e000f-9224-41c6-ba4c-6e1ea113cfdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:18:54 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-75a0ad45-0e01-47d3-981b-69b9ffa92afa tempest-VolumesTransfersTest-738834495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c21e000f-9224-41c6-ba4c-6e1ea113cfdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:18:54 devstack sudo[96126]: pam_unix(sudo:session): session closed for user root Nov 04 10:18:54 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-75a0ad45-0e01-47d3-981b-69b9ffa92afa tempest-VolumesTransfersTest-738834495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d1a891b-87d7-4581-93d9-7f8c7059d39b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:18:54 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-75a0ad45-0e01-47d3-981b-69b9ffa92afa tempest-VolumesTransfersTest-738834495 None] Volume 1c5fa159-7e1f-4d05-b255-71d1b02819ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c5fa159-7e1f-4d05-b255-71d1b02819ab', 'volume_size': 1} Nov 04 10:18:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-75a0ad45-0e01-47d3-981b-69b9ffa92afa tempest-VolumesTransfersTest-738834495 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:18:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-75a0ad45-0e01-47d3-981b-69b9ffa92afa tempest-VolumesTransfersTest-738834495 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:18:54 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-75a0ad45-0e01-47d3-981b-69b9ffa92afa tempest-VolumesTransfersTest-738834495 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:18:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1437309459',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c5fa159-7e1f-4d05-b255-71d1b02819ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f2508be1e9f4a598b58ce6b48549340',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:18:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:18:55Z,use_quota=True,user_id='ef02ea8cab514e5db69a85e48f519d3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 10:18:54 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-75a0ad45-0e01-47d3-981b-69b9ffa92afa tempest-VolumesTransfersTest-738834495 None] Creating volume 1c5fa159-7e1f-4d05-b255-71d1b02819ab {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:18:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-75a0ad45-0e01-47d3-981b-69b9ffa92afa tempest-VolumesTransfersTest-738834495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:18:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-75a0ad45-0e01-47d3-981b-69b9ffa92afa tempest-VolumesTransfersTest-738834495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:18:54 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-75a0ad45-0e01-47d3-981b-69b9ffa92afa tempest-VolumesTransfersTest-738834495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:18:54 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-75a0ad45-0e01-47d3-981b-69b9ffa92afa tempest-VolumesTransfersTest-738834495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:18:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-75a0ad45-0e01-47d3-981b-69b9ffa92afa tempest-VolumesTransfersTest-738834495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:18:54 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-75a0ad45-0e01-47d3-981b-69b9ffa92afa tempest-VolumesTransfersTest-738834495 None] Selected osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:18:54 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-75a0ad45-0e01-47d3-981b-69b9ffa92afa tempest-VolumesTransfersTest-738834495 None] casted to osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 Nov 04 10:18:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-75a0ad45-0e01-47d3-981b-69b9ffa92afa tempest-VolumesTransfersTest-738834495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-1c5fa159-7e1f-4d05-b255-71d1b02819ab 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:18:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-067e6952-346f-4603-817c-249fdd1c0b77 tempest-VolumesExtendTest-204608174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-d90b6a19-2b47-470c-b93e-a80352c0525f.1e879359-adfa-4d66-8bc7-2dcba7bdcab0" returned: 0 in 0.561s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:18:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-067e6952-346f-4603-817c-249fdd1c0b77 tempest-VolumesExtendTest-204608174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-d90b6a19-2b47-470c-b93e-a80352c0525f.1e879359-adfa-4d66-8bc7-2dcba7bdcab0 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:18:54 devstack sudo[96132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-1c5fa159-7e1f-4d05-b255-71d1b02819ab 1073741824 Nov 04 10:18:54 devstack sudo[96132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:18:54 devstack sudo[96133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-d90b6a19-2b47-470c-b93e-a80352c0525f.1e879359-adfa-4d66-8bc7-2dcba7bdcab0 Nov 04 10:18:54 devstack sudo[96133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:18:55 devstack sudo[96133]: pam_unix(sudo:session): session closed for user root Nov 04 10:18:55 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-067e6952-346f-4603-817c-249fdd1c0b77 tempest-VolumesExtendTest-204608174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-d90b6a19-2b47-470c-b93e-a80352c0525f.1e879359-adfa-4d66-8bc7-2dcba7bdcab0" returned: 0 in 0.290s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:18:55 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-067e6952-346f-4603-817c-249fdd1c0b77 tempest-VolumesExtendTest-204608174 None] Lock "cinder-quobyte-1e879359-adfa-4d66-8bc7-2dcba7bdcab0" released by "_delete_snapshot" :: held 2.173s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:18:55 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-067e6952-346f-4603-817c-249fdd1c0b77 tempest-VolumesExtendTest-204608174 None] Lock "cinder-quobyte-d90b6a19-2b47-470c-b93e-a80352c0525f" released by "delete_snapshot" :: held 2.200s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:18:55 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-067e6952-346f-4603-817c-249fdd1c0b77 tempest-VolumesExtendTest-204608174 None] Created reservations ['0a79d504-a946-46ac-9803-97b468441a37', 'ef94d9cf-00e6-46d5-ba42-7fadfff13317', '77f1b40e-d8d3-4730-97b1-f2ebe1c8e57e', 'cfbe8348-0b71-45da-aa68-e936b41d8beb'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:18:55 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-067e6952-346f-4603-817c-249fdd1c0b77 tempest-VolumesExtendTest-204608174 None] Delete snapshot completed successfully. Nov 04 10:18:55 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-067e6952-346f-4603-817c-249fdd1c0b77 tempest-VolumesExtendTest-204608174 None] Lock "cinder-1e879359-adfa-4d66-8bc7-2dcba7bdcab0-delete_snapshot" released by "delete_snapshot" :: held 2.396s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:18:55 devstack sudo[96132]: pam_unix(sudo:session): session closed for user root Nov 04 10:18:55 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-75a0ad45-0e01-47d3-981b-69b9ffa92afa tempest-VolumesTransfersTest-738834495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-1c5fa159-7e1f-4d05-b255-71d1b02819ab 1073741824" returned: 0 in 0.643s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:18:55 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-75a0ad45-0e01-47d3-981b-69b9ffa92afa tempest-VolumesTransfersTest-738834495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-1c5fa159-7e1f-4d05-b255-71d1b02819ab {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:18:55 devstack sudo[96141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-1c5fa159-7e1f-4d05-b255-71d1b02819ab Nov 04 10:18:55 devstack sudo[96141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:18:55 devstack sudo[96141]: pam_unix(sudo:session): session closed for user root Nov 04 10:18:55 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-75a0ad45-0e01-47d3-981b-69b9ffa92afa tempest-VolumesTransfersTest-738834495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-1c5fa159-7e1f-4d05-b255-71d1b02819ab" returned: 0 in 0.284s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:18:55 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-75a0ad45-0e01-47d3-981b-69b9ffa92afa tempest-VolumesTransfersTest-738834495 None] <== create_volume: return (991ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 10:18:55 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-75a0ad45-0e01-47d3-981b-69b9ffa92afa tempest-VolumesTransfersTest-738834495 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.994s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:18:55 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-75a0ad45-0e01-47d3-981b-69b9ffa92afa tempest-VolumesTransfersTest-738834495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d1a891b-87d7-4581-93d9-7f8c7059d39b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c5fa159-7e1f-4d05-b255-71d1b02819ab', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:18:55 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-75a0ad45-0e01-47d3-981b-69b9ffa92afa tempest-VolumesTransfersTest-738834495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d3aeb3b-b12a-41ba-bc0d-da7c31c57c66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:18:55 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-75a0ad45-0e01-47d3-981b-69b9ffa92afa tempest-VolumesTransfersTest-738834495 None] Volume volume-1c5fa159-7e1f-4d05-b255-71d1b02819ab (1c5fa159-7e1f-4d05-b255-71d1b02819ab): created successfully Nov 04 10:18:55 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-75a0ad45-0e01-47d3-981b-69b9ffa92afa tempest-VolumesTransfersTest-738834495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d3aeb3b-b12a-41ba-bc0d-da7c31c57c66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:18:55 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-75a0ad45-0e01-47d3-981b-69b9ffa92afa tempest-VolumesTransfersTest-738834495 None] Flow 'volume_create_manager' (b96ea519-b8bd-4a72-baa2-327867c61ae6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:18:55 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-75a0ad45-0e01-47d3-981b-69b9ffa92afa tempest-VolumesTransfersTest-738834495 None] Created volume successfully. Nov 04 10:18:56 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-95bec334-bb37-4648-b52c-dde7398c96f0 tempest-VolumesExtendTest-204608174 None] Acquiring lock "cinder-d90b6a19-2b47-470c-b93e-a80352c0525f-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:18:56 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-95bec334-bb37-4648-b52c-dde7398c96f0 tempest-VolumesExtendTest-204608174 None] Lock "cinder-d90b6a19-2b47-470c-b93e-a80352c0525f-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:18:56 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-95bec334-bb37-4648-b52c-dde7398c96f0 tempest-VolumesExtendTest-204608174 None] Acquiring lock "cinder-quobyte-d90b6a19-2b47-470c-b93e-a80352c0525f" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:18:56 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-95bec334-bb37-4648-b52c-dde7398c96f0 tempest-VolumesExtendTest-204608174 None] Lock "cinder-quobyte-d90b6a19-2b47-470c-b93e-a80352c0525f" acquired by "delete_volume" :: waited 0.021s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:18:56 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[27009fe1-ccd4-4144-8d0b-201f5963f930]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:18:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-95bec334-bb37-4648-b52c-dde7398c96f0 tempest-VolumesExtendTest-204608174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-d90b6a19-2b47-470c-b93e-a80352c0525f {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:18:56 devstack sudo[96144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-d90b6a19-2b47-470c-b93e-a80352c0525f Nov 04 10:18:56 devstack sudo[96144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:18:56 devstack sudo[96144]: pam_unix(sudo:session): session closed for user root Nov 04 10:18:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-95bec334-bb37-4648-b52c-dde7398c96f0 tempest-VolumesExtendTest-204608174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-d90b6a19-2b47-470c-b93e-a80352c0525f" returned: 0 in 0.425s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:18:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-95bec334-bb37-4648-b52c-dde7398c96f0 tempest-VolumesExtendTest-204608174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-d90b6a19-2b47-470c-b93e-a80352c0525f {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:18:57 devstack sudo[96149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-d90b6a19-2b47-470c-b93e-a80352c0525f Nov 04 10:18:57 devstack sudo[96149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:18:57 devstack sudo[96149]: pam_unix(sudo:session): session closed for user root Nov 04 10:18:57 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-95bec334-bb37-4648-b52c-dde7398c96f0 tempest-VolumesExtendTest-204608174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-d90b6a19-2b47-470c-b93e-a80352c0525f" returned: 0 in 0.291s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:18:57 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-95bec334-bb37-4648-b52c-dde7398c96f0 tempest-VolumesExtendTest-204608174 None] Lock "cinder-quobyte-d90b6a19-2b47-470c-b93e-a80352c0525f" released by "delete_volume" :: held 0.802s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:18:57 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-95bec334-bb37-4648-b52c-dde7398c96f0 tempest-VolumesExtendTest-204608174 None] Created reservations ['924dffbb-8e15-4025-b80c-1fd9848a6680', '6b3882c6-8474-4a00-b367-6c5c48f996d9', 'a3cb9acc-1473-4933-aca8-450c22e3ada9', '055d8249-b11e-437e-8a26-30ac5c4d1092'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:18:57 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-95bec334-bb37-4648-b52c-dde7398c96f0 tempest-VolumesExtendTest-204608174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:18:57 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-95bec334-bb37-4648-b52c-dde7398c96f0 tempest-VolumesExtendTest-204608174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:18:57 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-95bec334-bb37-4648-b52c-dde7398c96f0 tempest-VolumesExtendTest-204608174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:18:57 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-95bec334-bb37-4648-b52c-dde7398c96f0 tempest-VolumesExtendTest-204608174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:18:57 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-95bec334-bb37-4648-b52c-dde7398c96f0 tempest-VolumesExtendTest-204608174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:18:57 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-95bec334-bb37-4648-b52c-dde7398c96f0 tempest-VolumesExtendTest-204608174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:18:57 devstack sudo[96152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:18:57 devstack sudo[96152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:18:57 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-2099e775-9b85-457d-be33-ae27834886ef tempest-VolumesTransfersTest-439846016 None] Transfer volume completed successfully. Nov 04 10:18:57 devstack sudo[96152]: pam_unix(sudo:session): session closed for user root Nov 04 10:18:57 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-95bec334-bb37-4648-b52c-dde7398c96f0 tempest-VolumesExtendTest-204608174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.364s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:18:57 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-95bec334-bb37-4648-b52c-dde7398c96f0 tempest-VolumesExtendTest-204608174 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:18:57 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-95bec334-bb37-4648-b52c-dde7398c96f0 tempest-VolumesExtendTest-204608174 None] Deleted volume successfully. Nov 04 10:18:57 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-95bec334-bb37-4648-b52c-dde7398c96f0 tempest-VolumesExtendTest-204608174 None] Lock "cinder-d90b6a19-2b47-470c-b93e-a80352c0525f-delete_volume" released by "delete_volume" :: held 1.447s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:18:58 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-5c5cd54f-1665-4eb1-aa6c-09756d722b64 tempest-VolumesTransfersTest-865839619 None] Acquiring lock "cinder-1c5fa159-7e1f-4d05-b255-71d1b02819ab-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:18:58 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-5c5cd54f-1665-4eb1-aa6c-09756d722b64 tempest-VolumesTransfersTest-865839619 None] Lock "cinder-1c5fa159-7e1f-4d05-b255-71d1b02819ab-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:18:58 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-5c5cd54f-1665-4eb1-aa6c-09756d722b64 tempest-VolumesTransfersTest-865839619 None] Acquiring lock "cinder-quobyte-1c5fa159-7e1f-4d05-b255-71d1b02819ab" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:18:58 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-5c5cd54f-1665-4eb1-aa6c-09756d722b64 tempest-VolumesTransfersTest-865839619 None] Lock "cinder-quobyte-1c5fa159-7e1f-4d05-b255-71d1b02819ab" acquired by "delete_volume" :: waited 0.014s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:18:58 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[03100755-311e-4595-81c6-f9f935a9020a]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:18:58 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-5c5cd54f-1665-4eb1-aa6c-09756d722b64 tempest-VolumesTransfersTest-865839619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-1c5fa159-7e1f-4d05-b255-71d1b02819ab {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:18:58 devstack sudo[96156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-1c5fa159-7e1f-4d05-b255-71d1b02819ab Nov 04 10:18:58 devstack sudo[96156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:18:58 devstack sudo[96156]: pam_unix(sudo:session): session closed for user root Nov 04 10:18:58 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-5c5cd54f-1665-4eb1-aa6c-09756d722b64 tempest-VolumesTransfersTest-865839619 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-1c5fa159-7e1f-4d05-b255-71d1b02819ab" returned: 0 in 0.524s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:18:58 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-5c5cd54f-1665-4eb1-aa6c-09756d722b64 tempest-VolumesTransfersTest-865839619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-1c5fa159-7e1f-4d05-b255-71d1b02819ab {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:18:58 devstack sudo[96161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-1c5fa159-7e1f-4d05-b255-71d1b02819ab Nov 04 10:18:58 devstack sudo[96161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:18:59 devstack sudo[96161]: pam_unix(sudo:session): session closed for user root Nov 04 10:18:59 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-5c5cd54f-1665-4eb1-aa6c-09756d722b64 tempest-VolumesTransfersTest-865839619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-1c5fa159-7e1f-4d05-b255-71d1b02819ab" returned: 0 in 0.264s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:18:59 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-5c5cd54f-1665-4eb1-aa6c-09756d722b64 tempest-VolumesTransfersTest-865839619 None] Lock "cinder-quobyte-1c5fa159-7e1f-4d05-b255-71d1b02819ab" released by "delete_volume" :: held 0.851s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:18:59 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-5c5cd54f-1665-4eb1-aa6c-09756d722b64 tempest-VolumesTransfersTest-865839619 None] Created reservations ['4283e148-adcc-45bf-9261-563d86a223b0', '16afa4f9-872d-43c7-a97f-124721ab60d4', '35160415-8d8a-4953-939b-63f910bd22af', 'fababf33-4da0-464f-8659-ad48a1f922ab'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:18:59 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-5c5cd54f-1665-4eb1-aa6c-09756d722b64 tempest-VolumesTransfersTest-865839619 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:18:59 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-5c5cd54f-1665-4eb1-aa6c-09756d722b64 tempest-VolumesTransfersTest-865839619 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:18:59 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-5c5cd54f-1665-4eb1-aa6c-09756d722b64 tempest-VolumesTransfersTest-865839619 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:18:59 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-5c5cd54f-1665-4eb1-aa6c-09756d722b64 tempest-VolumesTransfersTest-865839619 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:18:59 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-5c5cd54f-1665-4eb1-aa6c-09756d722b64 tempest-VolumesTransfersTest-865839619 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:18:59 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-5c5cd54f-1665-4eb1-aa6c-09756d722b64 tempest-VolumesTransfersTest-865839619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:18:59 devstack sudo[96166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:18:59 devstack sudo[96166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:18:59 devstack sudo[96166]: pam_unix(sudo:session): session closed for user root Nov 04 10:18:59 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-5c5cd54f-1665-4eb1-aa6c-09756d722b64 tempest-VolumesTransfersTest-865839619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.354s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:18:59 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-5c5cd54f-1665-4eb1-aa6c-09756d722b64 tempest-VolumesTransfersTest-865839619 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:18:59 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-5c5cd54f-1665-4eb1-aa6c-09756d722b64 tempest-VolumesTransfersTest-865839619 None] Deleted volume successfully. Nov 04 10:18:59 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-5c5cd54f-1665-4eb1-aa6c-09756d722b64 tempest-VolumesTransfersTest-865839619 None] Lock "cinder-1c5fa159-7e1f-4d05-b255-71d1b02819ab-delete_volume" released by "delete_volume" :: held 1.496s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:19:00 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-079c7ce4-7efe-4c64-a2b6-c26fb2b3ec80 tempest-VolumesSnapshotTestJSON-1835544826 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:19:00 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-079c7ce4-7efe-4c64-a2b6-c26fb2b3ec80 tempest-VolumesSnapshotTestJSON-1835544826 None] Flow 'volume_create_manager' (c033ad04-168e-4225-9810-577d4ce3b7cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:19:00 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-079c7ce4-7efe-4c64-a2b6-c26fb2b3ec80 tempest-VolumesSnapshotTestJSON-1835544826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e665cb3-d69f-4215-85f6-a4efbeecd4ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:19:00 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-079c7ce4-7efe-4c64-a2b6-c26fb2b3ec80 tempest-VolumesSnapshotTestJSON-1835544826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e665cb3-d69f-4215-85f6-a4efbeecd4ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:19:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-494076526',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de24b84a-f23b-4f28-9058-839ddac8809f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c119592eb9b94d74ad294736ec076621',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:19:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:19:00Z,use_quota=True,user_id='1810941f24e64a14ad02f068e0d989ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:19:00 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-079c7ce4-7efe-4c64-a2b6-c26fb2b3ec80 tempest-VolumesSnapshotTestJSON-1835544826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67cfcd2d-99a9-4c7f-ba3b-749dc5499b1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:19:00 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-079c7ce4-7efe-4c64-a2b6-c26fb2b3ec80 tempest-VolumesSnapshotTestJSON-1835544826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67cfcd2d-99a9-4c7f-ba3b-749dc5499b1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:19:00 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-079c7ce4-7efe-4c64-a2b6-c26fb2b3ec80 tempest-VolumesSnapshotTestJSON-1835544826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d116944-8123-44a0-b634-1e9222458043) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:19:00 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-079c7ce4-7efe-4c64-a2b6-c26fb2b3ec80 tempest-VolumesSnapshotTestJSON-1835544826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d116944-8123-44a0-b634-1e9222458043) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de24b84a-f23b-4f28-9058-839ddac8809f', 'volume_name': 'volume-de24b84a-f23b-4f28-9058-839ddac8809f', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:19:00 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-079c7ce4-7efe-4c64-a2b6-c26fb2b3ec80 tempest-VolumesSnapshotTestJSON-1835544826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f75cf229-d906-493c-aaad-0d044a12a38f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:19:00 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-079c7ce4-7efe-4c64-a2b6-c26fb2b3ec80 tempest-VolumesSnapshotTestJSON-1835544826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f75cf229-d906-493c-aaad-0d044a12a38f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:19:00 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-079c7ce4-7efe-4c64-a2b6-c26fb2b3ec80 tempest-VolumesSnapshotTestJSON-1835544826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48acf487-1041-48ff-8844-52dd33e9cb01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:19:00 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-079c7ce4-7efe-4c64-a2b6-c26fb2b3ec80 tempest-VolumesSnapshotTestJSON-1835544826 None] Volume de24b84a-f23b-4f28-9058-839ddac8809f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de24b84a-f23b-4f28-9058-839ddac8809f', 'volume_size': 1} Nov 04 10:19:00 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-079c7ce4-7efe-4c64-a2b6-c26fb2b3ec80 tempest-VolumesSnapshotTestJSON-1835544826 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:19:00 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-079c7ce4-7efe-4c64-a2b6-c26fb2b3ec80 tempest-VolumesSnapshotTestJSON-1835544826 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:19:00 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-079c7ce4-7efe-4c64-a2b6-c26fb2b3ec80 tempest-VolumesSnapshotTestJSON-1835544826 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:19:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-494076526',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de24b84a-f23b-4f28-9058-839ddac8809f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c119592eb9b94d74ad294736ec076621',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:19:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:19:00Z,use_quota=True,user_id='1810941f24e64a14ad02f068e0d989ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 10:19:00 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-079c7ce4-7efe-4c64-a2b6-c26fb2b3ec80 tempest-VolumesSnapshotTestJSON-1835544826 None] Creating volume de24b84a-f23b-4f28-9058-839ddac8809f {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:19:00 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-079c7ce4-7efe-4c64-a2b6-c26fb2b3ec80 tempest-VolumesSnapshotTestJSON-1835544826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:19:00 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-079c7ce4-7efe-4c64-a2b6-c26fb2b3ec80 tempest-VolumesSnapshotTestJSON-1835544826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:19:00 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-079c7ce4-7efe-4c64-a2b6-c26fb2b3ec80 tempest-VolumesSnapshotTestJSON-1835544826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:19:00 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-079c7ce4-7efe-4c64-a2b6-c26fb2b3ec80 tempest-VolumesSnapshotTestJSON-1835544826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:19:00 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-079c7ce4-7efe-4c64-a2b6-c26fb2b3ec80 tempest-VolumesSnapshotTestJSON-1835544826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:19:00 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-079c7ce4-7efe-4c64-a2b6-c26fb2b3ec80 tempest-VolumesSnapshotTestJSON-1835544826 None] Selected osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:19:00 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-079c7ce4-7efe-4c64-a2b6-c26fb2b3ec80 tempest-VolumesSnapshotTestJSON-1835544826 None] casted to osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 Nov 04 10:19:00 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-079c7ce4-7efe-4c64-a2b6-c26fb2b3ec80 tempest-VolumesSnapshotTestJSON-1835544826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-de24b84a-f23b-4f28-9058-839ddac8809f 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:19:00 devstack sudo[96169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-de24b84a-f23b-4f28-9058-839ddac8809f 1073741824 Nov 04 10:19:00 devstack sudo[96169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:19:00 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3c883dc-40bd-46f1-bbe1-855eeaad08eb tempest-VolumesTransfersTest-738834495 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:19:00 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-d3c883dc-40bd-46f1-bbe1-855eeaad08eb tempest-VolumesTransfersTest-738834495 None] Flow 'volume_create_manager' (a2eac53c-3ec3-452e-bea9-cf7530e8ac12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:19:00 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-d3c883dc-40bd-46f1-bbe1-855eeaad08eb tempest-VolumesTransfersTest-738834495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acc7c40c-1b0e-4251-8356-146c05cfc7fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:19:00 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-d3c883dc-40bd-46f1-bbe1-855eeaad08eb tempest-VolumesTransfersTest-738834495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acc7c40c-1b0e-4251-8356-146c05cfc7fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:19:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1215286062',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b64c7c49-db5e-4fb6-8ee2-85fa0f8983dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f2508be1e9f4a598b58ce6b48549340',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:19:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:19:00Z,use_quota=True,user_id='ef02ea8cab514e5db69a85e48f519d3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:19:00 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-d3c883dc-40bd-46f1-bbe1-855eeaad08eb tempest-VolumesTransfersTest-738834495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5077b86b-7c90-424c-8824-8b37bbb408b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:19:00 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-d3c883dc-40bd-46f1-bbe1-855eeaad08eb tempest-VolumesTransfersTest-738834495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5077b86b-7c90-424c-8824-8b37bbb408b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:19:00 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-d3c883dc-40bd-46f1-bbe1-855eeaad08eb tempest-VolumesTransfersTest-738834495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79b50579-5d88-4521-b8e0-b3688f0a36e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:19:00 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-d3c883dc-40bd-46f1-bbe1-855eeaad08eb tempest-VolumesTransfersTest-738834495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79b50579-5d88-4521-b8e0-b3688f0a36e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b64c7c49-db5e-4fb6-8ee2-85fa0f8983dc', 'volume_name': 'volume-b64c7c49-db5e-4fb6-8ee2-85fa0f8983dc', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:19:00 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-d3c883dc-40bd-46f1-bbe1-855eeaad08eb tempest-VolumesTransfersTest-738834495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9e7d9b9-2a6a-4703-b82f-ae6463346c57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:19:00 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-d3c883dc-40bd-46f1-bbe1-855eeaad08eb tempest-VolumesTransfersTest-738834495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9e7d9b9-2a6a-4703-b82f-ae6463346c57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:19:00 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-d3c883dc-40bd-46f1-bbe1-855eeaad08eb tempest-VolumesTransfersTest-738834495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1dbdc223-61ad-4934-9829-e73d6356bcc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:19:00 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-d3c883dc-40bd-46f1-bbe1-855eeaad08eb tempest-VolumesTransfersTest-738834495 None] Volume b64c7c49-db5e-4fb6-8ee2-85fa0f8983dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b64c7c49-db5e-4fb6-8ee2-85fa0f8983dc', 'volume_size': 1} Nov 04 10:19:00 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-d3c883dc-40bd-46f1-bbe1-855eeaad08eb tempest-VolumesTransfersTest-738834495 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:19:00 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1950f61-bc79-4cab-8e0d-2d8a5037d8c0 tempest-AttachVolumeShelveTestJSON-659726282 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:19:00 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-d1950f61-bc79-4cab-8e0d-2d8a5037d8c0 tempest-AttachVolumeShelveTestJSON-659726282 None] Flow 'volume_create_manager' (0262f085-f3fe-401f-bc1f-698f88b93edf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:19:00 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-d1950f61-bc79-4cab-8e0d-2d8a5037d8c0 tempest-AttachVolumeShelveTestJSON-659726282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (127d8105-9adf-4eaf-956d-004c513659dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:19:00 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-d1950f61-bc79-4cab-8e0d-2d8a5037d8c0 tempest-AttachVolumeShelveTestJSON-659726282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (127d8105-9adf-4eaf-956d-004c513659dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:19:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1980655871',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a89341d4-da66-49d1-9538-a9f142d67d87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f904e9d6b4334ee693c6e1b6d11f9d7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:19:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:19:01Z,use_quota=True,user_id='03161679df6c417aa698c75a28b55931',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:19:00 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-d1950f61-bc79-4cab-8e0d-2d8a5037d8c0 tempest-AttachVolumeShelveTestJSON-659726282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (704f97e7-7529-493e-a86c-29dd9607aa31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:19:00 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-d1950f61-bc79-4cab-8e0d-2d8a5037d8c0 tempest-AttachVolumeShelveTestJSON-659726282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (704f97e7-7529-493e-a86c-29dd9607aa31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:19:00 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-d1950f61-bc79-4cab-8e0d-2d8a5037d8c0 tempest-AttachVolumeShelveTestJSON-659726282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0860a108-bebe-4228-a6be-2625f4b3435c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:19:00 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-d1950f61-bc79-4cab-8e0d-2d8a5037d8c0 tempest-AttachVolumeShelveTestJSON-659726282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0860a108-bebe-4228-a6be-2625f4b3435c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a89341d4-da66-49d1-9538-a9f142d67d87', 'volume_name': 'volume-a89341d4-da66-49d1-9538-a9f142d67d87', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:19:00 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-d1950f61-bc79-4cab-8e0d-2d8a5037d8c0 tempest-AttachVolumeShelveTestJSON-659726282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b82d067d-ac29-41d6-b876-847726a960dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:19:00 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-d1950f61-bc79-4cab-8e0d-2d8a5037d8c0 tempest-AttachVolumeShelveTestJSON-659726282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b82d067d-ac29-41d6-b876-847726a960dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:19:00 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-d1950f61-bc79-4cab-8e0d-2d8a5037d8c0 tempest-AttachVolumeShelveTestJSON-659726282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e3c7853-a64c-444b-8889-ace4f61c90e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:19:00 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-d1950f61-bc79-4cab-8e0d-2d8a5037d8c0 tempest-AttachVolumeShelveTestJSON-659726282 None] Volume a89341d4-da66-49d1-9538-a9f142d67d87: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a89341d4-da66-49d1-9538-a9f142d67d87', 'volume_size': 1} Nov 04 10:19:00 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-d1950f61-bc79-4cab-8e0d-2d8a5037d8c0 tempest-AttachVolumeShelveTestJSON-659726282 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:19:00 devstack sudo[96169]: pam_unix(sudo:session): session closed for user root Nov 04 10:19:00 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-079c7ce4-7efe-4c64-a2b6-c26fb2b3ec80 tempest-VolumesSnapshotTestJSON-1835544826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-de24b84a-f23b-4f28-9058-839ddac8809f 1073741824" returned: 0 in 0.564s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:19:00 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-079c7ce4-7efe-4c64-a2b6-c26fb2b3ec80 tempest-VolumesSnapshotTestJSON-1835544826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-de24b84a-f23b-4f28-9058-839ddac8809f {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:19:00 devstack sudo[96175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-de24b84a-f23b-4f28-9058-839ddac8809f Nov 04 10:19:00 devstack sudo[96175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:19:01 devstack sudo[96175]: pam_unix(sudo:session): session closed for user root Nov 04 10:19:01 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-079c7ce4-7efe-4c64-a2b6-c26fb2b3ec80 tempest-VolumesSnapshotTestJSON-1835544826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-de24b84a-f23b-4f28-9058-839ddac8809f" returned: 0 in 0.262s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:19:01 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-079c7ce4-7efe-4c64-a2b6-c26fb2b3ec80 tempest-VolumesSnapshotTestJSON-1835544826 None] <== create_volume: return (884ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 10:19:01 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-079c7ce4-7efe-4c64-a2b6-c26fb2b3ec80 tempest-VolumesSnapshotTestJSON-1835544826 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.887s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:19:01 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-d3c883dc-40bd-46f1-bbe1-855eeaad08eb tempest-VolumesTransfersTest-738834495 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.636s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:19:01 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-d3c883dc-40bd-46f1-bbe1-855eeaad08eb tempest-VolumesTransfersTest-738834495 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:19:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1215286062',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b64c7c49-db5e-4fb6-8ee2-85fa0f8983dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f2508be1e9f4a598b58ce6b48549340',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:19:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:19:00Z,use_quota=True,user_id='ef02ea8cab514e5db69a85e48f519d3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 10:19:01 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-d3c883dc-40bd-46f1-bbe1-855eeaad08eb tempest-VolumesTransfersTest-738834495 None] Creating volume b64c7c49-db5e-4fb6-8ee2-85fa0f8983dc {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:19:01 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-d3c883dc-40bd-46f1-bbe1-855eeaad08eb tempest-VolumesTransfersTest-738834495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:19:01 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-d3c883dc-40bd-46f1-bbe1-855eeaad08eb tempest-VolumesTransfersTest-738834495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:19:01 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-d3c883dc-40bd-46f1-bbe1-855eeaad08eb tempest-VolumesTransfersTest-738834495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:19:01 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-d3c883dc-40bd-46f1-bbe1-855eeaad08eb tempest-VolumesTransfersTest-738834495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:19:01 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-d3c883dc-40bd-46f1-bbe1-855eeaad08eb tempest-VolumesTransfersTest-738834495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:19:01 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-d3c883dc-40bd-46f1-bbe1-855eeaad08eb tempest-VolumesTransfersTest-738834495 None] Selected osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:19:01 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-d3c883dc-40bd-46f1-bbe1-855eeaad08eb tempest-VolumesTransfersTest-738834495 None] casted to osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 Nov 04 10:19:01 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d3c883dc-40bd-46f1-bbe1-855eeaad08eb tempest-VolumesTransfersTest-738834495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b64c7c49-db5e-4fb6-8ee2-85fa0f8983dc 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:19:01 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-079c7ce4-7efe-4c64-a2b6-c26fb2b3ec80 tempest-VolumesSnapshotTestJSON-1835544826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48acf487-1041-48ff-8844-52dd33e9cb01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de24b84a-f23b-4f28-9058-839ddac8809f', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:19:01 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-079c7ce4-7efe-4c64-a2b6-c26fb2b3ec80 tempest-VolumesSnapshotTestJSON-1835544826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7988f6e7-0a2d-4f72-ab27-8a9a812fcc4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:19:01 devstack sudo[96178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b64c7c49-db5e-4fb6-8ee2-85fa0f8983dc 1073741824 Nov 04 10:19:01 devstack sudo[96178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:19:01 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-079c7ce4-7efe-4c64-a2b6-c26fb2b3ec80 tempest-VolumesSnapshotTestJSON-1835544826 None] Volume volume-de24b84a-f23b-4f28-9058-839ddac8809f (de24b84a-f23b-4f28-9058-839ddac8809f): created successfully Nov 04 10:19:01 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-079c7ce4-7efe-4c64-a2b6-c26fb2b3ec80 tempest-VolumesSnapshotTestJSON-1835544826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7988f6e7-0a2d-4f72-ab27-8a9a812fcc4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:19:01 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-079c7ce4-7efe-4c64-a2b6-c26fb2b3ec80 tempest-VolumesSnapshotTestJSON-1835544826 None] Flow 'volume_create_manager' (c033ad04-168e-4225-9810-577d4ce3b7cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:19:01 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-079c7ce4-7efe-4c64-a2b6-c26fb2b3ec80 tempest-VolumesSnapshotTestJSON-1835544826 None] Created volume successfully. Nov 04 10:19:01 devstack sudo[96178]: pam_unix(sudo:session): session closed for user root Nov 04 10:19:01 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d3c883dc-40bd-46f1-bbe1-855eeaad08eb tempest-VolumesTransfersTest-738834495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b64c7c49-db5e-4fb6-8ee2-85fa0f8983dc 1073741824" returned: 0 in 0.497s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:19:01 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d3c883dc-40bd-46f1-bbe1-855eeaad08eb tempest-VolumesTransfersTest-738834495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b64c7c49-db5e-4fb6-8ee2-85fa0f8983dc {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:19:01 devstack sudo[96184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b64c7c49-db5e-4fb6-8ee2-85fa0f8983dc Nov 04 10:19:01 devstack sudo[96184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:19:01 devstack sudo[96184]: pam_unix(sudo:session): session closed for user root Nov 04 10:19:01 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d3c883dc-40bd-46f1-bbe1-855eeaad08eb tempest-VolumesTransfersTest-738834495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b64c7c49-db5e-4fb6-8ee2-85fa0f8983dc" returned: 0 in 0.267s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:19:01 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-d3c883dc-40bd-46f1-bbe1-855eeaad08eb tempest-VolumesTransfersTest-738834495 None] <== create_volume: return (818ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 10:19:01 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-d3c883dc-40bd-46f1-bbe1-855eeaad08eb tempest-VolumesTransfersTest-738834495 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.822s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:19:01 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-d1950f61-bc79-4cab-8e0d-2d8a5037d8c0 tempest-AttachVolumeShelveTestJSON-659726282 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.274s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:19:01 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-d1950f61-bc79-4cab-8e0d-2d8a5037d8c0 tempest-AttachVolumeShelveTestJSON-659726282 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:19:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1980655871',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a89341d4-da66-49d1-9538-a9f142d67d87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f904e9d6b4334ee693c6e1b6d11f9d7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:19:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:19:01Z,use_quota=True,user_id='03161679df6c417aa698c75a28b55931',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 10:19:01 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-d1950f61-bc79-4cab-8e0d-2d8a5037d8c0 tempest-AttachVolumeShelveTestJSON-659726282 None] Creating volume a89341d4-da66-49d1-9538-a9f142d67d87 {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:19:01 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-d1950f61-bc79-4cab-8e0d-2d8a5037d8c0 tempest-AttachVolumeShelveTestJSON-659726282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:19:01 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-d1950f61-bc79-4cab-8e0d-2d8a5037d8c0 tempest-AttachVolumeShelveTestJSON-659726282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:19:01 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-d1950f61-bc79-4cab-8e0d-2d8a5037d8c0 tempest-AttachVolumeShelveTestJSON-659726282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:19:01 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-d1950f61-bc79-4cab-8e0d-2d8a5037d8c0 tempest-AttachVolumeShelveTestJSON-659726282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:19:01 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-d1950f61-bc79-4cab-8e0d-2d8a5037d8c0 tempest-AttachVolumeShelveTestJSON-659726282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:19:01 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-d1950f61-bc79-4cab-8e0d-2d8a5037d8c0 tempest-AttachVolumeShelveTestJSON-659726282 None] Selected osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:19:01 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-d1950f61-bc79-4cab-8e0d-2d8a5037d8c0 tempest-AttachVolumeShelveTestJSON-659726282 None] casted to osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 Nov 04 10:19:01 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d1950f61-bc79-4cab-8e0d-2d8a5037d8c0 tempest-AttachVolumeShelveTestJSON-659726282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-a89341d4-da66-49d1-9538-a9f142d67d87 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:19:01 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-d3c883dc-40bd-46f1-bbe1-855eeaad08eb tempest-VolumesTransfersTest-738834495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1dbdc223-61ad-4934-9829-e73d6356bcc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b64c7c49-db5e-4fb6-8ee2-85fa0f8983dc', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:19:01 devstack sudo[96187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-a89341d4-da66-49d1-9538-a9f142d67d87 1073741824 Nov 04 10:19:01 devstack sudo[96187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:19:01 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-d3c883dc-40bd-46f1-bbe1-855eeaad08eb tempest-VolumesTransfersTest-738834495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97934f52-19d8-4050-8783-1682f9b25f55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:19:01 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-d3c883dc-40bd-46f1-bbe1-855eeaad08eb tempest-VolumesTransfersTest-738834495 None] Volume volume-b64c7c49-db5e-4fb6-8ee2-85fa0f8983dc (b64c7c49-db5e-4fb6-8ee2-85fa0f8983dc): created successfully Nov 04 10:19:02 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-d3c883dc-40bd-46f1-bbe1-855eeaad08eb tempest-VolumesTransfersTest-738834495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97934f52-19d8-4050-8783-1682f9b25f55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:19:02 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-d3c883dc-40bd-46f1-bbe1-855eeaad08eb tempest-VolumesTransfersTest-738834495 None] Flow 'volume_create_manager' (a2eac53c-3ec3-452e-bea9-cf7530e8ac12) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:19:02 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-d3c883dc-40bd-46f1-bbe1-855eeaad08eb tempest-VolumesTransfersTest-738834495 None] Created volume successfully. Nov 04 10:19:02 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-db098e1a-2569-4be8-b06c-f0dc3390a38a tempest-VolumesGetTest-1874363189 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:19:02 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-db098e1a-2569-4be8-b06c-f0dc3390a38a tempest-VolumesGetTest-1874363189 None] Flow 'volume_create_manager' (5db06c53-ad12-44ab-abb8-8b000df9a5f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:19:02 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-db098e1a-2569-4be8-b06c-f0dc3390a38a tempest-VolumesGetTest-1874363189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d5dd2e3-c53c-41e0-8e71-7cf53289c1f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:19:02 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-db098e1a-2569-4be8-b06c-f0dc3390a38a tempest-VolumesGetTest-1874363189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d5dd2e3-c53c-41e0-8e71-7cf53289c1f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:19:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1068075606',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b038c9fd-05dc-4113-9a31-3d2a7de26269,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='1fb9cd956e4c4871af0e738ec6daa746',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:19:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:19:02Z,use_quota=True,user_id='95fe690f67df4d6f87922789a65a81d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:19:02 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-db098e1a-2569-4be8-b06c-f0dc3390a38a tempest-VolumesGetTest-1874363189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93889ea9-650e-481f-a14b-441be376029a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:19:02 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-db098e1a-2569-4be8-b06c-f0dc3390a38a tempest-VolumesGetTest-1874363189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93889ea9-650e-481f-a14b-441be376029a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:19:02 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-db098e1a-2569-4be8-b06c-f0dc3390a38a tempest-VolumesGetTest-1874363189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd7d82f4-1e56-438f-916d-323861af74de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:19:02 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-db098e1a-2569-4be8-b06c-f0dc3390a38a tempest-VolumesGetTest-1874363189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd7d82f4-1e56-438f-916d-323861af74de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b038c9fd-05dc-4113-9a31-3d2a7de26269', 'volume_name': 'volume-b038c9fd-05dc-4113-9a31-3d2a7de26269', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:19:02 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-db098e1a-2569-4be8-b06c-f0dc3390a38a tempest-VolumesGetTest-1874363189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (376ae8ea-4321-442e-8b7a-d2bf60d911d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:19:02 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-db098e1a-2569-4be8-b06c-f0dc3390a38a tempest-VolumesGetTest-1874363189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (376ae8ea-4321-442e-8b7a-d2bf60d911d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:19:02 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-db098e1a-2569-4be8-b06c-f0dc3390a38a tempest-VolumesGetTest-1874363189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3f769ee-e36d-46b6-a0e1-84b809359c6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:19:02 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-db098e1a-2569-4be8-b06c-f0dc3390a38a tempest-VolumesGetTest-1874363189 None] Volume b038c9fd-05dc-4113-9a31-3d2a7de26269: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b038c9fd-05dc-4113-9a31-3d2a7de26269', 'volume_size': 1} Nov 04 10:19:02 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-db098e1a-2569-4be8-b06c-f0dc3390a38a tempest-VolumesGetTest-1874363189 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:19:02 devstack sudo[96187]: pam_unix(sudo:session): session closed for user root Nov 04 10:19:02 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d1950f61-bc79-4cab-8e0d-2d8a5037d8c0 tempest-AttachVolumeShelveTestJSON-659726282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-a89341d4-da66-49d1-9538-a9f142d67d87 1073741824" returned: 0 in 0.556s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:19:02 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d1950f61-bc79-4cab-8e0d-2d8a5037d8c0 tempest-AttachVolumeShelveTestJSON-659726282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-a89341d4-da66-49d1-9538-a9f142d67d87 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:19:02 devstack sudo[96194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-a89341d4-da66-49d1-9538-a9f142d67d87 Nov 04 10:19:02 devstack sudo[96194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:19:02 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-f4bc2c7b-1eee-4643-8a71-47006570bf61 tempest-VolumesTransfersTest-865839619 None] Acquiring lock "cinder-b64c7c49-db5e-4fb6-8ee2-85fa0f8983dc-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:19:02 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-f4bc2c7b-1eee-4643-8a71-47006570bf61 tempest-VolumesTransfersTest-865839619 None] Lock "cinder-b64c7c49-db5e-4fb6-8ee2-85fa0f8983dc-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:19:02 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-f4bc2c7b-1eee-4643-8a71-47006570bf61 tempest-VolumesTransfersTest-865839619 None] Acquiring lock "cinder-quobyte-b64c7c49-db5e-4fb6-8ee2-85fa0f8983dc" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:19:02 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-f2964302-992f-47f0-affe-f0df386a9f4d tempest-VolumesSnapshotTestJSON-1835544826 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:19:02 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-f4bc2c7b-1eee-4643-8a71-47006570bf61 tempest-VolumesTransfersTest-865839619 None] Lock "cinder-quobyte-b64c7c49-db5e-4fb6-8ee2-85fa0f8983dc" acquired by "delete_volume" :: waited 0.017s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:19:02 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[fec9a6ff-2a39-431f-a74b-402d9862f4db]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:19:02 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f4bc2c7b-1eee-4643-8a71-47006570bf61 tempest-VolumesTransfersTest-865839619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b64c7c49-db5e-4fb6-8ee2-85fa0f8983dc {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:19:02 devstack sudo[96194]: pam_unix(sudo:session): session closed for user root Nov 04 10:19:02 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d1950f61-bc79-4cab-8e0d-2d8a5037d8c0 tempest-AttachVolumeShelveTestJSON-659726282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-a89341d4-da66-49d1-9538-a9f142d67d87" returned: 0 in 0.356s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:19:02 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-d1950f61-bc79-4cab-8e0d-2d8a5037d8c0 tempest-AttachVolumeShelveTestJSON-659726282 None] <== create_volume: return (962ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 10:19:02 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-d1950f61-bc79-4cab-8e0d-2d8a5037d8c0 tempest-AttachVolumeShelveTestJSON-659726282 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.965s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:19:02 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-db098e1a-2569-4be8-b06c-f0dc3390a38a tempest-VolumesGetTest-1874363189 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.414s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:19:02 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-db098e1a-2569-4be8-b06c-f0dc3390a38a tempest-VolumesGetTest-1874363189 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:19:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1068075606',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b038c9fd-05dc-4113-9a31-3d2a7de26269,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='1fb9cd956e4c4871af0e738ec6daa746',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:19:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:19:02Z,use_quota=True,user_id='95fe690f67df4d6f87922789a65a81d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 10:19:02 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-db098e1a-2569-4be8-b06c-f0dc3390a38a tempest-VolumesGetTest-1874363189 None] Creating volume b038c9fd-05dc-4113-9a31-3d2a7de26269 {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:19:02 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-db098e1a-2569-4be8-b06c-f0dc3390a38a tempest-VolumesGetTest-1874363189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:19:02 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-db098e1a-2569-4be8-b06c-f0dc3390a38a tempest-VolumesGetTest-1874363189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:19:02 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-db098e1a-2569-4be8-b06c-f0dc3390a38a tempest-VolumesGetTest-1874363189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:19:02 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-db098e1a-2569-4be8-b06c-f0dc3390a38a tempest-VolumesGetTest-1874363189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:19:02 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-db098e1a-2569-4be8-b06c-f0dc3390a38a tempest-VolumesGetTest-1874363189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:19:02 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-db098e1a-2569-4be8-b06c-f0dc3390a38a tempest-VolumesGetTest-1874363189 None] Selected osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:19:02 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-db098e1a-2569-4be8-b06c-f0dc3390a38a tempest-VolumesGetTest-1874363189 None] casted to osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 Nov 04 10:19:02 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-db098e1a-2569-4be8-b06c-f0dc3390a38a tempest-VolumesGetTest-1874363189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b038c9fd-05dc-4113-9a31-3d2a7de26269 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:19:02 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-d1950f61-bc79-4cab-8e0d-2d8a5037d8c0 tempest-AttachVolumeShelveTestJSON-659726282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e3c7853-a64c-444b-8889-ace4f61c90e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a89341d4-da66-49d1-9538-a9f142d67d87', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:19:02 devstack sudo[96198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b038c9fd-05dc-4113-9a31-3d2a7de26269 1073741824 Nov 04 10:19:02 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-d1950f61-bc79-4cab-8e0d-2d8a5037d8c0 tempest-AttachVolumeShelveTestJSON-659726282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e7f3282-09ed-4eac-a50d-d02d25a19e5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:19:02 devstack sudo[96198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:19:02 devstack sudo[96197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b64c7c49-db5e-4fb6-8ee2-85fa0f8983dc Nov 04 10:19:02 devstack sudo[96197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:19:03 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-d1950f61-bc79-4cab-8e0d-2d8a5037d8c0 tempest-AttachVolumeShelveTestJSON-659726282 None] Volume volume-a89341d4-da66-49d1-9538-a9f142d67d87 (a89341d4-da66-49d1-9538-a9f142d67d87): created successfully Nov 04 10:19:03 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-d1950f61-bc79-4cab-8e0d-2d8a5037d8c0 tempest-AttachVolumeShelveTestJSON-659726282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e7f3282-09ed-4eac-a50d-d02d25a19e5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:19:03 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-d1950f61-bc79-4cab-8e0d-2d8a5037d8c0 tempest-AttachVolumeShelveTestJSON-659726282 None] Flow 'volume_create_manager' (0262f085-f3fe-401f-bc1f-698f88b93edf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:19:03 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-d1950f61-bc79-4cab-8e0d-2d8a5037d8c0 tempest-AttachVolumeShelveTestJSON-659726282 None] Created volume successfully. Nov 04 10:19:03 devstack sudo[96197]: pam_unix(sudo:session): session closed for user root Nov 04 10:19:03 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f4bc2c7b-1eee-4643-8a71-47006570bf61 tempest-VolumesTransfersTest-865839619 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b64c7c49-db5e-4fb6-8ee2-85fa0f8983dc" returned: 0 in 0.405s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:19:03 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f4bc2c7b-1eee-4643-8a71-47006570bf61 tempest-VolumesTransfersTest-865839619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b64c7c49-db5e-4fb6-8ee2-85fa0f8983dc {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:19:03 devstack sudo[96209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b64c7c49-db5e-4fb6-8ee2-85fa0f8983dc Nov 04 10:19:03 devstack sudo[96209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:19:03 devstack sudo[96198]: pam_unix(sudo:session): session closed for user root Nov 04 10:19:03 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-db098e1a-2569-4be8-b06c-f0dc3390a38a tempest-VolumesGetTest-1874363189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b038c9fd-05dc-4113-9a31-3d2a7de26269 1073741824" returned: 0 in 0.463s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:19:03 devstack cinder-volume[87068]: DEBUG dbcounter [-] [87068] Writing DB stats cinder:SELECT=110,cinder:INSERT=44,cinder:UPDATE=160,cinder:DELETE=16 {{(pid=87068) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 10:19:03 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-db098e1a-2569-4be8-b06c-f0dc3390a38a tempest-VolumesGetTest-1874363189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b038c9fd-05dc-4113-9a31-3d2a7de26269 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:19:03 devstack sudo[96211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b038c9fd-05dc-4113-9a31-3d2a7de26269 Nov 04 10:19:03 devstack sudo[96211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:19:03 devstack sudo[96209]: pam_unix(sudo:session): session closed for user root Nov 04 10:19:03 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f4bc2c7b-1eee-4643-8a71-47006570bf61 tempest-VolumesTransfersTest-865839619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b64c7c49-db5e-4fb6-8ee2-85fa0f8983dc" returned: 0 in 0.275s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:19:03 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-f4bc2c7b-1eee-4643-8a71-47006570bf61 tempest-VolumesTransfersTest-865839619 None] Lock "cinder-quobyte-b64c7c49-db5e-4fb6-8ee2-85fa0f8983dc" released by "delete_volume" :: held 0.731s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:19:03 devstack cinder-volume[87068]: DEBUG dbcounter [-] [87068] Writing DB stats cinder:UPDATE=162,cinder:DELETE=12,cinder:SELECT=128,cinder:INSERT=42 {{(pid=87068) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 10:19:03 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-f4bc2c7b-1eee-4643-8a71-47006570bf61 tempest-VolumesTransfersTest-865839619 None] Created reservations ['73125d0d-858e-44cf-a4c2-d7beca7fa346', 'e95b4ba0-b2f4-4229-b3f9-b9c44caea96b', '5c346485-f6ae-4ca3-8e95-c8336f2b85f8', 'd288eb7f-e46d-4ad1-80d9-3e3dfe5136c0'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:19:03 devstack sudo[96211]: pam_unix(sudo:session): session closed for user root Nov 04 10:19:03 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-db098e1a-2569-4be8-b06c-f0dc3390a38a tempest-VolumesGetTest-1874363189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b038c9fd-05dc-4113-9a31-3d2a7de26269" returned: 0 in 0.253s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:19:03 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-db098e1a-2569-4be8-b06c-f0dc3390a38a tempest-VolumesGetTest-1874363189 None] <== create_volume: return (761ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 10:19:03 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-db098e1a-2569-4be8-b06c-f0dc3390a38a tempest-VolumesGetTest-1874363189 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.764s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:19:03 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-f2964302-992f-47f0-affe-f0df386a9f4d tempest-VolumesSnapshotTestJSON-1835544826 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.831s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:19:03 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-db098e1a-2569-4be8-b06c-f0dc3390a38a tempest-VolumesGetTest-1874363189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3f769ee-e36d-46b6-a0e1-84b809359c6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b038c9fd-05dc-4113-9a31-3d2a7de26269', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:19:03 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-db098e1a-2569-4be8-b06c-f0dc3390a38a tempest-VolumesGetTest-1874363189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22d174e0-6fef-4cca-b61f-9cc7018afeb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:19:03 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-db098e1a-2569-4be8-b06c-f0dc3390a38a tempest-VolumesGetTest-1874363189 None] Volume volume-b038c9fd-05dc-4113-9a31-3d2a7de26269 (b038c9fd-05dc-4113-9a31-3d2a7de26269): created successfully Nov 04 10:19:03 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-db098e1a-2569-4be8-b06c-f0dc3390a38a tempest-VolumesGetTest-1874363189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22d174e0-6fef-4cca-b61f-9cc7018afeb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:19:03 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-db098e1a-2569-4be8-b06c-f0dc3390a38a tempest-VolumesGetTest-1874363189 None] Flow 'volume_create_manager' (5db06c53-ad12-44ab-abb8-8b000df9a5f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:19:03 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-f2964302-992f-47f0-affe-f0df386a9f4d tempest-VolumesSnapshotTestJSON-1835544826 None] Creating offline snapshot f2f486f8-cbf9-41f6-8de3-a83b39500b2d of volume de24b84a-f23b-4f28-9058-839ddac8809f {{(pid=87068) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 10:19:03 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-db098e1a-2569-4be8-b06c-f0dc3390a38a tempest-VolumesGetTest-1874363189 None] Created volume successfully. Nov 04 10:19:03 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[634cb9e4-f82d-4901-a883-3d11c0eba349]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:19:03 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-f4bc2c7b-1eee-4643-8a71-47006570bf61 tempest-VolumesTransfersTest-865839619 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:19:03 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-f4bc2c7b-1eee-4643-8a71-47006570bf61 tempest-VolumesTransfersTest-865839619 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:19:03 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-f4bc2c7b-1eee-4643-8a71-47006570bf61 tempest-VolumesTransfersTest-865839619 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:19:03 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-f4bc2c7b-1eee-4643-8a71-47006570bf61 tempest-VolumesTransfersTest-865839619 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:19:03 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-f4bc2c7b-1eee-4643-8a71-47006570bf61 tempest-VolumesTransfersTest-865839619 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:19:03 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f4bc2c7b-1eee-4643-8a71-47006570bf61 tempest-VolumesTransfersTest-865839619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:19:03 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f2964302-992f-47f0-affe-f0df386a9f4d tempest-VolumesSnapshotTestJSON-1835544826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-de24b84a-f23b-4f28-9058-839ddac8809f {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:19:03 devstack sudo[96219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:19:03 devstack sudo[96219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:19:03 devstack sudo[96220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-de24b84a-f23b-4f28-9058-839ddac8809f Nov 04 10:19:03 devstack sudo[96220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:19:04 devstack sudo[96219]: pam_unix(sudo:session): session closed for user root Nov 04 10:19:04 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f4bc2c7b-1eee-4643-8a71-47006570bf61 tempest-VolumesTransfersTest-865839619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.292s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:19:04 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-f4bc2c7b-1eee-4643-8a71-47006570bf61 tempest-VolumesTransfersTest-865839619 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:19:04 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-f4bc2c7b-1eee-4643-8a71-47006570bf61 tempest-VolumesTransfersTest-865839619 None] Deleted volume successfully. Nov 04 10:19:04 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-f4bc2c7b-1eee-4643-8a71-47006570bf61 tempest-VolumesTransfersTest-865839619 None] Lock "cinder-b64c7c49-db5e-4fb6-8ee2-85fa0f8983dc-delete_volume" released by "delete_volume" :: held 1.419s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:19:04 devstack sudo[96220]: pam_unix(sudo:session): session closed for user root Nov 04 10:19:04 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f2964302-992f-47f0-affe-f0df386a9f4d tempest-VolumesSnapshotTestJSON-1835544826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-de24b84a-f23b-4f28-9058-839ddac8809f" returned: 0 in 0.465s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:19:04 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f2964302-992f-47f0-affe-f0df386a9f4d tempest-VolumesSnapshotTestJSON-1835544826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-de24b84a-f23b-4f28-9058-839ddac8809f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-de24b84a-f23b-4f28-9058-839ddac8809f.f2f486f8-cbf9-41f6-8de3-a83b39500b2d 1G {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:19:04 devstack sudo[96228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-de24b84a-f23b-4f28-9058-839ddac8809f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-de24b84a-f23b-4f28-9058-839ddac8809f.f2f486f8-cbf9-41f6-8de3-a83b39500b2d 1G Nov 04 10:19:04 devstack sudo[96228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:19:04 devstack sudo[96228]: pam_unix(sudo:session): session closed for user root Nov 04 10:19:04 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f2964302-992f-47f0-affe-f0df386a9f4d tempest-VolumesSnapshotTestJSON-1835544826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-de24b84a-f23b-4f28-9058-839ddac8809f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-de24b84a-f23b-4f28-9058-839ddac8809f.f2f486f8-cbf9-41f6-8de3-a83b39500b2d 1G" returned: 0 in 0.487s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:19:04 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f2964302-992f-47f0-affe-f0df386a9f4d tempest-VolumesSnapshotTestJSON-1835544826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de24b84a-f23b-4f28-9058-839ddac8809f -F qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-de24b84a-f23b-4f28-9058-839ddac8809f.f2f486f8-cbf9-41f6-8de3-a83b39500b2d {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:19:04 devstack sudo[96234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de24b84a-f23b-4f28-9058-839ddac8809f -F qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-de24b84a-f23b-4f28-9058-839ddac8809f.f2f486f8-cbf9-41f6-8de3-a83b39500b2d Nov 04 10:19:04 devstack sudo[96234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:19:05 devstack sudo[96234]: pam_unix(sudo:session): session closed for user root Nov 04 10:19:05 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f2964302-992f-47f0-affe-f0df386a9f4d tempest-VolumesSnapshotTestJSON-1835544826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de24b84a-f23b-4f28-9058-839ddac8809f -F qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-de24b84a-f23b-4f28-9058-839ddac8809f.f2f486f8-cbf9-41f6-8de3-a83b39500b2d" returned: 0 in 0.435s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:19:05 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-f2964302-992f-47f0-affe-f0df386a9f4d tempest-VolumesSnapshotTestJSON-1835544826 None] /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-de24b84a-f23b-4f28-9058-839ddac8809f.f2f486f8-cbf9-41f6-8de3-a83b39500b2d is being set with open permissions: ugo+rw Nov 04 10:19:05 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f2964302-992f-47f0-affe-f0df386a9f4d tempest-VolumesSnapshotTestJSON-1835544826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-de24b84a-f23b-4f28-9058-839ddac8809f.f2f486f8-cbf9-41f6-8de3-a83b39500b2d {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:19:05 devstack sudo[96239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-de24b84a-f23b-4f28-9058-839ddac8809f.f2f486f8-cbf9-41f6-8de3-a83b39500b2d Nov 04 10:19:05 devstack sudo[96239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:19:05 devstack sudo[96239]: pam_unix(sudo:session): session closed for user root Nov 04 10:19:05 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f2964302-992f-47f0-affe-f0df386a9f4d tempest-VolumesSnapshotTestJSON-1835544826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-de24b84a-f23b-4f28-9058-839ddac8809f.f2f486f8-cbf9-41f6-8de3-a83b39500b2d" returned: 0 in 0.356s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:19:05 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f2964302-992f-47f0-affe-f0df386a9f4d tempest-VolumesSnapshotTestJSON-1835544826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-de24b84a-f23b-4f28-9058-839ddac8809f.info {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:19:05 devstack sudo[96244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-de24b84a-f23b-4f28-9058-839ddac8809f.info Nov 04 10:19:05 devstack sudo[96244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:19:05 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-452437f6-a67d-43fb-8c13-7f0be650ac2a tempest-VolumesGetTest-1874363189 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:19:05 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-452437f6-a67d-43fb-8c13-7f0be650ac2a tempest-VolumesGetTest-1874363189 None] Flow 'volume_create_manager' (919c54ea-aed3-436f-a985-8e2aba099e57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:19:05 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-452437f6-a67d-43fb-8c13-7f0be650ac2a tempest-VolumesGetTest-1874363189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec565082-6bd7-4ea1-8156-b076895e7064) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:19:06 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-452437f6-a67d-43fb-8c13-7f0be650ac2a tempest-VolumesGetTest-1874363189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec565082-6bd7-4ea1-8156-b076895e7064) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:19:06Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2105439931',display_name='tempest-VolumesGetTest-Volume-1593992431',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f043cfc-b27a-4d75-9d87-6395c165af58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1fb9cd956e4c4871af0e738ec6daa746',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:19:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:19:06Z,use_quota=True,user_id='95fe690f67df4d6f87922789a65a81d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:19:06 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-452437f6-a67d-43fb-8c13-7f0be650ac2a tempest-VolumesGetTest-1874363189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fe257f8-372a-44bc-a1bf-b7ea43f732da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:19:06 devstack sudo[96244]: pam_unix(sudo:session): session closed for user root Nov 04 10:19:06 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-452437f6-a67d-43fb-8c13-7f0be650ac2a tempest-VolumesGetTest-1874363189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fe257f8-372a-44bc-a1bf-b7ea43f732da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:19:06 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-452437f6-a67d-43fb-8c13-7f0be650ac2a tempest-VolumesGetTest-1874363189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a861a754-80bf-4272-a02c-29f69bf8af22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:19:06 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-452437f6-a67d-43fb-8c13-7f0be650ac2a tempest-VolumesGetTest-1874363189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a861a754-80bf-4272-a02c-29f69bf8af22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f043cfc-b27a-4d75-9d87-6395c165af58', 'volume_name': 'volume-3f043cfc-b27a-4d75-9d87-6395c165af58', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:19:06 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-452437f6-a67d-43fb-8c13-7f0be650ac2a tempest-VolumesGetTest-1874363189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18b9feed-b62b-439a-a52d-ca2b0dcfb160) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:19:06 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-452437f6-a67d-43fb-8c13-7f0be650ac2a tempest-VolumesGetTest-1874363189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18b9feed-b62b-439a-a52d-ca2b0dcfb160) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:19:06 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-452437f6-a67d-43fb-8c13-7f0be650ac2a tempest-VolumesGetTest-1874363189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b01be78-3f77-4c96-9b5b-d77ced737d6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:19:06 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-452437f6-a67d-43fb-8c13-7f0be650ac2a tempest-VolumesGetTest-1874363189 None] Volume 3f043cfc-b27a-4d75-9d87-6395c165af58: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f043cfc-b27a-4d75-9d87-6395c165af58', 'volume_size': 1} Nov 04 10:19:06 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-452437f6-a67d-43fb-8c13-7f0be650ac2a tempest-VolumesGetTest-1874363189 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:19:06 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f2964302-992f-47f0-affe-f0df386a9f4d tempest-VolumesSnapshotTestJSON-1835544826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-de24b84a-f23b-4f28-9058-839ddac8809f.info" returned: 0 in 0.405s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:19:06 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-f2964302-992f-47f0-affe-f0df386a9f4d tempest-VolumesSnapshotTestJSON-1835544826 None] /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-de24b84a-f23b-4f28-9058-839ddac8809f.info is being set with open permissions: ugo+rw Nov 04 10:19:06 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f2964302-992f-47f0-affe-f0df386a9f4d tempest-VolumesSnapshotTestJSON-1835544826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-de24b84a-f23b-4f28-9058-839ddac8809f.info {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:19:06 devstack sudo[96250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-de24b84a-f23b-4f28-9058-839ddac8809f.info Nov 04 10:19:06 devstack sudo[96250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:19:06 devstack sudo[96250]: pam_unix(sudo:session): session closed for user root Nov 04 10:19:06 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f2964302-992f-47f0-affe-f0df386a9f4d tempest-VolumesSnapshotTestJSON-1835544826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-de24b84a-f23b-4f28-9058-839ddac8809f.info" returned: 0 in 0.294s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:19:06 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-f2964302-992f-47f0-affe-f0df386a9f4d tempest-VolumesSnapshotTestJSON-1835544826 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.719s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:19:06 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-452437f6-a67d-43fb-8c13-7f0be650ac2a tempest-VolumesGetTest-1874363189 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.334s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:19:06 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-452437f6-a67d-43fb-8c13-7f0be650ac2a tempest-VolumesGetTest-1874363189 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:19:06Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2105439931',display_name='tempest-VolumesGetTest-Volume-1593992431',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f043cfc-b27a-4d75-9d87-6395c165af58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1fb9cd956e4c4871af0e738ec6daa746',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:19:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:19:06Z,use_quota=True,user_id='95fe690f67df4d6f87922789a65a81d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 10:19:06 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-452437f6-a67d-43fb-8c13-7f0be650ac2a tempest-VolumesGetTest-1874363189 None] Creating volume 3f043cfc-b27a-4d75-9d87-6395c165af58 {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:19:06 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-452437f6-a67d-43fb-8c13-7f0be650ac2a tempest-VolumesGetTest-1874363189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:19:06 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-452437f6-a67d-43fb-8c13-7f0be650ac2a tempest-VolumesGetTest-1874363189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:19:06 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-452437f6-a67d-43fb-8c13-7f0be650ac2a tempest-VolumesGetTest-1874363189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:19:06 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-452437f6-a67d-43fb-8c13-7f0be650ac2a tempest-VolumesGetTest-1874363189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:19:06 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-452437f6-a67d-43fb-8c13-7f0be650ac2a tempest-VolumesGetTest-1874363189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:19:06 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-452437f6-a67d-43fb-8c13-7f0be650ac2a tempest-VolumesGetTest-1874363189 None] Selected osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:19:06 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-452437f6-a67d-43fb-8c13-7f0be650ac2a tempest-VolumesGetTest-1874363189 None] casted to osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 Nov 04 10:19:06 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-452437f6-a67d-43fb-8c13-7f0be650ac2a tempest-VolumesGetTest-1874363189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-3f043cfc-b27a-4d75-9d87-6395c165af58 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:19:06 devstack sudo[96260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-3f043cfc-b27a-4d75-9d87-6395c165af58 1073741824 Nov 04 10:19:06 devstack sudo[96260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:19:06 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-f2964302-992f-47f0-affe-f0df386a9f4d tempest-VolumesSnapshotTestJSON-1835544826 None] Create snapshot completed successfully Nov 04 10:19:06 devstack sudo[96260]: pam_unix(sudo:session): session closed for user root Nov 04 10:19:06 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-452437f6-a67d-43fb-8c13-7f0be650ac2a tempest-VolumesGetTest-1874363189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-3f043cfc-b27a-4d75-9d87-6395c165af58 1073741824" returned: 0 in 0.559s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:19:07 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-452437f6-a67d-43fb-8c13-7f0be650ac2a tempest-VolumesGetTest-1874363189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-3f043cfc-b27a-4d75-9d87-6395c165af58 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:19:07 devstack sudo[96266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-3f043cfc-b27a-4d75-9d87-6395c165af58 Nov 04 10:19:07 devstack sudo[96266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:19:07 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-3016b9a4-da7e-418b-b9c2-ffcec8b77997 tempest-VolumesSnapshotTestJSON-1835544826 None] Acquiring lock "cinder-f2f486f8-cbf9-41f6-8de3-a83b39500b2d-delete_snapshot" by "delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:19:07 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-3016b9a4-da7e-418b-b9c2-ffcec8b77997 tempest-VolumesSnapshotTestJSON-1835544826 None] Lock "cinder-f2f486f8-cbf9-41f6-8de3-a83b39500b2d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:19:07 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-3016b9a4-da7e-418b-b9c2-ffcec8b77997 tempest-VolumesSnapshotTestJSON-1835544826 None] Acquiring lock "cinder-quobyte-de24b84a-f23b-4f28-9058-839ddac8809f" by "delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:19:07 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-3016b9a4-da7e-418b-b9c2-ffcec8b77997 tempest-VolumesSnapshotTestJSON-1835544826 None] Lock "cinder-quobyte-de24b84a-f23b-4f28-9058-839ddac8809f" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:19:07 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-3016b9a4-da7e-418b-b9c2-ffcec8b77997 tempest-VolumesSnapshotTestJSON-1835544826 None] Acquiring lock "cinder-quobyte-f2f486f8-cbf9-41f6-8de3-a83b39500b2d" by "_delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:19:07 devstack sudo[96266]: pam_unix(sudo:session): session closed for user root Nov 04 10:19:07 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-452437f6-a67d-43fb-8c13-7f0be650ac2a tempest-VolumesGetTest-1874363189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-3f043cfc-b27a-4d75-9d87-6395c165af58" returned: 0 in 0.406s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:19:07 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-452437f6-a67d-43fb-8c13-7f0be650ac2a tempest-VolumesGetTest-1874363189 None] <== create_volume: return (1050ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 10:19:07 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-452437f6-a67d-43fb-8c13-7f0be650ac2a tempest-VolumesGetTest-1874363189 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.053s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:19:07 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-452437f6-a67d-43fb-8c13-7f0be650ac2a tempest-VolumesGetTest-1874363189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b01be78-3f77-4c96-9b5b-d77ced737d6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f043cfc-b27a-4d75-9d87-6395c165af58', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:19:07 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-452437f6-a67d-43fb-8c13-7f0be650ac2a tempest-VolumesGetTest-1874363189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14e815c2-09c9-4860-978a-04f347f821f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:19:07 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-3016b9a4-da7e-418b-b9c2-ffcec8b77997 tempest-VolumesSnapshotTestJSON-1835544826 None] Lock "cinder-quobyte-f2f486f8-cbf9-41f6-8de3-a83b39500b2d" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:19:07 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-3016b9a4-da7e-418b-b9c2-ffcec8b77997 tempest-VolumesSnapshotTestJSON-1835544826 None] Deleting offline snapshot f2f486f8-cbf9-41f6-8de3-a83b39500b2d of volume de24b84a-f23b-4f28-9058-839ddac8809f {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 10:19:07 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-3016b9a4-da7e-418b-b9c2-ffcec8b77997 tempest-VolumesSnapshotTestJSON-1835544826 None] snapshot_file for this snap is: volume-de24b84a-f23b-4f28-9058-839ddac8809f.f2f486f8-cbf9-41f6-8de3-a83b39500b2d {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 10:19:07 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-452437f6-a67d-43fb-8c13-7f0be650ac2a tempest-VolumesGetTest-1874363189 None] Volume volume-3f043cfc-b27a-4d75-9d87-6395c165af58 (3f043cfc-b27a-4d75-9d87-6395c165af58): created successfully Nov 04 10:19:07 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-452437f6-a67d-43fb-8c13-7f0be650ac2a tempest-VolumesGetTest-1874363189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14e815c2-09c9-4860-978a-04f347f821f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:19:07 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-452437f6-a67d-43fb-8c13-7f0be650ac2a tempest-VolumesGetTest-1874363189 None] Flow 'volume_create_manager' (919c54ea-aed3-436f-a985-8e2aba099e57) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:19:07 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[a10f3033-d394-4f72-94e7-399cfa36c2e9]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:19:07 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-3016b9a4-da7e-418b-b9c2-ffcec8b77997 tempest-VolumesSnapshotTestJSON-1835544826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-de24b84a-f23b-4f28-9058-839ddac8809f.f2f486f8-cbf9-41f6-8de3-a83b39500b2d {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:19:07 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-452437f6-a67d-43fb-8c13-7f0be650ac2a tempest-VolumesGetTest-1874363189 None] Created volume successfully. Nov 04 10:19:07 devstack sudo[96269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-de24b84a-f23b-4f28-9058-839ddac8809f.f2f486f8-cbf9-41f6-8de3-a83b39500b2d Nov 04 10:19:07 devstack sudo[96269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:19:08 devstack sudo[96269]: pam_unix(sudo:session): session closed for user root Nov 04 10:19:08 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-3016b9a4-da7e-418b-b9c2-ffcec8b77997 tempest-VolumesSnapshotTestJSON-1835544826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-de24b84a-f23b-4f28-9058-839ddac8809f.f2f486f8-cbf9-41f6-8de3-a83b39500b2d" returned: 0 in 0.486s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:19:08 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-3016b9a4-da7e-418b-b9c2-ffcec8b77997 tempest-VolumesSnapshotTestJSON-1835544826 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-de24b84a-f23b-4f28-9058-839ddac8809f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87068) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 10:19:08 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[112a5fcb-451d-478b-b728-31c5bc0e5ad3]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:19:08 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-3016b9a4-da7e-418b-b9c2-ffcec8b77997 tempest-VolumesSnapshotTestJSON-1835544826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-de24b84a-f23b-4f28-9058-839ddac8809f {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:19:08 devstack sudo[96275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-de24b84a-f23b-4f28-9058-839ddac8809f Nov 04 10:19:08 devstack sudo[96275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:19:08 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-436ec061-0274-4b68-96b6-4940ec1a2037 tempest-VolumesGetTest-1874363189 None] Acquiring lock "cinder-3f043cfc-b27a-4d75-9d87-6395c165af58-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:19:08 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-436ec061-0274-4b68-96b6-4940ec1a2037 tempest-VolumesGetTest-1874363189 None] Lock "cinder-3f043cfc-b27a-4d75-9d87-6395c165af58-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:19:08 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-436ec061-0274-4b68-96b6-4940ec1a2037 tempest-VolumesGetTest-1874363189 None] Acquiring lock "cinder-quobyte-3f043cfc-b27a-4d75-9d87-6395c165af58" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:19:08 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-436ec061-0274-4b68-96b6-4940ec1a2037 tempest-VolumesGetTest-1874363189 None] Lock "cinder-quobyte-3f043cfc-b27a-4d75-9d87-6395c165af58" acquired by "delete_volume" :: waited 0.031s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:19:08 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe6bb5af-4dc2-48a8-9d61-0bec4468402c]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:19:08 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-436ec061-0274-4b68-96b6-4940ec1a2037 tempest-VolumesGetTest-1874363189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-3f043cfc-b27a-4d75-9d87-6395c165af58 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:19:08 devstack sudo[96275]: pam_unix(sudo:session): session closed for user root Nov 04 10:19:08 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-3016b9a4-da7e-418b-b9c2-ffcec8b77997 tempest-VolumesSnapshotTestJSON-1835544826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-de24b84a-f23b-4f28-9058-839ddac8809f" returned: 0 in 0.562s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:19:08 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-3016b9a4-da7e-418b-b9c2-ffcec8b77997 tempest-VolumesSnapshotTestJSON-1835544826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-de24b84a-f23b-4f28-9058-839ddac8809f.f2f486f8-cbf9-41f6-8de3-a83b39500b2d {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:19:08 devstack sudo[96281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-de24b84a-f23b-4f28-9058-839ddac8809f.f2f486f8-cbf9-41f6-8de3-a83b39500b2d Nov 04 10:19:08 devstack sudo[96281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:19:08 devstack sudo[96280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-3f043cfc-b27a-4d75-9d87-6395c165af58 Nov 04 10:19:08 devstack sudo[96280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:19:08 devstack sudo[96280]: pam_unix(sudo:session): session closed for user root Nov 04 10:19:08 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-436ec061-0274-4b68-96b6-4940ec1a2037 tempest-VolumesGetTest-1874363189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-3f043cfc-b27a-4d75-9d87-6395c165af58" returned: 0 in 0.477s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:19:08 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-436ec061-0274-4b68-96b6-4940ec1a2037 tempest-VolumesGetTest-1874363189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-3f043cfc-b27a-4d75-9d87-6395c165af58 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:19:09 devstack sudo[96290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-3f043cfc-b27a-4d75-9d87-6395c165af58 Nov 04 10:19:09 devstack sudo[96290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:19:09 devstack sudo[96281]: pam_unix(sudo:session): session closed for user root Nov 04 10:19:09 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-3016b9a4-da7e-418b-b9c2-ffcec8b77997 tempest-VolumesSnapshotTestJSON-1835544826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-de24b84a-f23b-4f28-9058-839ddac8809f.f2f486f8-cbf9-41f6-8de3-a83b39500b2d" returned: 0 in 0.429s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:19:09 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-3016b9a4-da7e-418b-b9c2-ffcec8b77997 tempest-VolumesSnapshotTestJSON-1835544826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-de24b84a-f23b-4f28-9058-839ddac8809f.f2f486f8-cbf9-41f6-8de3-a83b39500b2d {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:19:09 devstack sudo[96292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-de24b84a-f23b-4f28-9058-839ddac8809f.f2f486f8-cbf9-41f6-8de3-a83b39500b2d Nov 04 10:19:09 devstack sudo[96292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:19:09 devstack sudo[96292]: pam_unix(sudo:session): session closed for user root Nov 04 10:19:09 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-3016b9a4-da7e-418b-b9c2-ffcec8b77997 tempest-VolumesSnapshotTestJSON-1835544826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-de24b84a-f23b-4f28-9058-839ddac8809f.f2f486f8-cbf9-41f6-8de3-a83b39500b2d" returned: 0 in 0.317s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:19:09 devstack sudo[96290]: pam_unix(sudo:session): session closed for user root Nov 04 10:19:09 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-436ec061-0274-4b68-96b6-4940ec1a2037 tempest-VolumesGetTest-1874363189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-3f043cfc-b27a-4d75-9d87-6395c165af58" returned: 0 in 0.402s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:19:09 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-436ec061-0274-4b68-96b6-4940ec1a2037 tempest-VolumesGetTest-1874363189 None] Lock "cinder-quobyte-3f043cfc-b27a-4d75-9d87-6395c165af58" released by "delete_volume" :: held 0.969s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:19:09 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-3016b9a4-da7e-418b-b9c2-ffcec8b77997 tempest-VolumesSnapshotTestJSON-1835544826 None] Lock "cinder-quobyte-f2f486f8-cbf9-41f6-8de3-a83b39500b2d" released by "_delete_snapshot" :: held 2.012s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:19:09 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-3016b9a4-da7e-418b-b9c2-ffcec8b77997 tempest-VolumesSnapshotTestJSON-1835544826 None] Lock "cinder-quobyte-de24b84a-f23b-4f28-9058-839ddac8809f" released by "delete_snapshot" :: held 2.069s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:19:09 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-436ec061-0274-4b68-96b6-4940ec1a2037 tempest-VolumesGetTest-1874363189 None] Created reservations ['a59592ec-9fcf-4c4c-b01c-ce8577e10881', 'b482fd3f-765f-40b7-ba1f-e4e066b8530a', 'dd30bcfa-206f-4a86-baf0-0a4e38c18443', 'd354cbd3-9398-404c-829b-e0bf4f6876c6'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:19:09 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-3016b9a4-da7e-418b-b9c2-ffcec8b77997 tempest-VolumesSnapshotTestJSON-1835544826 None] Created reservations ['4eab2d4d-8606-4152-9e39-2b3096c59964', '02f22371-4caa-4371-8c42-07ca9e1f2042', '60e29371-8bc3-414b-bc30-55b135577a9c', 'b1635fc8-5d96-41b7-8ceb-dd59d8f7e205'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:19:09 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-436ec061-0274-4b68-96b6-4940ec1a2037 tempest-VolumesGetTest-1874363189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:19:09 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-436ec061-0274-4b68-96b6-4940ec1a2037 tempest-VolumesGetTest-1874363189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:19:09 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-436ec061-0274-4b68-96b6-4940ec1a2037 tempest-VolumesGetTest-1874363189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:19:09 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-436ec061-0274-4b68-96b6-4940ec1a2037 tempest-VolumesGetTest-1874363189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:19:09 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-436ec061-0274-4b68-96b6-4940ec1a2037 tempest-VolumesGetTest-1874363189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:19:09 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-436ec061-0274-4b68-96b6-4940ec1a2037 tempest-VolumesGetTest-1874363189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:19:09 devstack sudo[96296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:19:09 devstack sudo[96296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:19:09 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-3016b9a4-da7e-418b-b9c2-ffcec8b77997 tempest-VolumesSnapshotTestJSON-1835544826 None] Delete snapshot completed successfully. Nov 04 10:19:09 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-3016b9a4-da7e-418b-b9c2-ffcec8b77997 tempest-VolumesSnapshotTestJSON-1835544826 None] Lock "cinder-f2f486f8-cbf9-41f6-8de3-a83b39500b2d-delete_snapshot" released by "delete_snapshot" :: held 2.447s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:19:10 devstack sudo[96296]: pam_unix(sudo:session): session closed for user root Nov 04 10:19:10 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-436ec061-0274-4b68-96b6-4940ec1a2037 tempest-VolumesGetTest-1874363189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.386s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:19:10 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-436ec061-0274-4b68-96b6-4940ec1a2037 tempest-VolumesGetTest-1874363189 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:19:10 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-436ec061-0274-4b68-96b6-4940ec1a2037 tempest-VolumesGetTest-1874363189 None] Deleted volume successfully. Nov 04 10:19:10 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-436ec061-0274-4b68-96b6-4940ec1a2037 tempest-VolumesGetTest-1874363189 None] Lock "cinder-3f043cfc-b27a-4d75-9d87-6395c165af58-delete_volume" released by "delete_volume" :: held 1.845s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:19:10 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-38d145a1-b102-45df-84b2-8d906a40a8c8 tempest-VolumesGetTest-1874363189 None] Acquiring lock "cinder-b038c9fd-05dc-4113-9a31-3d2a7de26269-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:19:10 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-38d145a1-b102-45df-84b2-8d906a40a8c8 tempest-VolumesGetTest-1874363189 None] Lock "cinder-b038c9fd-05dc-4113-9a31-3d2a7de26269-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:19:10 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-38d145a1-b102-45df-84b2-8d906a40a8c8 tempest-VolumesGetTest-1874363189 None] Acquiring lock "cinder-quobyte-b038c9fd-05dc-4113-9a31-3d2a7de26269" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:19:10 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-38d145a1-b102-45df-84b2-8d906a40a8c8 tempest-VolumesGetTest-1874363189 None] Lock "cinder-quobyte-b038c9fd-05dc-4113-9a31-3d2a7de26269" acquired by "delete_volume" :: waited 0.024s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:19:10 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[39db8a23-6e54-45fe-bf52-2fb2cb9080f5]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:19:10 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-38d145a1-b102-45df-84b2-8d906a40a8c8 tempest-VolumesGetTest-1874363189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b038c9fd-05dc-4113-9a31-3d2a7de26269 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:19:11 devstack sudo[96300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b038c9fd-05dc-4113-9a31-3d2a7de26269 Nov 04 10:19:11 devstack sudo[96300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:19:11 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-36197c77-36c2-47c1-9efa-cdb99373e0a9 tempest-VolumesSnapshotTestJSON-1835544826 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:19:11 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-36197c77-36c2-47c1-9efa-cdb99373e0a9 tempest-VolumesSnapshotTestJSON-1835544826 None] Flow 'volume_create_manager' (bcca77de-b802-4a88-80b2-1cf8d1ff1202) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:19:11 devstack sudo[96300]: pam_unix(sudo:session): session closed for user root Nov 04 10:19:11 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-36197c77-36c2-47c1-9efa-cdb99373e0a9 tempest-VolumesSnapshotTestJSON-1835544826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (632a6ff5-c722-4d23-b713-42aee6396030) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:19:11 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-38d145a1-b102-45df-84b2-8d906a40a8c8 tempest-VolumesGetTest-1874363189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b038c9fd-05dc-4113-9a31-3d2a7de26269" returned: 0 in 0.590s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:19:11 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-38d145a1-b102-45df-84b2-8d906a40a8c8 tempest-VolumesGetTest-1874363189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b038c9fd-05dc-4113-9a31-3d2a7de26269 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:19:11 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-36197c77-36c2-47c1-9efa-cdb99373e0a9 tempest-VolumesSnapshotTestJSON-1835544826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (632a6ff5-c722-4d23-b713-42aee6396030) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:19:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-548885716',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb9258e0-0481-4295-805c-40a88e46fc53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c119592eb9b94d74ad294736ec076621',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:19:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:19:11Z,use_quota=True,user_id='1810941f24e64a14ad02f068e0d989ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:19:11 devstack sudo[96306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b038c9fd-05dc-4113-9a31-3d2a7de26269 Nov 04 10:19:11 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-36197c77-36c2-47c1-9efa-cdb99373e0a9 tempest-VolumesSnapshotTestJSON-1835544826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ee433d0-1052-4887-9921-9a23a43c5f04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:19:11 devstack sudo[96306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:19:11 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-36197c77-36c2-47c1-9efa-cdb99373e0a9 tempest-VolumesSnapshotTestJSON-1835544826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ee433d0-1052-4887-9921-9a23a43c5f04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:19:11 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-36197c77-36c2-47c1-9efa-cdb99373e0a9 tempest-VolumesSnapshotTestJSON-1835544826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10479ce7-a14b-4219-8ab4-ccecb0cad106) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:19:11 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-36197c77-36c2-47c1-9efa-cdb99373e0a9 tempest-VolumesSnapshotTestJSON-1835544826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10479ce7-a14b-4219-8ab4-ccecb0cad106) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb9258e0-0481-4295-805c-40a88e46fc53', 'volume_name': 'volume-cb9258e0-0481-4295-805c-40a88e46fc53', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:19:11 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-36197c77-36c2-47c1-9efa-cdb99373e0a9 tempest-VolumesSnapshotTestJSON-1835544826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efc60f32-fa92-4a67-b958-3806822ffdb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:19:11 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-36197c77-36c2-47c1-9efa-cdb99373e0a9 tempest-VolumesSnapshotTestJSON-1835544826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efc60f32-fa92-4a67-b958-3806822ffdb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:19:11 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-36197c77-36c2-47c1-9efa-cdb99373e0a9 tempest-VolumesSnapshotTestJSON-1835544826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0ad5f8c-65a6-4a96-9e73-8e76cc01e9ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:19:11 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-36197c77-36c2-47c1-9efa-cdb99373e0a9 tempest-VolumesSnapshotTestJSON-1835544826 None] Volume cb9258e0-0481-4295-805c-40a88e46fc53: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb9258e0-0481-4295-805c-40a88e46fc53', 'volume_size': 1} Nov 04 10:19:11 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-36197c77-36c2-47c1-9efa-cdb99373e0a9 tempest-VolumesSnapshotTestJSON-1835544826 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:19:11 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-36197c77-36c2-47c1-9efa-cdb99373e0a9 tempest-VolumesSnapshotTestJSON-1835544826 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:19:11 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-36197c77-36c2-47c1-9efa-cdb99373e0a9 tempest-VolumesSnapshotTestJSON-1835544826 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:19:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-548885716',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb9258e0-0481-4295-805c-40a88e46fc53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c119592eb9b94d74ad294736ec076621',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:19:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:19:11Z,use_quota=True,user_id='1810941f24e64a14ad02f068e0d989ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 10:19:11 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-36197c77-36c2-47c1-9efa-cdb99373e0a9 tempest-VolumesSnapshotTestJSON-1835544826 None] Creating volume cb9258e0-0481-4295-805c-40a88e46fc53 {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:19:11 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-36197c77-36c2-47c1-9efa-cdb99373e0a9 tempest-VolumesSnapshotTestJSON-1835544826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:19:11 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-36197c77-36c2-47c1-9efa-cdb99373e0a9 tempest-VolumesSnapshotTestJSON-1835544826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:19:11 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-36197c77-36c2-47c1-9efa-cdb99373e0a9 tempest-VolumesSnapshotTestJSON-1835544826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:19:11 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-36197c77-36c2-47c1-9efa-cdb99373e0a9 tempest-VolumesSnapshotTestJSON-1835544826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:19:11 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-36197c77-36c2-47c1-9efa-cdb99373e0a9 tempest-VolumesSnapshotTestJSON-1835544826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:19:11 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-36197c77-36c2-47c1-9efa-cdb99373e0a9 tempest-VolumesSnapshotTestJSON-1835544826 None] Selected osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:19:11 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-36197c77-36c2-47c1-9efa-cdb99373e0a9 tempest-VolumesSnapshotTestJSON-1835544826 None] casted to osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 Nov 04 10:19:11 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-36197c77-36c2-47c1-9efa-cdb99373e0a9 tempest-VolumesSnapshotTestJSON-1835544826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-cb9258e0-0481-4295-805c-40a88e46fc53 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:19:11 devstack sudo[96308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-cb9258e0-0481-4295-805c-40a88e46fc53 1073741824 Nov 04 10:19:11 devstack sudo[96308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:19:11 devstack sudo[96306]: pam_unix(sudo:session): session closed for user root Nov 04 10:19:11 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-38d145a1-b102-45df-84b2-8d906a40a8c8 tempest-VolumesGetTest-1874363189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b038c9fd-05dc-4113-9a31-3d2a7de26269" returned: 0 in 0.309s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:19:11 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-38d145a1-b102-45df-84b2-8d906a40a8c8 tempest-VolumesGetTest-1874363189 None] Lock "cinder-quobyte-b038c9fd-05dc-4113-9a31-3d2a7de26269" released by "delete_volume" :: held 0.971s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:19:11 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-38d145a1-b102-45df-84b2-8d906a40a8c8 tempest-VolumesGetTest-1874363189 None] Created reservations ['f01af44e-570a-450d-ab1c-8291bfee223b', '292c1040-23f8-4497-8666-f170cfb19767', 'f684c146-d05b-4426-9455-e2307c6d2fe4', '5a8f43d7-e348-43b1-9fc5-72ba0647bb4d'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:19:11 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-38d145a1-b102-45df-84b2-8d906a40a8c8 tempest-VolumesGetTest-1874363189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:19:11 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-38d145a1-b102-45df-84b2-8d906a40a8c8 tempest-VolumesGetTest-1874363189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:19:11 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-38d145a1-b102-45df-84b2-8d906a40a8c8 tempest-VolumesGetTest-1874363189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:19:11 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-38d145a1-b102-45df-84b2-8d906a40a8c8 tempest-VolumesGetTest-1874363189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:19:11 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-38d145a1-b102-45df-84b2-8d906a40a8c8 tempest-VolumesGetTest-1874363189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:19:11 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-38d145a1-b102-45df-84b2-8d906a40a8c8 tempest-VolumesGetTest-1874363189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:19:12 devstack sudo[96316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:19:12 devstack sudo[96316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:19:12 devstack sudo[96308]: pam_unix(sudo:session): session closed for user root Nov 04 10:19:12 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-36197c77-36c2-47c1-9efa-cdb99373e0a9 tempest-VolumesSnapshotTestJSON-1835544826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-cb9258e0-0481-4295-805c-40a88e46fc53 1073741824" returned: 0 in 0.756s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:19:12 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-36197c77-36c2-47c1-9efa-cdb99373e0a9 tempest-VolumesSnapshotTestJSON-1835544826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-cb9258e0-0481-4295-805c-40a88e46fc53 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:19:12 devstack sudo[96316]: pam_unix(sudo:session): session closed for user root Nov 04 10:19:12 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-38d145a1-b102-45df-84b2-8d906a40a8c8 tempest-VolumesGetTest-1874363189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.422s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:19:12 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-38d145a1-b102-45df-84b2-8d906a40a8c8 tempest-VolumesGetTest-1874363189 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:19:12 devstack sudo[96322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-cb9258e0-0481-4295-805c-40a88e46fc53 Nov 04 10:19:12 devstack sudo[96322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:19:12 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-38d145a1-b102-45df-84b2-8d906a40a8c8 tempest-VolumesGetTest-1874363189 None] Deleted volume successfully. Nov 04 10:19:12 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-38d145a1-b102-45df-84b2-8d906a40a8c8 tempest-VolumesGetTest-1874363189 None] Lock "cinder-b038c9fd-05dc-4113-9a31-3d2a7de26269-delete_volume" released by "delete_volume" :: held 1.769s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:19:12 devstack sudo[96322]: pam_unix(sudo:session): session closed for user root Nov 04 10:19:12 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-36197c77-36c2-47c1-9efa-cdb99373e0a9 tempest-VolumesSnapshotTestJSON-1835544826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-cb9258e0-0481-4295-805c-40a88e46fc53" returned: 0 in 0.447s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:19:12 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-36197c77-36c2-47c1-9efa-cdb99373e0a9 tempest-VolumesSnapshotTestJSON-1835544826 None] <== create_volume: return (1292ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 10:19:12 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-36197c77-36c2-47c1-9efa-cdb99373e0a9 tempest-VolumesSnapshotTestJSON-1835544826 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.295s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:19:12 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-36197c77-36c2-47c1-9efa-cdb99373e0a9 tempest-VolumesSnapshotTestJSON-1835544826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0ad5f8c-65a6-4a96-9e73-8e76cc01e9ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb9258e0-0481-4295-805c-40a88e46fc53', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:19:12 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-36197c77-36c2-47c1-9efa-cdb99373e0a9 tempest-VolumesSnapshotTestJSON-1835544826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4b607b0-e60a-4c79-9619-96f12c0bda31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:19:12 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-36197c77-36c2-47c1-9efa-cdb99373e0a9 tempest-VolumesSnapshotTestJSON-1835544826 None] Volume volume-cb9258e0-0481-4295-805c-40a88e46fc53 (cb9258e0-0481-4295-805c-40a88e46fc53): created successfully Nov 04 10:19:12 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-36197c77-36c2-47c1-9efa-cdb99373e0a9 tempest-VolumesSnapshotTestJSON-1835544826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4b607b0-e60a-4c79-9619-96f12c0bda31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:19:12 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-36197c77-36c2-47c1-9efa-cdb99373e0a9 tempest-VolumesSnapshotTestJSON-1835544826 None] Flow 'volume_create_manager' (bcca77de-b802-4a88-80b2-1cf8d1ff1202) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:19:12 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-36197c77-36c2-47c1-9efa-cdb99373e0a9 tempest-VolumesSnapshotTestJSON-1835544826 None] Created volume successfully. Nov 04 10:19:13 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-0646d0eb-6f95-4c8b-b265-0523e235f7fc tempest-VolumesGetTest-1874363189 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:19:13 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-0646d0eb-6f95-4c8b-b265-0523e235f7fc tempest-VolumesGetTest-1874363189 None] Flow 'volume_create_manager' (ed1f4bc3-dae0-4e54-9663-db271e4ffbe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:19:13 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-0646d0eb-6f95-4c8b-b265-0523e235f7fc tempest-VolumesGetTest-1874363189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38026d54-86ab-4b73-b26f-dfdbbc78742e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:19:13 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-0646d0eb-6f95-4c8b-b265-0523e235f7fc tempest-VolumesGetTest-1874363189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38026d54-86ab-4b73-b26f-dfdbbc78742e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:19:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1616447713',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fcd8200-de7b-40f6-b478-0840d62320e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1fb9cd956e4c4871af0e738ec6daa746',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:19:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:19:14Z,use_quota=True,user_id='95fe690f67df4d6f87922789a65a81d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:19:13 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-0646d0eb-6f95-4c8b-b265-0523e235f7fc tempest-VolumesGetTest-1874363189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c3196d7-6ea7-4082-96a0-1edaedf964dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:19:13 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-0646d0eb-6f95-4c8b-b265-0523e235f7fc tempest-VolumesGetTest-1874363189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c3196d7-6ea7-4082-96a0-1edaedf964dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:19:13 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-0646d0eb-6f95-4c8b-b265-0523e235f7fc tempest-VolumesGetTest-1874363189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54f27917-cf15-4b5d-a914-de51860af7db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:19:13 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-0646d0eb-6f95-4c8b-b265-0523e235f7fc tempest-VolumesGetTest-1874363189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54f27917-cf15-4b5d-a914-de51860af7db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8fcd8200-de7b-40f6-b478-0840d62320e2', 'volume_name': 'volume-8fcd8200-de7b-40f6-b478-0840d62320e2', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:19:13 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-0646d0eb-6f95-4c8b-b265-0523e235f7fc tempest-VolumesGetTest-1874363189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bba35959-59cf-4b2e-bb09-99549f7a8ede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:19:13 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-0646d0eb-6f95-4c8b-b265-0523e235f7fc tempest-VolumesGetTest-1874363189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bba35959-59cf-4b2e-bb09-99549f7a8ede) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:19:13 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-0646d0eb-6f95-4c8b-b265-0523e235f7fc tempest-VolumesGetTest-1874363189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e0dabac-7ce7-4151-861a-de13d7a40a63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:19:13 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-0646d0eb-6f95-4c8b-b265-0523e235f7fc tempest-VolumesGetTest-1874363189 None] Volume 8fcd8200-de7b-40f6-b478-0840d62320e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8fcd8200-de7b-40f6-b478-0840d62320e2', 'volume_size': 1} Nov 04 10:19:13 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-0646d0eb-6f95-4c8b-b265-0523e235f7fc tempest-VolumesGetTest-1874363189 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:19:13 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-0646d0eb-6f95-4c8b-b265-0523e235f7fc tempest-VolumesGetTest-1874363189 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:19:13 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-0646d0eb-6f95-4c8b-b265-0523e235f7fc tempest-VolumesGetTest-1874363189 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:19:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1616447713',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fcd8200-de7b-40f6-b478-0840d62320e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1fb9cd956e4c4871af0e738ec6daa746',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:19:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:19:14Z,use_quota=True,user_id='95fe690f67df4d6f87922789a65a81d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 10:19:13 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-0646d0eb-6f95-4c8b-b265-0523e235f7fc tempest-VolumesGetTest-1874363189 None] Creating volume 8fcd8200-de7b-40f6-b478-0840d62320e2 {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:19:13 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-0646d0eb-6f95-4c8b-b265-0523e235f7fc tempest-VolumesGetTest-1874363189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:19:13 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-0646d0eb-6f95-4c8b-b265-0523e235f7fc tempest-VolumesGetTest-1874363189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:19:13 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-0646d0eb-6f95-4c8b-b265-0523e235f7fc tempest-VolumesGetTest-1874363189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:19:13 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-0646d0eb-6f95-4c8b-b265-0523e235f7fc tempest-VolumesGetTest-1874363189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:19:13 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-0646d0eb-6f95-4c8b-b265-0523e235f7fc tempest-VolumesGetTest-1874363189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:19:13 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-0646d0eb-6f95-4c8b-b265-0523e235f7fc tempest-VolumesGetTest-1874363189 None] Selected osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:19:13 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-0646d0eb-6f95-4c8b-b265-0523e235f7fc tempest-VolumesGetTest-1874363189 None] casted to osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 Nov 04 10:19:13 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-0646d0eb-6f95-4c8b-b265-0523e235f7fc tempest-VolumesGetTest-1874363189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-8fcd8200-de7b-40f6-b478-0840d62320e2 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:19:13 devstack sudo[96341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-8fcd8200-de7b-40f6-b478-0840d62320e2 1073741824 Nov 04 10:19:13 devstack sudo[96341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:19:13 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-22fc1815-a20c-4e04-9364-58cbe23ba10b tempest-VolumesSnapshotTestJSON-1835544826 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:19:14 devstack sudo[96341]: pam_unix(sudo:session): session closed for user root Nov 04 10:19:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-0646d0eb-6f95-4c8b-b265-0523e235f7fc tempest-VolumesGetTest-1874363189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-8fcd8200-de7b-40f6-b478-0840d62320e2 1073741824" returned: 0 in 0.561s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:19:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-0646d0eb-6f95-4c8b-b265-0523e235f7fc tempest-VolumesGetTest-1874363189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-8fcd8200-de7b-40f6-b478-0840d62320e2 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:19:14 devstack sudo[96347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-8fcd8200-de7b-40f6-b478-0840d62320e2 Nov 04 10:19:14 devstack sudo[96347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:19:14 devstack sudo[96347]: pam_unix(sudo:session): session closed for user root Nov 04 10:19:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-0646d0eb-6f95-4c8b-b265-0523e235f7fc tempest-VolumesGetTest-1874363189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-8fcd8200-de7b-40f6-b478-0840d62320e2" returned: 0 in 0.278s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:19:14 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-0646d0eb-6f95-4c8b-b265-0523e235f7fc tempest-VolumesGetTest-1874363189 None] <== create_volume: return (880ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 10:19:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-0646d0eb-6f95-4c8b-b265-0523e235f7fc tempest-VolumesGetTest-1874363189 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.884s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:19:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-22fc1815-a20c-4e04-9364-58cbe23ba10b tempest-VolumesSnapshotTestJSON-1835544826 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.842s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:19:14 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-0646d0eb-6f95-4c8b-b265-0523e235f7fc tempest-VolumesGetTest-1874363189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e0dabac-7ce7-4151-861a-de13d7a40a63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8fcd8200-de7b-40f6-b478-0840d62320e2', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:19:14 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-0646d0eb-6f95-4c8b-b265-0523e235f7fc tempest-VolumesGetTest-1874363189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb915c8e-cdb1-4cf9-b603-927b603efedc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:19:14 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-22fc1815-a20c-4e04-9364-58cbe23ba10b tempest-VolumesSnapshotTestJSON-1835544826 None] Creating offline snapshot 2466f037-152d-4bc0-968f-09f3c8b384d6 of volume cb9258e0-0481-4295-805c-40a88e46fc53 {{(pid=87068) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 10:19:14 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-0646d0eb-6f95-4c8b-b265-0523e235f7fc tempest-VolumesGetTest-1874363189 None] Volume volume-8fcd8200-de7b-40f6-b478-0840d62320e2 (8fcd8200-de7b-40f6-b478-0840d62320e2): created successfully Nov 04 10:19:14 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-0646d0eb-6f95-4c8b-b265-0523e235f7fc tempest-VolumesGetTest-1874363189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb915c8e-cdb1-4cf9-b603-927b603efedc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:19:14 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-0646d0eb-6f95-4c8b-b265-0523e235f7fc tempest-VolumesGetTest-1874363189 None] Flow 'volume_create_manager' (ed1f4bc3-dae0-4e54-9663-db271e4ffbe5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:19:14 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e8aab2c-4006-4ffd-ab0c-73c66a65fa56]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:19:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-22fc1815-a20c-4e04-9364-58cbe23ba10b tempest-VolumesSnapshotTestJSON-1835544826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-cb9258e0-0481-4295-805c-40a88e46fc53 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:19:14 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-0646d0eb-6f95-4c8b-b265-0523e235f7fc tempest-VolumesGetTest-1874363189 None] Created volume successfully. Nov 04 10:19:14 devstack sudo[96350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-cb9258e0-0481-4295-805c-40a88e46fc53 Nov 04 10:19:14 devstack sudo[96350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:19:15 devstack sudo[96350]: pam_unix(sudo:session): session closed for user root Nov 04 10:19:15 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-22fc1815-a20c-4e04-9364-58cbe23ba10b tempest-VolumesSnapshotTestJSON-1835544826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-cb9258e0-0481-4295-805c-40a88e46fc53" returned: 0 in 0.445s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:19:15 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-22fc1815-a20c-4e04-9364-58cbe23ba10b tempest-VolumesSnapshotTestJSON-1835544826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-cb9258e0-0481-4295-805c-40a88e46fc53,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-cb9258e0-0481-4295-805c-40a88e46fc53.2466f037-152d-4bc0-968f-09f3c8b384d6 1G {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:19:15 devstack sudo[96355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-cb9258e0-0481-4295-805c-40a88e46fc53,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-cb9258e0-0481-4295-805c-40a88e46fc53.2466f037-152d-4bc0-968f-09f3c8b384d6 1G Nov 04 10:19:15 devstack sudo[96355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:19:15 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [req-566a2c58-e60f-479f-a426-b994c92513c5 req-1cf29412-04a0-4a5e-a7dd-c2ec2a30b41f tempest-AttachVolumeShelveTestJSON-659726282 None] No connector for attachment 28ad1a50-2c6d-4824-a6d1-d517503ca510; skipping storage backend terminate_connection call. {{(pid=87068) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Nov 04 10:19:15 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [req-566a2c58-e60f-479f-a426-b994c92513c5 req-1cf29412-04a0-4a5e-a7dd-c2ec2a30b41f tempest-AttachVolumeShelveTestJSON-659726282 None] Deleting attachment 28ad1a50-2c6d-4824-a6d1-d517503ca510. {{(pid=87068) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 04 10:19:15 devstack sudo[96355]: pam_unix(sudo:session): session closed for user root Nov 04 10:19:15 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-22fc1815-a20c-4e04-9364-58cbe23ba10b tempest-VolumesSnapshotTestJSON-1835544826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-cb9258e0-0481-4295-805c-40a88e46fc53,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-cb9258e0-0481-4295-805c-40a88e46fc53.2466f037-152d-4bc0-968f-09f3c8b384d6 1G" returned: 0 in 0.541s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:19:15 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-22fc1815-a20c-4e04-9364-58cbe23ba10b tempest-VolumesSnapshotTestJSON-1835544826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb9258e0-0481-4295-805c-40a88e46fc53 -F qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-cb9258e0-0481-4295-805c-40a88e46fc53.2466f037-152d-4bc0-968f-09f3c8b384d6 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:19:15 devstack sudo[96362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb9258e0-0481-4295-805c-40a88e46fc53 -F qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-cb9258e0-0481-4295-805c-40a88e46fc53.2466f037-152d-4bc0-968f-09f3c8b384d6 Nov 04 10:19:15 devstack sudo[96362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:19:16 devstack sudo[96362]: pam_unix(sudo:session): session closed for user root Nov 04 10:19:16 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-22fc1815-a20c-4e04-9364-58cbe23ba10b tempest-VolumesSnapshotTestJSON-1835544826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb9258e0-0481-4295-805c-40a88e46fc53 -F qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-cb9258e0-0481-4295-805c-40a88e46fc53.2466f037-152d-4bc0-968f-09f3c8b384d6" returned: 0 in 0.487s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:19:16 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-22fc1815-a20c-4e04-9364-58cbe23ba10b tempest-VolumesSnapshotTestJSON-1835544826 None] /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-cb9258e0-0481-4295-805c-40a88e46fc53.2466f037-152d-4bc0-968f-09f3c8b384d6 is being set with open permissions: ugo+rw Nov 04 10:19:16 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-22fc1815-a20c-4e04-9364-58cbe23ba10b tempest-VolumesSnapshotTestJSON-1835544826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-cb9258e0-0481-4295-805c-40a88e46fc53.2466f037-152d-4bc0-968f-09f3c8b384d6 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:19:16 devstack sudo[96367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-cb9258e0-0481-4295-805c-40a88e46fc53.2466f037-152d-4bc0-968f-09f3c8b384d6 Nov 04 10:19:16 devstack sudo[96367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:19:16 devstack sudo[96367]: pam_unix(sudo:session): session closed for user root Nov 04 10:19:16 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-22fc1815-a20c-4e04-9364-58cbe23ba10b tempest-VolumesSnapshotTestJSON-1835544826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-cb9258e0-0481-4295-805c-40a88e46fc53.2466f037-152d-4bc0-968f-09f3c8b384d6" returned: 0 in 0.327s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:19:16 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-741fef47-a2cb-47ce-9115-6ae56c1a0a55 tempest-VolumesGetTest-1874363189 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:19:16 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-22fc1815-a20c-4e04-9364-58cbe23ba10b tempest-VolumesSnapshotTestJSON-1835544826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-cb9258e0-0481-4295-805c-40a88e46fc53.info {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:19:16 devstack sudo[96372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-cb9258e0-0481-4295-805c-40a88e46fc53.info Nov 04 10:19:16 devstack sudo[96372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:19:16 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-741fef47-a2cb-47ce-9115-6ae56c1a0a55 tempest-VolumesGetTest-1874363189 None] Flow 'volume_create_manager' (f0cbc2d0-02cf-4e47-b76c-d68b7cef9c11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:19:16 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-741fef47-a2cb-47ce-9115-6ae56c1a0a55 tempest-VolumesGetTest-1874363189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d71235e2-2ad1-43e4-81ef-d07e5796998d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:19:16 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-741fef47-a2cb-47ce-9115-6ae56c1a0a55 tempest-VolumesGetTest-1874363189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d71235e2-2ad1-43e4-81ef-d07e5796998d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:19:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1373399050',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63a7f5eb-a002-484d-b701-110adf4a863b,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='1fb9cd956e4c4871af0e738ec6daa746',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:19:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=8fcd8200-de7b-40f6-b478-0840d62320e2,status='creating',terminated_at=None,updated_at=2026-11-04T09:19:17Z,use_quota=True,user_id='95fe690f67df4d6f87922789a65a81d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:19:16 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-741fef47-a2cb-47ce-9115-6ae56c1a0a55 tempest-VolumesGetTest-1874363189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f130fd8-2310-40ec-929c-bdaca8b00e03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:19:16 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-741fef47-a2cb-47ce-9115-6ae56c1a0a55 tempest-VolumesGetTest-1874363189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f130fd8-2310-40ec-929c-bdaca8b00e03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:19:16 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-741fef47-a2cb-47ce-9115-6ae56c1a0a55 tempest-VolumesGetTest-1874363189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b038fb1-4566-477d-b52e-0f976b5ad94b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:19:16 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-741fef47-a2cb-47ce-9115-6ae56c1a0a55 tempest-VolumesGetTest-1874363189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b038fb1-4566-477d-b52e-0f976b5ad94b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '63a7f5eb-a002-484d-b701-110adf4a863b', 'volume_name': 'volume-63a7f5eb-a002-484d-b701-110adf4a863b', 'volume_size': 1, 'source_volid': '8fcd8200-de7b-40f6-b478-0840d62320e2', 'source_volstatus': 'available'}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:19:16 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-741fef47-a2cb-47ce-9115-6ae56c1a0a55 tempest-VolumesGetTest-1874363189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdf4ce58-c642-460a-a1af-aee9dab761d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:19:16 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-741fef47-a2cb-47ce-9115-6ae56c1a0a55 tempest-VolumesGetTest-1874363189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdf4ce58-c642-460a-a1af-aee9dab761d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:19:16 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-741fef47-a2cb-47ce-9115-6ae56c1a0a55 tempest-VolumesGetTest-1874363189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b87b046-efbc-4868-b2c0-b2662960ca85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:19:16 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-741fef47-a2cb-47ce-9115-6ae56c1a0a55 tempest-VolumesGetTest-1874363189 None] Volume 63a7f5eb-a002-484d-b701-110adf4a863b: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-63a7f5eb-a002-484d-b701-110adf4a863b', 'volume_size': 1, 'source_volid': '8fcd8200-de7b-40f6-b478-0840d62320e2', 'source_volstatus': 'available'} Nov 04 10:19:16 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-741fef47-a2cb-47ce-9115-6ae56c1a0a55 tempest-VolumesGetTest-1874363189 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:19:16 devstack sudo[96372]: pam_unix(sudo:session): session closed for user root Nov 04 10:19:16 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-22fc1815-a20c-4e04-9364-58cbe23ba10b tempest-VolumesSnapshotTestJSON-1835544826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-cb9258e0-0481-4295-805c-40a88e46fc53.info" returned: 0 in 0.319s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:19:16 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-22fc1815-a20c-4e04-9364-58cbe23ba10b tempest-VolumesSnapshotTestJSON-1835544826 None] /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-cb9258e0-0481-4295-805c-40a88e46fc53.info is being set with open permissions: ugo+rw Nov 04 10:19:16 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-22fc1815-a20c-4e04-9364-58cbe23ba10b tempest-VolumesSnapshotTestJSON-1835544826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-cb9258e0-0481-4295-805c-40a88e46fc53.info {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:19:16 devstack sudo[96375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-cb9258e0-0481-4295-805c-40a88e46fc53.info Nov 04 10:19:16 devstack sudo[96375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:19:17 devstack sudo[96375]: pam_unix(sudo:session): session closed for user root Nov 04 10:19:17 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-22fc1815-a20c-4e04-9364-58cbe23ba10b tempest-VolumesSnapshotTestJSON-1835544826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-cb9258e0-0481-4295-805c-40a88e46fc53.info" returned: 0 in 0.336s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:19:17 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-22fc1815-a20c-4e04-9364-58cbe23ba10b tempest-VolumesSnapshotTestJSON-1835544826 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.653s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:19:17 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-741fef47-a2cb-47ce-9115-6ae56c1a0a55 tempest-VolumesGetTest-1874363189 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.563s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:19:17 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-741fef47-a2cb-47ce-9115-6ae56c1a0a55 tempest-VolumesGetTest-1874363189 None] Cloning volume 8fcd8200-de7b-40f6-b478-0840d62320e2 to volume 63a7f5eb-a002-484d-b701-110adf4a863b Nov 04 10:19:17 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-22fc1815-a20c-4e04-9364-58cbe23ba10b tempest-VolumesSnapshotTestJSON-1835544826 None] Create snapshot completed successfully Nov 04 10:19:17 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-741fef47-a2cb-47ce-9115-6ae56c1a0a55 tempest-VolumesGetTest-1874363189 None] Creating offline snapshot d3aa3297-c25b-4050-a2e3-eaf7274ac3ea of volume 8fcd8200-de7b-40f6-b478-0840d62320e2 {{(pid=87068) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 10:19:17 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d217371-bc95-449a-b55b-6b407b39d3d0]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:19:17 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-741fef47-a2cb-47ce-9115-6ae56c1a0a55 tempest-VolumesGetTest-1874363189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-8fcd8200-de7b-40f6-b478-0840d62320e2 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:19:17 devstack sudo[96378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-8fcd8200-de7b-40f6-b478-0840d62320e2 Nov 04 10:19:17 devstack sudo[96378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:19:17 devstack sudo[96378]: pam_unix(sudo:session): session closed for user root Nov 04 10:19:17 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-741fef47-a2cb-47ce-9115-6ae56c1a0a55 tempest-VolumesGetTest-1874363189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-8fcd8200-de7b-40f6-b478-0840d62320e2" returned: 0 in 0.513s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:19:17 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-741fef47-a2cb-47ce-9115-6ae56c1a0a55 tempest-VolumesGetTest-1874363189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-8fcd8200-de7b-40f6-b478-0840d62320e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-8fcd8200-de7b-40f6-b478-0840d62320e2.d3aa3297-c25b-4050-a2e3-eaf7274ac3ea 1G {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:19:17 devstack sudo[96383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-8fcd8200-de7b-40f6-b478-0840d62320e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-8fcd8200-de7b-40f6-b478-0840d62320e2.d3aa3297-c25b-4050-a2e3-eaf7274ac3ea 1G Nov 04 10:19:17 devstack sudo[96383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:19:18 devstack sudo[96383]: pam_unix(sudo:session): session closed for user root Nov 04 10:19:18 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-741fef47-a2cb-47ce-9115-6ae56c1a0a55 tempest-VolumesGetTest-1874363189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-8fcd8200-de7b-40f6-b478-0840d62320e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-8fcd8200-de7b-40f6-b478-0840d62320e2.d3aa3297-c25b-4050-a2e3-eaf7274ac3ea 1G" returned: 0 in 0.597s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:19:18 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-741fef47-a2cb-47ce-9115-6ae56c1a0a55 tempest-VolumesGetTest-1874363189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8fcd8200-de7b-40f6-b478-0840d62320e2 -F qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-8fcd8200-de7b-40f6-b478-0840d62320e2.d3aa3297-c25b-4050-a2e3-eaf7274ac3ea {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:19:18 devstack sudo[96389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8fcd8200-de7b-40f6-b478-0840d62320e2 -F qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-8fcd8200-de7b-40f6-b478-0840d62320e2.d3aa3297-c25b-4050-a2e3-eaf7274ac3ea Nov 04 10:19:18 devstack sudo[96389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:19:18 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3c34af2-c8f4-43ad-8126-219c9afafa34 tempest-VolumesSnapshotTestJSON-1835544826 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:19:18 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-b3c34af2-c8f4-43ad-8126-219c9afafa34 tempest-VolumesSnapshotTestJSON-1835544826 None] Flow 'volume_create_manager' (94d14bb1-68d2-44c9-9878-e9bc503358be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:19:18 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-b3c34af2-c8f4-43ad-8126-219c9afafa34 tempest-VolumesSnapshotTestJSON-1835544826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5554fe79-8ae9-4744-a1ac-0d3e2865e3ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:19:18 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-b3c34af2-c8f4-43ad-8126-219c9afafa34 tempest-VolumesSnapshotTestJSON-1835544826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5554fe79-8ae9-4744-a1ac-0d3e2865e3ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:19:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-864397713',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d58258e-c62f-4225-a831-97910ff79951,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c119592eb9b94d74ad294736ec076621',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:19:19Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=2466f037-152d-4bc0-968f-09f3c8b384d6,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:19:19Z,use_quota=True,user_id='1810941f24e64a14ad02f068e0d989ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:19:18 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-b3c34af2-c8f4-43ad-8126-219c9afafa34 tempest-VolumesSnapshotTestJSON-1835544826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a69923f-cf1b-46cb-8872-42b021dcdfe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:19:18 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-b3c34af2-c8f4-43ad-8126-219c9afafa34 tempest-VolumesSnapshotTestJSON-1835544826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a69923f-cf1b-46cb-8872-42b021dcdfe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:19:18 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-b3c34af2-c8f4-43ad-8126-219c9afafa34 tempest-VolumesSnapshotTestJSON-1835544826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a67ff74c-e780-46a9-b5e2-98fe04ff47ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:19:18 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-b3c34af2-c8f4-43ad-8126-219c9afafa34 tempest-VolumesSnapshotTestJSON-1835544826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a67ff74c-e780-46a9-b5e2-98fe04ff47ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '9d58258e-c62f-4225-a831-97910ff79951', 'volume_name': 'volume-9d58258e-c62f-4225-a831-97910ff79951', 'volume_size': 2, 'snapshot_id': '2466f037-152d-4bc0-968f-09f3c8b384d6'}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:19:18 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-b3c34af2-c8f4-43ad-8126-219c9afafa34 tempest-VolumesSnapshotTestJSON-1835544826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7458a1e2-a06c-4ead-9882-8aacbdaa8a4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:19:18 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-b3c34af2-c8f4-43ad-8126-219c9afafa34 tempest-VolumesSnapshotTestJSON-1835544826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7458a1e2-a06c-4ead-9882-8aacbdaa8a4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:19:18 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-b3c34af2-c8f4-43ad-8126-219c9afafa34 tempest-VolumesSnapshotTestJSON-1835544826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (945afa72-cd5c-46c0-a93b-759a344e03c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:19:18 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-b3c34af2-c8f4-43ad-8126-219c9afafa34 tempest-VolumesSnapshotTestJSON-1835544826 None] Volume 9d58258e-c62f-4225-a831-97910ff79951: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-9d58258e-c62f-4225-a831-97910ff79951', 'volume_size': 2, 'snapshot_id': '2466f037-152d-4bc0-968f-09f3c8b384d6'} Nov 04 10:19:18 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-b3c34af2-c8f4-43ad-8126-219c9afafa34 tempest-VolumesSnapshotTestJSON-1835544826 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:19:18 devstack sudo[96389]: pam_unix(sudo:session): session closed for user root Nov 04 10:19:18 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-741fef47-a2cb-47ce-9115-6ae56c1a0a55 tempest-VolumesGetTest-1874363189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8fcd8200-de7b-40f6-b478-0840d62320e2 -F qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-8fcd8200-de7b-40f6-b478-0840d62320e2.d3aa3297-c25b-4050-a2e3-eaf7274ac3ea" returned: 0 in 0.441s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:19:18 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-741fef47-a2cb-47ce-9115-6ae56c1a0a55 tempest-VolumesGetTest-1874363189 None] /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-8fcd8200-de7b-40f6-b478-0840d62320e2.d3aa3297-c25b-4050-a2e3-eaf7274ac3ea is being set with open permissions: ugo+rw Nov 04 10:19:18 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-741fef47-a2cb-47ce-9115-6ae56c1a0a55 tempest-VolumesGetTest-1874363189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-8fcd8200-de7b-40f6-b478-0840d62320e2.d3aa3297-c25b-4050-a2e3-eaf7274ac3ea {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:19:18 devstack sudo[96394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-8fcd8200-de7b-40f6-b478-0840d62320e2.d3aa3297-c25b-4050-a2e3-eaf7274ac3ea Nov 04 10:19:19 devstack sudo[96394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:19:19 devstack sudo[96394]: pam_unix(sudo:session): session closed for user root Nov 04 10:19:19 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-741fef47-a2cb-47ce-9115-6ae56c1a0a55 tempest-VolumesGetTest-1874363189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-8fcd8200-de7b-40f6-b478-0840d62320e2.d3aa3297-c25b-4050-a2e3-eaf7274ac3ea" returned: 0 in 0.319s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:19:19 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-741fef47-a2cb-47ce-9115-6ae56c1a0a55 tempest-VolumesGetTest-1874363189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-8fcd8200-de7b-40f6-b478-0840d62320e2.info {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:19:19 devstack sudo[96397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-8fcd8200-de7b-40f6-b478-0840d62320e2.info Nov 04 10:19:19 devstack sudo[96397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:19:19 devstack sudo[96397]: pam_unix(sudo:session): session closed for user root Nov 04 10:19:19 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-741fef47-a2cb-47ce-9115-6ae56c1a0a55 tempest-VolumesGetTest-1874363189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-8fcd8200-de7b-40f6-b478-0840d62320e2.info" returned: 0 in 0.319s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:19:19 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-741fef47-a2cb-47ce-9115-6ae56c1a0a55 tempest-VolumesGetTest-1874363189 None] /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-8fcd8200-de7b-40f6-b478-0840d62320e2.info is being set with open permissions: ugo+rw Nov 04 10:19:19 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-741fef47-a2cb-47ce-9115-6ae56c1a0a55 tempest-VolumesGetTest-1874363189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-8fcd8200-de7b-40f6-b478-0840d62320e2.info {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:19:19 devstack sudo[96400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-8fcd8200-de7b-40f6-b478-0840d62320e2.info Nov 04 10:19:19 devstack sudo[96400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:19:19 devstack sudo[96400]: pam_unix(sudo:session): session closed for user root Nov 04 10:19:19 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-741fef47-a2cb-47ce-9115-6ae56c1a0a55 tempest-VolumesGetTest-1874363189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-8fcd8200-de7b-40f6-b478-0840d62320e2.info" returned: 0 in 0.304s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:19:19 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-741fef47-a2cb-47ce-9115-6ae56c1a0a55 tempest-VolumesGetTest-1874363189 None] Acquiring lock "cinder-quobyte-63a7f5eb-a002-484d-b701-110adf4a863b" by "_copy_volume_from_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:19:20 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-741fef47-a2cb-47ce-9115-6ae56c1a0a55 tempest-VolumesGetTest-1874363189 None] Lock "cinder-quobyte-63a7f5eb-a002-484d-b701-110adf4a863b" acquired by "_copy_volume_from_snapshot" :: waited 0.035s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:19:20 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-741fef47-a2cb-47ce-9115-6ae56c1a0a55 tempest-VolumesGetTest-1874363189 None] snapshot: d3aa3297-c25b-4050-a2e3-eaf7274ac3ea, volume: 63a7f5eb-a002-484d-b701-110adf4a863b, {{(pid=87068) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 04 10:19:20 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-741fef47-a2cb-47ce-9115-6ae56c1a0a55 tempest-VolumesGetTest-1874363189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:19:20 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-741fef47-a2cb-47ce-9115-6ae56c1a0a55 tempest-VolumesGetTest-1874363189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:19:20 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-741fef47-a2cb-47ce-9115-6ae56c1a0a55 tempest-VolumesGetTest-1874363189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:19:20 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-741fef47-a2cb-47ce-9115-6ae56c1a0a55 tempest-VolumesGetTest-1874363189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:19:20 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-741fef47-a2cb-47ce-9115-6ae56c1a0a55 tempest-VolumesGetTest-1874363189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:19:20 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2fecbc8-90fc-41d0-94b0-25f76e850069]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:19:20 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-741fef47-a2cb-47ce-9115-6ae56c1a0a55 tempest-VolumesGetTest-1874363189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-8fcd8200-de7b-40f6-b478-0840d62320e2.d3aa3297-c25b-4050-a2e3-eaf7274ac3ea {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:19:20 devstack sudo[96403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-8fcd8200-de7b-40f6-b478-0840d62320e2.d3aa3297-c25b-4050-a2e3-eaf7274ac3ea Nov 04 10:19:20 devstack sudo[96403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:19:20 devstack sudo[96403]: pam_unix(sudo:session): session closed for user root Nov 04 10:19:20 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-741fef47-a2cb-47ce-9115-6ae56c1a0a55 tempest-VolumesGetTest-1874363189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-8fcd8200-de7b-40f6-b478-0840d62320e2.d3aa3297-c25b-4050-a2e3-eaf7274ac3ea" returned: 0 in 0.436s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:19:20 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-741fef47-a2cb-47ce-9115-6ae56c1a0a55 tempest-VolumesGetTest-1874363189 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8fcd8200-de7b-40f6-b478-0840d62320e2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87068) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 10:19:20 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[2339073c-3fc8-4c8c-a5a9-c02d25b49c8e]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:19:20 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-741fef47-a2cb-47ce-9115-6ae56c1a0a55 tempest-VolumesGetTest-1874363189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-8fcd8200-de7b-40f6-b478-0840d62320e2 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:19:20 devstack sudo[96409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-8fcd8200-de7b-40f6-b478-0840d62320e2 Nov 04 10:19:20 devstack sudo[96409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:19:20 devstack sudo[96409]: pam_unix(sudo:session): session closed for user root Nov 04 10:19:21 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-741fef47-a2cb-47ce-9115-6ae56c1a0a55 tempest-VolumesGetTest-1874363189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-8fcd8200-de7b-40f6-b478-0840d62320e2" returned: 0 in 0.466s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:19:21 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-741fef47-a2cb-47ce-9115-6ae56c1a0a55 tempest-VolumesGetTest-1874363189 None] will copy from snapshot at /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-8fcd8200-de7b-40f6-b478-0840d62320e2 {{(pid=87068) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 04 10:19:21 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-741fef47-a2cb-47ce-9115-6ae56c1a0a55 tempest-VolumesGetTest-1874363189 None] Creating direct copy from snapshot {{(pid=87068) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 04 10:19:21 devstack cinder-volume[87068]: DEBUG cinder.utils [None req-741fef47-a2cb-47ce-9115-6ae56c1a0a55 tempest-VolumesGetTest-1874363189 None] Path /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-63a7f5eb-a002-484d-b701-110adf4a863b not found in is_blk_device check {{(pid=87068) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 04 10:19:21 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-741fef47-a2cb-47ce-9115-6ae56c1a0a55 tempest-VolumesGetTest-1874363189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-8fcd8200-de7b-40f6-b478-0840d62320e2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-63a7f5eb-a002-484d-b701-110adf4a863b {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:19:21 devstack sudo[96414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-8fcd8200-de7b-40f6-b478-0840d62320e2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-63a7f5eb-a002-484d-b701-110adf4a863b Nov 04 10:19:21 devstack sudo[96414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:19:25 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-d373ab88-6777-45dd-a81e-bf0d7b8be304 tempest-VolumesActionsTest-1241883822 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:19:25 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-d373ab88-6777-45dd-a81e-bf0d7b8be304 tempest-VolumesActionsTest-1241883822 None] Flow 'volume_create_manager' (df47f7b1-1175-4634-a0de-c2a3b9d1f35f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:19:25 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-d373ab88-6777-45dd-a81e-bf0d7b8be304 tempest-VolumesActionsTest-1241883822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb06bf56-05b8-41fb-8a4e-05856e543f5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:19:25 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-d373ab88-6777-45dd-a81e-bf0d7b8be304 tempest-VolumesActionsTest-1241883822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb06bf56-05b8-41fb-8a4e-05856e543f5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:19:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2042698158',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61be2e3e-5d6c-4042-89f0-f7af5ea09dcd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa253e2871cc4dd68edcbf21714a87f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:19:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:19:26Z,use_quota=True,user_id='ab0f3774b20a44589f6b8b5efa81eda4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:19:25 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-d373ab88-6777-45dd-a81e-bf0d7b8be304 tempest-VolumesActionsTest-1241883822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5331387-1937-484b-a11f-610f92ded532) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:19:25 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-d373ab88-6777-45dd-a81e-bf0d7b8be304 tempest-VolumesActionsTest-1241883822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5331387-1937-484b-a11f-610f92ded532) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:19:25 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-d373ab88-6777-45dd-a81e-bf0d7b8be304 tempest-VolumesActionsTest-1241883822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11759c96-c95d-4b09-afc4-2de7cef7d3a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:19:25 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-d373ab88-6777-45dd-a81e-bf0d7b8be304 tempest-VolumesActionsTest-1241883822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11759c96-c95d-4b09-afc4-2de7cef7d3a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61be2e3e-5d6c-4042-89f0-f7af5ea09dcd', 'volume_name': 'volume-61be2e3e-5d6c-4042-89f0-f7af5ea09dcd', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:19:25 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-d373ab88-6777-45dd-a81e-bf0d7b8be304 tempest-VolumesActionsTest-1241883822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f9478da-11e1-4bd8-98bb-37b1ffa2ed16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:19:25 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-d373ab88-6777-45dd-a81e-bf0d7b8be304 tempest-VolumesActionsTest-1241883822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f9478da-11e1-4bd8-98bb-37b1ffa2ed16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:19:25 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-d373ab88-6777-45dd-a81e-bf0d7b8be304 tempest-VolumesActionsTest-1241883822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1517457c-d813-4f87-8f0a-5588e478edcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:19:25 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-d373ab88-6777-45dd-a81e-bf0d7b8be304 tempest-VolumesActionsTest-1241883822 None] Volume 61be2e3e-5d6c-4042-89f0-f7af5ea09dcd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61be2e3e-5d6c-4042-89f0-f7af5ea09dcd', 'volume_size': 1} Nov 04 10:19:25 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-d373ab88-6777-45dd-a81e-bf0d7b8be304 tempest-VolumesActionsTest-1241883822 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:19:29 devstack sudo[96414]: pam_unix(sudo:session): session closed for user root Nov 04 10:19:29 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-741fef47-a2cb-47ce-9115-6ae56c1a0a55 tempest-VolumesGetTest-1874363189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-8fcd8200-de7b-40f6-b478-0840d62320e2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-63a7f5eb-a002-484d-b701-110adf4a863b" returned: 0 in 8.659s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:19:29 devstack cinder-volume[87068]: DEBUG cinder.image.image_utils [None req-741fef47-a2cb-47ce-9115-6ae56c1a0a55 tempest-VolumesGetTest-1874363189 None] Image conversion details: src /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-8fcd8200-de7b-40f6-b478-0840d62320e2, size 1024.00 MB, duration 8.66 sec, destination /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-63a7f5eb-a002-484d-b701-110adf4a863b {{(pid=87068) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 04 10:19:29 devstack cinder-volume[87068]: INFO cinder.image.image_utils [None req-741fef47-a2cb-47ce-9115-6ae56c1a0a55 tempest-VolumesGetTest-1874363189 None] Converted 1024.00 MB image at 118.25 MB/s Nov 04 10:19:29 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-741fef47-a2cb-47ce-9115-6ae56c1a0a55 tempest-VolumesGetTest-1874363189 None] /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-63a7f5eb-a002-484d-b701-110adf4a863b is being set with open permissions: ugo+rw Nov 04 10:19:29 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-741fef47-a2cb-47ce-9115-6ae56c1a0a55 tempest-VolumesGetTest-1874363189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-63a7f5eb-a002-484d-b701-110adf4a863b {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:19:29 devstack sudo[96467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-63a7f5eb-a002-484d-b701-110adf4a863b Nov 04 10:19:29 devstack sudo[96467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:19:29 devstack sudo[96467]: pam_unix(sudo:session): session closed for user root Nov 04 10:19:29 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-741fef47-a2cb-47ce-9115-6ae56c1a0a55 tempest-VolumesGetTest-1874363189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-63a7f5eb-a002-484d-b701-110adf4a863b" returned: 0 in 0.273s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:19:29 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-741fef47-a2cb-47ce-9115-6ae56c1a0a55 tempest-VolumesGetTest-1874363189 None] Lock "cinder-quobyte-63a7f5eb-a002-484d-b701-110adf4a863b" released by "_copy_volume_from_snapshot" :: held 9.946s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:19:29 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-741fef47-a2cb-47ce-9115-6ae56c1a0a55 tempest-VolumesGetTest-1874363189 None] Acquiring lock "cinder-quobyte-d3aa3297-c25b-4050-a2e3-eaf7274ac3ea" by "_delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:19:29 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-741fef47-a2cb-47ce-9115-6ae56c1a0a55 tempest-VolumesGetTest-1874363189 None] Lock "cinder-quobyte-d3aa3297-c25b-4050-a2e3-eaf7274ac3ea" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:19:29 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-741fef47-a2cb-47ce-9115-6ae56c1a0a55 tempest-VolumesGetTest-1874363189 None] Deleting offline snapshot d3aa3297-c25b-4050-a2e3-eaf7274ac3ea of volume 8fcd8200-de7b-40f6-b478-0840d62320e2 {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 10:19:30 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-741fef47-a2cb-47ce-9115-6ae56c1a0a55 tempest-VolumesGetTest-1874363189 None] snapshot_file for this snap is: volume-8fcd8200-de7b-40f6-b478-0840d62320e2.d3aa3297-c25b-4050-a2e3-eaf7274ac3ea {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 10:19:30 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[07098823-c79c-4c5f-9140-ba85dc9b9daf]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:19:30 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-741fef47-a2cb-47ce-9115-6ae56c1a0a55 tempest-VolumesGetTest-1874363189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-8fcd8200-de7b-40f6-b478-0840d62320e2.d3aa3297-c25b-4050-a2e3-eaf7274ac3ea {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:19:30 devstack sudo[96470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-8fcd8200-de7b-40f6-b478-0840d62320e2.d3aa3297-c25b-4050-a2e3-eaf7274ac3ea Nov 04 10:19:30 devstack sudo[96470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:19:30 devstack sudo[96470]: pam_unix(sudo:session): session closed for user root Nov 04 10:19:30 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-741fef47-a2cb-47ce-9115-6ae56c1a0a55 tempest-VolumesGetTest-1874363189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-8fcd8200-de7b-40f6-b478-0840d62320e2.d3aa3297-c25b-4050-a2e3-eaf7274ac3ea" returned: 0 in 0.372s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:19:30 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-741fef47-a2cb-47ce-9115-6ae56c1a0a55 tempest-VolumesGetTest-1874363189 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8fcd8200-de7b-40f6-b478-0840d62320e2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87068) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 10:19:30 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[92fbe62e-4d99-4537-870a-f78ccb276994]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:19:30 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-741fef47-a2cb-47ce-9115-6ae56c1a0a55 tempest-VolumesGetTest-1874363189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-8fcd8200-de7b-40f6-b478-0840d62320e2 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:19:30 devstack sudo[96476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-8fcd8200-de7b-40f6-b478-0840d62320e2 Nov 04 10:19:30 devstack sudo[96476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:19:31 devstack sudo[96476]: pam_unix(sudo:session): session closed for user root Nov 04 10:19:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-741fef47-a2cb-47ce-9115-6ae56c1a0a55 tempest-VolumesGetTest-1874363189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-8fcd8200-de7b-40f6-b478-0840d62320e2" returned: 0 in 0.746s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:19:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-741fef47-a2cb-47ce-9115-6ae56c1a0a55 tempest-VolumesGetTest-1874363189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-8fcd8200-de7b-40f6-b478-0840d62320e2.d3aa3297-c25b-4050-a2e3-eaf7274ac3ea {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:19:31 devstack sudo[96524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-8fcd8200-de7b-40f6-b478-0840d62320e2.d3aa3297-c25b-4050-a2e3-eaf7274ac3ea Nov 04 10:19:31 devstack sudo[96524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:19:31 devstack sudo[96524]: pam_unix(sudo:session): session closed for user root Nov 04 10:19:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-741fef47-a2cb-47ce-9115-6ae56c1a0a55 tempest-VolumesGetTest-1874363189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-8fcd8200-de7b-40f6-b478-0840d62320e2.d3aa3297-c25b-4050-a2e3-eaf7274ac3ea" returned: 0 in 0.528s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:19:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-741fef47-a2cb-47ce-9115-6ae56c1a0a55 tempest-VolumesGetTest-1874363189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-8fcd8200-de7b-40f6-b478-0840d62320e2.d3aa3297-c25b-4050-a2e3-eaf7274ac3ea {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:19:31 devstack sudo[96550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-8fcd8200-de7b-40f6-b478-0840d62320e2.d3aa3297-c25b-4050-a2e3-eaf7274ac3ea Nov 04 10:19:31 devstack sudo[96550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:19:32 devstack sudo[96550]: pam_unix(sudo:session): session closed for user root Nov 04 10:19:32 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-741fef47-a2cb-47ce-9115-6ae56c1a0a55 tempest-VolumesGetTest-1874363189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-8fcd8200-de7b-40f6-b478-0840d62320e2.d3aa3297-c25b-4050-a2e3-eaf7274ac3ea" returned: 0 in 0.314s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:19:32 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-741fef47-a2cb-47ce-9115-6ae56c1a0a55 tempest-VolumesGetTest-1874363189 None] Lock "cinder-quobyte-d3aa3297-c25b-4050-a2e3-eaf7274ac3ea" released by "_delete_snapshot" :: held 2.092s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:19:32 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-741fef47-a2cb-47ce-9115-6ae56c1a0a55 tempest-VolumesGetTest-1874363189 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 14.791s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:19:32 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-b3c34af2-c8f4-43ad-8126-219c9afafa34 tempest-VolumesSnapshotTestJSON-1835544826 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 13.219s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:19:32 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-b3c34af2-c8f4-43ad-8126-219c9afafa34 tempest-VolumesSnapshotTestJSON-1835544826 None] Acquiring lock "cinder-quobyte-2466f037-152d-4bc0-968f-09f3c8b384d6-9d58258e-c62f-4225-a831-97910ff79951" by "_create_volume_from_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:19:32 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-741fef47-a2cb-47ce-9115-6ae56c1a0a55 tempest-VolumesGetTest-1874363189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b87b046-efbc-4868-b2c0-b2662960ca85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63a7f5eb-a002-484d-b701-110adf4a863b', 'volume_size': 1, 'source_volid': '8fcd8200-de7b-40f6-b478-0840d62320e2', 'source_volstatus': 'available'}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:19:32 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-741fef47-a2cb-47ce-9115-6ae56c1a0a55 tempest-VolumesGetTest-1874363189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f19cf3c4-1998-44e5-a1df-1181c57efc64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:19:32 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-b3c34af2-c8f4-43ad-8126-219c9afafa34 tempest-VolumesSnapshotTestJSON-1835544826 None] Lock "cinder-quobyte-2466f037-152d-4bc0-968f-09f3c8b384d6-9d58258e-c62f-4225-a831-97910ff79951" acquired by "_create_volume_from_snapshot" :: waited 0.031s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:19:32 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-b3c34af2-c8f4-43ad-8126-219c9afafa34 tempest-VolumesSnapshotTestJSON-1835544826 None] Creating volume 9d58258e-c62f-4225-a831-97910ff79951 from snapshot 2466f037-152d-4bc0-968f-09f3c8b384d6 {{(pid=87068) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 04 10:19:32 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-b3c34af2-c8f4-43ad-8126-219c9afafa34 tempest-VolumesSnapshotTestJSON-1835544826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:19:32 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-b3c34af2-c8f4-43ad-8126-219c9afafa34 tempest-VolumesSnapshotTestJSON-1835544826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:19:32 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-b3c34af2-c8f4-43ad-8126-219c9afafa34 tempest-VolumesSnapshotTestJSON-1835544826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:19:32 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-b3c34af2-c8f4-43ad-8126-219c9afafa34 tempest-VolumesSnapshotTestJSON-1835544826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:19:32 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-b3c34af2-c8f4-43ad-8126-219c9afafa34 tempest-VolumesSnapshotTestJSON-1835544826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:19:32 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-b3c34af2-c8f4-43ad-8126-219c9afafa34 tempest-VolumesSnapshotTestJSON-1835544826 None] Selected osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:19:32 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-b3c34af2-c8f4-43ad-8126-219c9afafa34 tempest-VolumesSnapshotTestJSON-1835544826 None] Acquiring lock "cinder-quobyte-9d58258e-c62f-4225-a831-97910ff79951" by "_copy_volume_from_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:19:32 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-741fef47-a2cb-47ce-9115-6ae56c1a0a55 tempest-VolumesGetTest-1874363189 None] Volume volume-63a7f5eb-a002-484d-b701-110adf4a863b (63a7f5eb-a002-484d-b701-110adf4a863b): created successfully Nov 04 10:19:32 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-741fef47-a2cb-47ce-9115-6ae56c1a0a55 tempest-VolumesGetTest-1874363189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f19cf3c4-1998-44e5-a1df-1181c57efc64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:19:32 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-741fef47-a2cb-47ce-9115-6ae56c1a0a55 tempest-VolumesGetTest-1874363189 None] Flow 'volume_create_manager' (f0cbc2d0-02cf-4e47-b76c-d68b7cef9c11) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:19:32 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-b3c34af2-c8f4-43ad-8126-219c9afafa34 tempest-VolumesSnapshotTestJSON-1835544826 None] Lock "cinder-quobyte-9d58258e-c62f-4225-a831-97910ff79951" acquired by "_copy_volume_from_snapshot" :: waited 0.041s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:19:32 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-b3c34af2-c8f4-43ad-8126-219c9afafa34 tempest-VolumesSnapshotTestJSON-1835544826 None] snapshot: 2466f037-152d-4bc0-968f-09f3c8b384d6, volume: 9d58258e-c62f-4225-a831-97910ff79951, {{(pid=87068) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 04 10:19:32 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-b3c34af2-c8f4-43ad-8126-219c9afafa34 tempest-VolumesSnapshotTestJSON-1835544826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:19:32 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-b3c34af2-c8f4-43ad-8126-219c9afafa34 tempest-VolumesSnapshotTestJSON-1835544826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:19:32 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-b3c34af2-c8f4-43ad-8126-219c9afafa34 tempest-VolumesSnapshotTestJSON-1835544826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:19:32 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-b3c34af2-c8f4-43ad-8126-219c9afafa34 tempest-VolumesSnapshotTestJSON-1835544826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:19:32 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-b3c34af2-c8f4-43ad-8126-219c9afafa34 tempest-VolumesSnapshotTestJSON-1835544826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:19:32 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-741fef47-a2cb-47ce-9115-6ae56c1a0a55 tempest-VolumesGetTest-1874363189 None] Created volume successfully. Nov 04 10:19:32 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[705313ee-dcf0-4cad-b21d-f502865f7428]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:19:32 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-b3c34af2-c8f4-43ad-8126-219c9afafa34 tempest-VolumesSnapshotTestJSON-1835544826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-cb9258e0-0481-4295-805c-40a88e46fc53.2466f037-152d-4bc0-968f-09f3c8b384d6 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:19:32 devstack sudo[96559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-cb9258e0-0481-4295-805c-40a88e46fc53.2466f037-152d-4bc0-968f-09f3c8b384d6 Nov 04 10:19:32 devstack sudo[96559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:19:32 devstack sudo[96559]: pam_unix(sudo:session): session closed for user root Nov 04 10:19:32 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-b3c34af2-c8f4-43ad-8126-219c9afafa34 tempest-VolumesSnapshotTestJSON-1835544826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-cb9258e0-0481-4295-805c-40a88e46fc53.2466f037-152d-4bc0-968f-09f3c8b384d6" returned: 0 in 0.462s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:19:32 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-b3c34af2-c8f4-43ad-8126-219c9afafa34 tempest-VolumesSnapshotTestJSON-1835544826 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cb9258e0-0481-4295-805c-40a88e46fc53(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87068) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 10:19:32 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[f486c104-c9df-40cf-885a-f6121b4de972]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:19:32 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-b3c34af2-c8f4-43ad-8126-219c9afafa34 tempest-VolumesSnapshotTestJSON-1835544826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-cb9258e0-0481-4295-805c-40a88e46fc53 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:19:32 devstack sudo[96566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-cb9258e0-0481-4295-805c-40a88e46fc53 Nov 04 10:19:32 devstack sudo[96566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:19:33 devstack sudo[96566]: pam_unix(sudo:session): session closed for user root Nov 04 10:19:33 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-b3c34af2-c8f4-43ad-8126-219c9afafa34 tempest-VolumesSnapshotTestJSON-1835544826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-cb9258e0-0481-4295-805c-40a88e46fc53" returned: 0 in 0.449s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:19:33 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-b3c34af2-c8f4-43ad-8126-219c9afafa34 tempest-VolumesSnapshotTestJSON-1835544826 None] will copy from snapshot at /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-cb9258e0-0481-4295-805c-40a88e46fc53 {{(pid=87068) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 04 10:19:33 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-b3c34af2-c8f4-43ad-8126-219c9afafa34 tempest-VolumesSnapshotTestJSON-1835544826 None] Creating direct copy from snapshot {{(pid=87068) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 04 10:19:33 devstack cinder-volume[87068]: DEBUG cinder.utils [None req-b3c34af2-c8f4-43ad-8126-219c9afafa34 tempest-VolumesSnapshotTestJSON-1835544826 None] Path /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-9d58258e-c62f-4225-a831-97910ff79951 not found in is_blk_device check {{(pid=87068) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 04 10:19:33 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-b3c34af2-c8f4-43ad-8126-219c9afafa34 tempest-VolumesSnapshotTestJSON-1835544826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-cb9258e0-0481-4295-805c-40a88e46fc53 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-9d58258e-c62f-4225-a831-97910ff79951 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:19:33 devstack sudo[96571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-cb9258e0-0481-4295-805c-40a88e46fc53 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-9d58258e-c62f-4225-a831-97910ff79951 Nov 04 10:19:33 devstack sudo[96571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:19:34 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-82f17d00-7a1c-4361-a6d7-a858de16d88d tempest-VolumesGetTest-1874363189 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:19:34 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-82f17d00-7a1c-4361-a6d7-a858de16d88d tempest-VolumesGetTest-1874363189 None] Flow 'volume_create_manager' (8be36d1b-8943-4786-b6b1-fb57d2b1f779) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:19:34 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-82f17d00-7a1c-4361-a6d7-a858de16d88d tempest-VolumesGetTest-1874363189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fefabbf7-3136-41c2-9a5b-931f5a1f73ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:19:34 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-82f17d00-7a1c-4361-a6d7-a858de16d88d tempest-VolumesGetTest-1874363189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fefabbf7-3136-41c2-9a5b-931f5a1f73ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:19:34Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1927728446',display_name='tempest-VolumesGetTest-Volume-1736910078',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15a74233-6fae-4165-938a-cd6055e1b960,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1fb9cd956e4c4871af0e738ec6daa746',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:19:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:19:34Z,use_quota=True,user_id='95fe690f67df4d6f87922789a65a81d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:19:34 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-82f17d00-7a1c-4361-a6d7-a858de16d88d tempest-VolumesGetTest-1874363189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7084dba2-59cf-4edc-b46d-34899f899ed8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:19:34 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-82f17d00-7a1c-4361-a6d7-a858de16d88d tempest-VolumesGetTest-1874363189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7084dba2-59cf-4edc-b46d-34899f899ed8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:19:34 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-82f17d00-7a1c-4361-a6d7-a858de16d88d tempest-VolumesGetTest-1874363189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba0ec2d1-95af-4501-9b4d-21023e57d2fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:19:34 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-82f17d00-7a1c-4361-a6d7-a858de16d88d tempest-VolumesGetTest-1874363189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba0ec2d1-95af-4501-9b4d-21023e57d2fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15a74233-6fae-4165-938a-cd6055e1b960', 'volume_name': 'volume-15a74233-6fae-4165-938a-cd6055e1b960', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:19:34 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-82f17d00-7a1c-4361-a6d7-a858de16d88d tempest-VolumesGetTest-1874363189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fcc2fd7-c451-44b1-8428-dac3e748da0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:19:34 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-82f17d00-7a1c-4361-a6d7-a858de16d88d tempest-VolumesGetTest-1874363189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fcc2fd7-c451-44b1-8428-dac3e748da0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:19:34 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-82f17d00-7a1c-4361-a6d7-a858de16d88d tempest-VolumesGetTest-1874363189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a847ea8a-34ba-47ea-a42a-3bebc209744f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:19:34 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-82f17d00-7a1c-4361-a6d7-a858de16d88d tempest-VolumesGetTest-1874363189 None] Volume 15a74233-6fae-4165-938a-cd6055e1b960: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15a74233-6fae-4165-938a-cd6055e1b960', 'volume_size': 1} Nov 04 10:19:34 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-82f17d00-7a1c-4361-a6d7-a858de16d88d tempest-VolumesGetTest-1874363189 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:19:41 devstack sudo[96571]: pam_unix(sudo:session): session closed for user root Nov 04 10:19:41 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-b3c34af2-c8f4-43ad-8126-219c9afafa34 tempest-VolumesSnapshotTestJSON-1835544826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-cb9258e0-0481-4295-805c-40a88e46fc53 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-9d58258e-c62f-4225-a831-97910ff79951" returned: 0 in 8.431s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:19:41 devstack cinder-volume[87068]: DEBUG cinder.image.image_utils [None req-b3c34af2-c8f4-43ad-8126-219c9afafa34 tempest-VolumesSnapshotTestJSON-1835544826 None] Image conversion details: src /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-cb9258e0-0481-4295-805c-40a88e46fc53, size 1024.00 MB, duration 8.43 sec, destination /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-9d58258e-c62f-4225-a831-97910ff79951 {{(pid=87068) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 04 10:19:41 devstack cinder-volume[87068]: INFO cinder.image.image_utils [None req-b3c34af2-c8f4-43ad-8126-219c9afafa34 tempest-VolumesSnapshotTestJSON-1835544826 None] Converted 1024.00 MB image at 121.45 MB/s Nov 04 10:19:41 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-b3c34af2-c8f4-43ad-8126-219c9afafa34 tempest-VolumesSnapshotTestJSON-1835544826 None] /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-9d58258e-c62f-4225-a831-97910ff79951 is being set with open permissions: ugo+rw Nov 04 10:19:41 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-b3c34af2-c8f4-43ad-8126-219c9afafa34 tempest-VolumesSnapshotTestJSON-1835544826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-9d58258e-c62f-4225-a831-97910ff79951 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:19:41 devstack sudo[96629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-9d58258e-c62f-4225-a831-97910ff79951 Nov 04 10:19:41 devstack sudo[96629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:19:41 devstack sudo[96629]: pam_unix(sudo:session): session closed for user root Nov 04 10:19:41 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-b3c34af2-c8f4-43ad-8126-219c9afafa34 tempest-VolumesSnapshotTestJSON-1835544826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-9d58258e-c62f-4225-a831-97910ff79951" returned: 0 in 0.245s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:19:41 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-b3c34af2-c8f4-43ad-8126-219c9afafa34 tempest-VolumesSnapshotTestJSON-1835544826 None] Lock "cinder-quobyte-9d58258e-c62f-4225-a831-97910ff79951" released by "_copy_volume_from_snapshot" :: held 9.740s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:19:42 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-b3c34af2-c8f4-43ad-8126-219c9afafa34 tempest-VolumesSnapshotTestJSON-1835544826 None] Lock "cinder-quobyte-2466f037-152d-4bc0-968f-09f3c8b384d6-9d58258e-c62f-4225-a831-97910ff79951" released by "_create_volume_from_snapshot" :: held 9.848s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:19:42 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-b3c34af2-c8f4-43ad-8126-219c9afafa34 tempest-VolumesSnapshotTestJSON-1835544826 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.880s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:19:42 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-d373ab88-6777-45dd-a81e-bf0d7b8be304 tempest-VolumesActionsTest-1241883822 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 16.171s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:19:42 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-d373ab88-6777-45dd-a81e-bf0d7b8be304 tempest-VolumesActionsTest-1241883822 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:19:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2042698158',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61be2e3e-5d6c-4042-89f0-f7af5ea09dcd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa253e2871cc4dd68edcbf21714a87f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:19:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:19:26Z,use_quota=True,user_id='ab0f3774b20a44589f6b8b5efa81eda4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 10:19:42 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-d373ab88-6777-45dd-a81e-bf0d7b8be304 tempest-VolumesActionsTest-1241883822 None] Creating volume 61be2e3e-5d6c-4042-89f0-f7af5ea09dcd {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:19:42 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-d373ab88-6777-45dd-a81e-bf0d7b8be304 tempest-VolumesActionsTest-1241883822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:19:42 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-d373ab88-6777-45dd-a81e-bf0d7b8be304 tempest-VolumesActionsTest-1241883822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:19:42 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-d373ab88-6777-45dd-a81e-bf0d7b8be304 tempest-VolumesActionsTest-1241883822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:19:42 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-d373ab88-6777-45dd-a81e-bf0d7b8be304 tempest-VolumesActionsTest-1241883822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:19:42 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-d373ab88-6777-45dd-a81e-bf0d7b8be304 tempest-VolumesActionsTest-1241883822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:19:42 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-d373ab88-6777-45dd-a81e-bf0d7b8be304 tempest-VolumesActionsTest-1241883822 None] Selected osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:19:42 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-d373ab88-6777-45dd-a81e-bf0d7b8be304 tempest-VolumesActionsTest-1241883822 None] casted to osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 Nov 04 10:19:42 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d373ab88-6777-45dd-a81e-bf0d7b8be304 tempest-VolumesActionsTest-1241883822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-61be2e3e-5d6c-4042-89f0-f7af5ea09dcd 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:19:42 devstack sudo[96632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-61be2e3e-5d6c-4042-89f0-f7af5ea09dcd 1073741824 Nov 04 10:19:42 devstack sudo[96632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:19:42 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-b3c34af2-c8f4-43ad-8126-219c9afafa34 tempest-VolumesSnapshotTestJSON-1835544826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (945afa72-cd5c-46c0-a93b-759a344e03c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d58258e-c62f-4225-a831-97910ff79951', 'volume_size': 2, 'snapshot_id': '2466f037-152d-4bc0-968f-09f3c8b384d6'}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:19:42 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-b3c34af2-c8f4-43ad-8126-219c9afafa34 tempest-VolumesSnapshotTestJSON-1835544826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fffacff5-bcca-4cad-b538-95096b14e1a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:19:42 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-b3c34af2-c8f4-43ad-8126-219c9afafa34 tempest-VolumesSnapshotTestJSON-1835544826 None] Volume volume-9d58258e-c62f-4225-a831-97910ff79951 (9d58258e-c62f-4225-a831-97910ff79951): created successfully Nov 04 10:19:42 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-b3c34af2-c8f4-43ad-8126-219c9afafa34 tempest-VolumesSnapshotTestJSON-1835544826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fffacff5-bcca-4cad-b538-95096b14e1a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:19:42 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-b3c34af2-c8f4-43ad-8126-219c9afafa34 tempest-VolumesSnapshotTestJSON-1835544826 None] Flow 'volume_create_manager' (94d14bb1-68d2-44c9-9878-e9bc503358be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:19:42 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-b3c34af2-c8f4-43ad-8126-219c9afafa34 tempest-VolumesSnapshotTestJSON-1835544826 None] Created volume successfully. Nov 04 10:19:42 devstack sudo[96632]: pam_unix(sudo:session): session closed for user root Nov 04 10:19:42 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d373ab88-6777-45dd-a81e-bf0d7b8be304 tempest-VolumesActionsTest-1241883822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-61be2e3e-5d6c-4042-89f0-f7af5ea09dcd 1073741824" returned: 0 in 0.478s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:19:42 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d373ab88-6777-45dd-a81e-bf0d7b8be304 tempest-VolumesActionsTest-1241883822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-61be2e3e-5d6c-4042-89f0-f7af5ea09dcd {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:19:42 devstack sudo[96639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-61be2e3e-5d6c-4042-89f0-f7af5ea09dcd Nov 04 10:19:42 devstack sudo[96639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:19:42 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-6bbe64e3-4bbf-41f1-a043-bb4b61a5b4ba tempest-VolumesSnapshotTestJSON-1835544826 None] Acquiring lock "cinder-9d58258e-c62f-4225-a831-97910ff79951-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:19:42 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-6bbe64e3-4bbf-41f1-a043-bb4b61a5b4ba tempest-VolumesSnapshotTestJSON-1835544826 None] Lock "cinder-9d58258e-c62f-4225-a831-97910ff79951-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:19:42 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-6bbe64e3-4bbf-41f1-a043-bb4b61a5b4ba tempest-VolumesSnapshotTestJSON-1835544826 None] Acquiring lock "cinder-quobyte-9d58258e-c62f-4225-a831-97910ff79951" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:19:42 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-6bbe64e3-4bbf-41f1-a043-bb4b61a5b4ba tempest-VolumesSnapshotTestJSON-1835544826 None] Lock "cinder-quobyte-9d58258e-c62f-4225-a831-97910ff79951" acquired by "delete_volume" :: waited 0.023s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:19:42 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[91e74dfb-14bd-443b-b9c6-4e79d94bcbfd]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:19:42 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6bbe64e3-4bbf-41f1-a043-bb4b61a5b4ba tempest-VolumesSnapshotTestJSON-1835544826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-9d58258e-c62f-4225-a831-97910ff79951 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:19:42 devstack sudo[96641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-9d58258e-c62f-4225-a831-97910ff79951 Nov 04 10:19:42 devstack sudo[96641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:19:42 devstack sudo[96639]: pam_unix(sudo:session): session closed for user root Nov 04 10:19:42 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d373ab88-6777-45dd-a81e-bf0d7b8be304 tempest-VolumesActionsTest-1241883822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-61be2e3e-5d6c-4042-89f0-f7af5ea09dcd" returned: 0 in 0.338s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:19:42 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-d373ab88-6777-45dd-a81e-bf0d7b8be304 tempest-VolumesActionsTest-1241883822 None] <== create_volume: return (856ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 10:19:42 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-d373ab88-6777-45dd-a81e-bf0d7b8be304 tempest-VolumesActionsTest-1241883822 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.860s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:19:42 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-82f17d00-7a1c-4361-a6d7-a858de16d88d tempest-VolumesGetTest-1874363189 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.200s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:19:42 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-82f17d00-7a1c-4361-a6d7-a858de16d88d tempest-VolumesGetTest-1874363189 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:19:34Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1927728446',display_name='tempest-VolumesGetTest-Volume-1736910078',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15a74233-6fae-4165-938a-cd6055e1b960,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1fb9cd956e4c4871af0e738ec6daa746',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:19:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:19:34Z,use_quota=True,user_id='95fe690f67df4d6f87922789a65a81d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 10:19:42 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-82f17d00-7a1c-4361-a6d7-a858de16d88d tempest-VolumesGetTest-1874363189 None] Creating volume 15a74233-6fae-4165-938a-cd6055e1b960 {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:19:42 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-82f17d00-7a1c-4361-a6d7-a858de16d88d tempest-VolumesGetTest-1874363189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:19:42 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-82f17d00-7a1c-4361-a6d7-a858de16d88d tempest-VolumesGetTest-1874363189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:19:42 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-82f17d00-7a1c-4361-a6d7-a858de16d88d tempest-VolumesGetTest-1874363189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:19:42 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-82f17d00-7a1c-4361-a6d7-a858de16d88d tempest-VolumesGetTest-1874363189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:19:42 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-82f17d00-7a1c-4361-a6d7-a858de16d88d tempest-VolumesGetTest-1874363189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:19:42 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-82f17d00-7a1c-4361-a6d7-a858de16d88d tempest-VolumesGetTest-1874363189 None] Selected osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:19:42 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-82f17d00-7a1c-4361-a6d7-a858de16d88d tempest-VolumesGetTest-1874363189 None] casted to osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 Nov 04 10:19:42 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-82f17d00-7a1c-4361-a6d7-a858de16d88d tempest-VolumesGetTest-1874363189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-15a74233-6fae-4165-938a-cd6055e1b960 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:19:42 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-d373ab88-6777-45dd-a81e-bf0d7b8be304 tempest-VolumesActionsTest-1241883822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1517457c-d813-4f87-8f0a-5588e478edcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61be2e3e-5d6c-4042-89f0-f7af5ea09dcd', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:19:42 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-d373ab88-6777-45dd-a81e-bf0d7b8be304 tempest-VolumesActionsTest-1241883822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11084201-021d-490b-a4b9-76db3d7914ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:19:42 devstack sudo[96644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-15a74233-6fae-4165-938a-cd6055e1b960 1073741824 Nov 04 10:19:42 devstack sudo[96644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:19:42 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-d373ab88-6777-45dd-a81e-bf0d7b8be304 tempest-VolumesActionsTest-1241883822 None] Volume volume-61be2e3e-5d6c-4042-89f0-f7af5ea09dcd (61be2e3e-5d6c-4042-89f0-f7af5ea09dcd): created successfully Nov 04 10:19:42 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-d373ab88-6777-45dd-a81e-bf0d7b8be304 tempest-VolumesActionsTest-1241883822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11084201-021d-490b-a4b9-76db3d7914ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:19:42 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-d373ab88-6777-45dd-a81e-bf0d7b8be304 tempest-VolumesActionsTest-1241883822 None] Flow 'volume_create_manager' (df47f7b1-1175-4634-a0de-c2a3b9d1f35f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:19:42 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-d373ab88-6777-45dd-a81e-bf0d7b8be304 tempest-VolumesActionsTest-1241883822 None] Created volume successfully. Nov 04 10:19:43 devstack sudo[96641]: pam_unix(sudo:session): session closed for user root Nov 04 10:19:43 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6bbe64e3-4bbf-41f1-a043-bb4b61a5b4ba tempest-VolumesSnapshotTestJSON-1835544826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-9d58258e-c62f-4225-a831-97910ff79951" returned: 0 in 0.394s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:19:43 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6bbe64e3-4bbf-41f1-a043-bb4b61a5b4ba tempest-VolumesSnapshotTestJSON-1835544826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-9d58258e-c62f-4225-a831-97910ff79951 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:19:43 devstack sudo[96650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-9d58258e-c62f-4225-a831-97910ff79951 Nov 04 10:19:43 devstack sudo[96650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:19:43 devstack sudo[96650]: pam_unix(sudo:session): session closed for user root Nov 04 10:19:43 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6bbe64e3-4bbf-41f1-a043-bb4b61a5b4ba tempest-VolumesSnapshotTestJSON-1835544826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-9d58258e-c62f-4225-a831-97910ff79951" returned: 0 in 0.333s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:19:43 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-6bbe64e3-4bbf-41f1-a043-bb4b61a5b4ba tempest-VolumesSnapshotTestJSON-1835544826 None] Lock "cinder-quobyte-9d58258e-c62f-4225-a831-97910ff79951" released by "delete_volume" :: held 0.798s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:19:43 devstack sudo[96644]: pam_unix(sudo:session): session closed for user root Nov 04 10:19:43 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-82f17d00-7a1c-4361-a6d7-a858de16d88d tempest-VolumesGetTest-1874363189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-15a74233-6fae-4165-938a-cd6055e1b960 1073741824" returned: 0 in 0.560s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:19:43 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-82f17d00-7a1c-4361-a6d7-a858de16d88d tempest-VolumesGetTest-1874363189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-15a74233-6fae-4165-938a-cd6055e1b960 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:19:43 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-6bbe64e3-4bbf-41f1-a043-bb4b61a5b4ba tempest-VolumesSnapshotTestJSON-1835544826 None] Created reservations ['e46ce52c-2744-4f36-ab73-7bad6b27900a', 'e034923f-7870-47aa-87d5-c012234f2de3', '29727424-520f-4a6d-9c2a-5f29ca85da76', '7faa525c-a312-4255-a6d7-abd4e17631a0'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:19:43 devstack sudo[96657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-15a74233-6fae-4165-938a-cd6055e1b960 Nov 04 10:19:43 devstack sudo[96657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:19:43 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-6bbe64e3-4bbf-41f1-a043-bb4b61a5b4ba tempest-VolumesSnapshotTestJSON-1835544826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:19:43 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-6bbe64e3-4bbf-41f1-a043-bb4b61a5b4ba tempest-VolumesSnapshotTestJSON-1835544826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:19:43 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-6bbe64e3-4bbf-41f1-a043-bb4b61a5b4ba tempest-VolumesSnapshotTestJSON-1835544826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:19:43 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-6bbe64e3-4bbf-41f1-a043-bb4b61a5b4ba tempest-VolumesSnapshotTestJSON-1835544826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:19:43 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-6bbe64e3-4bbf-41f1-a043-bb4b61a5b4ba tempest-VolumesSnapshotTestJSON-1835544826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:19:43 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6bbe64e3-4bbf-41f1-a043-bb4b61a5b4ba tempest-VolumesSnapshotTestJSON-1835544826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:19:43 devstack sudo[96659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:19:43 devstack sudo[96659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:19:43 devstack sudo[96657]: pam_unix(sudo:session): session closed for user root Nov 04 10:19:43 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-82f17d00-7a1c-4361-a6d7-a858de16d88d tempest-VolumesGetTest-1874363189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-15a74233-6fae-4165-938a-cd6055e1b960" returned: 0 in 0.328s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:19:43 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-82f17d00-7a1c-4361-a6d7-a858de16d88d tempest-VolumesGetTest-1874363189 None] <== create_volume: return (949ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 10:19:43 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-82f17d00-7a1c-4361-a6d7-a858de16d88d tempest-VolumesGetTest-1874363189 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.952s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:19:43 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-82f17d00-7a1c-4361-a6d7-a858de16d88d tempest-VolumesGetTest-1874363189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a847ea8a-34ba-47ea-a42a-3bebc209744f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15a74233-6fae-4165-938a-cd6055e1b960', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:19:43 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-82f17d00-7a1c-4361-a6d7-a858de16d88d tempest-VolumesGetTest-1874363189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcb4e017-c80c-4d7d-b835-2436de4b1e59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:19:43 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-82f17d00-7a1c-4361-a6d7-a858de16d88d tempest-VolumesGetTest-1874363189 None] Volume volume-15a74233-6fae-4165-938a-cd6055e1b960 (15a74233-6fae-4165-938a-cd6055e1b960): created successfully Nov 04 10:19:43 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-82f17d00-7a1c-4361-a6d7-a858de16d88d tempest-VolumesGetTest-1874363189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcb4e017-c80c-4d7d-b835-2436de4b1e59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:19:43 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-82f17d00-7a1c-4361-a6d7-a858de16d88d tempest-VolumesGetTest-1874363189 None] Flow 'volume_create_manager' (8be36d1b-8943-4786-b6b1-fb57d2b1f779) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:19:43 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-82469719-8099-422c-b592-76ca3ecba4f2 tempest-VolumesSnapshotTestJSON-1835544826 None] Acquiring lock "cinder-2466f037-152d-4bc0-968f-09f3c8b384d6-delete_snapshot" by "delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:19:43 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-82f17d00-7a1c-4361-a6d7-a858de16d88d tempest-VolumesGetTest-1874363189 None] Created volume successfully. Nov 04 10:19:43 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-82469719-8099-422c-b592-76ca3ecba4f2 tempest-VolumesSnapshotTestJSON-1835544826 None] Lock "cinder-2466f037-152d-4bc0-968f-09f3c8b384d6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.054s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:19:43 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-82469719-8099-422c-b592-76ca3ecba4f2 tempest-VolumesSnapshotTestJSON-1835544826 None] Acquiring lock "cinder-quobyte-cb9258e0-0481-4295-805c-40a88e46fc53" by "delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:19:44 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-82469719-8099-422c-b592-76ca3ecba4f2 tempest-VolumesSnapshotTestJSON-1835544826 None] Lock "cinder-quobyte-cb9258e0-0481-4295-805c-40a88e46fc53" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:19:44 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-82469719-8099-422c-b592-76ca3ecba4f2 tempest-VolumesSnapshotTestJSON-1835544826 None] Acquiring lock "cinder-quobyte-2466f037-152d-4bc0-968f-09f3c8b384d6" by "_delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:19:44 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-82469719-8099-422c-b592-76ca3ecba4f2 tempest-VolumesSnapshotTestJSON-1835544826 None] Lock "cinder-quobyte-2466f037-152d-4bc0-968f-09f3c8b384d6" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:19:44 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-82469719-8099-422c-b592-76ca3ecba4f2 tempest-VolumesSnapshotTestJSON-1835544826 None] Deleting offline snapshot 2466f037-152d-4bc0-968f-09f3c8b384d6 of volume cb9258e0-0481-4295-805c-40a88e46fc53 {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 10:19:44 devstack sudo[96659]: pam_unix(sudo:session): session closed for user root Nov 04 10:19:44 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-82469719-8099-422c-b592-76ca3ecba4f2 tempest-VolumesSnapshotTestJSON-1835544826 None] snapshot_file for this snap is: volume-cb9258e0-0481-4295-805c-40a88e46fc53.2466f037-152d-4bc0-968f-09f3c8b384d6 {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 10:19:44 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6bbe64e3-4bbf-41f1-a043-bb4b61a5b4ba tempest-VolumesSnapshotTestJSON-1835544826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.420s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:19:44 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-6bbe64e3-4bbf-41f1-a043-bb4b61a5b4ba tempest-VolumesSnapshotTestJSON-1835544826 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:19:44 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-6bbe64e3-4bbf-41f1-a043-bb4b61a5b4ba tempest-VolumesSnapshotTestJSON-1835544826 None] Deleted volume successfully. Nov 04 10:19:44 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[408c71ce-a157-4d29-b400-a81688cc3ad3]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:19:44 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-82469719-8099-422c-b592-76ca3ecba4f2 tempest-VolumesSnapshotTestJSON-1835544826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-cb9258e0-0481-4295-805c-40a88e46fc53.2466f037-152d-4bc0-968f-09f3c8b384d6 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:19:44 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-6bbe64e3-4bbf-41f1-a043-bb4b61a5b4ba tempest-VolumesSnapshotTestJSON-1835544826 None] Lock "cinder-9d58258e-c62f-4225-a831-97910ff79951-delete_volume" released by "delete_volume" :: held 1.528s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:19:44 devstack sudo[96663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-cb9258e0-0481-4295-805c-40a88e46fc53.2466f037-152d-4bc0-968f-09f3c8b384d6 Nov 04 10:19:44 devstack sudo[96663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:19:44 devstack sudo[96663]: pam_unix(sudo:session): session closed for user root Nov 04 10:19:44 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-82469719-8099-422c-b592-76ca3ecba4f2 tempest-VolumesSnapshotTestJSON-1835544826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-cb9258e0-0481-4295-805c-40a88e46fc53.2466f037-152d-4bc0-968f-09f3c8b384d6" returned: 0 in 0.471s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:19:44 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-82469719-8099-422c-b592-76ca3ecba4f2 tempest-VolumesSnapshotTestJSON-1835544826 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cb9258e0-0481-4295-805c-40a88e46fc53(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87068) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 10:19:44 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bdba8c1-3ecc-40a9-8258-fcbca680331c]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:19:44 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-82469719-8099-422c-b592-76ca3ecba4f2 tempest-VolumesSnapshotTestJSON-1835544826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-cb9258e0-0481-4295-805c-40a88e46fc53 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:19:44 devstack sudo[96688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-cb9258e0-0481-4295-805c-40a88e46fc53 Nov 04 10:19:44 devstack sudo[96688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:19:44 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-57b55e48-02c5-4c93-a969-11faa3579eaf tempest-VolumesGetTest-1874363189 None] Acquiring lock "cinder-15a74233-6fae-4165-938a-cd6055e1b960-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:19:44 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-57b55e48-02c5-4c93-a969-11faa3579eaf tempest-VolumesGetTest-1874363189 None] Lock "cinder-15a74233-6fae-4165-938a-cd6055e1b960-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:19:44 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-57b55e48-02c5-4c93-a969-11faa3579eaf tempest-VolumesGetTest-1874363189 None] Acquiring lock "cinder-quobyte-15a74233-6fae-4165-938a-cd6055e1b960" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:19:44 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-57b55e48-02c5-4c93-a969-11faa3579eaf tempest-VolumesGetTest-1874363189 None] Lock "cinder-quobyte-15a74233-6fae-4165-938a-cd6055e1b960" acquired by "delete_volume" :: waited 0.016s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:19:45 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[684e0c90-cb35-4bb8-acfb-1d97c2479cb8]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:19:45 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-57b55e48-02c5-4c93-a969-11faa3579eaf tempest-VolumesGetTest-1874363189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-15a74233-6fae-4165-938a-cd6055e1b960 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:19:45 devstack sudo[96691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-15a74233-6fae-4165-938a-cd6055e1b960 Nov 04 10:19:45 devstack sudo[96691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:19:45 devstack sudo[96688]: pam_unix(sudo:session): session closed for user root Nov 04 10:19:45 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-82469719-8099-422c-b592-76ca3ecba4f2 tempest-VolumesSnapshotTestJSON-1835544826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-cb9258e0-0481-4295-805c-40a88e46fc53" returned: 0 in 0.645s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:19:45 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-82469719-8099-422c-b592-76ca3ecba4f2 tempest-VolumesSnapshotTestJSON-1835544826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-cb9258e0-0481-4295-805c-40a88e46fc53.2466f037-152d-4bc0-968f-09f3c8b384d6 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:19:45 devstack sudo[96695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-cb9258e0-0481-4295-805c-40a88e46fc53.2466f037-152d-4bc0-968f-09f3c8b384d6 Nov 04 10:19:45 devstack sudo[96695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:19:45 devstack sudo[96691]: pam_unix(sudo:session): session closed for user root Nov 04 10:19:45 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-57b55e48-02c5-4c93-a969-11faa3579eaf tempest-VolumesGetTest-1874363189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-15a74233-6fae-4165-938a-cd6055e1b960" returned: 0 in 0.456s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:19:45 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-57b55e48-02c5-4c93-a969-11faa3579eaf tempest-VolumesGetTest-1874363189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-15a74233-6fae-4165-938a-cd6055e1b960 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:19:45 devstack sudo[96701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-15a74233-6fae-4165-938a-cd6055e1b960 Nov 04 10:19:45 devstack sudo[96701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:19:45 devstack sudo[96695]: pam_unix(sudo:session): session closed for user root Nov 04 10:19:45 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-82469719-8099-422c-b592-76ca3ecba4f2 tempest-VolumesSnapshotTestJSON-1835544826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-cb9258e0-0481-4295-805c-40a88e46fc53.2466f037-152d-4bc0-968f-09f3c8b384d6" returned: 0 in 0.422s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:19:45 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-82469719-8099-422c-b592-76ca3ecba4f2 tempest-VolumesSnapshotTestJSON-1835544826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-cb9258e0-0481-4295-805c-40a88e46fc53.2466f037-152d-4bc0-968f-09f3c8b384d6 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:19:45 devstack sudo[96708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-cb9258e0-0481-4295-805c-40a88e46fc53.2466f037-152d-4bc0-968f-09f3c8b384d6 Nov 04 10:19:45 devstack sudo[96708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:19:45 devstack sudo[96701]: pam_unix(sudo:session): session closed for user root Nov 04 10:19:45 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-57b55e48-02c5-4c93-a969-11faa3579eaf tempest-VolumesGetTest-1874363189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-15a74233-6fae-4165-938a-cd6055e1b960" returned: 0 in 0.287s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:19:45 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-57b55e48-02c5-4c93-a969-11faa3579eaf tempest-VolumesGetTest-1874363189 None] Lock "cinder-quobyte-15a74233-6fae-4165-938a-cd6055e1b960" released by "delete_volume" :: held 0.805s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:19:45 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-57b55e48-02c5-4c93-a969-11faa3579eaf tempest-VolumesGetTest-1874363189 None] Created reservations ['4ff547ab-9701-48d4-862c-c1cf7cdafd4c', '8dc19fc2-8f1b-4218-bebf-920e2d50faa6', '7c801e65-fa69-45db-b41c-0b8e7d30fce2', '62132b1f-5f36-4373-a2f3-2158e09f4445'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:19:45 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-57b55e48-02c5-4c93-a969-11faa3579eaf tempest-VolumesGetTest-1874363189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:19:45 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-57b55e48-02c5-4c93-a969-11faa3579eaf tempest-VolumesGetTest-1874363189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:19:45 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-57b55e48-02c5-4c93-a969-11faa3579eaf tempest-VolumesGetTest-1874363189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:19:45 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-57b55e48-02c5-4c93-a969-11faa3579eaf tempest-VolumesGetTest-1874363189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:19:45 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-57b55e48-02c5-4c93-a969-11faa3579eaf tempest-VolumesGetTest-1874363189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:19:45 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-57b55e48-02c5-4c93-a969-11faa3579eaf tempest-VolumesGetTest-1874363189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:19:46 devstack sudo[96711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:19:46 devstack sudo[96711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:19:46 devstack sudo[96708]: pam_unix(sudo:session): session closed for user root Nov 04 10:19:46 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-82469719-8099-422c-b592-76ca3ecba4f2 tempest-VolumesSnapshotTestJSON-1835544826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-cb9258e0-0481-4295-805c-40a88e46fc53.2466f037-152d-4bc0-968f-09f3c8b384d6" returned: 0 in 0.349s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:19:46 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-82469719-8099-422c-b592-76ca3ecba4f2 tempest-VolumesSnapshotTestJSON-1835544826 None] Lock "cinder-quobyte-2466f037-152d-4bc0-968f-09f3c8b384d6" released by "_delete_snapshot" :: held 2.091s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:19:46 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-82469719-8099-422c-b592-76ca3ecba4f2 tempest-VolumesSnapshotTestJSON-1835544826 None] Lock "cinder-quobyte-cb9258e0-0481-4295-805c-40a88e46fc53" released by "delete_snapshot" :: held 2.118s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:19:46 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-82469719-8099-422c-b592-76ca3ecba4f2 tempest-VolumesSnapshotTestJSON-1835544826 None] Created reservations ['ad189bff-e8bd-4a56-824f-8cf7c12631fe', '447368d9-f3dc-46a8-bbd0-3c0d6d1c5ec6', '804636b7-10a5-499f-9f44-768f90c133e8', 'd53edffa-8b4a-435c-8fa9-edeb09145f2f'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:19:46 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-d2a81208-9303-4412-8126-7e8758bfb6dd tempest-VolumesGetTest-1874363189 None] Acquiring lock "cinder-63a7f5eb-a002-484d-b701-110adf4a863b-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:19:46 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-82469719-8099-422c-b592-76ca3ecba4f2 tempest-VolumesSnapshotTestJSON-1835544826 None] Delete snapshot completed successfully. Nov 04 10:19:46 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-82469719-8099-422c-b592-76ca3ecba4f2 tempest-VolumesSnapshotTestJSON-1835544826 None] Lock "cinder-2466f037-152d-4bc0-968f-09f3c8b384d6-delete_snapshot" released by "delete_snapshot" :: held 2.299s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:19:46 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-d2a81208-9303-4412-8126-7e8758bfb6dd tempest-VolumesGetTest-1874363189 None] Lock "cinder-63a7f5eb-a002-484d-b701-110adf4a863b-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:19:46 devstack sudo[96711]: pam_unix(sudo:session): session closed for user root Nov 04 10:19:46 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-d2a81208-9303-4412-8126-7e8758bfb6dd tempest-VolumesGetTest-1874363189 None] Acquiring lock "cinder-quobyte-63a7f5eb-a002-484d-b701-110adf4a863b" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:19:46 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-57b55e48-02c5-4c93-a969-11faa3579eaf tempest-VolumesGetTest-1874363189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.354s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:19:46 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-57b55e48-02c5-4c93-a969-11faa3579eaf tempest-VolumesGetTest-1874363189 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:19:46 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-57b55e48-02c5-4c93-a969-11faa3579eaf tempest-VolumesGetTest-1874363189 None] Deleted volume successfully. Nov 04 10:19:46 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-d2a81208-9303-4412-8126-7e8758bfb6dd tempest-VolumesGetTest-1874363189 None] Lock "cinder-quobyte-63a7f5eb-a002-484d-b701-110adf4a863b" acquired by "delete_volume" :: waited 0.025s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:19:46 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-57b55e48-02c5-4c93-a969-11faa3579eaf tempest-VolumesGetTest-1874363189 None] Lock "cinder-15a74233-6fae-4165-938a-cd6055e1b960-delete_volume" released by "delete_volume" :: held 1.495s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:19:46 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[958d454b-d03c-48ab-ae55-37240190ceaa]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:19:46 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d2a81208-9303-4412-8126-7e8758bfb6dd tempest-VolumesGetTest-1874363189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-63a7f5eb-a002-484d-b701-110adf4a863b {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:19:46 devstack sudo[96718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-63a7f5eb-a002-484d-b701-110adf4a863b Nov 04 10:19:46 devstack sudo[96718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:19:46 devstack sudo[96718]: pam_unix(sudo:session): session closed for user root Nov 04 10:19:46 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d2a81208-9303-4412-8126-7e8758bfb6dd tempest-VolumesGetTest-1874363189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-63a7f5eb-a002-484d-b701-110adf4a863b" returned: 0 in 0.519s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:19:46 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d2a81208-9303-4412-8126-7e8758bfb6dd tempest-VolumesGetTest-1874363189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-63a7f5eb-a002-484d-b701-110adf4a863b {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:19:46 devstack sudo[96738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-63a7f5eb-a002-484d-b701-110adf4a863b Nov 04 10:19:46 devstack sudo[96738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:19:47 devstack sudo[96738]: pam_unix(sudo:session): session closed for user root Nov 04 10:19:47 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d2a81208-9303-4412-8126-7e8758bfb6dd tempest-VolumesGetTest-1874363189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-63a7f5eb-a002-484d-b701-110adf4a863b" returned: 0 in 0.279s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:19:47 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-d2a81208-9303-4412-8126-7e8758bfb6dd tempest-VolumesGetTest-1874363189 None] Lock "cinder-quobyte-63a7f5eb-a002-484d-b701-110adf4a863b" released by "delete_volume" :: held 0.858s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:19:47 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-6ee7b559-ebe7-44c6-9011-6cddec67cdc2 tempest-VolumesSnapshotTestJSON-1835544826 None] Acquiring lock "cinder-cb9258e0-0481-4295-805c-40a88e46fc53-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:19:47 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-d2a81208-9303-4412-8126-7e8758bfb6dd tempest-VolumesGetTest-1874363189 None] Created reservations ['3e9cd97d-3e4e-4502-bf84-c75e60b23fae', 'e236a06e-92e2-4be4-93be-dc60c3054dbc', 'b10f5e2d-f57a-4851-85c5-ee0cee2e830c', 'b12621d0-0207-4435-967f-e1473751e66f'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:19:47 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-6ee7b559-ebe7-44c6-9011-6cddec67cdc2 tempest-VolumesSnapshotTestJSON-1835544826 None] Lock "cinder-cb9258e0-0481-4295-805c-40a88e46fc53-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:19:47 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-6ee7b559-ebe7-44c6-9011-6cddec67cdc2 tempest-VolumesSnapshotTestJSON-1835544826 None] Acquiring lock "cinder-quobyte-cb9258e0-0481-4295-805c-40a88e46fc53" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:19:47 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-6ee7b559-ebe7-44c6-9011-6cddec67cdc2 tempest-VolumesSnapshotTestJSON-1835544826 None] Lock "cinder-quobyte-cb9258e0-0481-4295-805c-40a88e46fc53" acquired by "delete_volume" :: waited 0.025s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:19:47 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-d2a81208-9303-4412-8126-7e8758bfb6dd tempest-VolumesGetTest-1874363189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:19:47 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-d2a81208-9303-4412-8126-7e8758bfb6dd tempest-VolumesGetTest-1874363189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:19:47 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-d2a81208-9303-4412-8126-7e8758bfb6dd tempest-VolumesGetTest-1874363189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:19:47 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-d2a81208-9303-4412-8126-7e8758bfb6dd tempest-VolumesGetTest-1874363189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:19:47 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-d2a81208-9303-4412-8126-7e8758bfb6dd tempest-VolumesGetTest-1874363189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:19:47 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d2a81208-9303-4412-8126-7e8758bfb6dd tempest-VolumesGetTest-1874363189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:19:47 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c1a0777-f689-4644-9c8b-38110b95171b]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:19:47 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6ee7b559-ebe7-44c6-9011-6cddec67cdc2 tempest-VolumesSnapshotTestJSON-1835544826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-cb9258e0-0481-4295-805c-40a88e46fc53 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:19:47 devstack sudo[96745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:19:47 devstack sudo[96745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:19:47 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-31dd7dba-48bb-41f9-992e-7ee6ddcbf73c tempest-VolumesGetTest-1874363189 None] Acquiring lock "cinder-8fcd8200-de7b-40f6-b478-0840d62320e2-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:19:47 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-31dd7dba-48bb-41f9-992e-7ee6ddcbf73c tempest-VolumesGetTest-1874363189 None] Lock "cinder-8fcd8200-de7b-40f6-b478-0840d62320e2-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:19:47 devstack sudo[96746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-cb9258e0-0481-4295-805c-40a88e46fc53 Nov 04 10:19:47 devstack sudo[96746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:19:47 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-31dd7dba-48bb-41f9-992e-7ee6ddcbf73c tempest-VolumesGetTest-1874363189 None] Acquiring lock "cinder-quobyte-8fcd8200-de7b-40f6-b478-0840d62320e2" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:19:47 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-31dd7dba-48bb-41f9-992e-7ee6ddcbf73c tempest-VolumesGetTest-1874363189 None] Lock "cinder-quobyte-8fcd8200-de7b-40f6-b478-0840d62320e2" acquired by "delete_volume" :: waited 0.027s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:19:47 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[809ba15e-a443-45ff-8798-e549a76ebeaf]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:19:47 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-31dd7dba-48bb-41f9-992e-7ee6ddcbf73c tempest-VolumesGetTest-1874363189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-8fcd8200-de7b-40f6-b478-0840d62320e2 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:19:47 devstack sudo[96745]: pam_unix(sudo:session): session closed for user root Nov 04 10:19:47 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d2a81208-9303-4412-8126-7e8758bfb6dd tempest-VolumesGetTest-1874363189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.341s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:19:47 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-d2a81208-9303-4412-8126-7e8758bfb6dd tempest-VolumesGetTest-1874363189 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:19:47 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-d2a81208-9303-4412-8126-7e8758bfb6dd tempest-VolumesGetTest-1874363189 None] Deleted volume successfully. Nov 04 10:19:47 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-d2a81208-9303-4412-8126-7e8758bfb6dd tempest-VolumesGetTest-1874363189 None] Lock "cinder-63a7f5eb-a002-484d-b701-110adf4a863b-delete_volume" released by "delete_volume" :: held 1.555s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:19:47 devstack sudo[96750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-8fcd8200-de7b-40f6-b478-0840d62320e2 Nov 04 10:19:47 devstack sudo[96750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:19:47 devstack sudo[96746]: pam_unix(sudo:session): session closed for user root Nov 04 10:19:47 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6ee7b559-ebe7-44c6-9011-6cddec67cdc2 tempest-VolumesSnapshotTestJSON-1835544826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-cb9258e0-0481-4295-805c-40a88e46fc53" returned: 0 in 0.470s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:19:47 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6ee7b559-ebe7-44c6-9011-6cddec67cdc2 tempest-VolumesSnapshotTestJSON-1835544826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-cb9258e0-0481-4295-805c-40a88e46fc53 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:19:47 devstack sudo[96755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-cb9258e0-0481-4295-805c-40a88e46fc53 Nov 04 10:19:47 devstack sudo[96755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:19:48 devstack sudo[96750]: pam_unix(sudo:session): session closed for user root Nov 04 10:19:48 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-31dd7dba-48bb-41f9-992e-7ee6ddcbf73c tempest-VolumesGetTest-1874363189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-8fcd8200-de7b-40f6-b478-0840d62320e2" returned: 0 in 0.458s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:19:48 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-31dd7dba-48bb-41f9-992e-7ee6ddcbf73c tempest-VolumesGetTest-1874363189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-8fcd8200-de7b-40f6-b478-0840d62320e2 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:19:48 devstack sudo[96761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-8fcd8200-de7b-40f6-b478-0840d62320e2 Nov 04 10:19:48 devstack sudo[96761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:19:48 devstack sudo[96755]: pam_unix(sudo:session): session closed for user root Nov 04 10:19:48 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6ee7b559-ebe7-44c6-9011-6cddec67cdc2 tempest-VolumesSnapshotTestJSON-1835544826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-cb9258e0-0481-4295-805c-40a88e46fc53" returned: 0 in 0.354s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:19:48 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-6ee7b559-ebe7-44c6-9011-6cddec67cdc2 tempest-VolumesSnapshotTestJSON-1835544826 None] Lock "cinder-quobyte-cb9258e0-0481-4295-805c-40a88e46fc53" released by "delete_volume" :: held 0.938s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:19:48 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-6ee7b559-ebe7-44c6-9011-6cddec67cdc2 tempest-VolumesSnapshotTestJSON-1835544826 None] Created reservations ['ead7b8e9-810f-43ee-9268-7f9c3b3a7859', '329e214d-1025-47b4-af2e-aa78170a84bf', 'f1f4bde7-0558-41da-a0bb-d390e6d8d71e', 'd9bc4f47-6e3d-48ab-9c0c-1029f778a96e'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:19:48 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-6ee7b559-ebe7-44c6-9011-6cddec67cdc2 tempest-VolumesSnapshotTestJSON-1835544826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:19:48 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-6ee7b559-ebe7-44c6-9011-6cddec67cdc2 tempest-VolumesSnapshotTestJSON-1835544826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:19:48 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-6ee7b559-ebe7-44c6-9011-6cddec67cdc2 tempest-VolumesSnapshotTestJSON-1835544826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:19:48 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-6ee7b559-ebe7-44c6-9011-6cddec67cdc2 tempest-VolumesSnapshotTestJSON-1835544826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:19:48 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-6ee7b559-ebe7-44c6-9011-6cddec67cdc2 tempest-VolumesSnapshotTestJSON-1835544826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:19:48 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6ee7b559-ebe7-44c6-9011-6cddec67cdc2 tempest-VolumesSnapshotTestJSON-1835544826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:19:48 devstack sudo[96765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:19:48 devstack sudo[96765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:19:48 devstack sudo[96761]: pam_unix(sudo:session): session closed for user root Nov 04 10:19:48 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-31dd7dba-48bb-41f9-992e-7ee6ddcbf73c tempest-VolumesGetTest-1874363189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-8fcd8200-de7b-40f6-b478-0840d62320e2" returned: 0 in 0.332s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:19:48 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-31dd7dba-48bb-41f9-992e-7ee6ddcbf73c tempest-VolumesGetTest-1874363189 None] Lock "cinder-quobyte-8fcd8200-de7b-40f6-b478-0840d62320e2" released by "delete_volume" :: held 0.873s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:19:48 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-31dd7dba-48bb-41f9-992e-7ee6ddcbf73c tempest-VolumesGetTest-1874363189 None] Created reservations ['2a45509f-1e50-4ad3-b24e-33d3ec9d5e87', 'c75d2b6a-5226-4cab-be89-8327cc0d3d0e', '74eaccd5-7d40-440e-ae2d-b437e43bf20d', '9335a89b-4065-4545-b0ce-f411503ae6a8'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:19:48 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-31dd7dba-48bb-41f9-992e-7ee6ddcbf73c tempest-VolumesGetTest-1874363189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:19:48 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-31dd7dba-48bb-41f9-992e-7ee6ddcbf73c tempest-VolumesGetTest-1874363189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:19:48 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-31dd7dba-48bb-41f9-992e-7ee6ddcbf73c tempest-VolumesGetTest-1874363189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:19:48 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-31dd7dba-48bb-41f9-992e-7ee6ddcbf73c tempest-VolumesGetTest-1874363189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:19:48 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-31dd7dba-48bb-41f9-992e-7ee6ddcbf73c tempest-VolumesGetTest-1874363189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:19:48 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-31dd7dba-48bb-41f9-992e-7ee6ddcbf73c tempest-VolumesGetTest-1874363189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:19:48 devstack sudo[96765]: pam_unix(sudo:session): session closed for user root Nov 04 10:19:48 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6ee7b559-ebe7-44c6-9011-6cddec67cdc2 tempest-VolumesSnapshotTestJSON-1835544826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.317s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:19:48 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-6ee7b559-ebe7-44c6-9011-6cddec67cdc2 tempest-VolumesSnapshotTestJSON-1835544826 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:19:48 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-6ee7b559-ebe7-44c6-9011-6cddec67cdc2 tempest-VolumesSnapshotTestJSON-1835544826 None] Deleted volume successfully. Nov 04 10:19:48 devstack sudo[96768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:19:48 devstack sudo[96768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:19:48 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-6ee7b559-ebe7-44c6-9011-6cddec67cdc2 tempest-VolumesSnapshotTestJSON-1835544826 None] Lock "cinder-cb9258e0-0481-4295-805c-40a88e46fc53-delete_volume" released by "delete_volume" :: held 1.572s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:19:49 devstack sudo[96768]: pam_unix(sudo:session): session closed for user root Nov 04 10:19:49 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-31dd7dba-48bb-41f9-992e-7ee6ddcbf73c tempest-VolumesGetTest-1874363189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.518s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:19:49 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-31dd7dba-48bb-41f9-992e-7ee6ddcbf73c tempest-VolumesGetTest-1874363189 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:19:49 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-31dd7dba-48bb-41f9-992e-7ee6ddcbf73c tempest-VolumesGetTest-1874363189 None] Deleted volume successfully. Nov 04 10:19:49 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-31dd7dba-48bb-41f9-992e-7ee6ddcbf73c tempest-VolumesGetTest-1874363189 None] Lock "cinder-8fcd8200-de7b-40f6-b478-0840d62320e2-delete_volume" released by "delete_volume" :: held 1.753s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:19:50 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-203d295c-87dc-4adc-9cb6-0c1618465598 tempest-VolumesGetTest-1874363189 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:19:50 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-203d295c-87dc-4adc-9cb6-0c1618465598 tempest-VolumesGetTest-1874363189 None] Flow 'volume_create_manager' (2b1d546e-4c6b-4306-b462-676f7b09547f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:19:50 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-203d295c-87dc-4adc-9cb6-0c1618465598 tempest-VolumesGetTest-1874363189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d48f5a3a-0673-40ca-be01-22273fe4bb33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:19:50 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-203d295c-87dc-4adc-9cb6-0c1618465598 tempest-VolumesGetTest-1874363189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d48f5a3a-0673-40ca-be01-22273fe4bb33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:19:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-875946363',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=517d234d-18ac-4f27-ae22-2deda80f3b21,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='1fb9cd956e4c4871af0e738ec6daa746',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:19:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:19:50Z,use_quota=True,user_id='95fe690f67df4d6f87922789a65a81d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:19:50 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-203d295c-87dc-4adc-9cb6-0c1618465598 tempest-VolumesGetTest-1874363189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e27a5234-09e6-4974-af1d-c789ca41478b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:19:50 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-203d295c-87dc-4adc-9cb6-0c1618465598 tempest-VolumesGetTest-1874363189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e27a5234-09e6-4974-af1d-c789ca41478b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:19:50 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-203d295c-87dc-4adc-9cb6-0c1618465598 tempest-VolumesGetTest-1874363189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55cc2f13-3f73-47f0-b875-5b3f7427ca55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:19:50 devstack cinder-volume[87068]: DEBUG cinder.image.glance [None req-203d295c-87dc-4adc-9cb6-0c1618465598 tempest-VolumesGetTest-1874363189 None] Creating Keystone auth plugin from conf {{(pid=87068) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 04 10:19:50 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-5347b075-91e3-44dc-a1d1-64602b275a60 tempest-VolumesSnapshotTestJSON-1835544826 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:19:50 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-5347b075-91e3-44dc-a1d1-64602b275a60 tempest-VolumesSnapshotTestJSON-1835544826 None] Flow 'volume_create_manager' (459dc66b-5f9d-403d-97f1-c5733847f899) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:19:50 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-5347b075-91e3-44dc-a1d1-64602b275a60 tempest-VolumesSnapshotTestJSON-1835544826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b81b9ebe-3818-43f5-99a2-c773a3d0649f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:19:50 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-5347b075-91e3-44dc-a1d1-64602b275a60 tempest-VolumesSnapshotTestJSON-1835544826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b81b9ebe-3818-43f5-99a2-c773a3d0649f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:19:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1501739114',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8daede7c-3e86-4824-97cc-7d0296355d17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c119592eb9b94d74ad294736ec076621',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:19:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:19:51Z,use_quota=True,user_id='1810941f24e64a14ad02f068e0d989ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:19:50 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-5347b075-91e3-44dc-a1d1-64602b275a60 tempest-VolumesSnapshotTestJSON-1835544826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc6a8736-0acd-4f97-866a-1abf628812d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:19:50 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-5347b075-91e3-44dc-a1d1-64602b275a60 tempest-VolumesSnapshotTestJSON-1835544826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc6a8736-0acd-4f97-866a-1abf628812d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:19:50 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-5347b075-91e3-44dc-a1d1-64602b275a60 tempest-VolumesSnapshotTestJSON-1835544826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15b6a43d-e37e-4d5d-a3e2-e0bb1f150d6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:19:50 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-5347b075-91e3-44dc-a1d1-64602b275a60 tempest-VolumesSnapshotTestJSON-1835544826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15b6a43d-e37e-4d5d-a3e2-e0bb1f150d6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8daede7c-3e86-4824-97cc-7d0296355d17', 'volume_name': 'volume-8daede7c-3e86-4824-97cc-7d0296355d17', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:19:50 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-5347b075-91e3-44dc-a1d1-64602b275a60 tempest-VolumesSnapshotTestJSON-1835544826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcf79efc-112f-43ee-9a06-6ae2c355e790) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:19:50 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-5347b075-91e3-44dc-a1d1-64602b275a60 tempest-VolumesSnapshotTestJSON-1835544826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcf79efc-112f-43ee-9a06-6ae2c355e790) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:19:50 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-5347b075-91e3-44dc-a1d1-64602b275a60 tempest-VolumesSnapshotTestJSON-1835544826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (705271dc-f7e2-42a8-aefb-b0fbd2d8fa8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:19:50 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-5347b075-91e3-44dc-a1d1-64602b275a60 tempest-VolumesSnapshotTestJSON-1835544826 None] Volume 8daede7c-3e86-4824-97cc-7d0296355d17: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8daede7c-3e86-4824-97cc-7d0296355d17', 'volume_size': 1} Nov 04 10:19:50 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-5347b075-91e3-44dc-a1d1-64602b275a60 tempest-VolumesSnapshotTestJSON-1835544826 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:19:50 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-5347b075-91e3-44dc-a1d1-64602b275a60 tempest-VolumesSnapshotTestJSON-1835544826 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:19:50 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-5347b075-91e3-44dc-a1d1-64602b275a60 tempest-VolumesSnapshotTestJSON-1835544826 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:19:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1501739114',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8daede7c-3e86-4824-97cc-7d0296355d17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c119592eb9b94d74ad294736ec076621',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:19:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:19:51Z,use_quota=True,user_id='1810941f24e64a14ad02f068e0d989ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 10:19:50 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-5347b075-91e3-44dc-a1d1-64602b275a60 tempest-VolumesSnapshotTestJSON-1835544826 None] Creating volume 8daede7c-3e86-4824-97cc-7d0296355d17 {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:19:50 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-5347b075-91e3-44dc-a1d1-64602b275a60 tempest-VolumesSnapshotTestJSON-1835544826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:19:50 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-5347b075-91e3-44dc-a1d1-64602b275a60 tempest-VolumesSnapshotTestJSON-1835544826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:19:50 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-5347b075-91e3-44dc-a1d1-64602b275a60 tempest-VolumesSnapshotTestJSON-1835544826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:19:50 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-5347b075-91e3-44dc-a1d1-64602b275a60 tempest-VolumesSnapshotTestJSON-1835544826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:19:50 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-5347b075-91e3-44dc-a1d1-64602b275a60 tempest-VolumesSnapshotTestJSON-1835544826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:19:50 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-5347b075-91e3-44dc-a1d1-64602b275a60 tempest-VolumesSnapshotTestJSON-1835544826 None] Selected osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:19:50 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-5347b075-91e3-44dc-a1d1-64602b275a60 tempest-VolumesSnapshotTestJSON-1835544826 None] casted to osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 Nov 04 10:19:50 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-5347b075-91e3-44dc-a1d1-64602b275a60 tempest-VolumesSnapshotTestJSON-1835544826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-8daede7c-3e86-4824-97cc-7d0296355d17 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:19:50 devstack sudo[96843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-8daede7c-3e86-4824-97cc-7d0296355d17 1073741824 Nov 04 10:19:50 devstack sudo[96843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:19:51 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-203d295c-87dc-4adc-9cb6-0c1618465598 tempest-VolumesGetTest-1874363189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55cc2f13-3f73-47f0-b875-5b3f7427ca55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '517d234d-18ac-4f27-ae22-2deda80f3b21', 'volume_name': 'volume-517d234d-18ac-4f27-ae22-2deda80f3b21', 'volume_size': 1, 'image_id': 'c589a328-f3ed-418a-8877-e90bfc4cf133', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c589a328-f3ed-418a-8877-e90bfc4cf133', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '046e78417f874f20873c25a0eb7adc65', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c589a328-f3ed-418a-8877-e90bfc4cf133', 'created_at': datetime.datetime(2026, 11, 4, 9, 4, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 9, 5, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c589a328-f3ed-418a-8877-e90bfc4cf133/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:19:51 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-203d295c-87dc-4adc-9cb6-0c1618465598 tempest-VolumesGetTest-1874363189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42c18702-2c62-4450-b5fe-7c78690bed53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:19:51 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-203d295c-87dc-4adc-9cb6-0c1618465598 tempest-VolumesGetTest-1874363189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42c18702-2c62-4450-b5fe-7c78690bed53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:19:51 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-203d295c-87dc-4adc-9cb6-0c1618465598 tempest-VolumesGetTest-1874363189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1703e63-4ca3-4cce-bf24-be3a661e64af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:19:51 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-203d295c-87dc-4adc-9cb6-0c1618465598 tempest-VolumesGetTest-1874363189 None] Volume 517d234d-18ac-4f27-ae22-2deda80f3b21: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-517d234d-18ac-4f27-ae22-2deda80f3b21', 'volume_size': 1, 'image_id': 'c589a328-f3ed-418a-8877-e90bfc4cf133', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c589a328-f3ed-418a-8877-e90bfc4cf133', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '046e78417f874f20873c25a0eb7adc65', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c589a328-f3ed-418a-8877-e90bfc4cf133', 'created_at': datetime.datetime(2026, 11, 4, 9, 4, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 9, 5, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c589a328-f3ed-418a-8877-e90bfc4cf133/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 04 10:19:51 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-203d295c-87dc-4adc-9cb6-0c1618465598 tempest-VolumesGetTest-1874363189 None] Trying to clone 517d234d-18ac-4f27-ae22-2deda80f3b21 from image c589a328-f3ed-418a-8877-e90bfc4cf133 at location (None, [{'url': 'file:///opt/stack/data/glance/images/c589a328-f3ed-418a-8877-e90bfc4cf133', 'metadata': {}}]). {{(pid=87068) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 04 10:19:51 devstack sudo[96843]: pam_unix(sudo:session): session closed for user root Nov 04 10:19:51 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-5347b075-91e3-44dc-a1d1-64602b275a60 tempest-VolumesSnapshotTestJSON-1835544826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-8daede7c-3e86-4824-97cc-7d0296355d17 1073741824" returned: 0 in 0.813s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:19:51 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-5347b075-91e3-44dc-a1d1-64602b275a60 tempest-VolumesSnapshotTestJSON-1835544826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-8daede7c-3e86-4824-97cc-7d0296355d17 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:19:51 devstack sudo[96851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-8daede7c-3e86-4824-97cc-7d0296355d17 Nov 04 10:19:51 devstack sudo[96851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:19:51 devstack cinder-volume[87068]: DEBUG cinder.image.image_utils [None req-203d295c-87dc-4adc-9cb6-0c1618465598 tempest-VolumesGetTest-1874363189 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c589a328-f3ed-418a-8877-e90bfc4cf133_vm79v1j4devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87068) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 04 10:19:51 devstack cinder-volume[87068]: INFO cinder.image.image_utils [None req-203d295c-87dc-4adc-9cb6-0c1618465598 tempest-VolumesGetTest-1874363189 None] Image download 20.69 MB at 20.69 MB/s Nov 04 10:19:51 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[14441c89-0bdb-4168-a17e-3c9670086f0e]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:19:51 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-203d295c-87dc-4adc-9cb6-0c1618465598 tempest-VolumesGetTest-1874363189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c589a328-f3ed-418a-8877-e90bfc4cf133_vm79v1j4devstack@QuobyteHD {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:19:52 devstack sudo[96853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c589a328-f3ed-418a-8877-e90bfc4cf133_vm79v1j4devstack@QuobyteHD Nov 04 10:19:52 devstack sudo[96853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:19:52 devstack sudo[96851]: pam_unix(sudo:session): session closed for user root Nov 04 10:19:52 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-5347b075-91e3-44dc-a1d1-64602b275a60 tempest-VolumesSnapshotTestJSON-1835544826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-8daede7c-3e86-4824-97cc-7d0296355d17" returned: 0 in 0.405s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:19:52 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-5347b075-91e3-44dc-a1d1-64602b275a60 tempest-VolumesSnapshotTestJSON-1835544826 None] <== create_volume: return (1335ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 10:19:52 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-5347b075-91e3-44dc-a1d1-64602b275a60 tempest-VolumesSnapshotTestJSON-1835544826 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.339s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:19:52 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-5347b075-91e3-44dc-a1d1-64602b275a60 tempest-VolumesSnapshotTestJSON-1835544826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (705271dc-f7e2-42a8-aefb-b0fbd2d8fa8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8daede7c-3e86-4824-97cc-7d0296355d17', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:19:52 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-5347b075-91e3-44dc-a1d1-64602b275a60 tempest-VolumesSnapshotTestJSON-1835544826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2677574d-c5e8-4eca-8a73-b00a3082f550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:19:52 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-5347b075-91e3-44dc-a1d1-64602b275a60 tempest-VolumesSnapshotTestJSON-1835544826 None] Volume volume-8daede7c-3e86-4824-97cc-7d0296355d17 (8daede7c-3e86-4824-97cc-7d0296355d17): created successfully Nov 04 10:19:52 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-5347b075-91e3-44dc-a1d1-64602b275a60 tempest-VolumesSnapshotTestJSON-1835544826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2677574d-c5e8-4eca-8a73-b00a3082f550) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:19:52 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-5347b075-91e3-44dc-a1d1-64602b275a60 tempest-VolumesSnapshotTestJSON-1835544826 None] Flow 'volume_create_manager' (459dc66b-5f9d-403d-97f1-c5733847f899) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:19:52 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-5347b075-91e3-44dc-a1d1-64602b275a60 tempest-VolumesSnapshotTestJSON-1835544826 None] Created volume successfully. Nov 04 10:19:52 devstack sudo[96853]: pam_unix(sudo:session): session closed for user root Nov 04 10:19:52 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-203d295c-87dc-4adc-9cb6-0c1618465598 tempest-VolumesGetTest-1874363189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c589a328-f3ed-418a-8877-e90bfc4cf133_vm79v1j4devstack@QuobyteHD" returned: 0 in 0.486s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:19:52 devstack cinder-volume[87068]: DEBUG cinder.image.image_utils [None req-203d295c-87dc-4adc-9cb6-0c1618465598 tempest-VolumesGetTest-1874363189 None] Temporary image c589a328-f3ed-418a-8877-e90bfc4cf133 is fetched for user 95fe690f67df4d6f87922789a65a81d2. {{(pid=87068) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 04 10:19:52 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c84a368-2ff8-4498-9be9-d26b506e5533]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:19:52 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-203d295c-87dc-4adc-9cb6-0c1618465598 tempest-VolumesGetTest-1874363189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c589a328-f3ed-418a-8877-e90bfc4cf133_vm79v1j4devstack@QuobyteHD {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:19:52 devstack sudo[96860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c589a328-f3ed-418a-8877-e90bfc4cf133_vm79v1j4devstack@QuobyteHD Nov 04 10:19:52 devstack sudo[96860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:19:52 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-68dde4b4-2a45-48a2-90f9-899d265591f3 tempest-VolumesActionsTest-1241883822 None] Acquiring lock "cinder-61be2e3e-5d6c-4042-89f0-f7af5ea09dcd" by "attach_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:19:52 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-68dde4b4-2a45-48a2-90f9-899d265591f3 tempest-VolumesActionsTest-1241883822 None] Lock "cinder-61be2e3e-5d6c-4042-89f0-f7af5ea09dcd" acquired by "attach_volume" :: waited 0.030s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:19:52 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-68dde4b4-2a45-48a2-90f9-899d265591f3 tempest-VolumesActionsTest-1241883822 None] Attaching volume 61be2e3e-5d6c-4042-89f0-f7af5ea09dcd to instance 5ba31096-5543-4195-b850-272a296e9bc2 at mountpoint /dev/vdb on host None. Nov 04 10:19:52 devstack sudo[96860]: pam_unix(sudo:session): session closed for user root Nov 04 10:19:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-203d295c-87dc-4adc-9cb6-0c1618465598 tempest-VolumesGetTest-1874363189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c589a328-f3ed-418a-8877-e90bfc4cf133_vm79v1j4devstack@QuobyteHD" returned: 0 in 0.449s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:19:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-203d295c-87dc-4adc-9cb6-0c1618465598 tempest-VolumesGetTest-1874363189 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:19:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-203d295c-87dc-4adc-9cb6-0c1618465598 tempest-VolumesGetTest-1874363189 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:19:53 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-203d295c-87dc-4adc-9cb6-0c1618465598 tempest-VolumesGetTest-1874363189 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:19:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-875946363',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=517d234d-18ac-4f27-ae22-2deda80f3b21,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='1fb9cd956e4c4871af0e738ec6daa746',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:19:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:19:50Z,use_quota=True,user_id='95fe690f67df4d6f87922789a65a81d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 10:19:53 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-203d295c-87dc-4adc-9cb6-0c1618465598 tempest-VolumesGetTest-1874363189 None] Creating volume 517d234d-18ac-4f27-ae22-2deda80f3b21 {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:19:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-203d295c-87dc-4adc-9cb6-0c1618465598 tempest-VolumesGetTest-1874363189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:19:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-203d295c-87dc-4adc-9cb6-0c1618465598 tempest-VolumesGetTest-1874363189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:19:53 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-203d295c-87dc-4adc-9cb6-0c1618465598 tempest-VolumesGetTest-1874363189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:19:53 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-203d295c-87dc-4adc-9cb6-0c1618465598 tempest-VolumesGetTest-1874363189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:19:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-203d295c-87dc-4adc-9cb6-0c1618465598 tempest-VolumesGetTest-1874363189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:19:53 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-203d295c-87dc-4adc-9cb6-0c1618465598 tempest-VolumesGetTest-1874363189 None] Selected osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:19:53 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-203d295c-87dc-4adc-9cb6-0c1618465598 tempest-VolumesGetTest-1874363189 None] casted to osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 Nov 04 10:19:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-203d295c-87dc-4adc-9cb6-0c1618465598 tempest-VolumesGetTest-1874363189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-517d234d-18ac-4f27-ae22-2deda80f3b21 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:19:53 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-68dde4b4-2a45-48a2-90f9-899d265591f3 tempest-VolumesActionsTest-1241883822 None] Attach volume completed successfully. Nov 04 10:19:53 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-68dde4b4-2a45-48a2-90f9-899d265591f3 tempest-VolumesActionsTest-1241883822 None] Lock "cinder-61be2e3e-5d6c-4042-89f0-f7af5ea09dcd" released by "attach_volume" :: held 0.262s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:19:53 devstack sudo[96866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-517d234d-18ac-4f27-ae22-2deda80f3b21 1073741824 Nov 04 10:19:53 devstack sudo[96866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:19:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-20cd4e2e-f8e5-4fb8-aa76-c4cfb1e7abe5 tempest-VolumesSnapshotTestJSON-1835544826 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:19:53 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-b8cc649a-9a82-4848-bba6-c794b6587e44 tempest-VolumesActionsTest-1241883822 None] Acquiring lock "cinder-61be2e3e-5d6c-4042-89f0-f7af5ea09dcd-detach_volume" by "detach_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:19:53 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-b8cc649a-9a82-4848-bba6-c794b6587e44 tempest-VolumesActionsTest-1241883822 None] Lock "cinder-61be2e3e-5d6c-4042-89f0-f7af5ea09dcd-detach_volume" acquired by "detach_volume" :: waited 0.027s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:19:53 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-b8cc649a-9a82-4848-bba6-c794b6587e44 tempest-VolumesActionsTest-1241883822 None] Detaching volume 61be2e3e-5d6c-4042-89f0-f7af5ea09dcd from instance 5ba31096-5543-4195-b850-272a296e9bc2. Nov 04 10:19:53 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-b8cc649a-9a82-4848-bba6-c794b6587e44 tempest-VolumesActionsTest-1241883822 None] Detach volume completed successfully. Nov 04 10:19:53 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-b8cc649a-9a82-4848-bba6-c794b6587e44 tempest-VolumesActionsTest-1241883822 None] Lock "cinder-61be2e3e-5d6c-4042-89f0-f7af5ea09dcd-detach_volume" released by "detach_volume" :: held 0.069s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:19:53 devstack sudo[96866]: pam_unix(sudo:session): session closed for user root Nov 04 10:19:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-203d295c-87dc-4adc-9cb6-0c1618465598 tempest-VolumesGetTest-1874363189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-517d234d-18ac-4f27-ae22-2deda80f3b21 1073741824" returned: 0 in 0.597s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:19:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-203d295c-87dc-4adc-9cb6-0c1618465598 tempest-VolumesGetTest-1874363189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-517d234d-18ac-4f27-ae22-2deda80f3b21 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:19:53 devstack cinder-volume[87068]: DEBUG oslo_service.periodic_task [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87068) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 10:19:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:19:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:19:53 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:19:53 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:19:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:19:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:19:53 devstack sudo[96872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-517d234d-18ac-4f27-ae22-2deda80f3b21 Nov 04 10:19:53 devstack sudo[96872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:19:53 devstack sudo[96873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:19:53 devstack sudo[96873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:19:53 devstack sudo[96872]: pam_unix(sudo:session): session closed for user root Nov 04 10:19:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-203d295c-87dc-4adc-9cb6-0c1618465598 tempest-VolumesGetTest-1874363189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-517d234d-18ac-4f27-ae22-2deda80f3b21" returned: 0 in 0.324s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:19:53 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-203d295c-87dc-4adc-9cb6-0c1618465598 tempest-VolumesGetTest-1874363189 None] <== create_volume: return (983ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 10:19:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-203d295c-87dc-4adc-9cb6-0c1618465598 tempest-VolumesGetTest-1874363189 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.986s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:19:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-20cd4e2e-f8e5-4fb8-aa76-c4cfb1e7abe5 tempest-VolumesSnapshotTestJSON-1835544826 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.899s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:19:54 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-20cd4e2e-f8e5-4fb8-aa76-c4cfb1e7abe5 tempest-VolumesSnapshotTestJSON-1835544826 None] Creating offline snapshot 2a0bf2fb-fa7e-4927-af34-709b7c6ff1bd of volume 8daede7c-3e86-4824-97cc-7d0296355d17 {{(pid=87068) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 10:19:54 devstack sudo[96873]: pam_unix(sudo:session): session closed for user root Nov 04 10:19:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.344s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:19:54 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:19:54 devstack cinder-volume[87068]: DEBUG oslo_service.periodic_task [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Running periodic task VolumeManager._thread_info {{(pid=87068) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 10:19:54 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] thread count: 28 {{(pid=87068) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 04 10:19:54 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] thread info: [<_MainThread(MainThread, started 126275656192128)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87068) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 04 10:19:54 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[edaf927c-fdd0-49c0-9e20-3c48268b51df]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:19:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-20cd4e2e-f8e5-4fb8-aa76-c4cfb1e7abe5 tempest-VolumesSnapshotTestJSON-1835544826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-8daede7c-3e86-4824-97cc-7d0296355d17 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:19:54 devstack cinder-volume[87068]: DEBUG cinder.volume.volume_utils [None req-203d295c-87dc-4adc-9cb6-0c1618465598 tempest-VolumesGetTest-1874363189 None] Attempting download of c589a328-f3ed-418a-8877-e90bfc4cf133 ((None, [{'url': 'file:///opt/stack/data/glance/images/c589a328-f3ed-418a-8877-e90bfc4cf133', 'metadata': {}}])) to volume 517d234d-18ac-4f27-ae22-2deda80f3b21. {{(pid=87068) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 04 10:19:54 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7ed61d7-60db-4130-bb68-e345e431292c]: (4, 'raw') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:19:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-203d295c-87dc-4adc-9cb6-0c1618465598 tempest-VolumesGetTest-1874363189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c589a328-f3ed-418a-8877-e90bfc4cf133_hg0m5yed {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:19:54 devstack sudo[96883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-8daede7c-3e86-4824-97cc-7d0296355d17 Nov 04 10:19:54 devstack sudo[96883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:19:54 devstack sudo[96894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c589a328-f3ed-418a-8877-e90bfc4cf133_hg0m5yed Nov 04 10:19:54 devstack sudo[96894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:19:54 devstack sudo[96894]: pam_unix(sudo:session): session closed for user root Nov 04 10:19:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-203d295c-87dc-4adc-9cb6-0c1618465598 tempest-VolumesGetTest-1874363189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c589a328-f3ed-418a-8877-e90bfc4cf133_hg0m5yed" returned: 0 in 0.480s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:19:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-203d295c-87dc-4adc-9cb6-0c1618465598 tempest-VolumesGetTest-1874363189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c589a328-f3ed-418a-8877-e90bfc4cf133_hg0m5yed {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:19:54 devstack sudo[96883]: pam_unix(sudo:session): session closed for user root Nov 04 10:19:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-20cd4e2e-f8e5-4fb8-aa76-c4cfb1e7abe5 tempest-VolumesSnapshotTestJSON-1835544826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-8daede7c-3e86-4824-97cc-7d0296355d17" returned: 0 in 0.666s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:19:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-20cd4e2e-f8e5-4fb8-aa76-c4cfb1e7abe5 tempest-VolumesSnapshotTestJSON-1835544826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-8daede7c-3e86-4824-97cc-7d0296355d17,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-8daede7c-3e86-4824-97cc-7d0296355d17.2a0bf2fb-fa7e-4927-af34-709b7c6ff1bd 1G {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:19:54 devstack sudo[96911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-8daede7c-3e86-4824-97cc-7d0296355d17,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-8daede7c-3e86-4824-97cc-7d0296355d17.2a0bf2fb-fa7e-4927-af34-709b7c6ff1bd 1G Nov 04 10:19:54 devstack sudo[96911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:19:54 devstack sudo[96910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c589a328-f3ed-418a-8877-e90bfc4cf133_hg0m5yed Nov 04 10:19:54 devstack sudo[96910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:19:55 devstack sudo[96910]: pam_unix(sudo:session): session closed for user root Nov 04 10:19:55 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-203d295c-87dc-4adc-9cb6-0c1618465598 tempest-VolumesGetTest-1874363189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c589a328-f3ed-418a-8877-e90bfc4cf133_hg0m5yed" returned: 1 in 0.543s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:19:55 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-203d295c-87dc-4adc-9cb6-0c1618465598 tempest-VolumesGetTest-1874363189 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c589a328-f3ed-418a-8877-e90bfc4cf133_hg0m5yed' failed. Not Retrying. {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 04 10:19:55 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1db82b4-3b11-4e90-890b-80fab06f7c33]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:19:55 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-203d295c-87dc-4adc-9cb6-0c1618465598 tempest-VolumesGetTest-1874363189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c589a328-f3ed-418a-8877-e90bfc4cf133_vm79v1j4devstack@QuobyteHD {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:19:55 devstack sudo[96924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c589a328-f3ed-418a-8877-e90bfc4cf133_vm79v1j4devstack@QuobyteHD Nov 04 10:19:55 devstack sudo[96924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:19:55 devstack sudo[96911]: pam_unix(sudo:session): session closed for user root Nov 04 10:19:55 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-20cd4e2e-f8e5-4fb8-aa76-c4cfb1e7abe5 tempest-VolumesSnapshotTestJSON-1835544826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-8daede7c-3e86-4824-97cc-7d0296355d17,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-8daede7c-3e86-4824-97cc-7d0296355d17.2a0bf2fb-fa7e-4927-af34-709b7c6ff1bd 1G" returned: 0 in 1.007s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:19:55 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-20cd4e2e-f8e5-4fb8-aa76-c4cfb1e7abe5 tempest-VolumesSnapshotTestJSON-1835544826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8daede7c-3e86-4824-97cc-7d0296355d17 -F qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-8daede7c-3e86-4824-97cc-7d0296355d17.2a0bf2fb-fa7e-4927-af34-709b7c6ff1bd {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:19:55 devstack sudo[96943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8daede7c-3e86-4824-97cc-7d0296355d17 -F qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-8daede7c-3e86-4824-97cc-7d0296355d17.2a0bf2fb-fa7e-4927-af34-709b7c6ff1bd Nov 04 10:19:55 devstack sudo[96943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:19:55 devstack sudo[96924]: pam_unix(sudo:session): session closed for user root Nov 04 10:19:55 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-203d295c-87dc-4adc-9cb6-0c1618465598 tempest-VolumesGetTest-1874363189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c589a328-f3ed-418a-8877-e90bfc4cf133_vm79v1j4devstack@QuobyteHD" returned: 0 in 0.631s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:19:55 devstack cinder-volume[87068]: DEBUG cinder.image.image_utils [None req-203d295c-87dc-4adc-9cb6-0c1618465598 tempest-VolumesGetTest-1874363189 None] c589a328-f3ed-418a-8877-e90bfc4cf133 was qcow2, converting to qcow2 {{(pid=87068) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 04 10:19:55 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-203d295c-87dc-4adc-9cb6-0c1618465598 tempest-VolumesGetTest-1874363189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c589a328-f3ed-418a-8877-e90bfc4cf133_vm79v1j4devstack@QuobyteHD /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-517d234d-18ac-4f27-ae22-2deda80f3b21 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:19:55 devstack sudo[96950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c589a328-f3ed-418a-8877-e90bfc4cf133_vm79v1j4devstack@QuobyteHD /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-517d234d-18ac-4f27-ae22-2deda80f3b21 Nov 04 10:19:55 devstack sudo[96950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:19:56 devstack sudo[96943]: pam_unix(sudo:session): session closed for user root Nov 04 10:19:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-20cd4e2e-f8e5-4fb8-aa76-c4cfb1e7abe5 tempest-VolumesSnapshotTestJSON-1835544826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8daede7c-3e86-4824-97cc-7d0296355d17 -F qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-8daede7c-3e86-4824-97cc-7d0296355d17.2a0bf2fb-fa7e-4927-af34-709b7c6ff1bd" returned: 0 in 0.430s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:19:56 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-20cd4e2e-f8e5-4fb8-aa76-c4cfb1e7abe5 tempest-VolumesSnapshotTestJSON-1835544826 None] /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-8daede7c-3e86-4824-97cc-7d0296355d17.2a0bf2fb-fa7e-4927-af34-709b7c6ff1bd is being set with open permissions: ugo+rw Nov 04 10:19:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-20cd4e2e-f8e5-4fb8-aa76-c4cfb1e7abe5 tempest-VolumesSnapshotTestJSON-1835544826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-8daede7c-3e86-4824-97cc-7d0296355d17.2a0bf2fb-fa7e-4927-af34-709b7c6ff1bd {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:19:56 devstack sudo[96959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-8daede7c-3e86-4824-97cc-7d0296355d17.2a0bf2fb-fa7e-4927-af34-709b7c6ff1bd Nov 04 10:19:56 devstack sudo[96959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:19:56 devstack sudo[96959]: pam_unix(sudo:session): session closed for user root Nov 04 10:19:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-20cd4e2e-f8e5-4fb8-aa76-c4cfb1e7abe5 tempest-VolumesSnapshotTestJSON-1835544826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-8daede7c-3e86-4824-97cc-7d0296355d17.2a0bf2fb-fa7e-4927-af34-709b7c6ff1bd" returned: 0 in 0.361s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:19:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-20cd4e2e-f8e5-4fb8-aa76-c4cfb1e7abe5 tempest-VolumesSnapshotTestJSON-1835544826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-8daede7c-3e86-4824-97cc-7d0296355d17.info {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:19:56 devstack sudo[96971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-8daede7c-3e86-4824-97cc-7d0296355d17.info Nov 04 10:19:56 devstack sudo[96971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:19:56 devstack sudo[96971]: pam_unix(sudo:session): session closed for user root Nov 04 10:19:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-20cd4e2e-f8e5-4fb8-aa76-c4cfb1e7abe5 tempest-VolumesSnapshotTestJSON-1835544826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-8daede7c-3e86-4824-97cc-7d0296355d17.info" returned: 0 in 0.435s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:19:56 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-20cd4e2e-f8e5-4fb8-aa76-c4cfb1e7abe5 tempest-VolumesSnapshotTestJSON-1835544826 None] /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-8daede7c-3e86-4824-97cc-7d0296355d17.info is being set with open permissions: ugo+rw Nov 04 10:19:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-20cd4e2e-f8e5-4fb8-aa76-c4cfb1e7abe5 tempest-VolumesSnapshotTestJSON-1835544826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-8daede7c-3e86-4824-97cc-7d0296355d17.info {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:19:57 devstack sudo[96975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-8daede7c-3e86-4824-97cc-7d0296355d17.info Nov 04 10:19:57 devstack sudo[96975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:19:57 devstack sudo[96975]: pam_unix(sudo:session): session closed for user root Nov 04 10:19:57 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-20cd4e2e-f8e5-4fb8-aa76-c4cfb1e7abe5 tempest-VolumesSnapshotTestJSON-1835544826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-8daede7c-3e86-4824-97cc-7d0296355d17.info" returned: 0 in 0.384s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:19:57 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-20cd4e2e-f8e5-4fb8-aa76-c4cfb1e7abe5 tempest-VolumesSnapshotTestJSON-1835544826 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.415s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:19:57 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-20cd4e2e-f8e5-4fb8-aa76-c4cfb1e7abe5 tempest-VolumesSnapshotTestJSON-1835544826 None] Create snapshot completed successfully Nov 04 10:19:58 devstack sudo[96950]: pam_unix(sudo:session): session closed for user root Nov 04 10:19:58 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-203d295c-87dc-4adc-9cb6-0c1618465598 tempest-VolumesGetTest-1874363189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c589a328-f3ed-418a-8877-e90bfc4cf133_vm79v1j4devstack@QuobyteHD /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-517d234d-18ac-4f27-ae22-2deda80f3b21" returned: 0 in 2.809s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:19:58 devstack cinder-volume[87068]: DEBUG cinder.image.image_utils [None req-203d295c-87dc-4adc-9cb6-0c1618465598 tempest-VolumesGetTest-1874363189 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c589a328-f3ed-418a-8877-e90bfc4cf133_vm79v1j4devstack@QuobyteHD, size 112.00 MB, duration 2.81 sec, destination /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-517d234d-18ac-4f27-ae22-2deda80f3b21 {{(pid=87068) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 04 10:19:58 devstack cinder-volume[87068]: INFO cinder.image.image_utils [None req-203d295c-87dc-4adc-9cb6-0c1618465598 tempest-VolumesGetTest-1874363189 None] Converted 112.00 MB image at 39.86 MB/s Nov 04 10:19:58 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-203d295c-87dc-4adc-9cb6-0c1618465598 tempest-VolumesGetTest-1874363189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-517d234d-18ac-4f27-ae22-2deda80f3b21 1G {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:19:58 devstack sudo[96983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-517d234d-18ac-4f27-ae22-2deda80f3b21 1G Nov 04 10:19:58 devstack sudo[96983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:19:59 devstack sudo[96983]: pam_unix(sudo:session): session closed for user root Nov 04 10:19:59 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-203d295c-87dc-4adc-9cb6-0c1618465598 tempest-VolumesGetTest-1874363189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-517d234d-18ac-4f27-ae22-2deda80f3b21 1G" returned: 0 in 0.589s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:19:59 devstack cinder-volume[87068]: DEBUG cinder.volume.volume_utils [None req-203d295c-87dc-4adc-9cb6-0c1618465598 tempest-VolumesGetTest-1874363189 None] Downloaded image c589a328-f3ed-418a-8877-e90bfc4cf133 ((None, [{'url': 'file:///opt/stack/data/glance/images/c589a328-f3ed-418a-8877-e90bfc4cf133', 'metadata': {}}])) to volume 517d234d-18ac-4f27-ae22-2deda80f3b21 successfully. {{(pid=87068) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 04 10:19:59 devstack cinder-volume[87068]: DEBUG cinder.image.image_utils [None req-203d295c-87dc-4adc-9cb6-0c1618465598 tempest-VolumesGetTest-1874363189 None] Temporary image c589a328-f3ed-418a-8877-e90bfc4cf133 for user 95fe690f67df4d6f87922789a65a81d2 is deleted. {{(pid=87068) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 04 10:19:59 devstack cinder-volume[87068]: DEBUG cinder.volume.volume_utils [None req-203d295c-87dc-4adc-9cb6-0c1618465598 tempest-VolumesGetTest-1874363189 None] Marking volume 517d234d-18ac-4f27-ae22-2deda80f3b21 as bootable. {{(pid=87068) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 04 10:19:59 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-203d295c-87dc-4adc-9cb6-0c1618465598 tempest-VolumesGetTest-1874363189 None] Copying metadata from image c589a328-f3ed-418a-8877-e90bfc4cf133 to 517d234d-18ac-4f27-ae22-2deda80f3b21. {{(pid=87068) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 04 10:19:59 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-203d295c-87dc-4adc-9cb6-0c1618465598 tempest-VolumesGetTest-1874363189 None] Creating volume glance metadata for volume 517d234d-18ac-4f27-ae22-2deda80f3b21 backed by image c589a328-f3ed-418a-8877-e90bfc4cf133 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'c589a328-f3ed-418a-8877-e90bfc4cf133', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87068) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 04 10:19:59 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-363fcf69-2386-4f4e-88fd-88484f048042 tempest-VolumesSnapshotTestJSON-1835544826 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:19:59 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-363fcf69-2386-4f4e-88fd-88484f048042 tempest-VolumesSnapshotTestJSON-1835544826 None] Flow 'volume_create_manager' (b11ea79a-decc-4b15-b85d-5406c8ae7bb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:19:59 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-363fcf69-2386-4f4e-88fd-88484f048042 tempest-VolumesSnapshotTestJSON-1835544826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0869cb44-d552-4386-85f5-3f060525025c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:19:59 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-363fcf69-2386-4f4e-88fd-88484f048042 tempest-VolumesSnapshotTestJSON-1835544826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0869cb44-d552-4386-85f5-3f060525025c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:19:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1638441610',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2f3a2b7-edbc-4b29-907b-b77d17475348,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c119592eb9b94d74ad294736ec076621',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:19:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=2a0bf2fb-fa7e-4927-af34-709b7c6ff1bd,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:19:59Z,use_quota=True,user_id='1810941f24e64a14ad02f068e0d989ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:19:59 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-363fcf69-2386-4f4e-88fd-88484f048042 tempest-VolumesSnapshotTestJSON-1835544826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd5c31dd-8812-40d2-973c-a83fa3fbe41d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:19:59 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-363fcf69-2386-4f4e-88fd-88484f048042 tempest-VolumesSnapshotTestJSON-1835544826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd5c31dd-8812-40d2-973c-a83fa3fbe41d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:19:59 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-363fcf69-2386-4f4e-88fd-88484f048042 tempest-VolumesSnapshotTestJSON-1835544826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bdf455e-218a-4cfe-8aa0-5d801ac00688) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:19:59 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-363fcf69-2386-4f4e-88fd-88484f048042 tempest-VolumesSnapshotTestJSON-1835544826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bdf455e-218a-4cfe-8aa0-5d801ac00688) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd2f3a2b7-edbc-4b29-907b-b77d17475348', 'volume_name': 'volume-d2f3a2b7-edbc-4b29-907b-b77d17475348', 'volume_size': 1, 'snapshot_id': '2a0bf2fb-fa7e-4927-af34-709b7c6ff1bd'}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:19:59 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-363fcf69-2386-4f4e-88fd-88484f048042 tempest-VolumesSnapshotTestJSON-1835544826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c888ac6e-00d9-4016-a3d0-9af5977661b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:19:59 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-363fcf69-2386-4f4e-88fd-88484f048042 tempest-VolumesSnapshotTestJSON-1835544826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c888ac6e-00d9-4016-a3d0-9af5977661b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:19:59 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-363fcf69-2386-4f4e-88fd-88484f048042 tempest-VolumesSnapshotTestJSON-1835544826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a42fcc55-3e26-42f0-bb21-0676e216b1b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:19:59 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-363fcf69-2386-4f4e-88fd-88484f048042 tempest-VolumesSnapshotTestJSON-1835544826 None] Volume d2f3a2b7-edbc-4b29-907b-b77d17475348: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d2f3a2b7-edbc-4b29-907b-b77d17475348', 'volume_size': 1, 'snapshot_id': '2a0bf2fb-fa7e-4927-af34-709b7c6ff1bd'} Nov 04 10:19:59 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-363fcf69-2386-4f4e-88fd-88484f048042 tempest-VolumesSnapshotTestJSON-1835544826 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:19:59 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-363fcf69-2386-4f4e-88fd-88484f048042 tempest-VolumesSnapshotTestJSON-1835544826 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:19:59 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-363fcf69-2386-4f4e-88fd-88484f048042 tempest-VolumesSnapshotTestJSON-1835544826 None] Acquiring lock "cinder-quobyte-2a0bf2fb-fa7e-4927-af34-709b7c6ff1bd-d2f3a2b7-edbc-4b29-907b-b77d17475348" by "_create_volume_from_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:19:59 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-363fcf69-2386-4f4e-88fd-88484f048042 tempest-VolumesSnapshotTestJSON-1835544826 None] Lock "cinder-quobyte-2a0bf2fb-fa7e-4927-af34-709b7c6ff1bd-d2f3a2b7-edbc-4b29-907b-b77d17475348" acquired by "_create_volume_from_snapshot" :: waited 0.024s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:19:59 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-363fcf69-2386-4f4e-88fd-88484f048042 tempest-VolumesSnapshotTestJSON-1835544826 None] Creating volume d2f3a2b7-edbc-4b29-907b-b77d17475348 from snapshot 2a0bf2fb-fa7e-4927-af34-709b7c6ff1bd {{(pid=87068) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 04 10:19:59 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-363fcf69-2386-4f4e-88fd-88484f048042 tempest-VolumesSnapshotTestJSON-1835544826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:19:59 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-363fcf69-2386-4f4e-88fd-88484f048042 tempest-VolumesSnapshotTestJSON-1835544826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:19:59 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-363fcf69-2386-4f4e-88fd-88484f048042 tempest-VolumesSnapshotTestJSON-1835544826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:19:59 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-363fcf69-2386-4f4e-88fd-88484f048042 tempest-VolumesSnapshotTestJSON-1835544826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:19:59 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-363fcf69-2386-4f4e-88fd-88484f048042 tempest-VolumesSnapshotTestJSON-1835544826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:19:59 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-363fcf69-2386-4f4e-88fd-88484f048042 tempest-VolumesSnapshotTestJSON-1835544826 None] Selected osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:19:59 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-363fcf69-2386-4f4e-88fd-88484f048042 tempest-VolumesSnapshotTestJSON-1835544826 None] Acquiring lock "cinder-quobyte-d2f3a2b7-edbc-4b29-907b-b77d17475348" by "_copy_volume_from_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:19:59 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-d4dd559a-77ba-42d2-851b-866a550d88f2 tempest-AttachVolumeShelveTestJSON-659726282 None] Acquiring lock "cinder-a89341d4-da66-49d1-9538-a9f142d67d87-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:19:59 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-363fcf69-2386-4f4e-88fd-88484f048042 tempest-VolumesSnapshotTestJSON-1835544826 None] Lock "cinder-quobyte-d2f3a2b7-edbc-4b29-907b-b77d17475348" acquired by "_copy_volume_from_snapshot" :: waited 0.029s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:19:59 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-363fcf69-2386-4f4e-88fd-88484f048042 tempest-VolumesSnapshotTestJSON-1835544826 None] snapshot: 2a0bf2fb-fa7e-4927-af34-709b7c6ff1bd, volume: d2f3a2b7-edbc-4b29-907b-b77d17475348, {{(pid=87068) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 04 10:19:59 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-d4dd559a-77ba-42d2-851b-866a550d88f2 tempest-AttachVolumeShelveTestJSON-659726282 None] Lock "cinder-a89341d4-da66-49d1-9538-a9f142d67d87-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:19:59 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-363fcf69-2386-4f4e-88fd-88484f048042 tempest-VolumesSnapshotTestJSON-1835544826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:19:59 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-363fcf69-2386-4f4e-88fd-88484f048042 tempest-VolumesSnapshotTestJSON-1835544826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:19:59 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-363fcf69-2386-4f4e-88fd-88484f048042 tempest-VolumesSnapshotTestJSON-1835544826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:19:59 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-363fcf69-2386-4f4e-88fd-88484f048042 tempest-VolumesSnapshotTestJSON-1835544826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:19:59 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-363fcf69-2386-4f4e-88fd-88484f048042 tempest-VolumesSnapshotTestJSON-1835544826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:19:59 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-203d295c-87dc-4adc-9cb6-0c1618465598 tempest-VolumesGetTest-1874363189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1703e63-4ca3-4cce-bf24-be3a661e64af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-517d234d-18ac-4f27-ae22-2deda80f3b21', 'volume_size': 1, 'image_id': 'c589a328-f3ed-418a-8877-e90bfc4cf133', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c589a328-f3ed-418a-8877-e90bfc4cf133', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '046e78417f874f20873c25a0eb7adc65', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c589a328-f3ed-418a-8877-e90bfc4cf133', 'created_at': datetime.datetime(2026, 11, 4, 9, 4, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 9, 5, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c589a328-f3ed-418a-8877-e90bfc4cf133/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:19:59 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-203d295c-87dc-4adc-9cb6-0c1618465598 tempest-VolumesGetTest-1874363189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cce79dc-9130-4e3f-a3c9-02ae9f067ae8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:19:59 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[b06f5237-c81b-4661-8d0a-3a65d64398b6]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:19:59 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-363fcf69-2386-4f4e-88fd-88484f048042 tempest-VolumesSnapshotTestJSON-1835544826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-8daede7c-3e86-4824-97cc-7d0296355d17.2a0bf2fb-fa7e-4927-af34-709b7c6ff1bd {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:19:59 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-d4dd559a-77ba-42d2-851b-866a550d88f2 tempest-AttachVolumeShelveTestJSON-659726282 None] Acquiring lock "cinder-quobyte-a89341d4-da66-49d1-9538-a9f142d67d87" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:19:59 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-203d295c-87dc-4adc-9cb6-0c1618465598 tempest-VolumesGetTest-1874363189 None] Volume volume-517d234d-18ac-4f27-ae22-2deda80f3b21 (517d234d-18ac-4f27-ae22-2deda80f3b21): created successfully Nov 04 10:19:59 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-203d295c-87dc-4adc-9cb6-0c1618465598 tempest-VolumesGetTest-1874363189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cce79dc-9130-4e3f-a3c9-02ae9f067ae8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:19:59 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-203d295c-87dc-4adc-9cb6-0c1618465598 tempest-VolumesGetTest-1874363189 None] Flow 'volume_create_manager' (2b1d546e-4c6b-4306-b462-676f7b09547f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:19:59 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-d4dd559a-77ba-42d2-851b-866a550d88f2 tempest-AttachVolumeShelveTestJSON-659726282 None] Lock "cinder-quobyte-a89341d4-da66-49d1-9538-a9f142d67d87" acquired by "delete_volume" :: waited 0.047s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:19:59 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-203d295c-87dc-4adc-9cb6-0c1618465598 tempest-VolumesGetTest-1874363189 None] Created volume successfully. Nov 04 10:19:59 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed0e0737-7933-4ec4-b0fd-789c6a46424a]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:19:59 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d4dd559a-77ba-42d2-851b-866a550d88f2 tempest-AttachVolumeShelveTestJSON-659726282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-a89341d4-da66-49d1-9538-a9f142d67d87 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:19:59 devstack sudo[96988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-8daede7c-3e86-4824-97cc-7d0296355d17.2a0bf2fb-fa7e-4927-af34-709b7c6ff1bd Nov 04 10:19:59 devstack sudo[96988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:19:59 devstack sudo[96989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-a89341d4-da66-49d1-9538-a9f142d67d87 Nov 04 10:19:59 devstack sudo[96989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:20:00 devstack sudo[96988]: pam_unix(sudo:session): session closed for user root Nov 04 10:20:00 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-363fcf69-2386-4f4e-88fd-88484f048042 tempest-VolumesSnapshotTestJSON-1835544826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-8daede7c-3e86-4824-97cc-7d0296355d17.2a0bf2fb-fa7e-4927-af34-709b7c6ff1bd" returned: 0 in 0.515s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:20:00 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-363fcf69-2386-4f4e-88fd-88484f048042 tempest-VolumesSnapshotTestJSON-1835544826 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8daede7c-3e86-4824-97cc-7d0296355d17(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87068) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 10:20:00 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[61ddbc57-3097-4f69-bde7-190eaa49ea3c]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:20:00 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-363fcf69-2386-4f4e-88fd-88484f048042 tempest-VolumesSnapshotTestJSON-1835544826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-8daede7c-3e86-4824-97cc-7d0296355d17 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:20:00 devstack sudo[96989]: pam_unix(sudo:session): session closed for user root Nov 04 10:20:00 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d4dd559a-77ba-42d2-851b-866a550d88f2 tempest-AttachVolumeShelveTestJSON-659726282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-a89341d4-da66-49d1-9538-a9f142d67d87" returned: 0 in 0.548s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:20:00 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d4dd559a-77ba-42d2-851b-866a550d88f2 tempest-AttachVolumeShelveTestJSON-659726282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-a89341d4-da66-49d1-9538-a9f142d67d87 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:20:00 devstack sudo[97005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-8daede7c-3e86-4824-97cc-7d0296355d17 Nov 04 10:20:00 devstack sudo[97005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:20:00 devstack sudo[97013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-a89341d4-da66-49d1-9538-a9f142d67d87 Nov 04 10:20:00 devstack sudo[97013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:20:00 devstack sudo[97013]: pam_unix(sudo:session): session closed for user root Nov 04 10:20:00 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d4dd559a-77ba-42d2-851b-866a550d88f2 tempest-AttachVolumeShelveTestJSON-659726282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-a89341d4-da66-49d1-9538-a9f142d67d87" returned: 0 in 0.502s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:20:00 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-d4dd559a-77ba-42d2-851b-866a550d88f2 tempest-AttachVolumeShelveTestJSON-659726282 None] Lock "cinder-quobyte-a89341d4-da66-49d1-9538-a9f142d67d87" released by "delete_volume" :: held 1.132s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:20:00 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-d4dd559a-77ba-42d2-851b-866a550d88f2 tempest-AttachVolumeShelveTestJSON-659726282 None] Created reservations ['c13b9cb8-cc5f-4df9-b85b-b06860f4eb20', 'b1ff57b1-3d3d-4f25-b00a-c613ae1352da', '4bbe312f-354e-4f9f-9495-597f565b170a', '20bba746-6176-4bf2-8db2-1f95a7e26421'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:20:00 devstack sudo[97005]: pam_unix(sudo:session): session closed for user root Nov 04 10:20:00 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-363fcf69-2386-4f4e-88fd-88484f048042 tempest-VolumesSnapshotTestJSON-1835544826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-8daede7c-3e86-4824-97cc-7d0296355d17" returned: 0 in 0.796s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:20:01 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-363fcf69-2386-4f4e-88fd-88484f048042 tempest-VolumesSnapshotTestJSON-1835544826 None] will copy from snapshot at /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-8daede7c-3e86-4824-97cc-7d0296355d17 {{(pid=87068) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 04 10:20:01 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-363fcf69-2386-4f4e-88fd-88484f048042 tempest-VolumesSnapshotTestJSON-1835544826 None] Creating direct copy from snapshot {{(pid=87068) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 04 10:20:01 devstack cinder-volume[87068]: DEBUG cinder.utils [None req-363fcf69-2386-4f4e-88fd-88484f048042 tempest-VolumesSnapshotTestJSON-1835544826 None] Path /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-d2f3a2b7-edbc-4b29-907b-b77d17475348 not found in is_blk_device check {{(pid=87068) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 04 10:20:01 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-363fcf69-2386-4f4e-88fd-88484f048042 tempest-VolumesSnapshotTestJSON-1835544826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-8daede7c-3e86-4824-97cc-7d0296355d17 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-d2f3a2b7-edbc-4b29-907b-b77d17475348 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:20:01 devstack sudo[97026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-8daede7c-3e86-4824-97cc-7d0296355d17 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-d2f3a2b7-edbc-4b29-907b-b77d17475348 Nov 04 10:20:01 devstack sudo[97026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:20:01 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-d4dd559a-77ba-42d2-851b-866a550d88f2 tempest-AttachVolumeShelveTestJSON-659726282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:20:01 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-d4dd559a-77ba-42d2-851b-866a550d88f2 tempest-AttachVolumeShelveTestJSON-659726282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:20:01 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-d4dd559a-77ba-42d2-851b-866a550d88f2 tempest-AttachVolumeShelveTestJSON-659726282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:20:01 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-d4dd559a-77ba-42d2-851b-866a550d88f2 tempest-AttachVolumeShelveTestJSON-659726282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:20:01 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-d4dd559a-77ba-42d2-851b-866a550d88f2 tempest-AttachVolumeShelveTestJSON-659726282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:20:01 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d4dd559a-77ba-42d2-851b-866a550d88f2 tempest-AttachVolumeShelveTestJSON-659726282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:20:01 devstack sudo[97028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:20:01 devstack sudo[97028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:20:01 devstack sudo[97028]: pam_unix(sudo:session): session closed for user root Nov 04 10:20:01 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d4dd559a-77ba-42d2-851b-866a550d88f2 tempest-AttachVolumeShelveTestJSON-659726282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.370s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:20:01 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-d4dd559a-77ba-42d2-851b-866a550d88f2 tempest-AttachVolumeShelveTestJSON-659726282 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:20:01 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-d4dd559a-77ba-42d2-851b-866a550d88f2 tempest-AttachVolumeShelveTestJSON-659726282 None] Deleted volume successfully. Nov 04 10:20:01 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-b981cc9e-2962-4b10-80dd-0e54b6af7170 tempest-VolumesGetTest-1874363189 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:20:01 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-b981cc9e-2962-4b10-80dd-0e54b6af7170 tempest-VolumesGetTest-1874363189 None] Flow 'volume_create_manager' (7498043b-4a49-4109-b2da-6ae690a4607a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:20:01 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-b981cc9e-2962-4b10-80dd-0e54b6af7170 tempest-VolumesGetTest-1874363189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c175165-ab8f-45f5-ad86-7c9235773a73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:20:01 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-b981cc9e-2962-4b10-80dd-0e54b6af7170 tempest-VolumesGetTest-1874363189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c175165-ab8f-45f5-ad86-7c9235773a73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:20:01Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-63922293',display_name='tempest-VolumesGetTest-Volume-656056638',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a611e523-810a-40f6-b82c-3565eedaa446,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1fb9cd956e4c4871af0e738ec6daa746',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:20:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:20:01Z,use_quota=True,user_id='95fe690f67df4d6f87922789a65a81d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:20:01 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-b981cc9e-2962-4b10-80dd-0e54b6af7170 tempest-VolumesGetTest-1874363189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ece78ac-ede8-477c-b14a-613902abf4cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:20:01 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-b981cc9e-2962-4b10-80dd-0e54b6af7170 tempest-VolumesGetTest-1874363189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ece78ac-ede8-477c-b14a-613902abf4cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:20:01 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-b981cc9e-2962-4b10-80dd-0e54b6af7170 tempest-VolumesGetTest-1874363189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66255183-75ce-49c8-9301-353af599d966) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:20:01 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-b981cc9e-2962-4b10-80dd-0e54b6af7170 tempest-VolumesGetTest-1874363189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66255183-75ce-49c8-9301-353af599d966) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a611e523-810a-40f6-b82c-3565eedaa446', 'volume_name': 'volume-a611e523-810a-40f6-b82c-3565eedaa446', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:20:01 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-b981cc9e-2962-4b10-80dd-0e54b6af7170 tempest-VolumesGetTest-1874363189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48723a96-6f68-4f11-a867-ee04ae189300) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:20:01 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-b981cc9e-2962-4b10-80dd-0e54b6af7170 tempest-VolumesGetTest-1874363189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48723a96-6f68-4f11-a867-ee04ae189300) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:20:01 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-b981cc9e-2962-4b10-80dd-0e54b6af7170 tempest-VolumesGetTest-1874363189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6e9f532-80cd-40ee-a6af-6afac206bb62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:20:01 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-b981cc9e-2962-4b10-80dd-0e54b6af7170 tempest-VolumesGetTest-1874363189 None] Volume a611e523-810a-40f6-b82c-3565eedaa446: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a611e523-810a-40f6-b82c-3565eedaa446', 'volume_size': 1} Nov 04 10:20:01 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-b981cc9e-2962-4b10-80dd-0e54b6af7170 tempest-VolumesGetTest-1874363189 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:20:01 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-d4dd559a-77ba-42d2-851b-866a550d88f2 tempest-AttachVolumeShelveTestJSON-659726282 None] Lock "cinder-a89341d4-da66-49d1-9538-a9f142d67d87-delete_volume" released by "delete_volume" :: held 2.014s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:20:08 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-ab54e07c-3d24-4c95-bf81-04567b8c2f18 tempest-VolumesActionsTest-1241883822 None] Acquiring lock "cinder-61be2e3e-5d6c-4042-89f0-f7af5ea09dcd" by "attach_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:20:08 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-ab54e07c-3d24-4c95-bf81-04567b8c2f18 tempest-VolumesActionsTest-1241883822 None] Lock "cinder-61be2e3e-5d6c-4042-89f0-f7af5ea09dcd" acquired by "attach_volume" :: waited 0.047s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:20:08 devstack cinder-volume[87068]: DEBUG dbcounter [-] [87068] Writing DB stats cinder:UPDATE=117,cinder:SELECT=116,cinder:DELETE=12,cinder:INSERT=38 {{(pid=87068) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 10:20:08 devstack cinder-volume[87068]: DEBUG dbcounter [-] [87068] Writing DB stats cinder:SELECT=108,cinder:INSERT=36,cinder:UPDATE=129,cinder:DELETE=10 {{(pid=87068) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 10:20:09 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-ab54e07c-3d24-4c95-bf81-04567b8c2f18 tempest-VolumesActionsTest-1241883822 None] Attaching volume 61be2e3e-5d6c-4042-89f0-f7af5ea09dcd to instance 72550654-0a1f-48b4-88a3-659274bb711e at mountpoint /dev/vdb on host None. Nov 04 10:20:09 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-ab54e07c-3d24-4c95-bf81-04567b8c2f18 tempest-VolumesActionsTest-1241883822 None] Attach volume completed successfully. Nov 04 10:20:09 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-ab54e07c-3d24-4c95-bf81-04567b8c2f18 tempest-VolumesActionsTest-1241883822 None] Lock "cinder-61be2e3e-5d6c-4042-89f0-f7af5ea09dcd" released by "attach_volume" :: held 0.307s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:20:09 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-02e76cca-e539-4e2c-bf80-3a690adceec7 tempest-VolumesActionsTest-1241883822 None] Acquiring lock "cinder-61be2e3e-5d6c-4042-89f0-f7af5ea09dcd-detach_volume" by "detach_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:20:09 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-02e76cca-e539-4e2c-bf80-3a690adceec7 tempest-VolumesActionsTest-1241883822 None] Lock "cinder-61be2e3e-5d6c-4042-89f0-f7af5ea09dcd-detach_volume" acquired by "detach_volume" :: waited 0.073s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:20:09 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-02e76cca-e539-4e2c-bf80-3a690adceec7 tempest-VolumesActionsTest-1241883822 None] Detaching volume 61be2e3e-5d6c-4042-89f0-f7af5ea09dcd from instance 72550654-0a1f-48b4-88a3-659274bb711e. Nov 04 10:20:10 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-02e76cca-e539-4e2c-bf80-3a690adceec7 tempest-VolumesActionsTest-1241883822 None] Detach volume completed successfully. Nov 04 10:20:10 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-02e76cca-e539-4e2c-bf80-3a690adceec7 tempest-VolumesActionsTest-1241883822 None] Lock "cinder-61be2e3e-5d6c-4042-89f0-f7af5ea09dcd-detach_volume" released by "detach_volume" :: held 0.167s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:20:11 devstack sudo[97026]: pam_unix(sudo:session): session closed for user root Nov 04 10:20:11 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-363fcf69-2386-4f4e-88fd-88484f048042 tempest-VolumesSnapshotTestJSON-1835544826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-8daede7c-3e86-4824-97cc-7d0296355d17 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-d2f3a2b7-edbc-4b29-907b-b77d17475348" returned: 0 in 10.267s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:20:11 devstack cinder-volume[87068]: DEBUG cinder.image.image_utils [None req-363fcf69-2386-4f4e-88fd-88484f048042 tempest-VolumesSnapshotTestJSON-1835544826 None] Image conversion details: src /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-8daede7c-3e86-4824-97cc-7d0296355d17, size 1024.00 MB, duration 10.27 sec, destination /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-d2f3a2b7-edbc-4b29-907b-b77d17475348 {{(pid=87068) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 04 10:20:11 devstack cinder-volume[87068]: INFO cinder.image.image_utils [None req-363fcf69-2386-4f4e-88fd-88484f048042 tempest-VolumesSnapshotTestJSON-1835544826 None] Converted 1024.00 MB image at 99.73 MB/s Nov 04 10:20:11 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-363fcf69-2386-4f4e-88fd-88484f048042 tempest-VolumesSnapshotTestJSON-1835544826 None] /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-d2f3a2b7-edbc-4b29-907b-b77d17475348 is being set with open permissions: ugo+rw Nov 04 10:20:11 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-363fcf69-2386-4f4e-88fd-88484f048042 tempest-VolumesSnapshotTestJSON-1835544826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-d2f3a2b7-edbc-4b29-907b-b77d17475348 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:20:11 devstack sudo[97129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-d2f3a2b7-edbc-4b29-907b-b77d17475348 Nov 04 10:20:11 devstack sudo[97129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:20:11 devstack sudo[97129]: pam_unix(sudo:session): session closed for user root Nov 04 10:20:11 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-363fcf69-2386-4f4e-88fd-88484f048042 tempest-VolumesSnapshotTestJSON-1835544826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-d2f3a2b7-edbc-4b29-907b-b77d17475348" returned: 0 in 0.395s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:20:11 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-363fcf69-2386-4f4e-88fd-88484f048042 tempest-VolumesSnapshotTestJSON-1835544826 None] Lock "cinder-quobyte-d2f3a2b7-edbc-4b29-907b-b77d17475348" released by "_copy_volume_from_snapshot" :: held 12.142s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:20:11 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-363fcf69-2386-4f4e-88fd-88484f048042 tempest-VolumesSnapshotTestJSON-1835544826 None] Lock "cinder-quobyte-2a0bf2fb-fa7e-4927-af34-709b7c6ff1bd-d2f3a2b7-edbc-4b29-907b-b77d17475348" released by "_create_volume_from_snapshot" :: held 12.236s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:20:11 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-363fcf69-2386-4f4e-88fd-88484f048042 tempest-VolumesSnapshotTestJSON-1835544826 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.261s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:20:11 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-b981cc9e-2962-4b10-80dd-0e54b6af7170 tempest-VolumesGetTest-1874363189 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.181s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:20:11 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-b981cc9e-2962-4b10-80dd-0e54b6af7170 tempest-VolumesGetTest-1874363189 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:20:01Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-63922293',display_name='tempest-VolumesGetTest-Volume-656056638',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a611e523-810a-40f6-b82c-3565eedaa446,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1fb9cd956e4c4871af0e738ec6daa746',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:20:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:20:01Z,use_quota=True,user_id='95fe690f67df4d6f87922789a65a81d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 10:20:11 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-b981cc9e-2962-4b10-80dd-0e54b6af7170 tempest-VolumesGetTest-1874363189 None] Creating volume a611e523-810a-40f6-b82c-3565eedaa446 {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:20:11 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-b981cc9e-2962-4b10-80dd-0e54b6af7170 tempest-VolumesGetTest-1874363189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:20:11 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-b981cc9e-2962-4b10-80dd-0e54b6af7170 tempest-VolumesGetTest-1874363189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:20:11 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-b981cc9e-2962-4b10-80dd-0e54b6af7170 tempest-VolumesGetTest-1874363189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:20:11 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-b981cc9e-2962-4b10-80dd-0e54b6af7170 tempest-VolumesGetTest-1874363189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:20:11 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-b981cc9e-2962-4b10-80dd-0e54b6af7170 tempest-VolumesGetTest-1874363189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:20:11 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-b981cc9e-2962-4b10-80dd-0e54b6af7170 tempest-VolumesGetTest-1874363189 None] Selected osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:20:11 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-b981cc9e-2962-4b10-80dd-0e54b6af7170 tempest-VolumesGetTest-1874363189 None] casted to osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 Nov 04 10:20:11 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-b981cc9e-2962-4b10-80dd-0e54b6af7170 tempest-VolumesGetTest-1874363189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-a611e523-810a-40f6-b82c-3565eedaa446 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:20:11 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-363fcf69-2386-4f4e-88fd-88484f048042 tempest-VolumesSnapshotTestJSON-1835544826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a42fcc55-3e26-42f0-bb21-0676e216b1b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2f3a2b7-edbc-4b29-907b-b77d17475348', 'volume_size': 1, 'snapshot_id': '2a0bf2fb-fa7e-4927-af34-709b7c6ff1bd'}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:20:11 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-363fcf69-2386-4f4e-88fd-88484f048042 tempest-VolumesSnapshotTestJSON-1835544826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (656a810b-c217-4345-8a53-a4557df4950c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:20:11 devstack sudo[97142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-a611e523-810a-40f6-b82c-3565eedaa446 1073741824 Nov 04 10:20:11 devstack sudo[97142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:20:11 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-363fcf69-2386-4f4e-88fd-88484f048042 tempest-VolumesSnapshotTestJSON-1835544826 None] Volume volume-d2f3a2b7-edbc-4b29-907b-b77d17475348 (d2f3a2b7-edbc-4b29-907b-b77d17475348): created successfully Nov 04 10:20:11 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-363fcf69-2386-4f4e-88fd-88484f048042 tempest-VolumesSnapshotTestJSON-1835544826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (656a810b-c217-4345-8a53-a4557df4950c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:20:11 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-363fcf69-2386-4f4e-88fd-88484f048042 tempest-VolumesSnapshotTestJSON-1835544826 None] Flow 'volume_create_manager' (b11ea79a-decc-4b15-b85d-5406c8ae7bb5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:20:11 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-363fcf69-2386-4f4e-88fd-88484f048042 tempest-VolumesSnapshotTestJSON-1835544826 None] Created volume successfully. Nov 04 10:20:12 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-7b5ec0b4-546d-4633-8c6b-8e6156777b69 tempest-VolumesSnapshotTestJSON-1835544826 None] Acquiring lock "cinder-d2f3a2b7-edbc-4b29-907b-b77d17475348-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:20:12 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-7b5ec0b4-546d-4633-8c6b-8e6156777b69 tempest-VolumesSnapshotTestJSON-1835544826 None] Lock "cinder-d2f3a2b7-edbc-4b29-907b-b77d17475348-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:20:12 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-7b5ec0b4-546d-4633-8c6b-8e6156777b69 tempest-VolumesSnapshotTestJSON-1835544826 None] Acquiring lock "cinder-quobyte-d2f3a2b7-edbc-4b29-907b-b77d17475348" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:20:12 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-7b5ec0b4-546d-4633-8c6b-8e6156777b69 tempest-VolumesSnapshotTestJSON-1835544826 None] Lock "cinder-quobyte-d2f3a2b7-edbc-4b29-907b-b77d17475348" acquired by "delete_volume" :: waited 0.025s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:20:12 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[a63391ee-4629-4c00-9876-ead65482195e]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:20:12 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7b5ec0b4-546d-4633-8c6b-8e6156777b69 tempest-VolumesSnapshotTestJSON-1835544826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-d2f3a2b7-edbc-4b29-907b-b77d17475348 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:20:12 devstack sudo[97142]: pam_unix(sudo:session): session closed for user root Nov 04 10:20:12 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-b981cc9e-2962-4b10-80dd-0e54b6af7170 tempest-VolumesGetTest-1874363189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-a611e523-810a-40f6-b82c-3565eedaa446 1073741824" returned: 0 in 0.625s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:20:12 devstack sudo[97149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-d2f3a2b7-edbc-4b29-907b-b77d17475348 Nov 04 10:20:12 devstack sudo[97149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:20:12 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-b981cc9e-2962-4b10-80dd-0e54b6af7170 tempest-VolumesGetTest-1874363189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-a611e523-810a-40f6-b82c-3565eedaa446 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:20:12 devstack sudo[97151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-a611e523-810a-40f6-b82c-3565eedaa446 Nov 04 10:20:12 devstack sudo[97151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:20:12 devstack sudo[97151]: pam_unix(sudo:session): session closed for user root Nov 04 10:20:12 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-b981cc9e-2962-4b10-80dd-0e54b6af7170 tempest-VolumesGetTest-1874363189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-a611e523-810a-40f6-b82c-3565eedaa446" returned: 0 in 0.355s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:20:12 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-b981cc9e-2962-4b10-80dd-0e54b6af7170 tempest-VolumesGetTest-1874363189 None] <== create_volume: return (1036ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 10:20:12 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-b981cc9e-2962-4b10-80dd-0e54b6af7170 tempest-VolumesGetTest-1874363189 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.041s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:20:12 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-b981cc9e-2962-4b10-80dd-0e54b6af7170 tempest-VolumesGetTest-1874363189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6e9f532-80cd-40ee-a6af-6afac206bb62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a611e523-810a-40f6-b82c-3565eedaa446', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:20:12 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-b981cc9e-2962-4b10-80dd-0e54b6af7170 tempest-VolumesGetTest-1874363189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b92ee379-ef4e-42c9-b55c-4efb79effd54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:20:12 devstack sudo[97149]: pam_unix(sudo:session): session closed for user root Nov 04 10:20:12 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7b5ec0b4-546d-4633-8c6b-8e6156777b69 tempest-VolumesSnapshotTestJSON-1835544826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-d2f3a2b7-edbc-4b29-907b-b77d17475348" returned: 0 in 0.548s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:20:12 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7b5ec0b4-546d-4633-8c6b-8e6156777b69 tempest-VolumesSnapshotTestJSON-1835544826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-d2f3a2b7-edbc-4b29-907b-b77d17475348 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:20:12 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-b981cc9e-2962-4b10-80dd-0e54b6af7170 tempest-VolumesGetTest-1874363189 None] Volume volume-a611e523-810a-40f6-b82c-3565eedaa446 (a611e523-810a-40f6-b82c-3565eedaa446): created successfully Nov 04 10:20:12 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-b981cc9e-2962-4b10-80dd-0e54b6af7170 tempest-VolumesGetTest-1874363189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b92ee379-ef4e-42c9-b55c-4efb79effd54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:20:12 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-b981cc9e-2962-4b10-80dd-0e54b6af7170 tempest-VolumesGetTest-1874363189 None] Flow 'volume_create_manager' (7498043b-4a49-4109-b2da-6ae690a4607a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:20:12 devstack sudo[97159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-d2f3a2b7-edbc-4b29-907b-b77d17475348 Nov 04 10:20:12 devstack sudo[97159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:20:12 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-b981cc9e-2962-4b10-80dd-0e54b6af7170 tempest-VolumesGetTest-1874363189 None] Created volume successfully. Nov 04 10:20:13 devstack sudo[97159]: pam_unix(sudo:session): session closed for user root Nov 04 10:20:13 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7b5ec0b4-546d-4633-8c6b-8e6156777b69 tempest-VolumesSnapshotTestJSON-1835544826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-d2f3a2b7-edbc-4b29-907b-b77d17475348" returned: 0 in 0.383s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:20:13 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-7b5ec0b4-546d-4633-8c6b-8e6156777b69 tempest-VolumesSnapshotTestJSON-1835544826 None] Lock "cinder-quobyte-d2f3a2b7-edbc-4b29-907b-b77d17475348" released by "delete_volume" :: held 1.018s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:20:13 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-06739c91-97ea-4ccd-9dc5-cedc5aa53a75 tempest-VolumesGetTest-1874363189 None] Acquiring lock "cinder-a611e523-810a-40f6-b82c-3565eedaa446-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:20:13 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-7b5ec0b4-546d-4633-8c6b-8e6156777b69 tempest-VolumesSnapshotTestJSON-1835544826 None] Created reservations ['31242a22-cafe-4671-b2bd-04a2e95f1a6c', 'e72a34a6-5bfd-496d-957e-1669aec89db6', '6baed4f8-14a7-40b9-b462-76d5a8bc08b2', '369c8a67-67af-49af-8848-e8beb1a5d7a6'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:20:13 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-06739c91-97ea-4ccd-9dc5-cedc5aa53a75 tempest-VolumesGetTest-1874363189 None] Lock "cinder-a611e523-810a-40f6-b82c-3565eedaa446-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:20:13 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-06739c91-97ea-4ccd-9dc5-cedc5aa53a75 tempest-VolumesGetTest-1874363189 None] Acquiring lock "cinder-quobyte-a611e523-810a-40f6-b82c-3565eedaa446" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:20:13 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-06739c91-97ea-4ccd-9dc5-cedc5aa53a75 tempest-VolumesGetTest-1874363189 None] Lock "cinder-quobyte-a611e523-810a-40f6-b82c-3565eedaa446" acquired by "delete_volume" :: waited 0.018s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:20:13 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[e571ddc7-6c5d-4c35-903b-ef2c2fbb7031]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:20:13 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-06739c91-97ea-4ccd-9dc5-cedc5aa53a75 tempest-VolumesGetTest-1874363189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-a611e523-810a-40f6-b82c-3565eedaa446 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:20:13 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-7b5ec0b4-546d-4633-8c6b-8e6156777b69 tempest-VolumesSnapshotTestJSON-1835544826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:20:13 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-7b5ec0b4-546d-4633-8c6b-8e6156777b69 tempest-VolumesSnapshotTestJSON-1835544826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:20:13 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-7b5ec0b4-546d-4633-8c6b-8e6156777b69 tempest-VolumesSnapshotTestJSON-1835544826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:20:13 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-7b5ec0b4-546d-4633-8c6b-8e6156777b69 tempest-VolumesSnapshotTestJSON-1835544826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:20:13 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-7b5ec0b4-546d-4633-8c6b-8e6156777b69 tempest-VolumesSnapshotTestJSON-1835544826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:20:13 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7b5ec0b4-546d-4633-8c6b-8e6156777b69 tempest-VolumesSnapshotTestJSON-1835544826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:20:13 devstack sudo[97163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:20:13 devstack sudo[97163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:20:13 devstack sudo[97162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-a611e523-810a-40f6-b82c-3565eedaa446 Nov 04 10:20:13 devstack sudo[97162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:20:13 devstack sudo[97163]: pam_unix(sudo:session): session closed for user root Nov 04 10:20:13 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7b5ec0b4-546d-4633-8c6b-8e6156777b69 tempest-VolumesSnapshotTestJSON-1835544826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.332s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:20:13 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-7b5ec0b4-546d-4633-8c6b-8e6156777b69 tempest-VolumesSnapshotTestJSON-1835544826 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:20:13 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-7b5ec0b4-546d-4633-8c6b-8e6156777b69 tempest-VolumesSnapshotTestJSON-1835544826 None] Deleted volume successfully. Nov 04 10:20:13 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-7b5ec0b4-546d-4633-8c6b-8e6156777b69 tempest-VolumesSnapshotTestJSON-1835544826 None] Lock "cinder-d2f3a2b7-edbc-4b29-907b-b77d17475348-delete_volume" released by "delete_volume" :: held 1.774s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:20:14 devstack sudo[97162]: pam_unix(sudo:session): session closed for user root Nov 04 10:20:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-06739c91-97ea-4ccd-9dc5-cedc5aa53a75 tempest-VolumesGetTest-1874363189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-a611e523-810a-40f6-b82c-3565eedaa446" returned: 0 in 0.539s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:20:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-06739c91-97ea-4ccd-9dc5-cedc5aa53a75 tempest-VolumesGetTest-1874363189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-a611e523-810a-40f6-b82c-3565eedaa446 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:20:14 devstack sudo[97172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-a611e523-810a-40f6-b82c-3565eedaa446 Nov 04 10:20:14 devstack sudo[97172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:20:14 devstack sudo[97172]: pam_unix(sudo:session): session closed for user root Nov 04 10:20:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-06739c91-97ea-4ccd-9dc5-cedc5aa53a75 tempest-VolumesGetTest-1874363189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-a611e523-810a-40f6-b82c-3565eedaa446" returned: 0 in 0.282s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:20:14 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-06739c91-97ea-4ccd-9dc5-cedc5aa53a75 tempest-VolumesGetTest-1874363189 None] Lock "cinder-quobyte-a611e523-810a-40f6-b82c-3565eedaa446" released by "delete_volume" :: held 0.884s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:20:14 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-06739c91-97ea-4ccd-9dc5-cedc5aa53a75 tempest-VolumesGetTest-1874363189 None] Created reservations ['f397fe8b-802a-4573-bc52-4d5db40e1fd2', 'bb50c635-102f-4c62-8345-566242d16a97', '8d2d5665-de72-42fb-a044-71ac165d6c5e', '1085fc73-0598-45b4-8366-bf1613037ebe'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:20:14 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-161a1f7f-1854-47a8-b924-3b9b3ab199bc tempest-VolumesSnapshotTestJSON-1835544826 None] Acquiring lock "cinder-2a0bf2fb-fa7e-4927-af34-709b7c6ff1bd-delete_snapshot" by "delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:20:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-06739c91-97ea-4ccd-9dc5-cedc5aa53a75 tempest-VolumesGetTest-1874363189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:20:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-06739c91-97ea-4ccd-9dc5-cedc5aa53a75 tempest-VolumesGetTest-1874363189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:20:14 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-06739c91-97ea-4ccd-9dc5-cedc5aa53a75 tempest-VolumesGetTest-1874363189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:20:14 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-06739c91-97ea-4ccd-9dc5-cedc5aa53a75 tempest-VolumesGetTest-1874363189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:20:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-06739c91-97ea-4ccd-9dc5-cedc5aa53a75 tempest-VolumesGetTest-1874363189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:20:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-06739c91-97ea-4ccd-9dc5-cedc5aa53a75 tempest-VolumesGetTest-1874363189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:20:14 devstack sudo[97175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:20:14 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-161a1f7f-1854-47a8-b924-3b9b3ab199bc tempest-VolumesSnapshotTestJSON-1835544826 None] Lock "cinder-2a0bf2fb-fa7e-4927-af34-709b7c6ff1bd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.053s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:20:14 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-161a1f7f-1854-47a8-b924-3b9b3ab199bc tempest-VolumesSnapshotTestJSON-1835544826 None] Acquiring lock "cinder-quobyte-8daede7c-3e86-4824-97cc-7d0296355d17" by "delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:20:14 devstack sudo[97175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:20:14 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-161a1f7f-1854-47a8-b924-3b9b3ab199bc tempest-VolumesSnapshotTestJSON-1835544826 None] Lock "cinder-quobyte-8daede7c-3e86-4824-97cc-7d0296355d17" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:20:14 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-161a1f7f-1854-47a8-b924-3b9b3ab199bc tempest-VolumesSnapshotTestJSON-1835544826 None] Acquiring lock "cinder-quobyte-2a0bf2fb-fa7e-4927-af34-709b7c6ff1bd" by "_delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:20:14 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-161a1f7f-1854-47a8-b924-3b9b3ab199bc tempest-VolumesSnapshotTestJSON-1835544826 None] Lock "cinder-quobyte-2a0bf2fb-fa7e-4927-af34-709b7c6ff1bd" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:20:14 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-161a1f7f-1854-47a8-b924-3b9b3ab199bc tempest-VolumesSnapshotTestJSON-1835544826 None] Deleting offline snapshot 2a0bf2fb-fa7e-4927-af34-709b7c6ff1bd of volume 8daede7c-3e86-4824-97cc-7d0296355d17 {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 10:20:14 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-161a1f7f-1854-47a8-b924-3b9b3ab199bc tempest-VolumesSnapshotTestJSON-1835544826 None] snapshot_file for this snap is: volume-8daede7c-3e86-4824-97cc-7d0296355d17.2a0bf2fb-fa7e-4927-af34-709b7c6ff1bd {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 10:20:14 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6421586-9192-4285-861e-afc950ac7b32]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:20:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-161a1f7f-1854-47a8-b924-3b9b3ab199bc tempest-VolumesSnapshotTestJSON-1835544826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-8daede7c-3e86-4824-97cc-7d0296355d17.2a0bf2fb-fa7e-4927-af34-709b7c6ff1bd {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:20:14 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-87d4b25c-5409-4115-896b-183cfeab4d14 tempest-VolumesGetTest-1874363189 None] Acquiring lock "cinder-517d234d-18ac-4f27-ae22-2deda80f3b21-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:20:14 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-87d4b25c-5409-4115-896b-183cfeab4d14 tempest-VolumesGetTest-1874363189 None] Lock "cinder-517d234d-18ac-4f27-ae22-2deda80f3b21-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:20:14 devstack sudo[97177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-8daede7c-3e86-4824-97cc-7d0296355d17.2a0bf2fb-fa7e-4927-af34-709b7c6ff1bd Nov 04 10:20:14 devstack sudo[97177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:20:14 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-87d4b25c-5409-4115-896b-183cfeab4d14 tempest-VolumesGetTest-1874363189 None] Acquiring lock "cinder-quobyte-517d234d-18ac-4f27-ae22-2deda80f3b21" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:20:14 devstack sudo[97175]: pam_unix(sudo:session): session closed for user root Nov 04 10:20:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-06739c91-97ea-4ccd-9dc5-cedc5aa53a75 tempest-VolumesGetTest-1874363189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.403s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:20:14 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-06739c91-97ea-4ccd-9dc5-cedc5aa53a75 tempest-VolumesGetTest-1874363189 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:20:14 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-06739c91-97ea-4ccd-9dc5-cedc5aa53a75 tempest-VolumesGetTest-1874363189 None] Deleted volume successfully. Nov 04 10:20:14 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-87d4b25c-5409-4115-896b-183cfeab4d14 tempest-VolumesGetTest-1874363189 None] Lock "cinder-quobyte-517d234d-18ac-4f27-ae22-2deda80f3b21" acquired by "delete_volume" :: waited 0.040s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:20:15 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d8a00c1-b574-4dcc-865d-54994b1c2702]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:20:15 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-87d4b25c-5409-4115-896b-183cfeab4d14 tempest-VolumesGetTest-1874363189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-517d234d-18ac-4f27-ae22-2deda80f3b21 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:20:15 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-06739c91-97ea-4ccd-9dc5-cedc5aa53a75 tempest-VolumesGetTest-1874363189 None] Lock "cinder-a611e523-810a-40f6-b82c-3565eedaa446-delete_volume" released by "delete_volume" :: held 1.640s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:20:15 devstack sudo[97180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-517d234d-18ac-4f27-ae22-2deda80f3b21 Nov 04 10:20:15 devstack sudo[97180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:20:15 devstack sudo[97177]: pam_unix(sudo:session): session closed for user root Nov 04 10:20:15 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-161a1f7f-1854-47a8-b924-3b9b3ab199bc tempest-VolumesSnapshotTestJSON-1835544826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-8daede7c-3e86-4824-97cc-7d0296355d17.2a0bf2fb-fa7e-4927-af34-709b7c6ff1bd" returned: 0 in 0.561s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:20:15 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-161a1f7f-1854-47a8-b924-3b9b3ab199bc tempest-VolumesSnapshotTestJSON-1835544826 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8daede7c-3e86-4824-97cc-7d0296355d17(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87068) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 10:20:15 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[e378237f-1744-4c88-b7af-c331a42f9bb3]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:20:15 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-161a1f7f-1854-47a8-b924-3b9b3ab199bc tempest-VolumesSnapshotTestJSON-1835544826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-8daede7c-3e86-4824-97cc-7d0296355d17 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:20:15 devstack sudo[97185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-8daede7c-3e86-4824-97cc-7d0296355d17 Nov 04 10:20:15 devstack sudo[97185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:20:15 devstack sudo[97180]: pam_unix(sudo:session): session closed for user root Nov 04 10:20:15 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-87d4b25c-5409-4115-896b-183cfeab4d14 tempest-VolumesGetTest-1874363189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-517d234d-18ac-4f27-ae22-2deda80f3b21" returned: 0 in 0.470s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:20:15 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-87d4b25c-5409-4115-896b-183cfeab4d14 tempest-VolumesGetTest-1874363189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-517d234d-18ac-4f27-ae22-2deda80f3b21 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:20:15 devstack sudo[97190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-517d234d-18ac-4f27-ae22-2deda80f3b21 Nov 04 10:20:15 devstack sudo[97190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:20:15 devstack sudo[97190]: pam_unix(sudo:session): session closed for user root Nov 04 10:20:15 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-87d4b25c-5409-4115-896b-183cfeab4d14 tempest-VolumesGetTest-1874363189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-517d234d-18ac-4f27-ae22-2deda80f3b21" returned: 0 in 0.278s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:20:15 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-87d4b25c-5409-4115-896b-183cfeab4d14 tempest-VolumesGetTest-1874363189 None] Lock "cinder-quobyte-517d234d-18ac-4f27-ae22-2deda80f3b21" released by "delete_volume" :: held 0.817s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:20:15 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-87d4b25c-5409-4115-896b-183cfeab4d14 tempest-VolumesGetTest-1874363189 None] Created reservations ['e9920ca4-4031-460e-9698-4bf706639e5d', '29eaca44-f4a4-4002-8694-c9201538f876', '1871c438-17d4-4cc1-a51b-71b593a18ad0', 'c0401a00-1570-4bb1-a5de-c0d82bd82570'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:20:15 devstack sudo[97185]: pam_unix(sudo:session): session closed for user root Nov 04 10:20:15 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-161a1f7f-1854-47a8-b924-3b9b3ab199bc tempest-VolumesSnapshotTestJSON-1835544826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-8daede7c-3e86-4824-97cc-7d0296355d17" returned: 0 in 0.567s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:20:15 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-161a1f7f-1854-47a8-b924-3b9b3ab199bc tempest-VolumesSnapshotTestJSON-1835544826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-8daede7c-3e86-4824-97cc-7d0296355d17.2a0bf2fb-fa7e-4927-af34-709b7c6ff1bd {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:20:15 devstack sudo[97196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-8daede7c-3e86-4824-97cc-7d0296355d17.2a0bf2fb-fa7e-4927-af34-709b7c6ff1bd Nov 04 10:20:15 devstack sudo[97196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:20:15 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-87d4b25c-5409-4115-896b-183cfeab4d14 tempest-VolumesGetTest-1874363189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:20:15 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-87d4b25c-5409-4115-896b-183cfeab4d14 tempest-VolumesGetTest-1874363189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:20:15 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-87d4b25c-5409-4115-896b-183cfeab4d14 tempest-VolumesGetTest-1874363189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:20:15 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-87d4b25c-5409-4115-896b-183cfeab4d14 tempest-VolumesGetTest-1874363189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:20:15 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-87d4b25c-5409-4115-896b-183cfeab4d14 tempest-VolumesGetTest-1874363189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:20:15 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-87d4b25c-5409-4115-896b-183cfeab4d14 tempest-VolumesGetTest-1874363189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:20:16 devstack sudo[97198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:20:16 devstack sudo[97198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:20:16 devstack sudo[97198]: pam_unix(sudo:session): session closed for user root Nov 04 10:20:16 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-87d4b25c-5409-4115-896b-183cfeab4d14 tempest-VolumesGetTest-1874363189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.359s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:20:16 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-87d4b25c-5409-4115-896b-183cfeab4d14 tempest-VolumesGetTest-1874363189 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:20:16 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-87d4b25c-5409-4115-896b-183cfeab4d14 tempest-VolumesGetTest-1874363189 None] Deleted volume successfully. Nov 04 10:20:16 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-87d4b25c-5409-4115-896b-183cfeab4d14 tempest-VolumesGetTest-1874363189 None] Lock "cinder-517d234d-18ac-4f27-ae22-2deda80f3b21-delete_volume" released by "delete_volume" :: held 1.562s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:20:16 devstack sudo[97196]: pam_unix(sudo:session): session closed for user root Nov 04 10:20:16 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-161a1f7f-1854-47a8-b924-3b9b3ab199bc tempest-VolumesSnapshotTestJSON-1835544826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-8daede7c-3e86-4824-97cc-7d0296355d17.2a0bf2fb-fa7e-4927-af34-709b7c6ff1bd" returned: 0 in 0.557s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:20:16 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-161a1f7f-1854-47a8-b924-3b9b3ab199bc tempest-VolumesSnapshotTestJSON-1835544826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-8daede7c-3e86-4824-97cc-7d0296355d17.2a0bf2fb-fa7e-4927-af34-709b7c6ff1bd {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:20:16 devstack sudo[97204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-8daede7c-3e86-4824-97cc-7d0296355d17.2a0bf2fb-fa7e-4927-af34-709b7c6ff1bd Nov 04 10:20:16 devstack sudo[97204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:20:16 devstack sudo[97204]: pam_unix(sudo:session): session closed for user root Nov 04 10:20:16 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-161a1f7f-1854-47a8-b924-3b9b3ab199bc tempest-VolumesSnapshotTestJSON-1835544826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-8daede7c-3e86-4824-97cc-7d0296355d17.2a0bf2fb-fa7e-4927-af34-709b7c6ff1bd" returned: 0 in 0.331s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:20:16 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-161a1f7f-1854-47a8-b924-3b9b3ab199bc tempest-VolumesSnapshotTestJSON-1835544826 None] Lock "cinder-quobyte-2a0bf2fb-fa7e-4927-af34-709b7c6ff1bd" released by "_delete_snapshot" :: held 2.202s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:20:16 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-161a1f7f-1854-47a8-b924-3b9b3ab199bc tempest-VolumesSnapshotTestJSON-1835544826 None] Lock "cinder-quobyte-8daede7c-3e86-4824-97cc-7d0296355d17" released by "delete_snapshot" :: held 2.229s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:20:16 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-161a1f7f-1854-47a8-b924-3b9b3ab199bc tempest-VolumesSnapshotTestJSON-1835544826 None] Created reservations ['19ba9dd7-d454-4aa1-80ff-ab9f605f541a', '07a8c1be-ab22-474f-b5df-ae81ef1642eb', '14e71666-c9e4-411c-99bf-6051632b64fc', 'd05f435a-aeae-46d9-9462-9e54e574e617'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:20:17 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-161a1f7f-1854-47a8-b924-3b9b3ab199bc tempest-VolumesSnapshotTestJSON-1835544826 None] Delete snapshot completed successfully. Nov 04 10:20:17 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-161a1f7f-1854-47a8-b924-3b9b3ab199bc tempest-VolumesSnapshotTestJSON-1835544826 None] Lock "cinder-2a0bf2fb-fa7e-4927-af34-709b7c6ff1bd-delete_snapshot" released by "delete_snapshot" :: held 2.450s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:20:17 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [req-080dc9ed-1eca-4db9-8f39-8ddafda9723c req-7e4566b3-299f-4959-b780-535e11540a95 tempest-VolumesSnapshotsTestJSON-204824924 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:20:17 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [req-080dc9ed-1eca-4db9-8f39-8ddafda9723c req-7e4566b3-299f-4959-b780-535e11540a95 tempest-VolumesSnapshotsTestJSON-204824924 None] Flow 'volume_create_manager' (83c43366-a625-4000-a025-95ce28a75467) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:20:17 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [req-080dc9ed-1eca-4db9-8f39-8ddafda9723c req-7e4566b3-299f-4959-b780-535e11540a95 tempest-VolumesSnapshotsTestJSON-204824924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cd9f473-1573-4f65-bbda-2d0367467fa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:20:17 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [req-080dc9ed-1eca-4db9-8f39-8ddafda9723c req-7e4566b3-299f-4959-b780-535e11540a95 tempest-VolumesSnapshotsTestJSON-204824924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cd9f473-1573-4f65-bbda-2d0367467fa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:20:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1561331914',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88f285e8-9d4d-4286-b6a1-3273234cb275,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f2815dfb38d4a77ab13f0d6360d4643',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:20:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:20:17Z,use_quota=True,user_id='b72aa5fb922046679027f57daac83966',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:20:17 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [req-080dc9ed-1eca-4db9-8f39-8ddafda9723c req-7e4566b3-299f-4959-b780-535e11540a95 tempest-VolumesSnapshotsTestJSON-204824924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9772d8f9-d2b5-4470-a5e0-d5c5e31fc45c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:20:17 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [req-080dc9ed-1eca-4db9-8f39-8ddafda9723c req-7e4566b3-299f-4959-b780-535e11540a95 tempest-VolumesSnapshotsTestJSON-204824924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9772d8f9-d2b5-4470-a5e0-d5c5e31fc45c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:20:17 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [req-080dc9ed-1eca-4db9-8f39-8ddafda9723c req-7e4566b3-299f-4959-b780-535e11540a95 tempest-VolumesSnapshotsTestJSON-204824924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7e99afa-9353-4a1f-af75-91e231dba4ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:20:17 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [req-080dc9ed-1eca-4db9-8f39-8ddafda9723c req-7e4566b3-299f-4959-b780-535e11540a95 tempest-VolumesSnapshotsTestJSON-204824924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7e99afa-9353-4a1f-af75-91e231dba4ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '88f285e8-9d4d-4286-b6a1-3273234cb275', 'volume_name': 'volume-88f285e8-9d4d-4286-b6a1-3273234cb275', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:20:17 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [req-080dc9ed-1eca-4db9-8f39-8ddafda9723c req-7e4566b3-299f-4959-b780-535e11540a95 tempest-VolumesSnapshotsTestJSON-204824924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9055403-b4ca-4b7b-acfe-76ea49ed5532) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:20:17 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [req-080dc9ed-1eca-4db9-8f39-8ddafda9723c req-7e4566b3-299f-4959-b780-535e11540a95 tempest-VolumesSnapshotsTestJSON-204824924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9055403-b4ca-4b7b-acfe-76ea49ed5532) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:20:17 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [req-080dc9ed-1eca-4db9-8f39-8ddafda9723c req-7e4566b3-299f-4959-b780-535e11540a95 tempest-VolumesSnapshotsTestJSON-204824924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d0d11b6-3f2a-423b-88c6-b0f1d175b1cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:20:17 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [req-080dc9ed-1eca-4db9-8f39-8ddafda9723c req-7e4566b3-299f-4959-b780-535e11540a95 tempest-VolumesSnapshotsTestJSON-204824924 None] Volume 88f285e8-9d4d-4286-b6a1-3273234cb275: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-88f285e8-9d4d-4286-b6a1-3273234cb275', 'volume_size': 1} Nov 04 10:20:17 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [req-080dc9ed-1eca-4db9-8f39-8ddafda9723c req-7e4566b3-299f-4959-b780-535e11540a95 tempest-VolumesSnapshotsTestJSON-204824924 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:20:17 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [req-080dc9ed-1eca-4db9-8f39-8ddafda9723c req-7e4566b3-299f-4959-b780-535e11540a95 tempest-VolumesSnapshotsTestJSON-204824924 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:20:17 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [req-080dc9ed-1eca-4db9-8f39-8ddafda9723c req-7e4566b3-299f-4959-b780-535e11540a95 tempest-VolumesSnapshotsTestJSON-204824924 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:20:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1561331914',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88f285e8-9d4d-4286-b6a1-3273234cb275,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f2815dfb38d4a77ab13f0d6360d4643',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:20:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:20:17Z,use_quota=True,user_id='b72aa5fb922046679027f57daac83966',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 10:20:17 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [req-080dc9ed-1eca-4db9-8f39-8ddafda9723c req-7e4566b3-299f-4959-b780-535e11540a95 tempest-VolumesSnapshotsTestJSON-204824924 None] Creating volume 88f285e8-9d4d-4286-b6a1-3273234cb275 {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:20:17 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [req-080dc9ed-1eca-4db9-8f39-8ddafda9723c req-7e4566b3-299f-4959-b780-535e11540a95 tempest-VolumesSnapshotsTestJSON-204824924 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:20:17 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [req-080dc9ed-1eca-4db9-8f39-8ddafda9723c req-7e4566b3-299f-4959-b780-535e11540a95 tempest-VolumesSnapshotsTestJSON-204824924 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:20:17 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [req-080dc9ed-1eca-4db9-8f39-8ddafda9723c req-7e4566b3-299f-4959-b780-535e11540a95 tempest-VolumesSnapshotsTestJSON-204824924 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:20:17 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [req-080dc9ed-1eca-4db9-8f39-8ddafda9723c req-7e4566b3-299f-4959-b780-535e11540a95 tempest-VolumesSnapshotsTestJSON-204824924 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:20:17 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [req-080dc9ed-1eca-4db9-8f39-8ddafda9723c req-7e4566b3-299f-4959-b780-535e11540a95 tempest-VolumesSnapshotsTestJSON-204824924 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:20:17 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [req-080dc9ed-1eca-4db9-8f39-8ddafda9723c req-7e4566b3-299f-4959-b780-535e11540a95 tempest-VolumesSnapshotsTestJSON-204824924 None] Selected osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:20:17 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [req-080dc9ed-1eca-4db9-8f39-8ddafda9723c req-7e4566b3-299f-4959-b780-535e11540a95 tempest-VolumesSnapshotsTestJSON-204824924 None] casted to osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 Nov 04 10:20:17 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [req-080dc9ed-1eca-4db9-8f39-8ddafda9723c req-7e4566b3-299f-4959-b780-535e11540a95 tempest-VolumesSnapshotsTestJSON-204824924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-88f285e8-9d4d-4286-b6a1-3273234cb275 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:20:17 devstack sudo[97207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-88f285e8-9d4d-4286-b6a1-3273234cb275 1073741824 Nov 04 10:20:17 devstack sudo[97207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:20:17 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-226efeed-fa01-4b7b-ba20-2c60ed718f99 tempest-VolumesSnapshotTestJSON-1835544826 None] Acquiring lock "cinder-8daede7c-3e86-4824-97cc-7d0296355d17-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:20:17 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-226efeed-fa01-4b7b-ba20-2c60ed718f99 tempest-VolumesSnapshotTestJSON-1835544826 None] Lock "cinder-8daede7c-3e86-4824-97cc-7d0296355d17-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:20:17 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-226efeed-fa01-4b7b-ba20-2c60ed718f99 tempest-VolumesSnapshotTestJSON-1835544826 None] Acquiring lock "cinder-quobyte-8daede7c-3e86-4824-97cc-7d0296355d17" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:20:17 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-226efeed-fa01-4b7b-ba20-2c60ed718f99 tempest-VolumesSnapshotTestJSON-1835544826 None] Lock "cinder-quobyte-8daede7c-3e86-4824-97cc-7d0296355d17" acquired by "delete_volume" :: waited 0.019s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:20:18 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[f88929c7-1aeb-476d-a418-397b40e4258d]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:20:18 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-226efeed-fa01-4b7b-ba20-2c60ed718f99 tempest-VolumesSnapshotTestJSON-1835544826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-8daede7c-3e86-4824-97cc-7d0296355d17 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:20:18 devstack sudo[97212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-8daede7c-3e86-4824-97cc-7d0296355d17 Nov 04 10:20:18 devstack sudo[97212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:20:18 devstack sudo[97207]: pam_unix(sudo:session): session closed for user root Nov 04 10:20:18 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [req-080dc9ed-1eca-4db9-8f39-8ddafda9723c req-7e4566b3-299f-4959-b780-535e11540a95 tempest-VolumesSnapshotsTestJSON-204824924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-88f285e8-9d4d-4286-b6a1-3273234cb275 1073741824" returned: 0 in 0.698s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:20:18 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [req-080dc9ed-1eca-4db9-8f39-8ddafda9723c req-7e4566b3-299f-4959-b780-535e11540a95 tempest-VolumesSnapshotsTestJSON-204824924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-88f285e8-9d4d-4286-b6a1-3273234cb275 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:20:18 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-435849f0-9bee-4dd5-9bbe-2d9165bacfd0 tempest-VolumesActionsTest-1241883822 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:20:18 devstack sudo[97215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-88f285e8-9d4d-4286-b6a1-3273234cb275 Nov 04 10:20:18 devstack sudo[97215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:20:18 devstack sudo[97212]: pam_unix(sudo:session): session closed for user root Nov 04 10:20:18 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-226efeed-fa01-4b7b-ba20-2c60ed718f99 tempest-VolumesSnapshotTestJSON-1835544826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-8daede7c-3e86-4824-97cc-7d0296355d17" returned: 0 in 0.499s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:20:18 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-226efeed-fa01-4b7b-ba20-2c60ed718f99 tempest-VolumesSnapshotTestJSON-1835544826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-8daede7c-3e86-4824-97cc-7d0296355d17 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:20:18 devstack sudo[97221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-8daede7c-3e86-4824-97cc-7d0296355d17 Nov 04 10:20:18 devstack sudo[97221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:20:18 devstack sudo[97215]: pam_unix(sudo:session): session closed for user root Nov 04 10:20:18 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [req-080dc9ed-1eca-4db9-8f39-8ddafda9723c req-7e4566b3-299f-4959-b780-535e11540a95 tempest-VolumesSnapshotsTestJSON-204824924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-88f285e8-9d4d-4286-b6a1-3273234cb275" returned: 0 in 0.272s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:20:18 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [req-080dc9ed-1eca-4db9-8f39-8ddafda9723c req-7e4566b3-299f-4959-b780-535e11540a95 tempest-VolumesSnapshotsTestJSON-204824924 None] <== create_volume: return (1062ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 10:20:18 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [req-080dc9ed-1eca-4db9-8f39-8ddafda9723c req-7e4566b3-299f-4959-b780-535e11540a95 tempest-VolumesSnapshotsTestJSON-204824924 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.067s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:20:18 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-435849f0-9bee-4dd5-9bbe-2d9165bacfd0 tempest-VolumesActionsTest-1241883822 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.251s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:20:18 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [req-080dc9ed-1eca-4db9-8f39-8ddafda9723c req-7e4566b3-299f-4959-b780-535e11540a95 tempest-VolumesSnapshotsTestJSON-204824924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d0d11b6-3f2a-423b-88c6-b0f1d175b1cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88f285e8-9d4d-4286-b6a1-3273234cb275', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:20:18 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [req-080dc9ed-1eca-4db9-8f39-8ddafda9723c req-7e4566b3-299f-4959-b780-535e11540a95 tempest-VolumesSnapshotsTestJSON-204824924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dede5ff9-2015-41a2-9ac8-37b78df29527) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:20:18 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[a98cbbc1-a5c4-44e7-a1f7-e9fda952cb48]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:20:18 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-435849f0-9bee-4dd5-9bbe-2d9165bacfd0 tempest-VolumesActionsTest-1241883822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-61be2e3e-5d6c-4042-89f0-f7af5ea09dcd {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:20:18 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [req-080dc9ed-1eca-4db9-8f39-8ddafda9723c req-7e4566b3-299f-4959-b780-535e11540a95 tempest-VolumesSnapshotsTestJSON-204824924 None] Volume volume-88f285e8-9d4d-4286-b6a1-3273234cb275 (88f285e8-9d4d-4286-b6a1-3273234cb275): created successfully Nov 04 10:20:18 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [req-080dc9ed-1eca-4db9-8f39-8ddafda9723c req-7e4566b3-299f-4959-b780-535e11540a95 tempest-VolumesSnapshotsTestJSON-204824924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dede5ff9-2015-41a2-9ac8-37b78df29527) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:20:18 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [req-080dc9ed-1eca-4db9-8f39-8ddafda9723c req-7e4566b3-299f-4959-b780-535e11540a95 tempest-VolumesSnapshotsTestJSON-204824924 None] Flow 'volume_create_manager' (83c43366-a625-4000-a025-95ce28a75467) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:20:18 devstack cinder-volume[87068]: INFO cinder.volume.manager [req-080dc9ed-1eca-4db9-8f39-8ddafda9723c req-7e4566b3-299f-4959-b780-535e11540a95 tempest-VolumesSnapshotsTestJSON-204824924 None] Created volume successfully. Nov 04 10:20:18 devstack sudo[97221]: pam_unix(sudo:session): session closed for user root Nov 04 10:20:18 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-226efeed-fa01-4b7b-ba20-2c60ed718f99 tempest-VolumesSnapshotTestJSON-1835544826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-8daede7c-3e86-4824-97cc-7d0296355d17" returned: 0 in 0.313s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:20:18 devstack sudo[97224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-61be2e3e-5d6c-4042-89f0-f7af5ea09dcd Nov 04 10:20:18 devstack sudo[97224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:20:18 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-226efeed-fa01-4b7b-ba20-2c60ed718f99 tempest-VolumesSnapshotTestJSON-1835544826 None] Lock "cinder-quobyte-8daede7c-3e86-4824-97cc-7d0296355d17" released by "delete_volume" :: held 0.910s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:20:18 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-226efeed-fa01-4b7b-ba20-2c60ed718f99 tempest-VolumesSnapshotTestJSON-1835544826 None] Created reservations ['c83014da-799b-47c8-acf0-82d3f1583984', '26e35d50-ebe9-4884-8773-f9b9419ee188', 'ca269a3c-9db9-42f2-8f34-f68e3fa39031', '9c030f9b-0bd1-49f5-8c1f-6d84041c27cc'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:20:19 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-226efeed-fa01-4b7b-ba20-2c60ed718f99 tempest-VolumesSnapshotTestJSON-1835544826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:20:19 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-226efeed-fa01-4b7b-ba20-2c60ed718f99 tempest-VolumesSnapshotTestJSON-1835544826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:20:19 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-226efeed-fa01-4b7b-ba20-2c60ed718f99 tempest-VolumesSnapshotTestJSON-1835544826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:20:19 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-226efeed-fa01-4b7b-ba20-2c60ed718f99 tempest-VolumesSnapshotTestJSON-1835544826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:20:19 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-226efeed-fa01-4b7b-ba20-2c60ed718f99 tempest-VolumesSnapshotTestJSON-1835544826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:20:19 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-226efeed-fa01-4b7b-ba20-2c60ed718f99 tempest-VolumesSnapshotTestJSON-1835544826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:20:19 devstack sudo[97229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:20:19 devstack sudo[97229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:20:19 devstack sudo[97224]: pam_unix(sudo:session): session closed for user root Nov 04 10:20:19 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-435849f0-9bee-4dd5-9bbe-2d9165bacfd0 tempest-VolumesActionsTest-1241883822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-61be2e3e-5d6c-4042-89f0-f7af5ea09dcd" returned: 0 in 0.488s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:20:19 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2c094af-6557-4305-994f-b26912f0d152]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:20:19 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-435849f0-9bee-4dd5-9bbe-2d9165bacfd0 tempest-VolumesActionsTest-1241883822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-61be2e3e-5d6c-4042-89f0-f7af5ea09dcd {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:20:19 devstack sudo[97233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-61be2e3e-5d6c-4042-89f0-f7af5ea09dcd Nov 04 10:20:19 devstack sudo[97233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:20:19 devstack sudo[97229]: pam_unix(sudo:session): session closed for user root Nov 04 10:20:19 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-226efeed-fa01-4b7b-ba20-2c60ed718f99 tempest-VolumesSnapshotTestJSON-1835544826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.260s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:20:19 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-226efeed-fa01-4b7b-ba20-2c60ed718f99 tempest-VolumesSnapshotTestJSON-1835544826 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:20:19 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-226efeed-fa01-4b7b-ba20-2c60ed718f99 tempest-VolumesSnapshotTestJSON-1835544826 None] Deleted volume successfully. Nov 04 10:20:19 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-226efeed-fa01-4b7b-ba20-2c60ed718f99 tempest-VolumesSnapshotTestJSON-1835544826 None] Lock "cinder-8daede7c-3e86-4824-97cc-7d0296355d17-delete_volume" released by "delete_volume" :: held 1.571s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:20:19 devstack sudo[97233]: pam_unix(sudo:session): session closed for user root Nov 04 10:20:19 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-435849f0-9bee-4dd5-9bbe-2d9165bacfd0 tempest-VolumesActionsTest-1241883822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-61be2e3e-5d6c-4042-89f0-f7af5ea09dcd" returned: 0 in 0.384s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:20:19 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-435849f0-9bee-4dd5-9bbe-2d9165bacfd0 tempest-VolumesActionsTest-1241883822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-61be2e3e-5d6c-4042-89f0-f7af5ea09dcd /opt/stack/data/cinder/conversion/61be2e3e-5d6c-4042-89f0-f7af5ea09dcd.temp_image.12a20d01-f141-49b8-9c19-91f702f84635895d8jx1.img {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:20:19 devstack sudo[97239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-61be2e3e-5d6c-4042-89f0-f7af5ea09dcd /opt/stack/data/cinder/conversion/61be2e3e-5d6c-4042-89f0-f7af5ea09dcd.temp_image.12a20d01-f141-49b8-9c19-91f702f84635895d8jx1.img Nov 04 10:20:19 devstack sudo[97239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:20:19 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [req-50a3d8c7-d744-462a-94c7-f4b9337ad2f6 req-941c9ddc-8695-466d-b547-f073cc231d0c tempest-VolumesSnapshotsTestJSON-204824924 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:20:20 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-72a2c580-59b5-444a-aef5-89a3ccb79161 tempest-VolumesSnapshotTestJSON-1835544826 None] Acquiring lock "cinder-de24b84a-f23b-4f28-9058-839ddac8809f-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:20:20 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-72a2c580-59b5-444a-aef5-89a3ccb79161 tempest-VolumesSnapshotTestJSON-1835544826 None] Lock "cinder-de24b84a-f23b-4f28-9058-839ddac8809f-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:20:20 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-72a2c580-59b5-444a-aef5-89a3ccb79161 tempest-VolumesSnapshotTestJSON-1835544826 None] Acquiring lock "cinder-quobyte-de24b84a-f23b-4f28-9058-839ddac8809f" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:20:20 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-72a2c580-59b5-444a-aef5-89a3ccb79161 tempest-VolumesSnapshotTestJSON-1835544826 None] Lock "cinder-quobyte-de24b84a-f23b-4f28-9058-839ddac8809f" acquired by "delete_volume" :: waited 0.033s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:20:20 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[38159085-650d-46aa-ab60-ba3180aab39e]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:20:20 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-72a2c580-59b5-444a-aef5-89a3ccb79161 tempest-VolumesSnapshotTestJSON-1835544826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-de24b84a-f23b-4f28-9058-839ddac8809f {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:20:20 devstack sudo[97251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-de24b84a-f23b-4f28-9058-839ddac8809f Nov 04 10:20:20 devstack sudo[97251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:20:21 devstack sudo[97251]: pam_unix(sudo:session): session closed for user root Nov 04 10:20:21 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-72a2c580-59b5-444a-aef5-89a3ccb79161 tempest-VolumesSnapshotTestJSON-1835544826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-de24b84a-f23b-4f28-9058-839ddac8809f" returned: 0 in 0.661s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:20:21 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-72a2c580-59b5-444a-aef5-89a3ccb79161 tempest-VolumesSnapshotTestJSON-1835544826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-de24b84a-f23b-4f28-9058-839ddac8809f {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:20:21 devstack sudo[97256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-de24b84a-f23b-4f28-9058-839ddac8809f Nov 04 10:20:21 devstack sudo[97256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:20:21 devstack sudo[97256]: pam_unix(sudo:session): session closed for user root Nov 04 10:20:21 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-72a2c580-59b5-444a-aef5-89a3ccb79161 tempest-VolumesSnapshotTestJSON-1835544826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-de24b84a-f23b-4f28-9058-839ddac8809f" returned: 0 in 0.388s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:20:21 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-72a2c580-59b5-444a-aef5-89a3ccb79161 tempest-VolumesSnapshotTestJSON-1835544826 None] Lock "cinder-quobyte-de24b84a-f23b-4f28-9058-839ddac8809f" released by "delete_volume" :: held 1.235s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:20:21 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-72a2c580-59b5-444a-aef5-89a3ccb79161 tempest-VolumesSnapshotTestJSON-1835544826 None] Created reservations ['04ffd0f4-3207-42ce-97a7-87aeb8fd3c6e', 'abc7b9c5-c07a-4693-88cc-bbdf0403fb10', 'dfddfa50-a81e-4c2c-94ec-847a51d418df', 'be5b1810-f988-4eef-bc5e-75c7cc335baf'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:20:21 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-72a2c580-59b5-444a-aef5-89a3ccb79161 tempest-VolumesSnapshotTestJSON-1835544826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:20:21 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-72a2c580-59b5-444a-aef5-89a3ccb79161 tempest-VolumesSnapshotTestJSON-1835544826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:20:21 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-72a2c580-59b5-444a-aef5-89a3ccb79161 tempest-VolumesSnapshotTestJSON-1835544826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:20:21 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-72a2c580-59b5-444a-aef5-89a3ccb79161 tempest-VolumesSnapshotTestJSON-1835544826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:20:21 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-72a2c580-59b5-444a-aef5-89a3ccb79161 tempest-VolumesSnapshotTestJSON-1835544826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:20:21 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-72a2c580-59b5-444a-aef5-89a3ccb79161 tempest-VolumesSnapshotTestJSON-1835544826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:20:22 devstack sudo[97259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:20:22 devstack sudo[97259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:20:22 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-606274d6-a293-41fd-a282-af0107fdcbc1 tempest-VolumesListTestJSON-1714613792 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:20:22 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-606274d6-a293-41fd-a282-af0107fdcbc1 tempest-VolumesListTestJSON-1714613792 None] Flow 'volume_create_manager' (18282e6a-3eb7-4a8d-9335-e004123558fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:20:22 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-606274d6-a293-41fd-a282-af0107fdcbc1 tempest-VolumesListTestJSON-1714613792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a6d76b6-97b2-424d-99d1-e148c3f28695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:20:22 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-606274d6-a293-41fd-a282-af0107fdcbc1 tempest-VolumesListTestJSON-1714613792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a6d76b6-97b2-424d-99d1-e148c3f28695) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:20:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1256009562',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0457920d-96b6-4474-9317-d08c6a4c2d89,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c8633680e4a3437f8ad4c3aa42fae599',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:20:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:20:22Z,use_quota=True,user_id='1e63c5d23aa946bcabdbd905350f4004',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:20:22 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-606274d6-a293-41fd-a282-af0107fdcbc1 tempest-VolumesListTestJSON-1714613792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (674bae0b-48dc-4656-80a6-f67c7e9c9d44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:20:22 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-606274d6-a293-41fd-a282-af0107fdcbc1 tempest-VolumesListTestJSON-1714613792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (674bae0b-48dc-4656-80a6-f67c7e9c9d44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:20:22 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-606274d6-a293-41fd-a282-af0107fdcbc1 tempest-VolumesListTestJSON-1714613792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c5a9602-ed2f-47d8-8942-119a63118028) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:20:22 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-606274d6-a293-41fd-a282-af0107fdcbc1 tempest-VolumesListTestJSON-1714613792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c5a9602-ed2f-47d8-8942-119a63118028) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0457920d-96b6-4474-9317-d08c6a4c2d89', 'volume_name': 'volume-0457920d-96b6-4474-9317-d08c6a4c2d89', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:20:22 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-606274d6-a293-41fd-a282-af0107fdcbc1 tempest-VolumesListTestJSON-1714613792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe090df3-ebd3-49c7-85d5-f5dab4ba41bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:20:22 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-606274d6-a293-41fd-a282-af0107fdcbc1 tempest-VolumesListTestJSON-1714613792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe090df3-ebd3-49c7-85d5-f5dab4ba41bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:20:22 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-606274d6-a293-41fd-a282-af0107fdcbc1 tempest-VolumesListTestJSON-1714613792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24910d79-ffa2-4c9e-b11a-236601c6cc50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:20:22 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-606274d6-a293-41fd-a282-af0107fdcbc1 tempest-VolumesListTestJSON-1714613792 None] Volume 0457920d-96b6-4474-9317-d08c6a4c2d89: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0457920d-96b6-4474-9317-d08c6a4c2d89', 'volume_size': 1} Nov 04 10:20:22 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-606274d6-a293-41fd-a282-af0107fdcbc1 tempest-VolumesListTestJSON-1714613792 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:20:22 devstack sudo[97259]: pam_unix(sudo:session): session closed for user root Nov 04 10:20:22 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-72a2c580-59b5-444a-aef5-89a3ccb79161 tempest-VolumesSnapshotTestJSON-1835544826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.460s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:20:22 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-72a2c580-59b5-444a-aef5-89a3ccb79161 tempest-VolumesSnapshotTestJSON-1835544826 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:20:22 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-72a2c580-59b5-444a-aef5-89a3ccb79161 tempest-VolumesSnapshotTestJSON-1835544826 None] Deleted volume successfully. Nov 04 10:20:22 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-72a2c580-59b5-444a-aef5-89a3ccb79161 tempest-VolumesSnapshotTestJSON-1835544826 None] Lock "cinder-de24b84a-f23b-4f28-9058-839ddac8809f-delete_volume" released by "delete_volume" :: held 2.135s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:20:26 devstack sudo[97239]: pam_unix(sudo:session): session closed for user root Nov 04 10:20:26 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-435849f0-9bee-4dd5-9bbe-2d9165bacfd0 tempest-VolumesActionsTest-1241883822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-61be2e3e-5d6c-4042-89f0-f7af5ea09dcd /opt/stack/data/cinder/conversion/61be2e3e-5d6c-4042-89f0-f7af5ea09dcd.temp_image.12a20d01-f141-49b8-9c19-91f702f84635895d8jx1.img" returned: 0 in 7.387s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:20:26 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[623e34bd-0e70-4a8d-97d0-4d339e029648]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:20:26 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-435849f0-9bee-4dd5-9bbe-2d9165bacfd0 tempest-VolumesActionsTest-1241883822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-61be2e3e-5d6c-4042-89f0-f7af5ea09dcd {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:20:27 devstack sudo[97265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-61be2e3e-5d6c-4042-89f0-f7af5ea09dcd Nov 04 10:20:27 devstack sudo[97265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:20:27 devstack sudo[97265]: pam_unix(sudo:session): session closed for user root Nov 04 10:20:27 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-435849f0-9bee-4dd5-9bbe-2d9165bacfd0 tempest-VolumesActionsTest-1241883822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-61be2e3e-5d6c-4042-89f0-f7af5ea09dcd" returned: 0 in 0.621s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:20:27 devstack cinder-volume[87068]: DEBUG cinder.image.image_utils [None req-435849f0-9bee-4dd5-9bbe-2d9165bacfd0 tempest-VolumesActionsTest-1241883822 None] Image conversion details: src /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-61be2e3e-5d6c-4042-89f0-f7af5ea09dcd, size 1024.00 MB, duration 7.39 sec, destination /opt/stack/data/cinder/conversion/61be2e3e-5d6c-4042-89f0-f7af5ea09dcd.temp_image.12a20d01-f141-49b8-9c19-91f702f84635895d8jx1.img {{(pid=87068) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 04 10:20:27 devstack cinder-volume[87068]: INFO cinder.image.image_utils [None req-435849f0-9bee-4dd5-9bbe-2d9165bacfd0 tempest-VolumesActionsTest-1241883822 None] Converted 1024.00 MB image at 138.60 MB/s Nov 04 10:20:27 devstack cinder-volume[87068]: DEBUG cinder.image.image_utils [None req-435849f0-9bee-4dd5-9bbe-2d9165bacfd0 tempest-VolumesActionsTest-1241883822 None] 12a20d01-f141-49b8-9c19-91f702f84635 was raw, no need to convert to raw {{(pid=87068) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Nov 04 10:20:32 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-5de66407-725b-4c09-8e4c-d668b6936485 tempest-VolumesSnapshotListTestJSON-286994546 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:20:32 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-5de66407-725b-4c09-8e4c-d668b6936485 tempest-VolumesSnapshotListTestJSON-286994546 None] Flow 'volume_create_manager' (178438ac-75f3-4aa7-b779-0aa0943ba16d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:20:32 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-5de66407-725b-4c09-8e4c-d668b6936485 tempest-VolumesSnapshotListTestJSON-286994546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e204bd47-e274-449e-8b84-9ead3238436f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:20:32 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-5de66407-725b-4c09-8e4c-d668b6936485 tempest-VolumesSnapshotListTestJSON-286994546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e204bd47-e274-449e-8b84-9ead3238436f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:20:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-226077590',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cd7fd53-423f-4534-9925-6d2408c74977,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fea6e951048449f9af716ca0c48a1f1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:20:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:20:32Z,use_quota=True,user_id='b6ee10e341934bba8593a9180e9822e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:20:32 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-5de66407-725b-4c09-8e4c-d668b6936485 tempest-VolumesSnapshotListTestJSON-286994546 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ce9e288-cb0a-410f-a6d8-bcb6a97a0c5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:20:32 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-5de66407-725b-4c09-8e4c-d668b6936485 tempest-VolumesSnapshotListTestJSON-286994546 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ce9e288-cb0a-410f-a6d8-bcb6a97a0c5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:20:32 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-5de66407-725b-4c09-8e4c-d668b6936485 tempest-VolumesSnapshotListTestJSON-286994546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88ce8819-3ca2-4fd2-8091-1cd0ee15c0f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:20:32 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-5de66407-725b-4c09-8e4c-d668b6936485 tempest-VolumesSnapshotListTestJSON-286994546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88ce8819-3ca2-4fd2-8091-1cd0ee15c0f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6cd7fd53-423f-4534-9925-6d2408c74977', 'volume_name': 'volume-6cd7fd53-423f-4534-9925-6d2408c74977', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:20:32 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-5de66407-725b-4c09-8e4c-d668b6936485 tempest-VolumesSnapshotListTestJSON-286994546 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (889bb82a-0e83-4604-8fff-44daa99c3545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:20:32 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-5de66407-725b-4c09-8e4c-d668b6936485 tempest-VolumesSnapshotListTestJSON-286994546 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (889bb82a-0e83-4604-8fff-44daa99c3545) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:20:32 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-5de66407-725b-4c09-8e4c-d668b6936485 tempest-VolumesSnapshotListTestJSON-286994546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4da1ad9-aa10-4c2a-aadc-8cf0e3f7bcfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:20:32 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-5de66407-725b-4c09-8e4c-d668b6936485 tempest-VolumesSnapshotListTestJSON-286994546 None] Volume 6cd7fd53-423f-4534-9925-6d2408c74977: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6cd7fd53-423f-4534-9925-6d2408c74977', 'volume_size': 1} Nov 04 10:20:32 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-5de66407-725b-4c09-8e4c-d668b6936485 tempest-VolumesSnapshotListTestJSON-286994546 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:20:42 devstack cinder-volume[87068]: DEBUG dbcounter [-] [87068] Writing DB stats cinder:SELECT=41,cinder:INSERT=15,cinder:UPDATE=65,cinder:DELETE=4 {{(pid=87068) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 10:20:42 devstack cinder-volume[87068]: DEBUG dbcounter [-] [87068] Writing DB stats cinder:SELECT=49,cinder:UPDATE=51,cinder:INSERT=13,cinder:DELETE=4 {{(pid=87068) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 10:20:46 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-435849f0-9bee-4dd5-9bbe-2d9165bacfd0 tempest-VolumesActionsTest-1241883822 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 28.287s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:20:46 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-435849f0-9bee-4dd5-9bbe-2d9165bacfd0 tempest-VolumesActionsTest-1241883822 None] Uploaded volume to glance image-id: 12a20d01-f141-49b8-9c19-91f702f84635. {{(pid=87068) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Nov 04 10:20:46 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [req-50a3d8c7-d744-462a-94c7-f4b9337ad2f6 req-941c9ddc-8695-466d-b547-f073cc231d0c tempest-VolumesSnapshotsTestJSON-204824924 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 26.948s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:20:46 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [req-50a3d8c7-d744-462a-94c7-f4b9337ad2f6 req-941c9ddc-8695-466d-b547-f073cc231d0c tempest-VolumesSnapshotsTestJSON-204824924 None] Creating offline snapshot 37a3c6ea-f2d0-4ab1-9ece-c3db036c7cbe of volume 88f285e8-9d4d-4286-b6a1-3273234cb275 {{(pid=87068) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 10:20:46 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-435849f0-9bee-4dd5-9bbe-2d9165bacfd0 tempest-VolumesActionsTest-1241883822 None] Copy volume to image completed successfully. Nov 04 10:20:46 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[62380fdc-09f8-4de7-a4f4-abcd8dda3aff]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:20:46 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [req-50a3d8c7-d744-462a-94c7-f4b9337ad2f6 req-941c9ddc-8695-466d-b547-f073cc231d0c tempest-VolumesSnapshotsTestJSON-204824924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-88f285e8-9d4d-4286-b6a1-3273234cb275 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:20:47 devstack sudo[97319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-88f285e8-9d4d-4286-b6a1-3273234cb275 Nov 04 10:20:47 devstack sudo[97319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:20:47 devstack sudo[97319]: pam_unix(sudo:session): session closed for user root Nov 04 10:20:47 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [req-50a3d8c7-d744-462a-94c7-f4b9337ad2f6 req-941c9ddc-8695-466d-b547-f073cc231d0c tempest-VolumesSnapshotsTestJSON-204824924 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-88f285e8-9d4d-4286-b6a1-3273234cb275" returned: 0 in 0.340s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:20:47 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [req-50a3d8c7-d744-462a-94c7-f4b9337ad2f6 req-941c9ddc-8695-466d-b547-f073cc231d0c tempest-VolumesSnapshotsTestJSON-204824924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-88f285e8-9d4d-4286-b6a1-3273234cb275,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-88f285e8-9d4d-4286-b6a1-3273234cb275.37a3c6ea-f2d0-4ab1-9ece-c3db036c7cbe 1G {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:20:47 devstack sudo[97324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-88f285e8-9d4d-4286-b6a1-3273234cb275,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-88f285e8-9d4d-4286-b6a1-3273234cb275.37a3c6ea-f2d0-4ab1-9ece-c3db036c7cbe 1G Nov 04 10:20:47 devstack sudo[97324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:20:47 devstack sudo[97324]: pam_unix(sudo:session): session closed for user root Nov 04 10:20:47 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [req-50a3d8c7-d744-462a-94c7-f4b9337ad2f6 req-941c9ddc-8695-466d-b547-f073cc231d0c tempest-VolumesSnapshotsTestJSON-204824924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-88f285e8-9d4d-4286-b6a1-3273234cb275,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-88f285e8-9d4d-4286-b6a1-3273234cb275.37a3c6ea-f2d0-4ab1-9ece-c3db036c7cbe 1G" returned: 0 in 0.437s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:20:47 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [req-50a3d8c7-d744-462a-94c7-f4b9337ad2f6 req-941c9ddc-8695-466d-b547-f073cc231d0c tempest-VolumesSnapshotsTestJSON-204824924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-88f285e8-9d4d-4286-b6a1-3273234cb275 -F qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-88f285e8-9d4d-4286-b6a1-3273234cb275.37a3c6ea-f2d0-4ab1-9ece-c3db036c7cbe {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:20:47 devstack sudo[97330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-88f285e8-9d4d-4286-b6a1-3273234cb275 -F qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-88f285e8-9d4d-4286-b6a1-3273234cb275.37a3c6ea-f2d0-4ab1-9ece-c3db036c7cbe Nov 04 10:20:47 devstack sudo[97330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:20:48 devstack sudo[97330]: pam_unix(sudo:session): session closed for user root Nov 04 10:20:48 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [req-50a3d8c7-d744-462a-94c7-f4b9337ad2f6 req-941c9ddc-8695-466d-b547-f073cc231d0c tempest-VolumesSnapshotsTestJSON-204824924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-88f285e8-9d4d-4286-b6a1-3273234cb275 -F qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-88f285e8-9d4d-4286-b6a1-3273234cb275.37a3c6ea-f2d0-4ab1-9ece-c3db036c7cbe" returned: 0 in 0.306s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:20:48 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [req-50a3d8c7-d744-462a-94c7-f4b9337ad2f6 req-941c9ddc-8695-466d-b547-f073cc231d0c tempest-VolumesSnapshotsTestJSON-204824924 None] /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-88f285e8-9d4d-4286-b6a1-3273234cb275.37a3c6ea-f2d0-4ab1-9ece-c3db036c7cbe is being set with open permissions: ugo+rw Nov 04 10:20:48 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [req-50a3d8c7-d744-462a-94c7-f4b9337ad2f6 req-941c9ddc-8695-466d-b547-f073cc231d0c tempest-VolumesSnapshotsTestJSON-204824924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-88f285e8-9d4d-4286-b6a1-3273234cb275.37a3c6ea-f2d0-4ab1-9ece-c3db036c7cbe {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:20:48 devstack sudo[97335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-88f285e8-9d4d-4286-b6a1-3273234cb275.37a3c6ea-f2d0-4ab1-9ece-c3db036c7cbe Nov 04 10:20:48 devstack sudo[97335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:20:48 devstack sudo[97335]: pam_unix(sudo:session): session closed for user root Nov 04 10:20:48 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [req-50a3d8c7-d744-462a-94c7-f4b9337ad2f6 req-941c9ddc-8695-466d-b547-f073cc231d0c tempest-VolumesSnapshotsTestJSON-204824924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-88f285e8-9d4d-4286-b6a1-3273234cb275.37a3c6ea-f2d0-4ab1-9ece-c3db036c7cbe" returned: 0 in 0.244s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:20:48 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [req-50a3d8c7-d744-462a-94c7-f4b9337ad2f6 req-941c9ddc-8695-466d-b547-f073cc231d0c tempest-VolumesSnapshotsTestJSON-204824924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-88f285e8-9d4d-4286-b6a1-3273234cb275.info {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:20:48 devstack sudo[97338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-88f285e8-9d4d-4286-b6a1-3273234cb275.info Nov 04 10:20:48 devstack sudo[97338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:20:48 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-6eae0628-07d5-4599-90ab-93de93530386 tempest-VolumesActionsTest-1241883822 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:20:48 devstack sudo[97338]: pam_unix(sudo:session): session closed for user root Nov 04 10:20:48 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [req-50a3d8c7-d744-462a-94c7-f4b9337ad2f6 req-941c9ddc-8695-466d-b547-f073cc231d0c tempest-VolumesSnapshotsTestJSON-204824924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-88f285e8-9d4d-4286-b6a1-3273234cb275.info" returned: 0 in 0.243s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:20:48 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [req-50a3d8c7-d744-462a-94c7-f4b9337ad2f6 req-941c9ddc-8695-466d-b547-f073cc231d0c tempest-VolumesSnapshotsTestJSON-204824924 None] /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-88f285e8-9d4d-4286-b6a1-3273234cb275.info is being set with open permissions: ugo+rw Nov 04 10:20:48 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [req-50a3d8c7-d744-462a-94c7-f4b9337ad2f6 req-941c9ddc-8695-466d-b547-f073cc231d0c tempest-VolumesSnapshotsTestJSON-204824924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-88f285e8-9d4d-4286-b6a1-3273234cb275.info {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:20:48 devstack sudo[97341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-88f285e8-9d4d-4286-b6a1-3273234cb275.info Nov 04 10:20:48 devstack sudo[97341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:20:48 devstack sudo[97341]: pam_unix(sudo:session): session closed for user root Nov 04 10:20:48 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [req-50a3d8c7-d744-462a-94c7-f4b9337ad2f6 req-941c9ddc-8695-466d-b547-f073cc231d0c tempest-VolumesSnapshotsTestJSON-204824924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-88f285e8-9d4d-4286-b6a1-3273234cb275.info" returned: 0 in 0.235s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:20:48 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [req-50a3d8c7-d744-462a-94c7-f4b9337ad2f6 req-941c9ddc-8695-466d-b547-f073cc231d0c tempest-VolumesSnapshotsTestJSON-204824924 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.896s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:20:48 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-606274d6-a293-41fd-a282-af0107fdcbc1 tempest-VolumesListTestJSON-1714613792 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 26.630s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:20:48 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-606274d6-a293-41fd-a282-af0107fdcbc1 tempest-VolumesListTestJSON-1714613792 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:20:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1256009562',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0457920d-96b6-4474-9317-d08c6a4c2d89,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c8633680e4a3437f8ad4c3aa42fae599',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:20:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:20:22Z,use_quota=True,user_id='1e63c5d23aa946bcabdbd905350f4004',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 10:20:48 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-606274d6-a293-41fd-a282-af0107fdcbc1 tempest-VolumesListTestJSON-1714613792 None] Creating volume 0457920d-96b6-4474-9317-d08c6a4c2d89 {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:20:48 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-606274d6-a293-41fd-a282-af0107fdcbc1 tempest-VolumesListTestJSON-1714613792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:20:48 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-606274d6-a293-41fd-a282-af0107fdcbc1 tempest-VolumesListTestJSON-1714613792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:20:48 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-606274d6-a293-41fd-a282-af0107fdcbc1 tempest-VolumesListTestJSON-1714613792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:20:48 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-606274d6-a293-41fd-a282-af0107fdcbc1 tempest-VolumesListTestJSON-1714613792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:20:48 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-606274d6-a293-41fd-a282-af0107fdcbc1 tempest-VolumesListTestJSON-1714613792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:20:48 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-606274d6-a293-41fd-a282-af0107fdcbc1 tempest-VolumesListTestJSON-1714613792 None] Selected osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:20:48 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-606274d6-a293-41fd-a282-af0107fdcbc1 tempest-VolumesListTestJSON-1714613792 None] casted to osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 Nov 04 10:20:48 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-606274d6-a293-41fd-a282-af0107fdcbc1 tempest-VolumesListTestJSON-1714613792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-0457920d-96b6-4474-9317-d08c6a4c2d89 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:20:48 devstack sudo[97344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-0457920d-96b6-4474-9317-d08c6a4c2d89 1073741824 Nov 04 10:20:48 devstack sudo[97344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:20:48 devstack cinder-volume[87068]: INFO cinder.volume.manager [req-50a3d8c7-d744-462a-94c7-f4b9337ad2f6 req-941c9ddc-8695-466d-b547-f073cc231d0c tempest-VolumesSnapshotsTestJSON-204824924 None] Create snapshot completed successfully Nov 04 10:20:49 devstack sudo[97344]: pam_unix(sudo:session): session closed for user root Nov 04 10:20:49 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-606274d6-a293-41fd-a282-af0107fdcbc1 tempest-VolumesListTestJSON-1714613792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-0457920d-96b6-4474-9317-d08c6a4c2d89 1073741824" returned: 0 in 0.399s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:20:49 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-606274d6-a293-41fd-a282-af0107fdcbc1 tempest-VolumesListTestJSON-1714613792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-0457920d-96b6-4474-9317-d08c6a4c2d89 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:20:49 devstack sudo[97349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-0457920d-96b6-4474-9317-d08c6a4c2d89 Nov 04 10:20:49 devstack sudo[97349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:20:49 devstack sudo[97349]: pam_unix(sudo:session): session closed for user root Nov 04 10:20:49 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-606274d6-a293-41fd-a282-af0107fdcbc1 tempest-VolumesListTestJSON-1714613792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-0457920d-96b6-4474-9317-d08c6a4c2d89" returned: 0 in 0.237s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:20:49 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-606274d6-a293-41fd-a282-af0107fdcbc1 tempest-VolumesListTestJSON-1714613792 None] <== create_volume: return (675ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 10:20:49 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-606274d6-a293-41fd-a282-af0107fdcbc1 tempest-VolumesListTestJSON-1714613792 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.678s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:20:49 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-5de66407-725b-4c09-8e4c-d668b6936485 tempest-VolumesSnapshotListTestJSON-286994546 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 17.400s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:20:49 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-5de66407-725b-4c09-8e4c-d668b6936485 tempest-VolumesSnapshotListTestJSON-286994546 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:20:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-226077590',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cd7fd53-423f-4534-9925-6d2408c74977,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fea6e951048449f9af716ca0c48a1f1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:20:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:20:32Z,use_quota=True,user_id='b6ee10e341934bba8593a9180e9822e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 10:20:49 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-5de66407-725b-4c09-8e4c-d668b6936485 tempest-VolumesSnapshotListTestJSON-286994546 None] Creating volume 6cd7fd53-423f-4534-9925-6d2408c74977 {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:20:49 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-5de66407-725b-4c09-8e4c-d668b6936485 tempest-VolumesSnapshotListTestJSON-286994546 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:20:49 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-5de66407-725b-4c09-8e4c-d668b6936485 tempest-VolumesSnapshotListTestJSON-286994546 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:20:49 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-5de66407-725b-4c09-8e4c-d668b6936485 tempest-VolumesSnapshotListTestJSON-286994546 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:20:49 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-5de66407-725b-4c09-8e4c-d668b6936485 tempest-VolumesSnapshotListTestJSON-286994546 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:20:49 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-5de66407-725b-4c09-8e4c-d668b6936485 tempest-VolumesSnapshotListTestJSON-286994546 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:20:49 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-5de66407-725b-4c09-8e4c-d668b6936485 tempest-VolumesSnapshotListTestJSON-286994546 None] Selected osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:20:49 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-5de66407-725b-4c09-8e4c-d668b6936485 tempest-VolumesSnapshotListTestJSON-286994546 None] casted to osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 Nov 04 10:20:49 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-5de66407-725b-4c09-8e4c-d668b6936485 tempest-VolumesSnapshotListTestJSON-286994546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6cd7fd53-423f-4534-9925-6d2408c74977 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:20:49 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-606274d6-a293-41fd-a282-af0107fdcbc1 tempest-VolumesListTestJSON-1714613792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24910d79-ffa2-4c9e-b11a-236601c6cc50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0457920d-96b6-4474-9317-d08c6a4c2d89', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:20:49 devstack sudo[97352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6cd7fd53-423f-4534-9925-6d2408c74977 1073741824 Nov 04 10:20:49 devstack sudo[97352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:20:49 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-606274d6-a293-41fd-a282-af0107fdcbc1 tempest-VolumesListTestJSON-1714613792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f39a1f6e-346d-4b02-a6b8-b9511acffb22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:20:49 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-606274d6-a293-41fd-a282-af0107fdcbc1 tempest-VolumesListTestJSON-1714613792 None] Volume volume-0457920d-96b6-4474-9317-d08c6a4c2d89 (0457920d-96b6-4474-9317-d08c6a4c2d89): created successfully Nov 04 10:20:49 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-606274d6-a293-41fd-a282-af0107fdcbc1 tempest-VolumesListTestJSON-1714613792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f39a1f6e-346d-4b02-a6b8-b9511acffb22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:20:49 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-606274d6-a293-41fd-a282-af0107fdcbc1 tempest-VolumesListTestJSON-1714613792 None] Flow 'volume_create_manager' (18282e6a-3eb7-4a8d-9335-e004123558fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:20:49 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-606274d6-a293-41fd-a282-af0107fdcbc1 tempest-VolumesListTestJSON-1714613792 None] Created volume successfully. Nov 04 10:20:49 devstack cinder-volume[87068]: DEBUG cinder.coordination [req-77d2f85e-7cd3-49ee-8b5f-2ed8ec66f451 req-ac763e5a-ae9c-4168-8d2c-bef5f5398efe tempest-VolumesSnapshotsTestJSON-204824924 None] Acquiring lock "cinder-37a3c6ea-f2d0-4ab1-9ece-c3db036c7cbe-delete_snapshot" by "delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:20:49 devstack cinder-volume[87068]: DEBUG cinder.coordination [req-77d2f85e-7cd3-49ee-8b5f-2ed8ec66f451 req-ac763e5a-ae9c-4168-8d2c-bef5f5398efe tempest-VolumesSnapshotsTestJSON-204824924 None] Lock "cinder-37a3c6ea-f2d0-4ab1-9ece-c3db036c7cbe-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:20:49 devstack cinder-volume[87068]: DEBUG cinder.coordination [req-77d2f85e-7cd3-49ee-8b5f-2ed8ec66f451 req-ac763e5a-ae9c-4168-8d2c-bef5f5398efe tempest-VolumesSnapshotsTestJSON-204824924 None] Acquiring lock "cinder-quobyte-88f285e8-9d4d-4286-b6a1-3273234cb275" by "delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:20:49 devstack cinder-volume[87068]: DEBUG cinder.coordination [req-77d2f85e-7cd3-49ee-8b5f-2ed8ec66f451 req-ac763e5a-ae9c-4168-8d2c-bef5f5398efe tempest-VolumesSnapshotsTestJSON-204824924 None] Lock "cinder-quobyte-88f285e8-9d4d-4286-b6a1-3273234cb275" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:20:49 devstack cinder-volume[87068]: DEBUG cinder.coordination [req-77d2f85e-7cd3-49ee-8b5f-2ed8ec66f451 req-ac763e5a-ae9c-4168-8d2c-bef5f5398efe tempest-VolumesSnapshotsTestJSON-204824924 None] Acquiring lock "cinder-quobyte-37a3c6ea-f2d0-4ab1-9ece-c3db036c7cbe" by "_delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:20:49 devstack cinder-volume[87068]: DEBUG cinder.coordination [req-77d2f85e-7cd3-49ee-8b5f-2ed8ec66f451 req-ac763e5a-ae9c-4168-8d2c-bef5f5398efe tempest-VolumesSnapshotsTestJSON-204824924 None] Lock "cinder-quobyte-37a3c6ea-f2d0-4ab1-9ece-c3db036c7cbe" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:20:49 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [req-77d2f85e-7cd3-49ee-8b5f-2ed8ec66f451 req-ac763e5a-ae9c-4168-8d2c-bef5f5398efe tempest-VolumesSnapshotsTestJSON-204824924 None] Deleting offline snapshot 37a3c6ea-f2d0-4ab1-9ece-c3db036c7cbe of volume 88f285e8-9d4d-4286-b6a1-3273234cb275 {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 10:20:50 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [req-77d2f85e-7cd3-49ee-8b5f-2ed8ec66f451 req-ac763e5a-ae9c-4168-8d2c-bef5f5398efe tempest-VolumesSnapshotsTestJSON-204824924 None] snapshot_file for this snap is: volume-88f285e8-9d4d-4286-b6a1-3273234cb275.37a3c6ea-f2d0-4ab1-9ece-c3db036c7cbe {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 10:20:50 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[34f80525-d172-486f-9059-534149201023]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:20:50 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [req-77d2f85e-7cd3-49ee-8b5f-2ed8ec66f451 req-ac763e5a-ae9c-4168-8d2c-bef5f5398efe tempest-VolumesSnapshotsTestJSON-204824924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-88f285e8-9d4d-4286-b6a1-3273234cb275.37a3c6ea-f2d0-4ab1-9ece-c3db036c7cbe {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:20:50 devstack sudo[97352]: pam_unix(sudo:session): session closed for user root Nov 04 10:20:50 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-5de66407-725b-4c09-8e4c-d668b6936485 tempest-VolumesSnapshotListTestJSON-286994546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6cd7fd53-423f-4534-9925-6d2408c74977 1073741824" returned: 0 in 0.521s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:20:50 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-5de66407-725b-4c09-8e4c-d668b6936485 tempest-VolumesSnapshotListTestJSON-286994546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6cd7fd53-423f-4534-9925-6d2408c74977 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:20:50 devstack sudo[97359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6cd7fd53-423f-4534-9925-6d2408c74977 Nov 04 10:20:50 devstack sudo[97359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:20:50 devstack sudo[97358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-88f285e8-9d4d-4286-b6a1-3273234cb275.37a3c6ea-f2d0-4ab1-9ece-c3db036c7cbe Nov 04 10:20:50 devstack sudo[97358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:20:50 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a705fb7-3d3d-46c8-bb94-a07d4e3f9dfe tempest-VolumesListTestJSON-1714613792 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:20:50 devstack sudo[97359]: pam_unix(sudo:session): session closed for user root Nov 04 10:20:50 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-4a705fb7-3d3d-46c8-bb94-a07d4e3f9dfe tempest-VolumesListTestJSON-1714613792 None] Flow 'volume_create_manager' (7afa6b06-e7b8-4aed-bac8-91efd77b1f28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:20:50 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-4a705fb7-3d3d-46c8-bb94-a07d4e3f9dfe tempest-VolumesListTestJSON-1714613792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87422e76-fd33-4c34-b4af-20730933965c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:20:50 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-5de66407-725b-4c09-8e4c-d668b6936485 tempest-VolumesSnapshotListTestJSON-286994546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6cd7fd53-423f-4534-9925-6d2408c74977" returned: 0 in 0.331s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:20:50 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-5de66407-725b-4c09-8e4c-d668b6936485 tempest-VolumesSnapshotListTestJSON-286994546 None] <== create_volume: return (896ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 10:20:50 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-5de66407-725b-4c09-8e4c-d668b6936485 tempest-VolumesSnapshotListTestJSON-286994546 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.899s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:20:50 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-6eae0628-07d5-4599-90ab-93de93530386 tempest-VolumesActionsTest-1241883822 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 1.956s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:20:50 devstack sudo[97358]: pam_unix(sudo:session): session closed for user root Nov 04 10:20:50 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-4a705fb7-3d3d-46c8-bb94-a07d4e3f9dfe tempest-VolumesListTestJSON-1714613792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87422e76-fd33-4c34-b4af-20730933965c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:20:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1241155496',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fe125e5-c91b-4273-9ffc-1aef5c923527,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c8633680e4a3437f8ad4c3aa42fae599',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:20:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:20:50Z,use_quota=True,user_id='1e63c5d23aa946bcabdbd905350f4004',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:20:50 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-4a705fb7-3d3d-46c8-bb94-a07d4e3f9dfe tempest-VolumesListTestJSON-1714613792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82e04690-9e5f-4907-9ee3-cde9597fd5f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:20:50 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-4a705fb7-3d3d-46c8-bb94-a07d4e3f9dfe tempest-VolumesListTestJSON-1714613792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82e04690-9e5f-4907-9ee3-cde9597fd5f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:20:50 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-4a705fb7-3d3d-46c8-bb94-a07d4e3f9dfe tempest-VolumesListTestJSON-1714613792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14bdaf5a-d123-49a3-9912-8d8b890acfa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:20:50 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-4a705fb7-3d3d-46c8-bb94-a07d4e3f9dfe tempest-VolumesListTestJSON-1714613792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14bdaf5a-d123-49a3-9912-8d8b890acfa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7fe125e5-c91b-4273-9ffc-1aef5c923527', 'volume_name': 'volume-7fe125e5-c91b-4273-9ffc-1aef5c923527', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:20:50 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-4a705fb7-3d3d-46c8-bb94-a07d4e3f9dfe tempest-VolumesListTestJSON-1714613792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e38f3a8a-8d89-4fd9-808a-e9544c639a68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:20:50 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-4a705fb7-3d3d-46c8-bb94-a07d4e3f9dfe tempest-VolumesListTestJSON-1714613792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e38f3a8a-8d89-4fd9-808a-e9544c639a68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:20:50 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-4a705fb7-3d3d-46c8-bb94-a07d4e3f9dfe tempest-VolumesListTestJSON-1714613792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6a34c67-c8d5-4c35-bd23-840ad322cc4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:20:50 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-4a705fb7-3d3d-46c8-bb94-a07d4e3f9dfe tempest-VolumesListTestJSON-1714613792 None] Volume 7fe125e5-c91b-4273-9ffc-1aef5c923527: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7fe125e5-c91b-4273-9ffc-1aef5c923527', 'volume_size': 1} Nov 04 10:20:50 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-4a705fb7-3d3d-46c8-bb94-a07d4e3f9dfe tempest-VolumesListTestJSON-1714613792 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:20:50 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[9448d194-27ff-42de-8337-10acb83c5923]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:20:50 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [req-77d2f85e-7cd3-49ee-8b5f-2ed8ec66f451 req-ac763e5a-ae9c-4168-8d2c-bef5f5398efe tempest-VolumesSnapshotsTestJSON-204824924 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-88f285e8-9d4d-4286-b6a1-3273234cb275.37a3c6ea-f2d0-4ab1-9ece-c3db036c7cbe" returned: 0 in 0.457s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:20:50 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6eae0628-07d5-4599-90ab-93de93530386 tempest-VolumesActionsTest-1241883822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-61be2e3e-5d6c-4042-89f0-f7af5ea09dcd {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:20:50 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [req-77d2f85e-7cd3-49ee-8b5f-2ed8ec66f451 req-ac763e5a-ae9c-4168-8d2c-bef5f5398efe tempest-VolumesSnapshotsTestJSON-204824924 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-88f285e8-9d4d-4286-b6a1-3273234cb275(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87068) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 10:20:50 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-5de66407-725b-4c09-8e4c-d668b6936485 tempest-VolumesSnapshotListTestJSON-286994546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4da1ad9-aa10-4c2a-aadc-8cf0e3f7bcfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6cd7fd53-423f-4534-9925-6d2408c74977', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:20:50 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-5de66407-725b-4c09-8e4c-d668b6936485 tempest-VolumesSnapshotListTestJSON-286994546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (288b8689-8ca5-4b4c-92d7-7ee42c69e004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:20:50 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[62c3cdca-dffb-4cf2-a39a-b9d4ce975324]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:20:50 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [req-77d2f85e-7cd3-49ee-8b5f-2ed8ec66f451 req-ac763e5a-ae9c-4168-8d2c-bef5f5398efe tempest-VolumesSnapshotsTestJSON-204824924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-88f285e8-9d4d-4286-b6a1-3273234cb275 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:20:50 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-5de66407-725b-4c09-8e4c-d668b6936485 tempest-VolumesSnapshotListTestJSON-286994546 None] Volume volume-6cd7fd53-423f-4534-9925-6d2408c74977 (6cd7fd53-423f-4534-9925-6d2408c74977): created successfully Nov 04 10:20:50 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-5de66407-725b-4c09-8e4c-d668b6936485 tempest-VolumesSnapshotListTestJSON-286994546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (288b8689-8ca5-4b4c-92d7-7ee42c69e004) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:20:50 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-5de66407-725b-4c09-8e4c-d668b6936485 tempest-VolumesSnapshotListTestJSON-286994546 None] Flow 'volume_create_manager' (178438ac-75f3-4aa7-b779-0aa0943ba16d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:20:50 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-5de66407-725b-4c09-8e4c-d668b6936485 tempest-VolumesSnapshotListTestJSON-286994546 None] Created volume successfully. Nov 04 10:20:50 devstack sudo[97366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-61be2e3e-5d6c-4042-89f0-f7af5ea09dcd Nov 04 10:20:50 devstack sudo[97366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:20:50 devstack sudo[97367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-88f285e8-9d4d-4286-b6a1-3273234cb275 Nov 04 10:20:50 devstack sudo[97367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:20:50 devstack sudo[97366]: pam_unix(sudo:session): session closed for user root Nov 04 10:20:50 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6eae0628-07d5-4599-90ab-93de93530386 tempest-VolumesActionsTest-1241883822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-61be2e3e-5d6c-4042-89f0-f7af5ea09dcd" returned: 0 in 0.365s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:20:50 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[524c1347-107f-4e22-ac4b-f4f66fe7dfbd]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:20:50 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6eae0628-07d5-4599-90ab-93de93530386 tempest-VolumesActionsTest-1241883822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-61be2e3e-5d6c-4042-89f0-f7af5ea09dcd {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:20:50 devstack sudo[97367]: pam_unix(sudo:session): session closed for user root Nov 04 10:20:50 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [req-77d2f85e-7cd3-49ee-8b5f-2ed8ec66f451 req-ac763e5a-ae9c-4168-8d2c-bef5f5398efe tempest-VolumesSnapshotsTestJSON-204824924 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-88f285e8-9d4d-4286-b6a1-3273234cb275" returned: 0 in 0.359s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:20:50 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [req-77d2f85e-7cd3-49ee-8b5f-2ed8ec66f451 req-ac763e5a-ae9c-4168-8d2c-bef5f5398efe tempest-VolumesSnapshotsTestJSON-204824924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-88f285e8-9d4d-4286-b6a1-3273234cb275.37a3c6ea-f2d0-4ab1-9ece-c3db036c7cbe {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:20:50 devstack sudo[97377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-88f285e8-9d4d-4286-b6a1-3273234cb275.37a3c6ea-f2d0-4ab1-9ece-c3db036c7cbe Nov 04 10:20:50 devstack sudo[97377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:20:50 devstack sudo[97376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-61be2e3e-5d6c-4042-89f0-f7af5ea09dcd Nov 04 10:20:50 devstack sudo[97376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:20:51 devstack sudo[97376]: pam_unix(sudo:session): session closed for user root Nov 04 10:20:51 devstack sudo[97377]: pam_unix(sudo:session): session closed for user root Nov 04 10:20:51 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6eae0628-07d5-4599-90ab-93de93530386 tempest-VolumesActionsTest-1241883822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-61be2e3e-5d6c-4042-89f0-f7af5ea09dcd" returned: 0 in 0.394s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:20:51 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [req-77d2f85e-7cd3-49ee-8b5f-2ed8ec66f451 req-ac763e5a-ae9c-4168-8d2c-bef5f5398efe tempest-VolumesSnapshotsTestJSON-204824924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-88f285e8-9d4d-4286-b6a1-3273234cb275.37a3c6ea-f2d0-4ab1-9ece-c3db036c7cbe" returned: 0 in 0.366s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:20:51 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6eae0628-07d5-4599-90ab-93de93530386 tempest-VolumesActionsTest-1241883822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-61be2e3e-5d6c-4042-89f0-f7af5ea09dcd /opt/stack/data/cinder/conversion/61be2e3e-5d6c-4042-89f0-f7af5ea09dcd.temp_image.28e32a72-11a3-4368-b3ac-58285263eb0ey8l8xe3n.img {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:20:51 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [req-77d2f85e-7cd3-49ee-8b5f-2ed8ec66f451 req-ac763e5a-ae9c-4168-8d2c-bef5f5398efe tempest-VolumesSnapshotsTestJSON-204824924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-88f285e8-9d4d-4286-b6a1-3273234cb275.37a3c6ea-f2d0-4ab1-9ece-c3db036c7cbe {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:20:51 devstack sudo[97386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-61be2e3e-5d6c-4042-89f0-f7af5ea09dcd /opt/stack/data/cinder/conversion/61be2e3e-5d6c-4042-89f0-f7af5ea09dcd.temp_image.28e32a72-11a3-4368-b3ac-58285263eb0ey8l8xe3n.img Nov 04 10:20:51 devstack sudo[97386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:20:51 devstack sudo[97387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-88f285e8-9d4d-4286-b6a1-3273234cb275.37a3c6ea-f2d0-4ab1-9ece-c3db036c7cbe Nov 04 10:20:51 devstack sudo[97387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:20:51 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-fece56f6-ac50-481f-bd84-dac26d7b584e tempest-VolumesSnapshotListTestJSON-286994546 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:20:51 devstack sudo[97387]: pam_unix(sudo:session): session closed for user root Nov 04 10:20:51 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [req-77d2f85e-7cd3-49ee-8b5f-2ed8ec66f451 req-ac763e5a-ae9c-4168-8d2c-bef5f5398efe tempest-VolumesSnapshotsTestJSON-204824924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-88f285e8-9d4d-4286-b6a1-3273234cb275.37a3c6ea-f2d0-4ab1-9ece-c3db036c7cbe" returned: 0 in 0.276s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:20:51 devstack cinder-volume[87068]: DEBUG cinder.coordination [req-77d2f85e-7cd3-49ee-8b5f-2ed8ec66f451 req-ac763e5a-ae9c-4168-8d2c-bef5f5398efe tempest-VolumesSnapshotsTestJSON-204824924 None] Lock "cinder-quobyte-37a3c6ea-f2d0-4ab1-9ece-c3db036c7cbe" released by "_delete_snapshot" :: held 1.667s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:20:51 devstack cinder-volume[87068]: DEBUG cinder.coordination [req-77d2f85e-7cd3-49ee-8b5f-2ed8ec66f451 req-ac763e5a-ae9c-4168-8d2c-bef5f5398efe tempest-VolumesSnapshotsTestJSON-204824924 None] Lock "cinder-quobyte-88f285e8-9d4d-4286-b6a1-3273234cb275" released by "delete_snapshot" :: held 1.697s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:20:51 devstack cinder-volume[87068]: DEBUG cinder.quota [req-77d2f85e-7cd3-49ee-8b5f-2ed8ec66f451 req-ac763e5a-ae9c-4168-8d2c-bef5f5398efe tempest-VolumesSnapshotsTestJSON-204824924 None] Created reservations ['05087f82-bba4-486f-9d2b-33a207db4b09', '4ed9c593-0211-432b-a4f3-c7950f54a4f3', 'c395827e-0228-43ee-922e-958563974d48', '7cec0277-a744-49a9-a007-3b8ad6f9fecb'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:20:51 devstack cinder-volume[87068]: INFO cinder.volume.manager [req-77d2f85e-7cd3-49ee-8b5f-2ed8ec66f451 req-ac763e5a-ae9c-4168-8d2c-bef5f5398efe tempest-VolumesSnapshotsTestJSON-204824924 None] Delete snapshot completed successfully. Nov 04 10:20:51 devstack cinder-volume[87068]: DEBUG cinder.coordination [req-77d2f85e-7cd3-49ee-8b5f-2ed8ec66f451 req-ac763e5a-ae9c-4168-8d2c-bef5f5398efe tempest-VolumesSnapshotsTestJSON-204824924 None] Lock "cinder-37a3c6ea-f2d0-4ab1-9ece-c3db036c7cbe-delete_snapshot" released by "delete_snapshot" :: held 1.948s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:20:52 devstack cinder-volume[87068]: DEBUG cinder.coordination [req-b3ae3f14-6821-46f7-a1c1-1b328b03b5be req-bad2b7f0-e0ea-4c9d-84f6-de2a615e32ad tempest-VolumesSnapshotsTestJSON-204824924 None] Acquiring lock "cinder-88f285e8-9d4d-4286-b6a1-3273234cb275-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:20:52 devstack cinder-volume[87068]: DEBUG cinder.coordination [req-b3ae3f14-6821-46f7-a1c1-1b328b03b5be req-bad2b7f0-e0ea-4c9d-84f6-de2a615e32ad tempest-VolumesSnapshotsTestJSON-204824924 None] Lock "cinder-88f285e8-9d4d-4286-b6a1-3273234cb275-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:20:52 devstack cinder-volume[87068]: DEBUG cinder.coordination [req-b3ae3f14-6821-46f7-a1c1-1b328b03b5be req-bad2b7f0-e0ea-4c9d-84f6-de2a615e32ad tempest-VolumesSnapshotsTestJSON-204824924 None] Acquiring lock "cinder-quobyte-88f285e8-9d4d-4286-b6a1-3273234cb275" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:20:52 devstack cinder-volume[87068]: DEBUG cinder.coordination [req-b3ae3f14-6821-46f7-a1c1-1b328b03b5be req-bad2b7f0-e0ea-4c9d-84f6-de2a615e32ad tempest-VolumesSnapshotsTestJSON-204824924 None] Lock "cinder-quobyte-88f285e8-9d4d-4286-b6a1-3273234cb275" acquired by "delete_volume" :: waited 0.045s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:20:52 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[b06cfa5d-274b-4e12-988c-17e599eb11ad]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:20:52 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [req-b3ae3f14-6821-46f7-a1c1-1b328b03b5be req-bad2b7f0-e0ea-4c9d-84f6-de2a615e32ad tempest-VolumesSnapshotsTestJSON-204824924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-88f285e8-9d4d-4286-b6a1-3273234cb275 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:20:52 devstack sudo[97402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-88f285e8-9d4d-4286-b6a1-3273234cb275 Nov 04 10:20:52 devstack sudo[97402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:20:53 devstack sudo[97402]: pam_unix(sudo:session): session closed for user root Nov 04 10:20:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [req-b3ae3f14-6821-46f7-a1c1-1b328b03b5be req-bad2b7f0-e0ea-4c9d-84f6-de2a615e32ad tempest-VolumesSnapshotsTestJSON-204824924 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-88f285e8-9d4d-4286-b6a1-3273234cb275" returned: 0 in 0.624s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:20:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [req-b3ae3f14-6821-46f7-a1c1-1b328b03b5be req-bad2b7f0-e0ea-4c9d-84f6-de2a615e32ad tempest-VolumesSnapshotsTestJSON-204824924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-88f285e8-9d4d-4286-b6a1-3273234cb275 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:20:53 devstack sudo[97408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-88f285e8-9d4d-4286-b6a1-3273234cb275 Nov 04 10:20:53 devstack sudo[97408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:20:53 devstack sudo[97408]: pam_unix(sudo:session): session closed for user root Nov 04 10:20:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [req-b3ae3f14-6821-46f7-a1c1-1b328b03b5be req-bad2b7f0-e0ea-4c9d-84f6-de2a615e32ad tempest-VolumesSnapshotsTestJSON-204824924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-88f285e8-9d4d-4286-b6a1-3273234cb275" returned: 0 in 0.321s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:20:53 devstack cinder-volume[87068]: DEBUG cinder.coordination [req-b3ae3f14-6821-46f7-a1c1-1b328b03b5be req-bad2b7f0-e0ea-4c9d-84f6-de2a615e32ad tempest-VolumesSnapshotsTestJSON-204824924 None] Lock "cinder-quobyte-88f285e8-9d4d-4286-b6a1-3273234cb275" released by "delete_volume" :: held 1.104s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:20:53 devstack cinder-volume[87068]: DEBUG cinder.quota [req-b3ae3f14-6821-46f7-a1c1-1b328b03b5be req-bad2b7f0-e0ea-4c9d-84f6-de2a615e32ad tempest-VolumesSnapshotsTestJSON-204824924 None] Created reservations ['8b33b830-28aa-4434-aa7a-5ede9639e63f', 'bc9105c9-37b0-4982-9dd7-37544505b32e', '54753c03-853f-44c6-81ae-5e591d0b660c', '0de3ce68-902e-4cc6-867c-96b34212bb14'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:20:53 devstack cinder-volume[87068]: DEBUG oslo_service.periodic_task [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87068) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 10:20:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:20:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:20:53 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:20:53 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:20:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:20:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:20:53 devstack sudo[97411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:20:53 devstack sudo[97411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:20:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [req-b3ae3f14-6821-46f7-a1c1-1b328b03b5be req-bad2b7f0-e0ea-4c9d-84f6-de2a615e32ad tempest-VolumesSnapshotsTestJSON-204824924 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:20:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [req-b3ae3f14-6821-46f7-a1c1-1b328b03b5be req-bad2b7f0-e0ea-4c9d-84f6-de2a615e32ad tempest-VolumesSnapshotsTestJSON-204824924 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:20:53 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [req-b3ae3f14-6821-46f7-a1c1-1b328b03b5be req-bad2b7f0-e0ea-4c9d-84f6-de2a615e32ad tempest-VolumesSnapshotsTestJSON-204824924 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:20:53 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [req-b3ae3f14-6821-46f7-a1c1-1b328b03b5be req-bad2b7f0-e0ea-4c9d-84f6-de2a615e32ad tempest-VolumesSnapshotsTestJSON-204824924 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:20:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [req-b3ae3f14-6821-46f7-a1c1-1b328b03b5be req-bad2b7f0-e0ea-4c9d-84f6-de2a615e32ad tempest-VolumesSnapshotsTestJSON-204824924 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:20:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [req-b3ae3f14-6821-46f7-a1c1-1b328b03b5be req-bad2b7f0-e0ea-4c9d-84f6-de2a615e32ad tempest-VolumesSnapshotsTestJSON-204824924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:20:53 devstack sudo[97413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:20:53 devstack sudo[97413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:20:54 devstack sudo[97411]: pam_unix(sudo:session): session closed for user root Nov 04 10:20:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.386s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:20:54 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:20:54 devstack cinder-volume[87068]: DEBUG oslo_service.periodic_task [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Running periodic task VolumeManager._thread_info {{(pid=87068) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 10:20:54 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] thread count: 28 {{(pid=87068) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 04 10:20:54 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] thread info: [<_MainThread(MainThread, started 126275656192128)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87068) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 04 10:20:54 devstack sudo[97413]: pam_unix(sudo:session): session closed for user root Nov 04 10:20:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [req-b3ae3f14-6821-46f7-a1c1-1b328b03b5be req-bad2b7f0-e0ea-4c9d-84f6-de2a615e32ad tempest-VolumesSnapshotsTestJSON-204824924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.566s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:20:54 devstack cinder-volume[87068]: DEBUG cinder.manager [req-b3ae3f14-6821-46f7-a1c1-1b328b03b5be req-bad2b7f0-e0ea-4c9d-84f6-de2a615e32ad tempest-VolumesSnapshotsTestJSON-204824924 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:20:54 devstack cinder-volume[87068]: INFO cinder.volume.manager [req-b3ae3f14-6821-46f7-a1c1-1b328b03b5be req-bad2b7f0-e0ea-4c9d-84f6-de2a615e32ad tempest-VolumesSnapshotsTestJSON-204824924 None] Deleted volume successfully. Nov 04 10:20:54 devstack cinder-volume[87068]: DEBUG cinder.coordination [req-b3ae3f14-6821-46f7-a1c1-1b328b03b5be req-bad2b7f0-e0ea-4c9d-84f6-de2a615e32ad tempest-VolumesSnapshotsTestJSON-204824924 None] Lock "cinder-88f285e8-9d4d-4286-b6a1-3273234cb275-delete_volume" released by "delete_volume" :: held 2.126s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:20:57 devstack sudo[97386]: pam_unix(sudo:session): session closed for user root Nov 04 10:20:57 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6eae0628-07d5-4599-90ab-93de93530386 tempest-VolumesActionsTest-1241883822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-61be2e3e-5d6c-4042-89f0-f7af5ea09dcd /opt/stack/data/cinder/conversion/61be2e3e-5d6c-4042-89f0-f7af5ea09dcd.temp_image.28e32a72-11a3-4368-b3ac-58285263eb0ey8l8xe3n.img" returned: 0 in 6.605s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:20:57 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed59c512-3637-46d9-bb48-92fa5e6a6fcf]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:20:57 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6eae0628-07d5-4599-90ab-93de93530386 tempest-VolumesActionsTest-1241883822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-61be2e3e-5d6c-4042-89f0-f7af5ea09dcd {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:20:58 devstack sudo[97419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-61be2e3e-5d6c-4042-89f0-f7af5ea09dcd Nov 04 10:20:58 devstack sudo[97419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:20:58 devstack sudo[97419]: pam_unix(sudo:session): session closed for user root Nov 04 10:20:58 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6eae0628-07d5-4599-90ab-93de93530386 tempest-VolumesActionsTest-1241883822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-61be2e3e-5d6c-4042-89f0-f7af5ea09dcd" returned: 0 in 0.511s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:20:58 devstack cinder-volume[87068]: DEBUG cinder.image.image_utils [None req-6eae0628-07d5-4599-90ab-93de93530386 tempest-VolumesActionsTest-1241883822 None] Image conversion details: src /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-61be2e3e-5d6c-4042-89f0-f7af5ea09dcd, size 1024.00 MB, duration 6.61 sec, destination /opt/stack/data/cinder/conversion/61be2e3e-5d6c-4042-89f0-f7af5ea09dcd.temp_image.28e32a72-11a3-4368-b3ac-58285263eb0ey8l8xe3n.img {{(pid=87068) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 04 10:20:58 devstack cinder-volume[87068]: INFO cinder.image.image_utils [None req-6eae0628-07d5-4599-90ab-93de93530386 tempest-VolumesActionsTest-1241883822 None] Converted 1024.00 MB image at 155.01 MB/s Nov 04 10:20:58 devstack cinder-volume[87068]: DEBUG cinder.image.image_utils [None req-6eae0628-07d5-4599-90ab-93de93530386 tempest-VolumesActionsTest-1241883822 None] 28e32a72-11a3-4368-b3ac-58285263eb0e was raw, converting to qcow2 {{(pid=87068) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1203}} Nov 04 10:20:58 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b8109c3-463d-480c-942f-a3f795902d48]: (4, 'raw') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:20:58 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6eae0628-07d5-4599-90ab-93de93530386 tempest-VolumesActionsTest-1241883822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/61be2e3e-5d6c-4042-89f0-f7af5ea09dcd.temp_image.28e32a72-11a3-4368-b3ac-58285263eb0ey8l8xe3n.img {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:20:58 devstack sudo[97424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/61be2e3e-5d6c-4042-89f0-f7af5ea09dcd.temp_image.28e32a72-11a3-4368-b3ac-58285263eb0ey8l8xe3n.img Nov 04 10:20:58 devstack sudo[97424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:20:58 devstack sudo[97424]: pam_unix(sudo:session): session closed for user root Nov 04 10:20:58 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6eae0628-07d5-4599-90ab-93de93530386 tempest-VolumesActionsTest-1241883822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/61be2e3e-5d6c-4042-89f0-f7af5ea09dcd.temp_image.28e32a72-11a3-4368-b3ac-58285263eb0ey8l8xe3n.img" returned: 0 in 0.316s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:20:58 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6eae0628-07d5-4599-90ab-93de93530386 tempest-VolumesActionsTest-1241883822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/61be2e3e-5d6c-4042-89f0-f7af5ea09dcd.temp_image.28e32a72-11a3-4368-b3ac-58285263eb0ey8l8xe3n.img {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:20:58 devstack sudo[97428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/61be2e3e-5d6c-4042-89f0-f7af5ea09dcd.temp_image.28e32a72-11a3-4368-b3ac-58285263eb0ey8l8xe3n.img Nov 04 10:20:58 devstack sudo[97428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:20:59 devstack sudo[97428]: pam_unix(sudo:session): session closed for user root Nov 04 10:20:59 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6eae0628-07d5-4599-90ab-93de93530386 tempest-VolumesActionsTest-1241883822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/61be2e3e-5d6c-4042-89f0-f7af5ea09dcd.temp_image.28e32a72-11a3-4368-b3ac-58285263eb0ey8l8xe3n.img" returned: 1 in 0.332s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:20:59 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6eae0628-07d5-4599-90ab-93de93530386 tempest-VolumesActionsTest-1241883822 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/61be2e3e-5d6c-4042-89f0-f7af5ea09dcd.temp_image.28e32a72-11a3-4368-b3ac-58285263eb0ey8l8xe3n.img' failed. Not Retrying. {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 04 10:20:59 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6eae0628-07d5-4599-90ab-93de93530386 tempest-VolumesActionsTest-1241883822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/61be2e3e-5d6c-4042-89f0-f7af5ea09dcd.temp_image.28e32a72-11a3-4368-b3ac-58285263eb0ey8l8xe3n.img /opt/stack/data/cinder/conversion/vol_upload_jc7ehiiu {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:20:59 devstack sudo[97433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/61be2e3e-5d6c-4042-89f0-f7af5ea09dcd.temp_image.28e32a72-11a3-4368-b3ac-58285263eb0ey8l8xe3n.img /opt/stack/data/cinder/conversion/vol_upload_jc7ehiiu Nov 04 10:20:59 devstack sudo[97433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:20:59 devstack sudo[97433]: pam_unix(sudo:session): session closed for user root Nov 04 10:20:59 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6eae0628-07d5-4599-90ab-93de93530386 tempest-VolumesActionsTest-1241883822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/61be2e3e-5d6c-4042-89f0-f7af5ea09dcd.temp_image.28e32a72-11a3-4368-b3ac-58285263eb0ey8l8xe3n.img /opt/stack/data/cinder/conversion/vol_upload_jc7ehiiu" returned: 0 in 0.256s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:20:59 devstack cinder-volume[87068]: DEBUG cinder.image.image_utils [None req-6eae0628-07d5-4599-90ab-93de93530386 tempest-VolumesActionsTest-1241883822 None] Image conversion details: src /opt/stack/data/cinder/conversion/61be2e3e-5d6c-4042-89f0-f7af5ea09dcd.temp_image.28e32a72-11a3-4368-b3ac-58285263eb0ey8l8xe3n.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_jc7ehiiu {{(pid=87068) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 04 10:20:59 devstack cinder-volume[87068]: INFO cinder.image.image_utils [None req-6eae0628-07d5-4599-90ab-93de93530386 tempest-VolumesActionsTest-1241883822 None] Converted 1024.00 MB image at 1024.00 MB/s Nov 04 10:20:59 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed9b456d-e922-4ddc-bc6a-276d975505e5]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:20:59 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6eae0628-07d5-4599-90ab-93de93530386 tempest-VolumesActionsTest-1241883822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_jc7ehiiu {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:20:59 devstack sudo[97439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_jc7ehiiu Nov 04 10:20:59 devstack sudo[97439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:20:59 devstack sudo[97439]: pam_unix(sudo:session): session closed for user root Nov 04 10:20:59 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6eae0628-07d5-4599-90ab-93de93530386 tempest-VolumesActionsTest-1241883822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_jc7ehiiu" returned: 0 in 0.313s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:21:00 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-f52dc5cb-a58f-4421-8441-4cdba2634b27 tempest-VolumesTestJSON-57329144 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:21:00 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-f52dc5cb-a58f-4421-8441-4cdba2634b27 tempest-VolumesTestJSON-57329144 None] Flow 'volume_create_manager' (4ad1769e-22cf-42ed-8646-00e22bfaf47d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:21:00 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-f52dc5cb-a58f-4421-8441-4cdba2634b27 tempest-VolumesTestJSON-57329144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (772c48a8-ca94-4974-9148-d20ba959242b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:21:00 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-f52dc5cb-a58f-4421-8441-4cdba2634b27 tempest-VolumesTestJSON-57329144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (772c48a8-ca94-4974-9148-d20ba959242b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:21:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-922791744',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5268e4af-d9f6-467e-897c-933b9dcb32c9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='da188ab0d1d74f38a160ddae0198552a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:21:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:21:00Z,use_quota=True,user_id='8ff03cbb8229420fb66d9af783bdfa12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:21:00 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-f52dc5cb-a58f-4421-8441-4cdba2634b27 tempest-VolumesTestJSON-57329144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (875388a1-e251-4b4b-a409-d1ab7da5c27a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:21:00 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-f52dc5cb-a58f-4421-8441-4cdba2634b27 tempest-VolumesTestJSON-57329144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (875388a1-e251-4b4b-a409-d1ab7da5c27a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:21:00 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-f52dc5cb-a58f-4421-8441-4cdba2634b27 tempest-VolumesTestJSON-57329144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f6f836b-8b45-4dfa-9fd2-8c7361ffe101) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:21:00 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-f52dc5cb-a58f-4421-8441-4cdba2634b27 tempest-VolumesTestJSON-57329144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f6f836b-8b45-4dfa-9fd2-8c7361ffe101) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5268e4af-d9f6-467e-897c-933b9dcb32c9', 'volume_name': 'volume-5268e4af-d9f6-467e-897c-933b9dcb32c9', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:21:00 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-f52dc5cb-a58f-4421-8441-4cdba2634b27 tempest-VolumesTestJSON-57329144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (032683e1-5661-4e83-8588-09705f7a182e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:21:00 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-f52dc5cb-a58f-4421-8441-4cdba2634b27 tempest-VolumesTestJSON-57329144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (032683e1-5661-4e83-8588-09705f7a182e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:21:00 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-f52dc5cb-a58f-4421-8441-4cdba2634b27 tempest-VolumesTestJSON-57329144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a5a1c0d-a405-411d-947b-b1ee5fd29b3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:21:00 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-f52dc5cb-a58f-4421-8441-4cdba2634b27 tempest-VolumesTestJSON-57329144 None] Volume 5268e4af-d9f6-467e-897c-933b9dcb32c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5268e4af-d9f6-467e-897c-933b9dcb32c9', 'volume_size': 1} Nov 04 10:21:00 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-f52dc5cb-a58f-4421-8441-4cdba2634b27 tempest-VolumesTestJSON-57329144 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:21:01 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-6eae0628-07d5-4599-90ab-93de93530386 tempest-VolumesActionsTest-1241883822 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 10.593s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:21:01 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-6eae0628-07d5-4599-90ab-93de93530386 tempest-VolumesActionsTest-1241883822 None] Uploaded volume to glance image-id: 28e32a72-11a3-4368-b3ac-58285263eb0e. {{(pid=87068) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Nov 04 10:21:01 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-4a705fb7-3d3d-46c8-bb94-a07d4e3f9dfe tempest-VolumesListTestJSON-1714613792 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.541s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:21:01 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-4a705fb7-3d3d-46c8-bb94-a07d4e3f9dfe tempest-VolumesListTestJSON-1714613792 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:20:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1241155496',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fe125e5-c91b-4273-9ffc-1aef5c923527,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c8633680e4a3437f8ad4c3aa42fae599',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:20:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:20:50Z,use_quota=True,user_id='1e63c5d23aa946bcabdbd905350f4004',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 10:21:01 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-4a705fb7-3d3d-46c8-bb94-a07d4e3f9dfe tempest-VolumesListTestJSON-1714613792 None] Creating volume 7fe125e5-c91b-4273-9ffc-1aef5c923527 {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:21:01 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-4a705fb7-3d3d-46c8-bb94-a07d4e3f9dfe tempest-VolumesListTestJSON-1714613792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:21:01 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-4a705fb7-3d3d-46c8-bb94-a07d4e3f9dfe tempest-VolumesListTestJSON-1714613792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:21:01 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-4a705fb7-3d3d-46c8-bb94-a07d4e3f9dfe tempest-VolumesListTestJSON-1714613792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:21:01 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-4a705fb7-3d3d-46c8-bb94-a07d4e3f9dfe tempest-VolumesListTestJSON-1714613792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:21:01 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-4a705fb7-3d3d-46c8-bb94-a07d4e3f9dfe tempest-VolumesListTestJSON-1714613792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:21:01 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-4a705fb7-3d3d-46c8-bb94-a07d4e3f9dfe tempest-VolumesListTestJSON-1714613792 None] Selected osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:21:01 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-4a705fb7-3d3d-46c8-bb94-a07d4e3f9dfe tempest-VolumesListTestJSON-1714613792 None] casted to osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 Nov 04 10:21:01 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-4a705fb7-3d3d-46c8-bb94-a07d4e3f9dfe tempest-VolumesListTestJSON-1714613792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-7fe125e5-c91b-4273-9ffc-1aef5c923527 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:21:01 devstack sudo[97444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-7fe125e5-c91b-4273-9ffc-1aef5c923527 1073741824 Nov 04 10:21:01 devstack sudo[97444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:21:01 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-6eae0628-07d5-4599-90ab-93de93530386 tempest-VolumesActionsTest-1241883822 None] Copy volume to image completed successfully. Nov 04 10:21:01 devstack sudo[97444]: pam_unix(sudo:session): session closed for user root Nov 04 10:21:01 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-4a705fb7-3d3d-46c8-bb94-a07d4e3f9dfe tempest-VolumesListTestJSON-1714613792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-7fe125e5-c91b-4273-9ffc-1aef5c923527 1073741824" returned: 0 in 0.491s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:21:01 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-4a705fb7-3d3d-46c8-bb94-a07d4e3f9dfe tempest-VolumesListTestJSON-1714613792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-7fe125e5-c91b-4273-9ffc-1aef5c923527 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:21:01 devstack sudo[97450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-7fe125e5-c91b-4273-9ffc-1aef5c923527 Nov 04 10:21:01 devstack sudo[97450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:21:02 devstack sudo[97450]: pam_unix(sudo:session): session closed for user root Nov 04 10:21:02 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-4a705fb7-3d3d-46c8-bb94-a07d4e3f9dfe tempest-VolumesListTestJSON-1714613792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-7fe125e5-c91b-4273-9ffc-1aef5c923527" returned: 0 in 0.250s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:21:02 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-4a705fb7-3d3d-46c8-bb94-a07d4e3f9dfe tempest-VolumesListTestJSON-1714613792 None] <== create_volume: return (1031ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 10:21:02 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-4a705fb7-3d3d-46c8-bb94-a07d4e3f9dfe tempest-VolumesListTestJSON-1714613792 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.033s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:21:02 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-fece56f6-ac50-481f-bd84-dac26d7b584e tempest-VolumesSnapshotListTestJSON-286994546 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 10.680s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:21:02 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-fece56f6-ac50-481f-bd84-dac26d7b584e tempest-VolumesSnapshotListTestJSON-286994546 None] Creating offline snapshot e76624f4-9bcc-4e76-b6be-114af48e731c of volume 6cd7fd53-423f-4534-9925-6d2408c74977 {{(pid=87068) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 10:21:02 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-4a705fb7-3d3d-46c8-bb94-a07d4e3f9dfe tempest-VolumesListTestJSON-1714613792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6a34c67-c8d5-4c35-bd23-840ad322cc4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7fe125e5-c91b-4273-9ffc-1aef5c923527', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:21:02 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-4a705fb7-3d3d-46c8-bb94-a07d4e3f9dfe tempest-VolumesListTestJSON-1714613792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd5d15bc-d28c-4903-ac8c-b728db73d659) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:21:02 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae6dfb98-7400-4497-b7b2-fd2eda141d25]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:21:02 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-fece56f6-ac50-481f-bd84-dac26d7b584e tempest-VolumesSnapshotListTestJSON-286994546 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6cd7fd53-423f-4534-9925-6d2408c74977 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:21:02 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-4a705fb7-3d3d-46c8-bb94-a07d4e3f9dfe tempest-VolumesListTestJSON-1714613792 None] Volume volume-7fe125e5-c91b-4273-9ffc-1aef5c923527 (7fe125e5-c91b-4273-9ffc-1aef5c923527): created successfully Nov 04 10:21:02 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-4a705fb7-3d3d-46c8-bb94-a07d4e3f9dfe tempest-VolumesListTestJSON-1714613792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd5d15bc-d28c-4903-ac8c-b728db73d659) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:21:02 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-4a705fb7-3d3d-46c8-bb94-a07d4e3f9dfe tempest-VolumesListTestJSON-1714613792 None] Flow 'volume_create_manager' (7afa6b06-e7b8-4aed-bac8-91efd77b1f28) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:21:02 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-4a705fb7-3d3d-46c8-bb94-a07d4e3f9dfe tempest-VolumesListTestJSON-1714613792 None] Created volume successfully. Nov 04 10:21:02 devstack sudo[97453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6cd7fd53-423f-4534-9925-6d2408c74977 Nov 04 10:21:02 devstack sudo[97453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:21:02 devstack sudo[97453]: pam_unix(sudo:session): session closed for user root Nov 04 10:21:02 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-fece56f6-ac50-481f-bd84-dac26d7b584e tempest-VolumesSnapshotListTestJSON-286994546 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6cd7fd53-423f-4534-9925-6d2408c74977" returned: 0 in 0.418s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:21:02 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-fece56f6-ac50-481f-bd84-dac26d7b584e tempest-VolumesSnapshotListTestJSON-286994546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6cd7fd53-423f-4534-9925-6d2408c74977,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6cd7fd53-423f-4534-9925-6d2408c74977.e76624f4-9bcc-4e76-b6be-114af48e731c 1G {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:21:02 devstack sudo[97459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6cd7fd53-423f-4534-9925-6d2408c74977,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6cd7fd53-423f-4534-9925-6d2408c74977.e76624f4-9bcc-4e76-b6be-114af48e731c 1G Nov 04 10:21:02 devstack sudo[97459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:21:02 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-f7b3300b-c2a7-4381-bd16-14cce0c9b874 tempest-VolumesActionsTest-1241883822 None] Acquiring lock "cinder-61be2e3e-5d6c-4042-89f0-f7af5ea09dcd-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:21:02 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-f7b3300b-c2a7-4381-bd16-14cce0c9b874 tempest-VolumesActionsTest-1241883822 None] Lock "cinder-61be2e3e-5d6c-4042-89f0-f7af5ea09dcd-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:21:02 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-f7b3300b-c2a7-4381-bd16-14cce0c9b874 tempest-VolumesActionsTest-1241883822 None] Acquiring lock "cinder-quobyte-61be2e3e-5d6c-4042-89f0-f7af5ea09dcd" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:21:02 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-f7b3300b-c2a7-4381-bd16-14cce0c9b874 tempest-VolumesActionsTest-1241883822 None] Lock "cinder-quobyte-61be2e3e-5d6c-4042-89f0-f7af5ea09dcd" acquired by "delete_volume" :: waited 0.024s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:21:02 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dd9e94d-0f61-4baf-aaf1-7229a2308fa3]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:21:02 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f7b3300b-c2a7-4381-bd16-14cce0c9b874 tempest-VolumesActionsTest-1241883822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-61be2e3e-5d6c-4042-89f0-f7af5ea09dcd {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:21:02 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-344acb25-e11e-4449-b8d1-8b18f1113260 tempest-VolumesListTestJSON-1714613792 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:21:02 devstack sudo[97463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-61be2e3e-5d6c-4042-89f0-f7af5ea09dcd Nov 04 10:21:02 devstack sudo[97463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:21:02 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-344acb25-e11e-4449-b8d1-8b18f1113260 tempest-VolumesListTestJSON-1714613792 None] Flow 'volume_create_manager' (c2f3e578-3637-431f-8f58-97738f5013fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:21:02 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-344acb25-e11e-4449-b8d1-8b18f1113260 tempest-VolumesListTestJSON-1714613792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab52ee21-e385-41f6-9b92-cf2207297d76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:21:03 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-344acb25-e11e-4449-b8d1-8b18f1113260 tempest-VolumesListTestJSON-1714613792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab52ee21-e385-41f6-9b92-cf2207297d76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:21:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1640022827',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbebb358-9edc-4744-8f4f-df3e66bdc0b7,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c8633680e4a3437f8ad4c3aa42fae599',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:21:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:21:03Z,use_quota=True,user_id='1e63c5d23aa946bcabdbd905350f4004',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:21:03 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-344acb25-e11e-4449-b8d1-8b18f1113260 tempest-VolumesListTestJSON-1714613792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (794926b0-8603-4197-a65e-82726ffd3426) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:21:03 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-344acb25-e11e-4449-b8d1-8b18f1113260 tempest-VolumesListTestJSON-1714613792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (794926b0-8603-4197-a65e-82726ffd3426) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:21:03 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-344acb25-e11e-4449-b8d1-8b18f1113260 tempest-VolumesListTestJSON-1714613792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4a936b9-8fb7-4cc2-8ba2-268e87810737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:21:03 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-344acb25-e11e-4449-b8d1-8b18f1113260 tempest-VolumesListTestJSON-1714613792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4a936b9-8fb7-4cc2-8ba2-268e87810737) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cbebb358-9edc-4744-8f4f-df3e66bdc0b7', 'volume_name': 'volume-cbebb358-9edc-4744-8f4f-df3e66bdc0b7', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:21:03 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-344acb25-e11e-4449-b8d1-8b18f1113260 tempest-VolumesListTestJSON-1714613792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f17d2321-d1e0-454d-aa7e-39ea272f857e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:21:03 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-344acb25-e11e-4449-b8d1-8b18f1113260 tempest-VolumesListTestJSON-1714613792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f17d2321-d1e0-454d-aa7e-39ea272f857e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:21:03 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-344acb25-e11e-4449-b8d1-8b18f1113260 tempest-VolumesListTestJSON-1714613792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e8d60f2-3066-4137-8748-a037b8932840) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:21:03 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-344acb25-e11e-4449-b8d1-8b18f1113260 tempest-VolumesListTestJSON-1714613792 None] Volume cbebb358-9edc-4744-8f4f-df3e66bdc0b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cbebb358-9edc-4744-8f4f-df3e66bdc0b7', 'volume_size': 1} Nov 04 10:21:03 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-344acb25-e11e-4449-b8d1-8b18f1113260 tempest-VolumesListTestJSON-1714613792 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:21:03 devstack sudo[97459]: pam_unix(sudo:session): session closed for user root Nov 04 10:21:03 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-fece56f6-ac50-481f-bd84-dac26d7b584e tempest-VolumesSnapshotListTestJSON-286994546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6cd7fd53-423f-4534-9925-6d2408c74977,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6cd7fd53-423f-4534-9925-6d2408c74977.e76624f4-9bcc-4e76-b6be-114af48e731c 1G" returned: 0 in 0.559s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:21:03 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-fece56f6-ac50-481f-bd84-dac26d7b584e tempest-VolumesSnapshotListTestJSON-286994546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6cd7fd53-423f-4534-9925-6d2408c74977 -F qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6cd7fd53-423f-4534-9925-6d2408c74977.e76624f4-9bcc-4e76-b6be-114af48e731c {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:21:03 devstack sudo[97467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6cd7fd53-423f-4534-9925-6d2408c74977 -F qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6cd7fd53-423f-4534-9925-6d2408c74977.e76624f4-9bcc-4e76-b6be-114af48e731c Nov 04 10:21:03 devstack sudo[97467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:21:03 devstack sudo[97463]: pam_unix(sudo:session): session closed for user root Nov 04 10:21:03 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f7b3300b-c2a7-4381-bd16-14cce0c9b874 tempest-VolumesActionsTest-1241883822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-61be2e3e-5d6c-4042-89f0-f7af5ea09dcd" returned: 0 in 0.379s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:21:03 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f7b3300b-c2a7-4381-bd16-14cce0c9b874 tempest-VolumesActionsTest-1241883822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-61be2e3e-5d6c-4042-89f0-f7af5ea09dcd {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:21:03 devstack sudo[97472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-61be2e3e-5d6c-4042-89f0-f7af5ea09dcd Nov 04 10:21:03 devstack sudo[97472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:21:03 devstack sudo[97467]: pam_unix(sudo:session): session closed for user root Nov 04 10:21:03 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-fece56f6-ac50-481f-bd84-dac26d7b584e tempest-VolumesSnapshotListTestJSON-286994546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6cd7fd53-423f-4534-9925-6d2408c74977 -F qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6cd7fd53-423f-4534-9925-6d2408c74977.e76624f4-9bcc-4e76-b6be-114af48e731c" returned: 0 in 0.302s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:21:03 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-fece56f6-ac50-481f-bd84-dac26d7b584e tempest-VolumesSnapshotListTestJSON-286994546 None] /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6cd7fd53-423f-4534-9925-6d2408c74977.e76624f4-9bcc-4e76-b6be-114af48e731c is being set with open permissions: ugo+rw Nov 04 10:21:03 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-fece56f6-ac50-481f-bd84-dac26d7b584e tempest-VolumesSnapshotListTestJSON-286994546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6cd7fd53-423f-4534-9925-6d2408c74977.e76624f4-9bcc-4e76-b6be-114af48e731c {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:21:03 devstack sudo[97477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6cd7fd53-423f-4534-9925-6d2408c74977.e76624f4-9bcc-4e76-b6be-114af48e731c Nov 04 10:21:03 devstack sudo[97477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:21:03 devstack sudo[97472]: pam_unix(sudo:session): session closed for user root Nov 04 10:21:03 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f7b3300b-c2a7-4381-bd16-14cce0c9b874 tempest-VolumesActionsTest-1241883822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-61be2e3e-5d6c-4042-89f0-f7af5ea09dcd" returned: 0 in 0.261s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:21:03 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-f7b3300b-c2a7-4381-bd16-14cce0c9b874 tempest-VolumesActionsTest-1241883822 None] Lock "cinder-quobyte-61be2e3e-5d6c-4042-89f0-f7af5ea09dcd" released by "delete_volume" :: held 0.682s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:21:03 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-f7b3300b-c2a7-4381-bd16-14cce0c9b874 tempest-VolumesActionsTest-1241883822 None] Created reservations ['770ba716-c801-40b6-b8f1-a130e3cb6183', '65246222-535b-4a2e-92d0-2dde17d4494c', '71102f12-899e-4492-9220-73c22e1e8a66', 'd09f27b2-d6f1-4bce-80cd-c6456ffb0a5b'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:21:03 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-f7b3300b-c2a7-4381-bd16-14cce0c9b874 tempest-VolumesActionsTest-1241883822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:21:03 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-f7b3300b-c2a7-4381-bd16-14cce0c9b874 tempest-VolumesActionsTest-1241883822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:21:03 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-f7b3300b-c2a7-4381-bd16-14cce0c9b874 tempest-VolumesActionsTest-1241883822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:21:03 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-f7b3300b-c2a7-4381-bd16-14cce0c9b874 tempest-VolumesActionsTest-1241883822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:21:03 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-f7b3300b-c2a7-4381-bd16-14cce0c9b874 tempest-VolumesActionsTest-1241883822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:21:03 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f7b3300b-c2a7-4381-bd16-14cce0c9b874 tempest-VolumesActionsTest-1241883822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:21:03 devstack sudo[97477]: pam_unix(sudo:session): session closed for user root Nov 04 10:21:03 devstack sudo[97481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:21:03 devstack sudo[97481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:21:03 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-fece56f6-ac50-481f-bd84-dac26d7b584e tempest-VolumesSnapshotListTestJSON-286994546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6cd7fd53-423f-4534-9925-6d2408c74977.e76624f4-9bcc-4e76-b6be-114af48e731c" returned: 0 in 0.260s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:21:03 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-fece56f6-ac50-481f-bd84-dac26d7b584e tempest-VolumesSnapshotListTestJSON-286994546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6cd7fd53-423f-4534-9925-6d2408c74977.info {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:21:03 devstack sudo[97483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6cd7fd53-423f-4534-9925-6d2408c74977.info Nov 04 10:21:03 devstack sudo[97483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:21:03 devstack sudo[97481]: pam_unix(sudo:session): session closed for user root Nov 04 10:21:03 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f7b3300b-c2a7-4381-bd16-14cce0c9b874 tempest-VolumesActionsTest-1241883822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.257s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:21:03 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-f7b3300b-c2a7-4381-bd16-14cce0c9b874 tempest-VolumesActionsTest-1241883822 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:21:03 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-f7b3300b-c2a7-4381-bd16-14cce0c9b874 tempest-VolumesActionsTest-1241883822 None] Deleted volume successfully. Nov 04 10:21:03 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-f7b3300b-c2a7-4381-bd16-14cce0c9b874 tempest-VolumesActionsTest-1241883822 None] Lock "cinder-61be2e3e-5d6c-4042-89f0-f7af5ea09dcd-delete_volume" released by "delete_volume" :: held 1.190s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:21:03 devstack sudo[97483]: pam_unix(sudo:session): session closed for user root Nov 04 10:21:03 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-fece56f6-ac50-481f-bd84-dac26d7b584e tempest-VolumesSnapshotListTestJSON-286994546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6cd7fd53-423f-4534-9925-6d2408c74977.info" returned: 0 in 0.311s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:21:03 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-fece56f6-ac50-481f-bd84-dac26d7b584e tempest-VolumesSnapshotListTestJSON-286994546 None] /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6cd7fd53-423f-4534-9925-6d2408c74977.info is being set with open permissions: ugo+rw Nov 04 10:21:03 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-fece56f6-ac50-481f-bd84-dac26d7b584e tempest-VolumesSnapshotListTestJSON-286994546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6cd7fd53-423f-4534-9925-6d2408c74977.info {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:21:04 devstack sudo[97487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6cd7fd53-423f-4534-9925-6d2408c74977.info Nov 04 10:21:04 devstack sudo[97487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:21:04 devstack sudo[97487]: pam_unix(sudo:session): session closed for user root Nov 04 10:21:04 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-fece56f6-ac50-481f-bd84-dac26d7b584e tempest-VolumesSnapshotListTestJSON-286994546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6cd7fd53-423f-4534-9925-6d2408c74977.info" returned: 0 in 0.240s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:21:04 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-fece56f6-ac50-481f-bd84-dac26d7b584e tempest-VolumesSnapshotListTestJSON-286994546 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.187s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:21:04 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-f52dc5cb-a58f-4421-8441-4cdba2634b27 tempest-VolumesTestJSON-57329144 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.127s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:21:04 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-f52dc5cb-a58f-4421-8441-4cdba2634b27 tempest-VolumesTestJSON-57329144 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:21:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-922791744',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5268e4af-d9f6-467e-897c-933b9dcb32c9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='da188ab0d1d74f38a160ddae0198552a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:21:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:21:00Z,use_quota=True,user_id='8ff03cbb8229420fb66d9af783bdfa12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 10:21:04 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-f52dc5cb-a58f-4421-8441-4cdba2634b27 tempest-VolumesTestJSON-57329144 None] Creating volume 5268e4af-d9f6-467e-897c-933b9dcb32c9 {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:21:04 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-f52dc5cb-a58f-4421-8441-4cdba2634b27 tempest-VolumesTestJSON-57329144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:21:04 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-f52dc5cb-a58f-4421-8441-4cdba2634b27 tempest-VolumesTestJSON-57329144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:21:04 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-f52dc5cb-a58f-4421-8441-4cdba2634b27 tempest-VolumesTestJSON-57329144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:21:04 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-f52dc5cb-a58f-4421-8441-4cdba2634b27 tempest-VolumesTestJSON-57329144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:21:04 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-f52dc5cb-a58f-4421-8441-4cdba2634b27 tempest-VolumesTestJSON-57329144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:21:04 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-f52dc5cb-a58f-4421-8441-4cdba2634b27 tempest-VolumesTestJSON-57329144 None] Selected osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:21:04 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-f52dc5cb-a58f-4421-8441-4cdba2634b27 tempest-VolumesTestJSON-57329144 None] casted to osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 Nov 04 10:21:04 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f52dc5cb-a58f-4421-8441-4cdba2634b27 tempest-VolumesTestJSON-57329144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-5268e4af-d9f6-467e-897c-933b9dcb32c9 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:21:04 devstack sudo[97490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-5268e4af-d9f6-467e-897c-933b9dcb32c9 1073741824 Nov 04 10:21:04 devstack sudo[97490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:21:04 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-fece56f6-ac50-481f-bd84-dac26d7b584e tempest-VolumesSnapshotListTestJSON-286994546 None] Create snapshot completed successfully Nov 04 10:21:04 devstack sudo[97490]: pam_unix(sudo:session): session closed for user root Nov 04 10:21:04 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f52dc5cb-a58f-4421-8441-4cdba2634b27 tempest-VolumesTestJSON-57329144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-5268e4af-d9f6-467e-897c-933b9dcb32c9 1073741824" returned: 0 in 0.458s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:21:04 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f52dc5cb-a58f-4421-8441-4cdba2634b27 tempest-VolumesTestJSON-57329144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-5268e4af-d9f6-467e-897c-933b9dcb32c9 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:21:04 devstack sudo[97496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-5268e4af-d9f6-467e-897c-933b9dcb32c9 Nov 04 10:21:04 devstack sudo[97496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:21:05 devstack sudo[97496]: pam_unix(sudo:session): session closed for user root Nov 04 10:21:05 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f52dc5cb-a58f-4421-8441-4cdba2634b27 tempest-VolumesTestJSON-57329144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-5268e4af-d9f6-467e-897c-933b9dcb32c9" returned: 0 in 0.266s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:21:05 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-f52dc5cb-a58f-4421-8441-4cdba2634b27 tempest-VolumesTestJSON-57329144 None] <== create_volume: return (766ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 10:21:05 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-f52dc5cb-a58f-4421-8441-4cdba2634b27 tempest-VolumesTestJSON-57329144 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.770s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:21:05 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-344acb25-e11e-4449-b8d1-8b18f1113260 tempest-VolumesListTestJSON-1714613792 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.983s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:21:05 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-344acb25-e11e-4449-b8d1-8b18f1113260 tempest-VolumesListTestJSON-1714613792 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:21:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1640022827',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbebb358-9edc-4744-8f4f-df3e66bdc0b7,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c8633680e4a3437f8ad4c3aa42fae599',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:21:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:21:03Z,use_quota=True,user_id='1e63c5d23aa946bcabdbd905350f4004',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 10:21:05 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-344acb25-e11e-4449-b8d1-8b18f1113260 tempest-VolumesListTestJSON-1714613792 None] Creating volume cbebb358-9edc-4744-8f4f-df3e66bdc0b7 {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:21:05 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-344acb25-e11e-4449-b8d1-8b18f1113260 tempest-VolumesListTestJSON-1714613792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:21:05 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-344acb25-e11e-4449-b8d1-8b18f1113260 tempest-VolumesListTestJSON-1714613792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:21:05 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-344acb25-e11e-4449-b8d1-8b18f1113260 tempest-VolumesListTestJSON-1714613792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:21:05 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-344acb25-e11e-4449-b8d1-8b18f1113260 tempest-VolumesListTestJSON-1714613792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:21:05 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-344acb25-e11e-4449-b8d1-8b18f1113260 tempest-VolumesListTestJSON-1714613792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:21:05 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-344acb25-e11e-4449-b8d1-8b18f1113260 tempest-VolumesListTestJSON-1714613792 None] Selected osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:21:05 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-344acb25-e11e-4449-b8d1-8b18f1113260 tempest-VolumesListTestJSON-1714613792 None] casted to osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 Nov 04 10:21:05 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-344acb25-e11e-4449-b8d1-8b18f1113260 tempest-VolumesListTestJSON-1714613792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-cbebb358-9edc-4744-8f4f-df3e66bdc0b7 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:21:05 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-f52dc5cb-a58f-4421-8441-4cdba2634b27 tempest-VolumesTestJSON-57329144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a5a1c0d-a405-411d-947b-b1ee5fd29b3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5268e4af-d9f6-467e-897c-933b9dcb32c9', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:21:05 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-f52dc5cb-a58f-4421-8441-4cdba2634b27 tempest-VolumesTestJSON-57329144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5b460f8-02a4-4888-b030-30712f3517af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:21:05 devstack sudo[97499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-cbebb358-9edc-4744-8f4f-df3e66bdc0b7 1073741824 Nov 04 10:21:05 devstack sudo[97499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:21:05 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-f52dc5cb-a58f-4421-8441-4cdba2634b27 tempest-VolumesTestJSON-57329144 None] Volume volume-5268e4af-d9f6-467e-897c-933b9dcb32c9 (5268e4af-d9f6-467e-897c-933b9dcb32c9): created successfully Nov 04 10:21:05 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-f52dc5cb-a58f-4421-8441-4cdba2634b27 tempest-VolumesTestJSON-57329144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5b460f8-02a4-4888-b030-30712f3517af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:21:05 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-f52dc5cb-a58f-4421-8441-4cdba2634b27 tempest-VolumesTestJSON-57329144 None] Flow 'volume_create_manager' (4ad1769e-22cf-42ed-8646-00e22bfaf47d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:21:05 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-f52dc5cb-a58f-4421-8441-4cdba2634b27 tempest-VolumesTestJSON-57329144 None] Created volume successfully. Nov 04 10:21:05 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-8f8d37cd-7bf9-4c23-856b-d0d3b066e761 tempest-VolumesSnapshotListTestJSON-286994546 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:21:05 devstack sudo[97499]: pam_unix(sudo:session): session closed for user root Nov 04 10:21:05 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-344acb25-e11e-4449-b8d1-8b18f1113260 tempest-VolumesListTestJSON-1714613792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-cbebb358-9edc-4744-8f4f-df3e66bdc0b7 1073741824" returned: 0 in 0.545s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:21:05 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-344acb25-e11e-4449-b8d1-8b18f1113260 tempest-VolumesListTestJSON-1714613792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-cbebb358-9edc-4744-8f4f-df3e66bdc0b7 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:21:05 devstack sudo[97506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-cbebb358-9edc-4744-8f4f-df3e66bdc0b7 Nov 04 10:21:05 devstack sudo[97506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:21:05 devstack sudo[97506]: pam_unix(sudo:session): session closed for user root Nov 04 10:21:05 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-344acb25-e11e-4449-b8d1-8b18f1113260 tempest-VolumesListTestJSON-1714613792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-cbebb358-9edc-4744-8f4f-df3e66bdc0b7" returned: 0 in 0.257s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:21:05 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-344acb25-e11e-4449-b8d1-8b18f1113260 tempest-VolumesListTestJSON-1714613792 None] <== create_volume: return (849ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 10:21:05 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-344acb25-e11e-4449-b8d1-8b18f1113260 tempest-VolumesListTestJSON-1714613792 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.853s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:21:05 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-8f8d37cd-7bf9-4c23-856b-d0d3b066e761 tempest-VolumesSnapshotListTestJSON-286994546 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.607s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:21:05 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-344acb25-e11e-4449-b8d1-8b18f1113260 tempest-VolumesListTestJSON-1714613792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e8d60f2-3066-4137-8748-a037b8932840) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cbebb358-9edc-4744-8f4f-df3e66bdc0b7', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:21:05 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-344acb25-e11e-4449-b8d1-8b18f1113260 tempest-VolumesListTestJSON-1714613792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (223c4838-6b4a-430e-81f5-fa1cd0dfdb7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:21:05 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-8f8d37cd-7bf9-4c23-856b-d0d3b066e761 tempest-VolumesSnapshotListTestJSON-286994546 None] Creating offline snapshot ee024861-063a-46da-80d4-b68cf3327373 of volume 6cd7fd53-423f-4534-9925-6d2408c74977 {{(pid=87068) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 10:21:06 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-344acb25-e11e-4449-b8d1-8b18f1113260 tempest-VolumesListTestJSON-1714613792 None] Volume volume-cbebb358-9edc-4744-8f4f-df3e66bdc0b7 (cbebb358-9edc-4744-8f4f-df3e66bdc0b7): created successfully Nov 04 10:21:06 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-344acb25-e11e-4449-b8d1-8b18f1113260 tempest-VolumesListTestJSON-1714613792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (223c4838-6b4a-430e-81f5-fa1cd0dfdb7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:21:06 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-344acb25-e11e-4449-b8d1-8b18f1113260 tempest-VolumesListTestJSON-1714613792 None] Flow 'volume_create_manager' (c2f3e578-3637-431f-8f58-97738f5013fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:21:06 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ac176d0-605c-4c23-a82e-0f116a5b7384]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:21:06 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-8f8d37cd-7bf9-4c23-856b-d0d3b066e761 tempest-VolumesSnapshotListTestJSON-286994546 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6cd7fd53-423f-4534-9925-6d2408c74977.e76624f4-9bcc-4e76-b6be-114af48e731c {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:21:06 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-344acb25-e11e-4449-b8d1-8b18f1113260 tempest-VolumesListTestJSON-1714613792 None] Created volume successfully. Nov 04 10:21:06 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-1cda1752-0295-46fb-a612-0bc37f00eec0 tempest-VolumesTestJSON-57329144 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:21:06 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1cda1752-0295-46fb-a612-0bc37f00eec0 tempest-VolumesTestJSON-57329144 None] Flow 'volume_create_manager' (16dc25df-3747-4927-91e0-797a75937aa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:21:06 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1cda1752-0295-46fb-a612-0bc37f00eec0 tempest-VolumesTestJSON-57329144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15e79b36-c5fe-48a2-b494-357403852a84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:21:06 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1cda1752-0295-46fb-a612-0bc37f00eec0 tempest-VolumesTestJSON-57329144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15e79b36-c5fe-48a2-b494-357403852a84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:21:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-262485226',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=791542bf-ecac-4bbb-943e-d34bf8b73ea2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='da188ab0d1d74f38a160ddae0198552a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:21:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:21:06Z,use_quota=True,user_id='8ff03cbb8229420fb66d9af783bdfa12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:21:06 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1cda1752-0295-46fb-a612-0bc37f00eec0 tempest-VolumesTestJSON-57329144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fc8d9c4-d624-4b92-8c7d-ab5256e3140e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:21:06 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1cda1752-0295-46fb-a612-0bc37f00eec0 tempest-VolumesTestJSON-57329144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fc8d9c4-d624-4b92-8c7d-ab5256e3140e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:21:06 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1cda1752-0295-46fb-a612-0bc37f00eec0 tempest-VolumesTestJSON-57329144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c4984dc-5699-4640-adc6-d330f67fc8c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:21:06 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1cda1752-0295-46fb-a612-0bc37f00eec0 tempest-VolumesTestJSON-57329144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c4984dc-5699-4640-adc6-d330f67fc8c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '791542bf-ecac-4bbb-943e-d34bf8b73ea2', 'volume_name': 'volume-791542bf-ecac-4bbb-943e-d34bf8b73ea2', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:21:06 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1cda1752-0295-46fb-a612-0bc37f00eec0 tempest-VolumesTestJSON-57329144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f39bf864-346d-4383-90b7-cc63d303b856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:21:06 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1cda1752-0295-46fb-a612-0bc37f00eec0 tempest-VolumesTestJSON-57329144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f39bf864-346d-4383-90b7-cc63d303b856) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:21:06 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1cda1752-0295-46fb-a612-0bc37f00eec0 tempest-VolumesTestJSON-57329144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa2eceaf-1a65-4df3-89f8-f44c10aa2060) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:21:06 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-1cda1752-0295-46fb-a612-0bc37f00eec0 tempest-VolumesTestJSON-57329144 None] Volume 791542bf-ecac-4bbb-943e-d34bf8b73ea2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-791542bf-ecac-4bbb-943e-d34bf8b73ea2', 'volume_size': 1} Nov 04 10:21:06 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-1cda1752-0295-46fb-a612-0bc37f00eec0 tempest-VolumesTestJSON-57329144 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:21:06 devstack sudo[97509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6cd7fd53-423f-4534-9925-6d2408c74977.e76624f4-9bcc-4e76-b6be-114af48e731c Nov 04 10:21:06 devstack sudo[97509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:21:06 devstack sudo[97509]: pam_unix(sudo:session): session closed for user root Nov 04 10:21:06 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-8f8d37cd-7bf9-4c23-856b-d0d3b066e761 tempest-VolumesSnapshotListTestJSON-286994546 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6cd7fd53-423f-4534-9925-6d2408c74977.e76624f4-9bcc-4e76-b6be-114af48e731c" returned: 0 in 0.389s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:21:06 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-8f8d37cd-7bf9-4c23-856b-d0d3b066e761 tempest-VolumesSnapshotListTestJSON-286994546 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6cd7fd53-423f-4534-9925-6d2408c74977(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87068) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 10:21:06 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-8f8d37cd-7bf9-4c23-856b-d0d3b066e761 tempest-VolumesSnapshotListTestJSON-286994546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6cd7fd53-423f-4534-9925-6d2408c74977.e76624f4-9bcc-4e76-b6be-114af48e731c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6cd7fd53-423f-4534-9925-6d2408c74977.ee024861-063a-46da-80d4-b68cf3327373 1G {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:21:06 devstack sudo[97514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6cd7fd53-423f-4534-9925-6d2408c74977.e76624f4-9bcc-4e76-b6be-114af48e731c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6cd7fd53-423f-4534-9925-6d2408c74977.ee024861-063a-46da-80d4-b68cf3327373 1G Nov 04 10:21:06 devstack sudo[97514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:21:06 devstack sudo[97514]: pam_unix(sudo:session): session closed for user root Nov 04 10:21:06 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-8f8d37cd-7bf9-4c23-856b-d0d3b066e761 tempest-VolumesSnapshotListTestJSON-286994546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6cd7fd53-423f-4534-9925-6d2408c74977.e76624f4-9bcc-4e76-b6be-114af48e731c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6cd7fd53-423f-4534-9925-6d2408c74977.ee024861-063a-46da-80d4-b68cf3327373 1G" returned: 0 in 0.400s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:21:06 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-8f8d37cd-7bf9-4c23-856b-d0d3b066e761 tempest-VolumesSnapshotListTestJSON-286994546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6cd7fd53-423f-4534-9925-6d2408c74977.e76624f4-9bcc-4e76-b6be-114af48e731c -F qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6cd7fd53-423f-4534-9925-6d2408c74977.ee024861-063a-46da-80d4-b68cf3327373 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:21:06 devstack sudo[97520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6cd7fd53-423f-4534-9925-6d2408c74977.e76624f4-9bcc-4e76-b6be-114af48e731c -F qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6cd7fd53-423f-4534-9925-6d2408c74977.ee024861-063a-46da-80d4-b68cf3327373 Nov 04 10:21:06 devstack sudo[97520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:21:07 devstack sudo[97520]: pam_unix(sudo:session): session closed for user root Nov 04 10:21:07 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-8f8d37cd-7bf9-4c23-856b-d0d3b066e761 tempest-VolumesSnapshotListTestJSON-286994546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6cd7fd53-423f-4534-9925-6d2408c74977.e76624f4-9bcc-4e76-b6be-114af48e731c -F qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6cd7fd53-423f-4534-9925-6d2408c74977.ee024861-063a-46da-80d4-b68cf3327373" returned: 0 in 0.319s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:21:07 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-8f8d37cd-7bf9-4c23-856b-d0d3b066e761 tempest-VolumesSnapshotListTestJSON-286994546 None] /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6cd7fd53-423f-4534-9925-6d2408c74977.ee024861-063a-46da-80d4-b68cf3327373 is being set with open permissions: ugo+rw Nov 04 10:21:07 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-8f8d37cd-7bf9-4c23-856b-d0d3b066e761 tempest-VolumesSnapshotListTestJSON-286994546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6cd7fd53-423f-4534-9925-6d2408c74977.ee024861-063a-46da-80d4-b68cf3327373 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:21:07 devstack sudo[97526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6cd7fd53-423f-4534-9925-6d2408c74977.ee024861-063a-46da-80d4-b68cf3327373 Nov 04 10:21:07 devstack sudo[97526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:21:07 devstack sudo[97526]: pam_unix(sudo:session): session closed for user root Nov 04 10:21:07 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-8f8d37cd-7bf9-4c23-856b-d0d3b066e761 tempest-VolumesSnapshotListTestJSON-286994546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6cd7fd53-423f-4534-9925-6d2408c74977.ee024861-063a-46da-80d4-b68cf3327373" returned: 0 in 0.386s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:21:07 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-8f8d37cd-7bf9-4c23-856b-d0d3b066e761 tempest-VolumesSnapshotListTestJSON-286994546 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.687s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:21:07 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-1cda1752-0295-46fb-a612-0bc37f00eec0 tempest-VolumesTestJSON-57329144 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.436s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:21:07 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-1cda1752-0295-46fb-a612-0bc37f00eec0 tempest-VolumesTestJSON-57329144 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:21:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-262485226',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=791542bf-ecac-4bbb-943e-d34bf8b73ea2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='da188ab0d1d74f38a160ddae0198552a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:21:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:21:06Z,use_quota=True,user_id='8ff03cbb8229420fb66d9af783bdfa12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 10:21:07 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-1cda1752-0295-46fb-a612-0bc37f00eec0 tempest-VolumesTestJSON-57329144 None] Creating volume 791542bf-ecac-4bbb-943e-d34bf8b73ea2 {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:21:07 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-1cda1752-0295-46fb-a612-0bc37f00eec0 tempest-VolumesTestJSON-57329144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:21:07 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-1cda1752-0295-46fb-a612-0bc37f00eec0 tempest-VolumesTestJSON-57329144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:21:07 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-1cda1752-0295-46fb-a612-0bc37f00eec0 tempest-VolumesTestJSON-57329144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:21:07 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-1cda1752-0295-46fb-a612-0bc37f00eec0 tempest-VolumesTestJSON-57329144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:21:07 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-1cda1752-0295-46fb-a612-0bc37f00eec0 tempest-VolumesTestJSON-57329144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:21:07 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-1cda1752-0295-46fb-a612-0bc37f00eec0 tempest-VolumesTestJSON-57329144 None] Selected osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:21:07 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-1cda1752-0295-46fb-a612-0bc37f00eec0 tempest-VolumesTestJSON-57329144 None] casted to osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 Nov 04 10:21:07 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-1cda1752-0295-46fb-a612-0bc37f00eec0 tempest-VolumesTestJSON-57329144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-791542bf-ecac-4bbb-943e-d34bf8b73ea2 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:21:07 devstack sudo[97529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-791542bf-ecac-4bbb-943e-d34bf8b73ea2 1073741824 Nov 04 10:21:07 devstack sudo[97529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:21:07 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-8f8d37cd-7bf9-4c23-856b-d0d3b066e761 tempest-VolumesSnapshotListTestJSON-286994546 None] Create snapshot completed successfully Nov 04 10:21:08 devstack sudo[97529]: pam_unix(sudo:session): session closed for user root Nov 04 10:21:08 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-1cda1752-0295-46fb-a612-0bc37f00eec0 tempest-VolumesTestJSON-57329144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-791542bf-ecac-4bbb-943e-d34bf8b73ea2 1073741824" returned: 0 in 0.569s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:21:08 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-1cda1752-0295-46fb-a612-0bc37f00eec0 tempest-VolumesTestJSON-57329144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-791542bf-ecac-4bbb-943e-d34bf8b73ea2 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:21:08 devstack sudo[97534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-791542bf-ecac-4bbb-943e-d34bf8b73ea2 Nov 04 10:21:08 devstack sudo[97534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:21:08 devstack sudo[97534]: pam_unix(sudo:session): session closed for user root Nov 04 10:21:08 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-1cda1752-0295-46fb-a612-0bc37f00eec0 tempest-VolumesTestJSON-57329144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-791542bf-ecac-4bbb-943e-d34bf8b73ea2" returned: 0 in 0.360s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:21:08 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-1cda1752-0295-46fb-a612-0bc37f00eec0 tempest-VolumesTestJSON-57329144 None] <== create_volume: return (977ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 10:21:08 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-1cda1752-0295-46fb-a612-0bc37f00eec0 tempest-VolumesTestJSON-57329144 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.983s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:21:08 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1cda1752-0295-46fb-a612-0bc37f00eec0 tempest-VolumesTestJSON-57329144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa2eceaf-1a65-4df3-89f8-f44c10aa2060) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-791542bf-ecac-4bbb-943e-d34bf8b73ea2', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:21:08 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1cda1752-0295-46fb-a612-0bc37f00eec0 tempest-VolumesTestJSON-57329144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5f18cc3-c981-4d70-8f61-c788749abf2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:21:08 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-1cda1752-0295-46fb-a612-0bc37f00eec0 tempest-VolumesTestJSON-57329144 None] Volume volume-791542bf-ecac-4bbb-943e-d34bf8b73ea2 (791542bf-ecac-4bbb-943e-d34bf8b73ea2): created successfully Nov 04 10:21:08 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1cda1752-0295-46fb-a612-0bc37f00eec0 tempest-VolumesTestJSON-57329144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5f18cc3-c981-4d70-8f61-c788749abf2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:21:08 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1cda1752-0295-46fb-a612-0bc37f00eec0 tempest-VolumesTestJSON-57329144 None] Flow 'volume_create_manager' (16dc25df-3747-4927-91e0-797a75937aa5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:21:08 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-1cda1752-0295-46fb-a612-0bc37f00eec0 tempest-VolumesTestJSON-57329144 None] Created volume successfully. Nov 04 10:21:08 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-337f42fa-bf95-4089-a9ca-a432cf061161 tempest-VolumesSnapshotListTestJSON-286994546 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:21:08 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-337f42fa-bf95-4089-a9ca-a432cf061161 tempest-VolumesSnapshotListTestJSON-286994546 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:21:08 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-337f42fa-bf95-4089-a9ca-a432cf061161 tempest-VolumesSnapshotListTestJSON-286994546 None] Creating offline snapshot 715903e4-b0e1-4f41-8d10-915b3668e4b4 of volume 6cd7fd53-423f-4534-9925-6d2408c74977 {{(pid=87068) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 10:21:08 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbf684ff-9b9f-4fc5-b4bb-70d12dc20e4e]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:21:08 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-337f42fa-bf95-4089-a9ca-a432cf061161 tempest-VolumesSnapshotListTestJSON-286994546 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6cd7fd53-423f-4534-9925-6d2408c74977.ee024861-063a-46da-80d4-b68cf3327373 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:21:08 devstack sudo[97538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6cd7fd53-423f-4534-9925-6d2408c74977.ee024861-063a-46da-80d4-b68cf3327373 Nov 04 10:21:08 devstack sudo[97538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:21:09 devstack sudo[97538]: pam_unix(sudo:session): session closed for user root Nov 04 10:21:09 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-337f42fa-bf95-4089-a9ca-a432cf061161 tempest-VolumesSnapshotListTestJSON-286994546 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6cd7fd53-423f-4534-9925-6d2408c74977.ee024861-063a-46da-80d4-b68cf3327373" returned: 0 in 0.468s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:21:09 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-337f42fa-bf95-4089-a9ca-a432cf061161 tempest-VolumesSnapshotListTestJSON-286994546 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6cd7fd53-423f-4534-9925-6d2408c74977(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87068) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 10:21:09 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-337f42fa-bf95-4089-a9ca-a432cf061161 tempest-VolumesSnapshotListTestJSON-286994546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6cd7fd53-423f-4534-9925-6d2408c74977.ee024861-063a-46da-80d4-b68cf3327373,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6cd7fd53-423f-4534-9925-6d2408c74977.715903e4-b0e1-4f41-8d10-915b3668e4b4 1G {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:21:09 devstack sudo[97543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6cd7fd53-423f-4534-9925-6d2408c74977.ee024861-063a-46da-80d4-b68cf3327373,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6cd7fd53-423f-4534-9925-6d2408c74977.715903e4-b0e1-4f41-8d10-915b3668e4b4 1G Nov 04 10:21:09 devstack sudo[97543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:21:09 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-86f7d307-3db3-4802-af74-e3267c7cd9a7 tempest-VolumesTestJSON-57329144 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:21:09 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-86f7d307-3db3-4802-af74-e3267c7cd9a7 tempest-VolumesTestJSON-57329144 None] Flow 'volume_create_manager' (f8ade549-dfcc-4c02-a675-9a021973a45e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:21:09 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-86f7d307-3db3-4802-af74-e3267c7cd9a7 tempest-VolumesTestJSON-57329144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ba5a620-f7bd-4e12-9e2c-23e15bf41d61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:21:09 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-d59ab1ae-3234-4712-a2e7-0adefcd7159d tempest-VolumesListTestJSON-1714613792 None] Acquiring lock "cinder-cbebb358-9edc-4744-8f4f-df3e66bdc0b7-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:21:09 devstack sudo[97543]: pam_unix(sudo:session): session closed for user root Nov 04 10:21:09 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-86f7d307-3db3-4802-af74-e3267c7cd9a7 tempest-VolumesTestJSON-57329144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ba5a620-f7bd-4e12-9e2c-23e15bf41d61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:21:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1480064426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45f0dedd-ed7d-4327-b95d-8a46ea4f6eee,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='da188ab0d1d74f38a160ddae0198552a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:21:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:21:10Z,use_quota=True,user_id='8ff03cbb8229420fb66d9af783bdfa12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:21:09 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-86f7d307-3db3-4802-af74-e3267c7cd9a7 tempest-VolumesTestJSON-57329144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0ca7ca6-c03b-4afb-9ac6-d8a4c32e15fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:21:09 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-86f7d307-3db3-4802-af74-e3267c7cd9a7 tempest-VolumesTestJSON-57329144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0ca7ca6-c03b-4afb-9ac6-d8a4c32e15fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:21:09 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-86f7d307-3db3-4802-af74-e3267c7cd9a7 tempest-VolumesTestJSON-57329144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22a9c216-a696-4a68-8f2f-4eb960797ada) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:21:09 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-86f7d307-3db3-4802-af74-e3267c7cd9a7 tempest-VolumesTestJSON-57329144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22a9c216-a696-4a68-8f2f-4eb960797ada) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45f0dedd-ed7d-4327-b95d-8a46ea4f6eee', 'volume_name': 'volume-45f0dedd-ed7d-4327-b95d-8a46ea4f6eee', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:21:09 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-86f7d307-3db3-4802-af74-e3267c7cd9a7 tempest-VolumesTestJSON-57329144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3b9e39b-e73e-4c45-bce7-2bfc57de35c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:21:09 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-86f7d307-3db3-4802-af74-e3267c7cd9a7 tempest-VolumesTestJSON-57329144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3b9e39b-e73e-4c45-bce7-2bfc57de35c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:21:09 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-86f7d307-3db3-4802-af74-e3267c7cd9a7 tempest-VolumesTestJSON-57329144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1375a78b-4204-445f-a976-9c667946c1cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:21:09 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-86f7d307-3db3-4802-af74-e3267c7cd9a7 tempest-VolumesTestJSON-57329144 None] Volume 45f0dedd-ed7d-4327-b95d-8a46ea4f6eee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45f0dedd-ed7d-4327-b95d-8a46ea4f6eee', 'volume_size': 1} Nov 04 10:21:09 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-86f7d307-3db3-4802-af74-e3267c7cd9a7 tempest-VolumesTestJSON-57329144 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:21:09 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-d59ab1ae-3234-4712-a2e7-0adefcd7159d tempest-VolumesListTestJSON-1714613792 None] Lock "cinder-cbebb358-9edc-4744-8f4f-df3e66bdc0b7-delete_volume" acquired by "delete_volume" :: waited 0.086s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:21:09 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-337f42fa-bf95-4089-a9ca-a432cf061161 tempest-VolumesSnapshotListTestJSON-286994546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6cd7fd53-423f-4534-9925-6d2408c74977.ee024861-063a-46da-80d4-b68cf3327373,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6cd7fd53-423f-4534-9925-6d2408c74977.715903e4-b0e1-4f41-8d10-915b3668e4b4 1G" returned: 0 in 0.768s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:21:09 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-337f42fa-bf95-4089-a9ca-a432cf061161 tempest-VolumesSnapshotListTestJSON-286994546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6cd7fd53-423f-4534-9925-6d2408c74977.ee024861-063a-46da-80d4-b68cf3327373 -F qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6cd7fd53-423f-4534-9925-6d2408c74977.715903e4-b0e1-4f41-8d10-915b3668e4b4 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:21:10 devstack sudo[97549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6cd7fd53-423f-4534-9925-6d2408c74977.ee024861-063a-46da-80d4-b68cf3327373 -F qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6cd7fd53-423f-4534-9925-6d2408c74977.715903e4-b0e1-4f41-8d10-915b3668e4b4 Nov 04 10:21:10 devstack sudo[97549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:21:10 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-d59ab1ae-3234-4712-a2e7-0adefcd7159d tempest-VolumesListTestJSON-1714613792 None] Acquiring lock "cinder-quobyte-cbebb358-9edc-4744-8f4f-df3e66bdc0b7" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:21:10 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-d59ab1ae-3234-4712-a2e7-0adefcd7159d tempest-VolumesListTestJSON-1714613792 None] Lock "cinder-quobyte-cbebb358-9edc-4744-8f4f-df3e66bdc0b7" acquired by "delete_volume" :: waited 0.017s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:21:10 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[57d922ef-1076-4713-9b07-6f2c8a64ff01]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:21:10 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d59ab1ae-3234-4712-a2e7-0adefcd7159d tempest-VolumesListTestJSON-1714613792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-cbebb358-9edc-4744-8f4f-df3e66bdc0b7 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:21:10 devstack sudo[97551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-cbebb358-9edc-4744-8f4f-df3e66bdc0b7 Nov 04 10:21:10 devstack sudo[97551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:21:10 devstack sudo[97549]: pam_unix(sudo:session): session closed for user root Nov 04 10:21:10 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-337f42fa-bf95-4089-a9ca-a432cf061161 tempest-VolumesSnapshotListTestJSON-286994546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6cd7fd53-423f-4534-9925-6d2408c74977.ee024861-063a-46da-80d4-b68cf3327373 -F qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6cd7fd53-423f-4534-9925-6d2408c74977.715903e4-b0e1-4f41-8d10-915b3668e4b4" returned: 0 in 0.348s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:21:10 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-337f42fa-bf95-4089-a9ca-a432cf061161 tempest-VolumesSnapshotListTestJSON-286994546 None] /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6cd7fd53-423f-4534-9925-6d2408c74977.715903e4-b0e1-4f41-8d10-915b3668e4b4 is being set with open permissions: ugo+rw Nov 04 10:21:10 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-337f42fa-bf95-4089-a9ca-a432cf061161 tempest-VolumesSnapshotListTestJSON-286994546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6cd7fd53-423f-4534-9925-6d2408c74977.715903e4-b0e1-4f41-8d10-915b3668e4b4 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:21:10 devstack sudo[97556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6cd7fd53-423f-4534-9925-6d2408c74977.715903e4-b0e1-4f41-8d10-915b3668e4b4 Nov 04 10:21:10 devstack sudo[97556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:21:10 devstack sudo[97551]: pam_unix(sudo:session): session closed for user root Nov 04 10:21:10 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d59ab1ae-3234-4712-a2e7-0adefcd7159d tempest-VolumesListTestJSON-1714613792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-cbebb358-9edc-4744-8f4f-df3e66bdc0b7" returned: 0 in 0.392s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:21:10 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d59ab1ae-3234-4712-a2e7-0adefcd7159d tempest-VolumesListTestJSON-1714613792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-cbebb358-9edc-4744-8f4f-df3e66bdc0b7 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:21:10 devstack sudo[97562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-cbebb358-9edc-4744-8f4f-df3e66bdc0b7 Nov 04 10:21:10 devstack sudo[97562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:21:10 devstack sudo[97556]: pam_unix(sudo:session): session closed for user root Nov 04 10:21:10 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-337f42fa-bf95-4089-a9ca-a432cf061161 tempest-VolumesSnapshotListTestJSON-286994546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6cd7fd53-423f-4534-9925-6d2408c74977.715903e4-b0e1-4f41-8d10-915b3668e4b4" returned: 0 in 0.261s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:21:10 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-337f42fa-bf95-4089-a9ca-a432cf061161 tempest-VolumesSnapshotListTestJSON-286994546 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.953s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:21:10 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-86f7d307-3db3-4802-af74-e3267c7cd9a7 tempest-VolumesTestJSON-57329144 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.668s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:21:10 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-86f7d307-3db3-4802-af74-e3267c7cd9a7 tempest-VolumesTestJSON-57329144 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:21:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1480064426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45f0dedd-ed7d-4327-b95d-8a46ea4f6eee,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='da188ab0d1d74f38a160ddae0198552a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:21:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:21:10Z,use_quota=True,user_id='8ff03cbb8229420fb66d9af783bdfa12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 10:21:10 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-86f7d307-3db3-4802-af74-e3267c7cd9a7 tempest-VolumesTestJSON-57329144 None] Creating volume 45f0dedd-ed7d-4327-b95d-8a46ea4f6eee {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:21:10 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-86f7d307-3db3-4802-af74-e3267c7cd9a7 tempest-VolumesTestJSON-57329144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:21:10 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-86f7d307-3db3-4802-af74-e3267c7cd9a7 tempest-VolumesTestJSON-57329144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:21:10 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-86f7d307-3db3-4802-af74-e3267c7cd9a7 tempest-VolumesTestJSON-57329144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:21:10 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-86f7d307-3db3-4802-af74-e3267c7cd9a7 tempest-VolumesTestJSON-57329144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:21:10 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-86f7d307-3db3-4802-af74-e3267c7cd9a7 tempest-VolumesTestJSON-57329144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:21:10 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-86f7d307-3db3-4802-af74-e3267c7cd9a7 tempest-VolumesTestJSON-57329144 None] Selected osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:21:10 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-86f7d307-3db3-4802-af74-e3267c7cd9a7 tempest-VolumesTestJSON-57329144 None] casted to osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 Nov 04 10:21:10 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-86f7d307-3db3-4802-af74-e3267c7cd9a7 tempest-VolumesTestJSON-57329144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-45f0dedd-ed7d-4327-b95d-8a46ea4f6eee 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:21:10 devstack sudo[97565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-45f0dedd-ed7d-4327-b95d-8a46ea4f6eee 1073741824 Nov 04 10:21:10 devstack sudo[97565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:21:10 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-337f42fa-bf95-4089-a9ca-a432cf061161 tempest-VolumesSnapshotListTestJSON-286994546 None] Create snapshot completed successfully Nov 04 10:21:10 devstack sudo[97562]: pam_unix(sudo:session): session closed for user root Nov 04 10:21:10 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d59ab1ae-3234-4712-a2e7-0adefcd7159d tempest-VolumesListTestJSON-1714613792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-cbebb358-9edc-4744-8f4f-df3e66bdc0b7" returned: 0 in 0.309s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:21:10 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-d59ab1ae-3234-4712-a2e7-0adefcd7159d tempest-VolumesListTestJSON-1714613792 None] Lock "cinder-quobyte-cbebb358-9edc-4744-8f4f-df3e66bdc0b7" released by "delete_volume" :: held 0.746s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:21:10 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-d59ab1ae-3234-4712-a2e7-0adefcd7159d tempest-VolumesListTestJSON-1714613792 None] Created reservations ['9d60e182-0f77-4820-964d-4bea36b3c2f9', '9bacb73f-142e-43c4-8726-8838a9f04ea2', '6866da9a-4f8d-49d5-a9aa-a7c868f68b37', 'f0df634d-34e9-4a55-83bb-e9f682955526'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:21:10 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-d59ab1ae-3234-4712-a2e7-0adefcd7159d tempest-VolumesListTestJSON-1714613792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:21:10 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-d59ab1ae-3234-4712-a2e7-0adefcd7159d tempest-VolumesListTestJSON-1714613792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:21:10 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-d59ab1ae-3234-4712-a2e7-0adefcd7159d tempest-VolumesListTestJSON-1714613792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:21:10 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-d59ab1ae-3234-4712-a2e7-0adefcd7159d tempest-VolumesListTestJSON-1714613792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:21:10 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-d59ab1ae-3234-4712-a2e7-0adefcd7159d tempest-VolumesListTestJSON-1714613792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:21:10 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d59ab1ae-3234-4712-a2e7-0adefcd7159d tempest-VolumesListTestJSON-1714613792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:21:10 devstack sudo[97571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:21:10 devstack sudo[97571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:21:11 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-c6f24fbe-0ffb-4b63-84a3-32e50e8a75b1 tempest-VolumesListTestJSON-1714613792 None] Acquiring lock "cinder-7fe125e5-c91b-4273-9ffc-1aef5c923527-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:21:11 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-c6f24fbe-0ffb-4b63-84a3-32e50e8a75b1 tempest-VolumesListTestJSON-1714613792 None] Lock "cinder-7fe125e5-c91b-4273-9ffc-1aef5c923527-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:21:11 devstack sudo[97565]: pam_unix(sudo:session): session closed for user root Nov 04 10:21:11 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-86f7d307-3db3-4802-af74-e3267c7cd9a7 tempest-VolumesTestJSON-57329144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-45f0dedd-ed7d-4327-b95d-8a46ea4f6eee 1073741824" returned: 0 in 0.550s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:21:11 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-c6f24fbe-0ffb-4b63-84a3-32e50e8a75b1 tempest-VolumesListTestJSON-1714613792 None] Acquiring lock "cinder-quobyte-7fe125e5-c91b-4273-9ffc-1aef5c923527" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:21:11 devstack sudo[97571]: pam_unix(sudo:session): session closed for user root Nov 04 10:21:11 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-c6f24fbe-0ffb-4b63-84a3-32e50e8a75b1 tempest-VolumesListTestJSON-1714613792 None] Lock "cinder-quobyte-7fe125e5-c91b-4273-9ffc-1aef5c923527" acquired by "delete_volume" :: waited 0.026s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:21:11 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d59ab1ae-3234-4712-a2e7-0adefcd7159d tempest-VolumesListTestJSON-1714613792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.341s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:21:11 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-d59ab1ae-3234-4712-a2e7-0adefcd7159d tempest-VolumesListTestJSON-1714613792 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:21:11 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-86f7d307-3db3-4802-af74-e3267c7cd9a7 tempest-VolumesTestJSON-57329144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-45f0dedd-ed7d-4327-b95d-8a46ea4f6eee {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:21:11 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[231a45dc-7a32-4066-9187-4e78696dba49]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:21:11 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-d59ab1ae-3234-4712-a2e7-0adefcd7159d tempest-VolumesListTestJSON-1714613792 None] Deleted volume successfully. Nov 04 10:21:11 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c6f24fbe-0ffb-4b63-84a3-32e50e8a75b1 tempest-VolumesListTestJSON-1714613792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-7fe125e5-c91b-4273-9ffc-1aef5c923527 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:21:11 devstack sudo[97575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-45f0dedd-ed7d-4327-b95d-8a46ea4f6eee Nov 04 10:21:11 devstack sudo[97575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:21:11 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-d59ab1ae-3234-4712-a2e7-0adefcd7159d tempest-VolumesListTestJSON-1714613792 None] Lock "cinder-cbebb358-9edc-4744-8f4f-df3e66bdc0b7-delete_volume" released by "delete_volume" :: held 1.369s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:21:11 devstack sudo[97576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-7fe125e5-c91b-4273-9ffc-1aef5c923527 Nov 04 10:21:11 devstack sudo[97576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:21:11 devstack sudo[97575]: pam_unix(sudo:session): session closed for user root Nov 04 10:21:11 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-86f7d307-3db3-4802-af74-e3267c7cd9a7 tempest-VolumesTestJSON-57329144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-45f0dedd-ed7d-4327-b95d-8a46ea4f6eee" returned: 0 in 0.281s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:21:11 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-86f7d307-3db3-4802-af74-e3267c7cd9a7 tempest-VolumesTestJSON-57329144 None] <== create_volume: return (923ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 10:21:11 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-86f7d307-3db3-4802-af74-e3267c7cd9a7 tempest-VolumesTestJSON-57329144 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.926s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:21:11 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-86f7d307-3db3-4802-af74-e3267c7cd9a7 tempest-VolumesTestJSON-57329144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1375a78b-4204-445f-a976-9c667946c1cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45f0dedd-ed7d-4327-b95d-8a46ea4f6eee', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:21:11 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-86f7d307-3db3-4802-af74-e3267c7cd9a7 tempest-VolumesTestJSON-57329144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (094b0323-804d-4936-bae7-0e1a4f062215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:21:11 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-86f7d307-3db3-4802-af74-e3267c7cd9a7 tempest-VolumesTestJSON-57329144 None] Volume volume-45f0dedd-ed7d-4327-b95d-8a46ea4f6eee (45f0dedd-ed7d-4327-b95d-8a46ea4f6eee): created successfully Nov 04 10:21:11 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-86f7d307-3db3-4802-af74-e3267c7cd9a7 tempest-VolumesTestJSON-57329144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (094b0323-804d-4936-bae7-0e1a4f062215) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:21:11 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-86f7d307-3db3-4802-af74-e3267c7cd9a7 tempest-VolumesTestJSON-57329144 None] Flow 'volume_create_manager' (f8ade549-dfcc-4c02-a675-9a021973a45e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:21:11 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-86f7d307-3db3-4802-af74-e3267c7cd9a7 tempest-VolumesTestJSON-57329144 None] Created volume successfully. Nov 04 10:21:11 devstack sudo[97576]: pam_unix(sudo:session): session closed for user root Nov 04 10:21:11 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c6f24fbe-0ffb-4b63-84a3-32e50e8a75b1 tempest-VolumesListTestJSON-1714613792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-7fe125e5-c91b-4273-9ffc-1aef5c923527" returned: 0 in 0.391s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:21:11 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c6f24fbe-0ffb-4b63-84a3-32e50e8a75b1 tempest-VolumesListTestJSON-1714613792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-7fe125e5-c91b-4273-9ffc-1aef5c923527 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:21:11 devstack sudo[97583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-7fe125e5-c91b-4273-9ffc-1aef5c923527 Nov 04 10:21:11 devstack sudo[97583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:21:11 devstack sudo[97583]: pam_unix(sudo:session): session closed for user root Nov 04 10:21:11 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c6f24fbe-0ffb-4b63-84a3-32e50e8a75b1 tempest-VolumesListTestJSON-1714613792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-7fe125e5-c91b-4273-9ffc-1aef5c923527" returned: 0 in 0.277s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:21:12 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-c6f24fbe-0ffb-4b63-84a3-32e50e8a75b1 tempest-VolumesListTestJSON-1714613792 None] Lock "cinder-quobyte-7fe125e5-c91b-4273-9ffc-1aef5c923527" released by "delete_volume" :: held 0.733s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:21:12 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-c6f24fbe-0ffb-4b63-84a3-32e50e8a75b1 tempest-VolumesListTestJSON-1714613792 None] Created reservations ['4ffacf6e-cd6d-4661-b9a4-2e918fd047af', '7a190a4b-8898-4645-a514-6773c2835299', '6f4b65a4-41a3-4964-88a1-3b4c14f220e4', '8fbeeb3e-0fc4-435d-9952-30d81bad8799'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:21:12 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-c6f24fbe-0ffb-4b63-84a3-32e50e8a75b1 tempest-VolumesListTestJSON-1714613792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:21:12 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-c6f24fbe-0ffb-4b63-84a3-32e50e8a75b1 tempest-VolumesListTestJSON-1714613792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:21:12 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-c6f24fbe-0ffb-4b63-84a3-32e50e8a75b1 tempest-VolumesListTestJSON-1714613792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:21:12 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-c6f24fbe-0ffb-4b63-84a3-32e50e8a75b1 tempest-VolumesListTestJSON-1714613792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:21:12 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-c6f24fbe-0ffb-4b63-84a3-32e50e8a75b1 tempest-VolumesListTestJSON-1714613792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:21:12 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c6f24fbe-0ffb-4b63-84a3-32e50e8a75b1 tempest-VolumesListTestJSON-1714613792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:21:12 devstack sudo[97586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:21:12 devstack sudo[97586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:21:12 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-b483e1f6-a5e8-4cf2-b7aa-c6e1ed59ba67 tempest-VolumesNegativeTest-519856752 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:21:12 devstack sudo[97586]: pam_unix(sudo:session): session closed for user root Nov 04 10:21:12 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-b483e1f6-a5e8-4cf2-b7aa-c6e1ed59ba67 tempest-VolumesNegativeTest-519856752 None] Flow 'volume_create_manager' (5b54089e-afb0-4871-9c44-7cc1c26873d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:21:12 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-b483e1f6-a5e8-4cf2-b7aa-c6e1ed59ba67 tempest-VolumesNegativeTest-519856752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42114e74-619d-47f3-8b36-41aaefe3957e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:21:12 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c6f24fbe-0ffb-4b63-84a3-32e50e8a75b1 tempest-VolumesListTestJSON-1714613792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.328s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:21:12 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-c6f24fbe-0ffb-4b63-84a3-32e50e8a75b1 tempest-VolumesListTestJSON-1714613792 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:21:12 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-e7deeda2-99a9-4caf-820a-f90db359edc9 tempest-VolumesListTestJSON-1714613792 None] Acquiring lock "cinder-0457920d-96b6-4474-9317-d08c6a4c2d89-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:21:12 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-c6f24fbe-0ffb-4b63-84a3-32e50e8a75b1 tempest-VolumesListTestJSON-1714613792 None] Deleted volume successfully. Nov 04 10:21:12 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-b483e1f6-a5e8-4cf2-b7aa-c6e1ed59ba67 tempest-VolumesNegativeTest-519856752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42114e74-619d-47f3-8b36-41aaefe3957e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:21:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1197650138',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0720847-3817-45ce-9dc6-1c96e60bdb7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21a7e19080b945ae8267e60012d64334',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:21:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:21:12Z,use_quota=True,user_id='4ac459d37dec4f8fab37a798850e7bc8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:21:12 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-b483e1f6-a5e8-4cf2-b7aa-c6e1ed59ba67 tempest-VolumesNegativeTest-519856752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fc5295a-09ea-41c4-82e5-b4cd64bdf334) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:21:12 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-b483e1f6-a5e8-4cf2-b7aa-c6e1ed59ba67 tempest-VolumesNegativeTest-519856752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fc5295a-09ea-41c4-82e5-b4cd64bdf334) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:21:12 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-b483e1f6-a5e8-4cf2-b7aa-c6e1ed59ba67 tempest-VolumesNegativeTest-519856752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (249a549f-1c2d-4418-983f-ad784abe0efb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:21:12 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-b483e1f6-a5e8-4cf2-b7aa-c6e1ed59ba67 tempest-VolumesNegativeTest-519856752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (249a549f-1c2d-4418-983f-ad784abe0efb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0720847-3817-45ce-9dc6-1c96e60bdb7f', 'volume_name': 'volume-c0720847-3817-45ce-9dc6-1c96e60bdb7f', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:21:12 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-b483e1f6-a5e8-4cf2-b7aa-c6e1ed59ba67 tempest-VolumesNegativeTest-519856752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1c4dd25-fd15-4d71-9703-020dd354de52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:21:12 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-b483e1f6-a5e8-4cf2-b7aa-c6e1ed59ba67 tempest-VolumesNegativeTest-519856752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1c4dd25-fd15-4d71-9703-020dd354de52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:21:12 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-b483e1f6-a5e8-4cf2-b7aa-c6e1ed59ba67 tempest-VolumesNegativeTest-519856752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d394845-d8b3-42b3-825e-7c00176207ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:21:12 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-b483e1f6-a5e8-4cf2-b7aa-c6e1ed59ba67 tempest-VolumesNegativeTest-519856752 None] Volume c0720847-3817-45ce-9dc6-1c96e60bdb7f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0720847-3817-45ce-9dc6-1c96e60bdb7f', 'volume_size': 1} Nov 04 10:21:12 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-b483e1f6-a5e8-4cf2-b7aa-c6e1ed59ba67 tempest-VolumesNegativeTest-519856752 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:21:12 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-b483e1f6-a5e8-4cf2-b7aa-c6e1ed59ba67 tempest-VolumesNegativeTest-519856752 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:21:12 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-b483e1f6-a5e8-4cf2-b7aa-c6e1ed59ba67 tempest-VolumesNegativeTest-519856752 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:21:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1197650138',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0720847-3817-45ce-9dc6-1c96e60bdb7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21a7e19080b945ae8267e60012d64334',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:21:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:21:12Z,use_quota=True,user_id='4ac459d37dec4f8fab37a798850e7bc8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 10:21:12 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-b483e1f6-a5e8-4cf2-b7aa-c6e1ed59ba67 tempest-VolumesNegativeTest-519856752 None] Creating volume c0720847-3817-45ce-9dc6-1c96e60bdb7f {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:21:12 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-b483e1f6-a5e8-4cf2-b7aa-c6e1ed59ba67 tempest-VolumesNegativeTest-519856752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:21:12 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-b483e1f6-a5e8-4cf2-b7aa-c6e1ed59ba67 tempest-VolumesNegativeTest-519856752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:21:12 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-b483e1f6-a5e8-4cf2-b7aa-c6e1ed59ba67 tempest-VolumesNegativeTest-519856752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:21:12 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-b483e1f6-a5e8-4cf2-b7aa-c6e1ed59ba67 tempest-VolumesNegativeTest-519856752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:21:12 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-b483e1f6-a5e8-4cf2-b7aa-c6e1ed59ba67 tempest-VolumesNegativeTest-519856752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:21:12 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-b483e1f6-a5e8-4cf2-b7aa-c6e1ed59ba67 tempest-VolumesNegativeTest-519856752 None] Selected osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:21:12 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-b483e1f6-a5e8-4cf2-b7aa-c6e1ed59ba67 tempest-VolumesNegativeTest-519856752 None] casted to osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 Nov 04 10:21:12 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-b483e1f6-a5e8-4cf2-b7aa-c6e1ed59ba67 tempest-VolumesNegativeTest-519856752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-c0720847-3817-45ce-9dc6-1c96e60bdb7f 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:21:12 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-c6f24fbe-0ffb-4b63-84a3-32e50e8a75b1 tempest-VolumesListTestJSON-1714613792 None] Lock "cinder-7fe125e5-c91b-4273-9ffc-1aef5c923527-delete_volume" released by "delete_volume" :: held 1.506s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:21:12 devstack sudo[97590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-c0720847-3817-45ce-9dc6-1c96e60bdb7f 1073741824 Nov 04 10:21:12 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-e7deeda2-99a9-4caf-820a-f90db359edc9 tempest-VolumesListTestJSON-1714613792 None] Lock "cinder-0457920d-96b6-4474-9317-d08c6a4c2d89-delete_volume" acquired by "delete_volume" :: waited 0.133s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:21:12 devstack sudo[97590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:21:12 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-e7deeda2-99a9-4caf-820a-f90db359edc9 tempest-VolumesListTestJSON-1714613792 None] Acquiring lock "cinder-quobyte-0457920d-96b6-4474-9317-d08c6a4c2d89" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:21:12 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-e7deeda2-99a9-4caf-820a-f90db359edc9 tempest-VolumesListTestJSON-1714613792 None] Lock "cinder-quobyte-0457920d-96b6-4474-9317-d08c6a4c2d89" acquired by "delete_volume" :: waited 0.018s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:21:12 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[9afaf763-2586-4527-9ebc-3bca6e56f722]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:21:12 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-e7deeda2-99a9-4caf-820a-f90db359edc9 tempest-VolumesListTestJSON-1714613792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-0457920d-96b6-4474-9317-d08c6a4c2d89 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:21:12 devstack sudo[97592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-0457920d-96b6-4474-9317-d08c6a4c2d89 Nov 04 10:21:12 devstack sudo[97592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:21:13 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-2c759d84-4872-4945-ae52-52ad3c08ab9c tempest-VolumesSnapshotListTestJSON-286994546 None] Acquiring lock "cinder-715903e4-b0e1-4f41-8d10-915b3668e4b4-delete_snapshot" by "delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:21:13 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-2c759d84-4872-4945-ae52-52ad3c08ab9c tempest-VolumesSnapshotListTestJSON-286994546 None] Lock "cinder-715903e4-b0e1-4f41-8d10-915b3668e4b4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:21:13 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-2c759d84-4872-4945-ae52-52ad3c08ab9c tempest-VolumesSnapshotListTestJSON-286994546 None] Acquiring lock "cinder-quobyte-6cd7fd53-423f-4534-9925-6d2408c74977" by "delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:21:13 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-2c759d84-4872-4945-ae52-52ad3c08ab9c tempest-VolumesSnapshotListTestJSON-286994546 None] Lock "cinder-quobyte-6cd7fd53-423f-4534-9925-6d2408c74977" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:21:13 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-2c759d84-4872-4945-ae52-52ad3c08ab9c tempest-VolumesSnapshotListTestJSON-286994546 None] Acquiring lock "cinder-quobyte-715903e4-b0e1-4f41-8d10-915b3668e4b4" by "_delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:21:13 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-2c759d84-4872-4945-ae52-52ad3c08ab9c tempest-VolumesSnapshotListTestJSON-286994546 None] Lock "cinder-quobyte-715903e4-b0e1-4f41-8d10-915b3668e4b4" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:21:13 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-2c759d84-4872-4945-ae52-52ad3c08ab9c tempest-VolumesSnapshotListTestJSON-286994546 None] Deleting offline snapshot 715903e4-b0e1-4f41-8d10-915b3668e4b4 of volume 6cd7fd53-423f-4534-9925-6d2408c74977 {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 10:21:13 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-2c759d84-4872-4945-ae52-52ad3c08ab9c tempest-VolumesSnapshotListTestJSON-286994546 None] snapshot_file for this snap is: volume-6cd7fd53-423f-4534-9925-6d2408c74977.715903e4-b0e1-4f41-8d10-915b3668e4b4 {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 10:21:13 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[e53a3b3c-1947-44e4-b630-19722b6132cb]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:21:13 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-2c759d84-4872-4945-ae52-52ad3c08ab9c tempest-VolumesSnapshotListTestJSON-286994546 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6cd7fd53-423f-4534-9925-6d2408c74977.715903e4-b0e1-4f41-8d10-915b3668e4b4 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:21:13 devstack sudo[97597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6cd7fd53-423f-4534-9925-6d2408c74977.715903e4-b0e1-4f41-8d10-915b3668e4b4 Nov 04 10:21:13 devstack sudo[97597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:21:13 devstack sudo[97590]: pam_unix(sudo:session): session closed for user root Nov 04 10:21:13 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-b483e1f6-a5e8-4cf2-b7aa-c6e1ed59ba67 tempest-VolumesNegativeTest-519856752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-c0720847-3817-45ce-9dc6-1c96e60bdb7f 1073741824" returned: 0 in 0.675s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:21:13 devstack sudo[97592]: pam_unix(sudo:session): session closed for user root Nov 04 10:21:13 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-b483e1f6-a5e8-4cf2-b7aa-c6e1ed59ba67 tempest-VolumesNegativeTest-519856752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-c0720847-3817-45ce-9dc6-1c96e60bdb7f {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:21:13 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-e7deeda2-99a9-4caf-820a-f90db359edc9 tempest-VolumesListTestJSON-1714613792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-0457920d-96b6-4474-9317-d08c6a4c2d89" returned: 0 in 0.576s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:21:13 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-e7deeda2-99a9-4caf-820a-f90db359edc9 tempest-VolumesListTestJSON-1714613792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-0457920d-96b6-4474-9317-d08c6a4c2d89 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:21:13 devstack sudo[97603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-c0720847-3817-45ce-9dc6-1c96e60bdb7f Nov 04 10:21:13 devstack sudo[97603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:21:13 devstack sudo[97604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-0457920d-96b6-4474-9317-d08c6a4c2d89 Nov 04 10:21:13 devstack sudo[97604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:21:13 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-a20cc19f-accd-4457-bb75-69b69773da53 tempest-VolumesTestJSON-57329144 None] Acquiring lock "cinder-45f0dedd-ed7d-4327-b95d-8a46ea4f6eee-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:21:13 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-a20cc19f-accd-4457-bb75-69b69773da53 tempest-VolumesTestJSON-57329144 None] Lock "cinder-45f0dedd-ed7d-4327-b95d-8a46ea4f6eee-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:21:13 devstack sudo[97597]: pam_unix(sudo:session): session closed for user root Nov 04 10:21:13 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-2c759d84-4872-4945-ae52-52ad3c08ab9c tempest-VolumesSnapshotListTestJSON-286994546 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6cd7fd53-423f-4534-9925-6d2408c74977.715903e4-b0e1-4f41-8d10-915b3668e4b4" returned: 0 in 0.467s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:21:13 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-2c759d84-4872-4945-ae52-52ad3c08ab9c tempest-VolumesSnapshotListTestJSON-286994546 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6cd7fd53-423f-4534-9925-6d2408c74977(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87068) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 10:21:13 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[b49d4e09-d745-4bc0-9ad5-59f3c215c6d8]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:21:13 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-2c759d84-4872-4945-ae52-52ad3c08ab9c tempest-VolumesSnapshotListTestJSON-286994546 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6cd7fd53-423f-4534-9925-6d2408c74977.ee024861-063a-46da-80d4-b68cf3327373 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:21:13 devstack sudo[97604]: pam_unix(sudo:session): session closed for user root Nov 04 10:21:13 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-a20cc19f-accd-4457-bb75-69b69773da53 tempest-VolumesTestJSON-57329144 None] Acquiring lock "cinder-quobyte-45f0dedd-ed7d-4327-b95d-8a46ea4f6eee" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:21:13 devstack sudo[97603]: pam_unix(sudo:session): session closed for user root Nov 04 10:21:13 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-e7deeda2-99a9-4caf-820a-f90db359edc9 tempest-VolumesListTestJSON-1714613792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-0457920d-96b6-4474-9317-d08c6a4c2d89" returned: 0 in 0.326s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:21:13 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-b483e1f6-a5e8-4cf2-b7aa-c6e1ed59ba67 tempest-VolumesNegativeTest-519856752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-c0720847-3817-45ce-9dc6-1c96e60bdb7f" returned: 0 in 0.351s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:21:13 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-b483e1f6-a5e8-4cf2-b7aa-c6e1ed59ba67 tempest-VolumesNegativeTest-519856752 None] <== create_volume: return (1079ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 10:21:13 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-b483e1f6-a5e8-4cf2-b7aa-c6e1ed59ba67 tempest-VolumesNegativeTest-519856752 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.081s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:21:13 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-e7deeda2-99a9-4caf-820a-f90db359edc9 tempest-VolumesListTestJSON-1714613792 None] Lock "cinder-quobyte-0457920d-96b6-4474-9317-d08c6a4c2d89" released by "delete_volume" :: held 0.976s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:21:13 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-a20cc19f-accd-4457-bb75-69b69773da53 tempest-VolumesTestJSON-57329144 None] Lock "cinder-quobyte-45f0dedd-ed7d-4327-b95d-8a46ea4f6eee" acquired by "delete_volume" :: waited 0.039s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:21:13 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-b483e1f6-a5e8-4cf2-b7aa-c6e1ed59ba67 tempest-VolumesNegativeTest-519856752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d394845-d8b3-42b3-825e-7c00176207ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0720847-3817-45ce-9dc6-1c96e60bdb7f', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:21:13 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-b483e1f6-a5e8-4cf2-b7aa-c6e1ed59ba67 tempest-VolumesNegativeTest-519856752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6549dad5-7486-4cfd-8151-02bb3425939c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:21:13 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5cbb818-6faa-40b2-8490-3058fd4e6098]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:21:13 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-a20cc19f-accd-4457-bb75-69b69773da53 tempest-VolumesTestJSON-57329144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-45f0dedd-ed7d-4327-b95d-8a46ea4f6eee {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:21:13 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-b483e1f6-a5e8-4cf2-b7aa-c6e1ed59ba67 tempest-VolumesNegativeTest-519856752 None] Volume volume-c0720847-3817-45ce-9dc6-1c96e60bdb7f (c0720847-3817-45ce-9dc6-1c96e60bdb7f): created successfully Nov 04 10:21:13 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-b483e1f6-a5e8-4cf2-b7aa-c6e1ed59ba67 tempest-VolumesNegativeTest-519856752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6549dad5-7486-4cfd-8151-02bb3425939c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:21:13 devstack sudo[97613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6cd7fd53-423f-4534-9925-6d2408c74977.ee024861-063a-46da-80d4-b68cf3327373 Nov 04 10:21:13 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-b483e1f6-a5e8-4cf2-b7aa-c6e1ed59ba67 tempest-VolumesNegativeTest-519856752 None] Flow 'volume_create_manager' (5b54089e-afb0-4871-9c44-7cc1c26873d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:21:13 devstack sudo[97613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:21:13 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-b483e1f6-a5e8-4cf2-b7aa-c6e1ed59ba67 tempest-VolumesNegativeTest-519856752 None] Created volume successfully. Nov 04 10:21:13 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-e7deeda2-99a9-4caf-820a-f90db359edc9 tempest-VolumesListTestJSON-1714613792 None] Created reservations ['d4fc3f34-38ae-4c6e-a408-0af47635aed8', '19268016-7972-4824-8db0-6b2056c78855', 'ebd028a1-938d-41fe-99af-793b770e464e', 'a595c3cc-3046-486a-a400-11f43cb38dde'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:21:13 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-e7deeda2-99a9-4caf-820a-f90db359edc9 tempest-VolumesListTestJSON-1714613792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:21:13 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-e7deeda2-99a9-4caf-820a-f90db359edc9 tempest-VolumesListTestJSON-1714613792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:21:13 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-e7deeda2-99a9-4caf-820a-f90db359edc9 tempest-VolumesListTestJSON-1714613792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:21:13 devstack sudo[97614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-45f0dedd-ed7d-4327-b95d-8a46ea4f6eee Nov 04 10:21:13 devstack sudo[97614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:21:13 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-e7deeda2-99a9-4caf-820a-f90db359edc9 tempest-VolumesListTestJSON-1714613792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:21:13 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-e7deeda2-99a9-4caf-820a-f90db359edc9 tempest-VolumesListTestJSON-1714613792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:21:13 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-e7deeda2-99a9-4caf-820a-f90db359edc9 tempest-VolumesListTestJSON-1714613792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:21:13 devstack sudo[97617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:21:13 devstack sudo[97617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:21:14 devstack sudo[97613]: pam_unix(sudo:session): session closed for user root Nov 04 10:21:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-2c759d84-4872-4945-ae52-52ad3c08ab9c tempest-VolumesSnapshotListTestJSON-286994546 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6cd7fd53-423f-4534-9925-6d2408c74977.ee024861-063a-46da-80d4-b68cf3327373" returned: 0 in 0.390s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:21:14 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-2c759d84-4872-4945-ae52-52ad3c08ab9c tempest-VolumesSnapshotListTestJSON-286994546 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6cd7fd53-423f-4534-9925-6d2408c74977(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87068) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 10:21:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-2c759d84-4872-4945-ae52-52ad3c08ab9c tempest-VolumesSnapshotListTestJSON-286994546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6cd7fd53-423f-4534-9925-6d2408c74977.715903e4-b0e1-4f41-8d10-915b3668e4b4 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:21:14 devstack sudo[97622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6cd7fd53-423f-4534-9925-6d2408c74977.715903e4-b0e1-4f41-8d10-915b3668e4b4 Nov 04 10:21:14 devstack sudo[97622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:21:14 devstack sudo[97617]: pam_unix(sudo:session): session closed for user root Nov 04 10:21:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-e7deeda2-99a9-4caf-820a-f90db359edc9 tempest-VolumesListTestJSON-1714613792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.261s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:21:14 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-e7deeda2-99a9-4caf-820a-f90db359edc9 tempest-VolumesListTestJSON-1714613792 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:21:14 devstack sudo[97614]: pam_unix(sudo:session): session closed for user root Nov 04 10:21:14 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-e7deeda2-99a9-4caf-820a-f90db359edc9 tempest-VolumesListTestJSON-1714613792 None] Deleted volume successfully. Nov 04 10:21:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-a20cc19f-accd-4457-bb75-69b69773da53 tempest-VolumesTestJSON-57329144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-45f0dedd-ed7d-4327-b95d-8a46ea4f6eee" returned: 0 in 0.414s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:21:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-a20cc19f-accd-4457-bb75-69b69773da53 tempest-VolumesTestJSON-57329144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-45f0dedd-ed7d-4327-b95d-8a46ea4f6eee {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:21:14 devstack sudo[97628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-45f0dedd-ed7d-4327-b95d-8a46ea4f6eee Nov 04 10:21:14 devstack sudo[97628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:21:14 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-e7deeda2-99a9-4caf-820a-f90db359edc9 tempest-VolumesListTestJSON-1714613792 None] Lock "cinder-0457920d-96b6-4474-9317-d08c6a4c2d89-delete_volume" released by "delete_volume" :: held 1.533s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:21:14 devstack sudo[97628]: pam_unix(sudo:session): session closed for user root Nov 04 10:21:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-a20cc19f-accd-4457-bb75-69b69773da53 tempest-VolumesTestJSON-57329144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-45f0dedd-ed7d-4327-b95d-8a46ea4f6eee" returned: 0 in 0.280s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:21:14 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-a20cc19f-accd-4457-bb75-69b69773da53 tempest-VolumesTestJSON-57329144 None] Lock "cinder-quobyte-45f0dedd-ed7d-4327-b95d-8a46ea4f6eee" released by "delete_volume" :: held 0.746s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:21:14 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-a20cc19f-accd-4457-bb75-69b69773da53 tempest-VolumesTestJSON-57329144 None] Created reservations ['675828c6-25fb-4945-805d-2034d93606c2', '17dc8f37-dd05-49d5-aa6d-a3a3c622a22d', 'd999600c-841b-4466-bcea-5f4d4da35c2c', '8035f158-d732-4dad-be9e-da1070f707cb'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:21:14 devstack sudo[97622]: pam_unix(sudo:session): session closed for user root Nov 04 10:21:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-2c759d84-4872-4945-ae52-52ad3c08ab9c tempest-VolumesSnapshotListTestJSON-286994546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6cd7fd53-423f-4534-9925-6d2408c74977.715903e4-b0e1-4f41-8d10-915b3668e4b4" returned: 0 in 0.493s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:21:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-2c759d84-4872-4945-ae52-52ad3c08ab9c tempest-VolumesSnapshotListTestJSON-286994546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6cd7fd53-423f-4534-9925-6d2408c74977.715903e4-b0e1-4f41-8d10-915b3668e4b4 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:21:14 devstack sudo[97635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6cd7fd53-423f-4534-9925-6d2408c74977.715903e4-b0e1-4f41-8d10-915b3668e4b4 Nov 04 10:21:14 devstack sudo[97635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:21:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-a20cc19f-accd-4457-bb75-69b69773da53 tempest-VolumesTestJSON-57329144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:21:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-a20cc19f-accd-4457-bb75-69b69773da53 tempest-VolumesTestJSON-57329144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:21:14 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-a20cc19f-accd-4457-bb75-69b69773da53 tempest-VolumesTestJSON-57329144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:21:14 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-a20cc19f-accd-4457-bb75-69b69773da53 tempest-VolumesTestJSON-57329144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:21:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-a20cc19f-accd-4457-bb75-69b69773da53 tempest-VolumesTestJSON-57329144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:21:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-a20cc19f-accd-4457-bb75-69b69773da53 tempest-VolumesTestJSON-57329144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:21:14 devstack sudo[97637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:21:14 devstack sudo[97637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:21:14 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-88d11d5a-da51-4a3a-819b-71d46eaae4c8 tempest-VolumesTestJSON-57329144 None] Acquiring lock "cinder-791542bf-ecac-4bbb-943e-d34bf8b73ea2-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:21:14 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-88d11d5a-da51-4a3a-819b-71d46eaae4c8 tempest-VolumesTestJSON-57329144 None] Lock "cinder-791542bf-ecac-4bbb-943e-d34bf8b73ea2-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:21:14 devstack sudo[97635]: pam_unix(sudo:session): session closed for user root Nov 04 10:21:14 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-88d11d5a-da51-4a3a-819b-71d46eaae4c8 tempest-VolumesTestJSON-57329144 None] Acquiring lock "cinder-quobyte-791542bf-ecac-4bbb-943e-d34bf8b73ea2" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:21:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-2c759d84-4872-4945-ae52-52ad3c08ab9c tempest-VolumesSnapshotListTestJSON-286994546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6cd7fd53-423f-4534-9925-6d2408c74977.715903e4-b0e1-4f41-8d10-915b3668e4b4" returned: 0 in 0.297s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:21:14 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-88d11d5a-da51-4a3a-819b-71d46eaae4c8 tempest-VolumesTestJSON-57329144 None] Lock "cinder-quobyte-791542bf-ecac-4bbb-943e-d34bf8b73ea2" acquired by "delete_volume" :: waited 0.058s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:21:14 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-2c759d84-4872-4945-ae52-52ad3c08ab9c tempest-VolumesSnapshotListTestJSON-286994546 None] Lock "cinder-quobyte-715903e4-b0e1-4f41-8d10-915b3668e4b4" released by "_delete_snapshot" :: held 1.833s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:21:14 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-2c759d84-4872-4945-ae52-52ad3c08ab9c tempest-VolumesSnapshotListTestJSON-286994546 None] Lock "cinder-quobyte-6cd7fd53-423f-4534-9925-6d2408c74977" released by "delete_snapshot" :: held 1.863s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:21:14 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e6893bb-75f8-4e0f-aaf8-80de2f8f66d6]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:21:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-88d11d5a-da51-4a3a-819b-71d46eaae4c8 tempest-VolumesTestJSON-57329144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-791542bf-ecac-4bbb-943e-d34bf8b73ea2 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:21:15 devstack sudo[97637]: pam_unix(sudo:session): session closed for user root Nov 04 10:21:15 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-2c759d84-4872-4945-ae52-52ad3c08ab9c tempest-VolumesSnapshotListTestJSON-286994546 None] Created reservations ['4267171e-be7a-4613-93f2-dc70e77991b7', 'b54df501-b28b-4b26-99c2-e2e17fe32f26', '278de0a5-2b60-4549-9da5-aa4a156aabe4', 'b2430275-acdb-4b18-8773-e152106a8001'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:21:15 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-a20cc19f-accd-4457-bb75-69b69773da53 tempest-VolumesTestJSON-57329144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.435s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:21:15 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-a20cc19f-accd-4457-bb75-69b69773da53 tempest-VolumesTestJSON-57329144 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:21:15 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-a20cc19f-accd-4457-bb75-69b69773da53 tempest-VolumesTestJSON-57329144 None] Deleted volume successfully. Nov 04 10:21:15 devstack sudo[97641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-791542bf-ecac-4bbb-943e-d34bf8b73ea2 Nov 04 10:21:15 devstack sudo[97641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:21:15 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-a20cc19f-accd-4457-bb75-69b69773da53 tempest-VolumesTestJSON-57329144 None] Lock "cinder-45f0dedd-ed7d-4327-b95d-8a46ea4f6eee-delete_volume" released by "delete_volume" :: held 1.505s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:21:15 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-2c759d84-4872-4945-ae52-52ad3c08ab9c tempest-VolumesSnapshotListTestJSON-286994546 None] Delete snapshot completed successfully. Nov 04 10:21:15 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-2c759d84-4872-4945-ae52-52ad3c08ab9c tempest-VolumesSnapshotListTestJSON-286994546 None] Lock "cinder-715903e4-b0e1-4f41-8d10-915b3668e4b4-delete_snapshot" released by "delete_snapshot" :: held 2.103s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:21:15 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-9316eb81-b6b8-4957-8ccf-3aabcfcb3e48 tempest-VolumesSnapshotListTestJSON-286994546 None] Acquiring lock "cinder-ee024861-063a-46da-80d4-b68cf3327373-delete_snapshot" by "delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:21:15 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-9316eb81-b6b8-4957-8ccf-3aabcfcb3e48 tempest-VolumesSnapshotListTestJSON-286994546 None] Lock "cinder-ee024861-063a-46da-80d4-b68cf3327373-delete_snapshot" acquired by "delete_snapshot" :: waited 0.044s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:21:15 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-9316eb81-b6b8-4957-8ccf-3aabcfcb3e48 tempest-VolumesSnapshotListTestJSON-286994546 None] Acquiring lock "cinder-quobyte-6cd7fd53-423f-4534-9925-6d2408c74977" by "delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:21:15 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-9316eb81-b6b8-4957-8ccf-3aabcfcb3e48 tempest-VolumesSnapshotListTestJSON-286994546 None] Lock "cinder-quobyte-6cd7fd53-423f-4534-9925-6d2408c74977" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:21:15 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-9316eb81-b6b8-4957-8ccf-3aabcfcb3e48 tempest-VolumesSnapshotListTestJSON-286994546 None] Acquiring lock "cinder-quobyte-ee024861-063a-46da-80d4-b68cf3327373" by "_delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:21:15 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-9316eb81-b6b8-4957-8ccf-3aabcfcb3e48 tempest-VolumesSnapshotListTestJSON-286994546 None] Lock "cinder-quobyte-ee024861-063a-46da-80d4-b68cf3327373" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:21:15 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-9316eb81-b6b8-4957-8ccf-3aabcfcb3e48 tempest-VolumesSnapshotListTestJSON-286994546 None] Deleting offline snapshot ee024861-063a-46da-80d4-b68cf3327373 of volume 6cd7fd53-423f-4534-9925-6d2408c74977 {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 10:21:15 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-9316eb81-b6b8-4957-8ccf-3aabcfcb3e48 tempest-VolumesSnapshotListTestJSON-286994546 None] snapshot_file for this snap is: volume-6cd7fd53-423f-4534-9925-6d2408c74977.ee024861-063a-46da-80d4-b68cf3327373 {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 10:21:15 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4fa427b-9b1c-4f2e-8777-caa27cb035b7]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:21:15 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-9316eb81-b6b8-4957-8ccf-3aabcfcb3e48 tempest-VolumesSnapshotListTestJSON-286994546 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6cd7fd53-423f-4534-9925-6d2408c74977.ee024861-063a-46da-80d4-b68cf3327373 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:21:15 devstack sudo[97646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6cd7fd53-423f-4534-9925-6d2408c74977.ee024861-063a-46da-80d4-b68cf3327373 Nov 04 10:21:15 devstack sudo[97646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:21:15 devstack sudo[97641]: pam_unix(sudo:session): session closed for user root Nov 04 10:21:15 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-88d11d5a-da51-4a3a-819b-71d46eaae4c8 tempest-VolumesTestJSON-57329144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-791542bf-ecac-4bbb-943e-d34bf8b73ea2" returned: 0 in 0.629s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:21:15 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-88d11d5a-da51-4a3a-819b-71d46eaae4c8 tempest-VolumesTestJSON-57329144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-791542bf-ecac-4bbb-943e-d34bf8b73ea2 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:21:15 devstack sudo[97651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-791542bf-ecac-4bbb-943e-d34bf8b73ea2 Nov 04 10:21:15 devstack sudo[97651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:21:15 devstack sudo[97646]: pam_unix(sudo:session): session closed for user root Nov 04 10:21:15 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-9316eb81-b6b8-4957-8ccf-3aabcfcb3e48 tempest-VolumesSnapshotListTestJSON-286994546 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6cd7fd53-423f-4534-9925-6d2408c74977.ee024861-063a-46da-80d4-b68cf3327373" returned: 0 in 0.431s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:21:15 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-9316eb81-b6b8-4957-8ccf-3aabcfcb3e48 tempest-VolumesSnapshotListTestJSON-286994546 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6cd7fd53-423f-4534-9925-6d2408c74977(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87068) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 10:21:15 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9174cd4-e049-468c-bed9-6d8bb70337da]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:21:15 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-9316eb81-b6b8-4957-8ccf-3aabcfcb3e48 tempest-VolumesSnapshotListTestJSON-286994546 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6cd7fd53-423f-4534-9925-6d2408c74977.e76624f4-9bcc-4e76-b6be-114af48e731c {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:21:15 devstack sudo[97651]: pam_unix(sudo:session): session closed for user root Nov 04 10:21:15 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-88d11d5a-da51-4a3a-819b-71d46eaae4c8 tempest-VolumesTestJSON-57329144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-791542bf-ecac-4bbb-943e-d34bf8b73ea2" returned: 0 in 0.373s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:21:15 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-88d11d5a-da51-4a3a-819b-71d46eaae4c8 tempest-VolumesTestJSON-57329144 None] Lock "cinder-quobyte-791542bf-ecac-4bbb-943e-d34bf8b73ea2" released by "delete_volume" :: held 1.078s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:21:16 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-88d11d5a-da51-4a3a-819b-71d46eaae4c8 tempest-VolumesTestJSON-57329144 None] Created reservations ['9d5f0dd2-52f7-452d-b6ac-ce4cc59c38e4', 'edd838a8-3990-411d-b289-cb108ab48963', '4d402dc2-de8a-43e4-8457-51df3347d977', 'fe60e5f4-515d-4d47-a3d4-1686ee41a79d'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:21:16 devstack sudo[97658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6cd7fd53-423f-4534-9925-6d2408c74977.e76624f4-9bcc-4e76-b6be-114af48e731c Nov 04 10:21:16 devstack sudo[97658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:21:16 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-88d11d5a-da51-4a3a-819b-71d46eaae4c8 tempest-VolumesTestJSON-57329144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:21:16 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-88d11d5a-da51-4a3a-819b-71d46eaae4c8 tempest-VolumesTestJSON-57329144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:21:16 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-88d11d5a-da51-4a3a-819b-71d46eaae4c8 tempest-VolumesTestJSON-57329144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:21:16 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-88d11d5a-da51-4a3a-819b-71d46eaae4c8 tempest-VolumesTestJSON-57329144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:21:16 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-88d11d5a-da51-4a3a-819b-71d46eaae4c8 tempest-VolumesTestJSON-57329144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:21:16 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-88d11d5a-da51-4a3a-819b-71d46eaae4c8 tempest-VolumesTestJSON-57329144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:21:16 devstack sudo[97660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:21:16 devstack sudo[97660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:21:16 devstack sudo[97658]: pam_unix(sudo:session): session closed for user root Nov 04 10:21:16 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-9316eb81-b6b8-4957-8ccf-3aabcfcb3e48 tempest-VolumesSnapshotListTestJSON-286994546 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6cd7fd53-423f-4534-9925-6d2408c74977.e76624f4-9bcc-4e76-b6be-114af48e731c" returned: 0 in 0.577s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:21:16 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-9316eb81-b6b8-4957-8ccf-3aabcfcb3e48 tempest-VolumesSnapshotListTestJSON-286994546 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6cd7fd53-423f-4534-9925-6d2408c74977(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87068) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 10:21:16 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-9316eb81-b6b8-4957-8ccf-3aabcfcb3e48 tempest-VolumesSnapshotListTestJSON-286994546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6cd7fd53-423f-4534-9925-6d2408c74977.ee024861-063a-46da-80d4-b68cf3327373 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:21:16 devstack sudo[97666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6cd7fd53-423f-4534-9925-6d2408c74977.ee024861-063a-46da-80d4-b68cf3327373 Nov 04 10:21:16 devstack sudo[97666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:21:16 devstack sudo[97660]: pam_unix(sudo:session): session closed for user root Nov 04 10:21:16 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-88d11d5a-da51-4a3a-819b-71d46eaae4c8 tempest-VolumesTestJSON-57329144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.350s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:21:16 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-88d11d5a-da51-4a3a-819b-71d46eaae4c8 tempest-VolumesTestJSON-57329144 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:21:16 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-88d11d5a-da51-4a3a-819b-71d46eaae4c8 tempest-VolumesTestJSON-57329144 None] Deleted volume successfully. Nov 04 10:21:16 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-88d11d5a-da51-4a3a-819b-71d46eaae4c8 tempest-VolumesTestJSON-57329144 None] Lock "cinder-791542bf-ecac-4bbb-943e-d34bf8b73ea2-delete_volume" released by "delete_volume" :: held 1.812s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:21:16 devstack sudo[97666]: pam_unix(sudo:session): session closed for user root Nov 04 10:21:16 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-9316eb81-b6b8-4957-8ccf-3aabcfcb3e48 tempest-VolumesSnapshotListTestJSON-286994546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6cd7fd53-423f-4534-9925-6d2408c74977.ee024861-063a-46da-80d4-b68cf3327373" returned: 0 in 0.485s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:21:16 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-9316eb81-b6b8-4957-8ccf-3aabcfcb3e48 tempest-VolumesSnapshotListTestJSON-286994546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6cd7fd53-423f-4534-9925-6d2408c74977.ee024861-063a-46da-80d4-b68cf3327373 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:21:17 devstack sudo[97671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6cd7fd53-423f-4534-9925-6d2408c74977.ee024861-063a-46da-80d4-b68cf3327373 Nov 04 10:21:17 devstack sudo[97671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:21:17 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-ce77b3ce-dbd3-41ec-8f9a-2483ece157c3 tempest-VolumesTestJSON-57329144 None] Acquiring lock "cinder-5268e4af-d9f6-467e-897c-933b9dcb32c9-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:21:17 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-ce77b3ce-dbd3-41ec-8f9a-2483ece157c3 tempest-VolumesTestJSON-57329144 None] Lock "cinder-5268e4af-d9f6-467e-897c-933b9dcb32c9-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:21:17 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-ce77b3ce-dbd3-41ec-8f9a-2483ece157c3 tempest-VolumesTestJSON-57329144 None] Acquiring lock "cinder-quobyte-5268e4af-d9f6-467e-897c-933b9dcb32c9" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:21:17 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-ce77b3ce-dbd3-41ec-8f9a-2483ece157c3 tempest-VolumesTestJSON-57329144 None] Lock "cinder-quobyte-5268e4af-d9f6-467e-897c-933b9dcb32c9" acquired by "delete_volume" :: waited 0.031s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:21:17 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[7313fd09-6dd5-4d8c-8cf2-b8548c9b44f2]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:21:17 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ce77b3ce-dbd3-41ec-8f9a-2483ece157c3 tempest-VolumesTestJSON-57329144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-5268e4af-d9f6-467e-897c-933b9dcb32c9 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:21:17 devstack sudo[97671]: pam_unix(sudo:session): session closed for user root Nov 04 10:21:17 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-9316eb81-b6b8-4957-8ccf-3aabcfcb3e48 tempest-VolumesSnapshotListTestJSON-286994546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6cd7fd53-423f-4534-9925-6d2408c74977.ee024861-063a-46da-80d4-b68cf3327373" returned: 0 in 0.460s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:21:17 devstack sudo[97674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-5268e4af-d9f6-467e-897c-933b9dcb32c9 Nov 04 10:21:17 devstack sudo[97674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:21:17 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-9316eb81-b6b8-4957-8ccf-3aabcfcb3e48 tempest-VolumesSnapshotListTestJSON-286994546 None] Lock "cinder-quobyte-ee024861-063a-46da-80d4-b68cf3327373" released by "_delete_snapshot" :: held 2.139s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:21:17 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-9316eb81-b6b8-4957-8ccf-3aabcfcb3e48 tempest-VolumesSnapshotListTestJSON-286994546 None] Lock "cinder-quobyte-6cd7fd53-423f-4534-9925-6d2408c74977" released by "delete_snapshot" :: held 2.170s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:21:17 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-9316eb81-b6b8-4957-8ccf-3aabcfcb3e48 tempest-VolumesSnapshotListTestJSON-286994546 None] Created reservations ['048b7a0b-09b6-4ed9-8643-1256f2007397', 'bf44bf81-b39e-439e-9de7-cca92f18c5b0', '10f98d3d-a1eb-46a4-94db-8e9051d8aa94', '7a9da18f-8a49-42a7-8394-de5266688780'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:21:17 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-9316eb81-b6b8-4957-8ccf-3aabcfcb3e48 tempest-VolumesSnapshotListTestJSON-286994546 None] Delete snapshot completed successfully. Nov 04 10:21:17 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-9316eb81-b6b8-4957-8ccf-3aabcfcb3e48 tempest-VolumesSnapshotListTestJSON-286994546 None] Lock "cinder-ee024861-063a-46da-80d4-b68cf3327373-delete_snapshot" released by "delete_snapshot" :: held 2.461s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:21:17 devstack sudo[97674]: pam_unix(sudo:session): session closed for user root Nov 04 10:21:17 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ce77b3ce-dbd3-41ec-8f9a-2483ece157c3 tempest-VolumesTestJSON-57329144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-5268e4af-d9f6-467e-897c-933b9dcb32c9" returned: 0 in 0.554s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:21:17 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ce77b3ce-dbd3-41ec-8f9a-2483ece157c3 tempest-VolumesTestJSON-57329144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-5268e4af-d9f6-467e-897c-933b9dcb32c9 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:21:17 devstack sudo[97680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-5268e4af-d9f6-467e-897c-933b9dcb32c9 Nov 04 10:21:17 devstack sudo[97680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:21:18 devstack sudo[97680]: pam_unix(sudo:session): session closed for user root Nov 04 10:21:18 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ce77b3ce-dbd3-41ec-8f9a-2483ece157c3 tempest-VolumesTestJSON-57329144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-5268e4af-d9f6-467e-897c-933b9dcb32c9" returned: 0 in 0.319s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:21:18 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-ce77b3ce-dbd3-41ec-8f9a-2483ece157c3 tempest-VolumesTestJSON-57329144 None] Lock "cinder-quobyte-5268e4af-d9f6-467e-897c-933b9dcb32c9" released by "delete_volume" :: held 0.948s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:21:18 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-ce77b3ce-dbd3-41ec-8f9a-2483ece157c3 tempest-VolumesTestJSON-57329144 None] Created reservations ['1ed25e96-b898-47ca-948b-b43fd77940a1', 'bad69df8-5b36-4af8-a30d-ee5d60a9fa3e', '2eb6e15f-06de-49d5-b7db-2ac7f66dc5dd', 'd708fcd5-c34c-41aa-b4a4-fed2816299eb'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:21:18 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-ce77b3ce-dbd3-41ec-8f9a-2483ece157c3 tempest-VolumesTestJSON-57329144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:21:18 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-ce77b3ce-dbd3-41ec-8f9a-2483ece157c3 tempest-VolumesTestJSON-57329144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:21:18 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-ce77b3ce-dbd3-41ec-8f9a-2483ece157c3 tempest-VolumesTestJSON-57329144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:21:18 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-ce77b3ce-dbd3-41ec-8f9a-2483ece157c3 tempest-VolumesTestJSON-57329144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:21:18 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-ce77b3ce-dbd3-41ec-8f9a-2483ece157c3 tempest-VolumesTestJSON-57329144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:21:18 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ce77b3ce-dbd3-41ec-8f9a-2483ece157c3 tempest-VolumesTestJSON-57329144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:21:18 devstack sudo[97697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:21:18 devstack sudo[97697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:21:18 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-261889e5-46a8-4a99-8d1d-35182ef988c8 tempest-VolumesSnapshotListTestJSON-286994546 None] Acquiring lock "cinder-e76624f4-9bcc-4e76-b6be-114af48e731c-delete_snapshot" by "delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:21:18 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-261889e5-46a8-4a99-8d1d-35182ef988c8 tempest-VolumesSnapshotListTestJSON-286994546 None] Lock "cinder-e76624f4-9bcc-4e76-b6be-114af48e731c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:21:18 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-261889e5-46a8-4a99-8d1d-35182ef988c8 tempest-VolumesSnapshotListTestJSON-286994546 None] Acquiring lock "cinder-quobyte-6cd7fd53-423f-4534-9925-6d2408c74977" by "delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:21:18 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-261889e5-46a8-4a99-8d1d-35182ef988c8 tempest-VolumesSnapshotListTestJSON-286994546 None] Lock "cinder-quobyte-6cd7fd53-423f-4534-9925-6d2408c74977" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:21:18 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-261889e5-46a8-4a99-8d1d-35182ef988c8 tempest-VolumesSnapshotListTestJSON-286994546 None] Acquiring lock "cinder-quobyte-e76624f4-9bcc-4e76-b6be-114af48e731c" by "_delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:21:18 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-261889e5-46a8-4a99-8d1d-35182ef988c8 tempest-VolumesSnapshotListTestJSON-286994546 None] Lock "cinder-quobyte-e76624f4-9bcc-4e76-b6be-114af48e731c" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:21:18 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-261889e5-46a8-4a99-8d1d-35182ef988c8 tempest-VolumesSnapshotListTestJSON-286994546 None] Deleting offline snapshot e76624f4-9bcc-4e76-b6be-114af48e731c of volume 6cd7fd53-423f-4534-9925-6d2408c74977 {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 10:21:18 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-261889e5-46a8-4a99-8d1d-35182ef988c8 tempest-VolumesSnapshotListTestJSON-286994546 None] snapshot_file for this snap is: volume-6cd7fd53-423f-4534-9925-6d2408c74977.e76624f4-9bcc-4e76-b6be-114af48e731c {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 10:21:18 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[a74d31f8-d0ee-4b51-9e36-cd257c0d3f46]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:21:18 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-261889e5-46a8-4a99-8d1d-35182ef988c8 tempest-VolumesSnapshotListTestJSON-286994546 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6cd7fd53-423f-4534-9925-6d2408c74977.e76624f4-9bcc-4e76-b6be-114af48e731c {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:21:18 devstack sudo[97697]: pam_unix(sudo:session): session closed for user root Nov 04 10:21:18 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ce77b3ce-dbd3-41ec-8f9a-2483ece157c3 tempest-VolumesTestJSON-57329144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.314s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:21:18 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-ce77b3ce-dbd3-41ec-8f9a-2483ece157c3 tempest-VolumesTestJSON-57329144 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:21:18 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-ce77b3ce-dbd3-41ec-8f9a-2483ece157c3 tempest-VolumesTestJSON-57329144 None] Deleted volume successfully. Nov 04 10:21:18 devstack sudo[97699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6cd7fd53-423f-4534-9925-6d2408c74977.e76624f4-9bcc-4e76-b6be-114af48e731c Nov 04 10:21:18 devstack sudo[97699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:21:18 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-ce77b3ce-dbd3-41ec-8f9a-2483ece157c3 tempest-VolumesTestJSON-57329144 None] Lock "cinder-5268e4af-d9f6-467e-897c-933b9dcb32c9-delete_volume" released by "delete_volume" :: held 1.720s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:21:19 devstack sudo[97699]: pam_unix(sudo:session): session closed for user root Nov 04 10:21:19 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-261889e5-46a8-4a99-8d1d-35182ef988c8 tempest-VolumesSnapshotListTestJSON-286994546 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6cd7fd53-423f-4534-9925-6d2408c74977.e76624f4-9bcc-4e76-b6be-114af48e731c" returned: 0 in 0.474s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:21:19 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-261889e5-46a8-4a99-8d1d-35182ef988c8 tempest-VolumesSnapshotListTestJSON-286994546 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6cd7fd53-423f-4534-9925-6d2408c74977(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87068) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 10:21:19 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[863d19b1-684e-49a2-8317-6a5931879d97]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:21:19 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-261889e5-46a8-4a99-8d1d-35182ef988c8 tempest-VolumesSnapshotListTestJSON-286994546 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6cd7fd53-423f-4534-9925-6d2408c74977 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:21:19 devstack sudo[97705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6cd7fd53-423f-4534-9925-6d2408c74977 Nov 04 10:21:19 devstack sudo[97705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:21:19 devstack sudo[97705]: pam_unix(sudo:session): session closed for user root Nov 04 10:21:19 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-261889e5-46a8-4a99-8d1d-35182ef988c8 tempest-VolumesSnapshotListTestJSON-286994546 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6cd7fd53-423f-4534-9925-6d2408c74977" returned: 0 in 0.534s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:21:19 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-261889e5-46a8-4a99-8d1d-35182ef988c8 tempest-VolumesSnapshotListTestJSON-286994546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6cd7fd53-423f-4534-9925-6d2408c74977.e76624f4-9bcc-4e76-b6be-114af48e731c {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:21:19 devstack sudo[97710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6cd7fd53-423f-4534-9925-6d2408c74977.e76624f4-9bcc-4e76-b6be-114af48e731c Nov 04 10:21:19 devstack sudo[97710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:21:20 devstack sudo[97710]: pam_unix(sudo:session): session closed for user root Nov 04 10:21:20 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-261889e5-46a8-4a99-8d1d-35182ef988c8 tempest-VolumesSnapshotListTestJSON-286994546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6cd7fd53-423f-4534-9925-6d2408c74977.e76624f4-9bcc-4e76-b6be-114af48e731c" returned: 0 in 0.527s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:21:20 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-261889e5-46a8-4a99-8d1d-35182ef988c8 tempest-VolumesSnapshotListTestJSON-286994546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6cd7fd53-423f-4534-9925-6d2408c74977.e76624f4-9bcc-4e76-b6be-114af48e731c {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:21:20 devstack sudo[97715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6cd7fd53-423f-4534-9925-6d2408c74977.e76624f4-9bcc-4e76-b6be-114af48e731c Nov 04 10:21:20 devstack sudo[97715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:21:20 devstack sudo[97715]: pam_unix(sudo:session): session closed for user root Nov 04 10:21:20 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-261889e5-46a8-4a99-8d1d-35182ef988c8 tempest-VolumesSnapshotListTestJSON-286994546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6cd7fd53-423f-4534-9925-6d2408c74977.e76624f4-9bcc-4e76-b6be-114af48e731c" returned: 0 in 0.274s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:21:20 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-261889e5-46a8-4a99-8d1d-35182ef988c8 tempest-VolumesSnapshotListTestJSON-286994546 None] Lock "cinder-quobyte-e76624f4-9bcc-4e76-b6be-114af48e731c" released by "_delete_snapshot" :: held 2.002s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:21:20 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-261889e5-46a8-4a99-8d1d-35182ef988c8 tempest-VolumesSnapshotListTestJSON-286994546 None] Lock "cinder-quobyte-6cd7fd53-423f-4534-9925-6d2408c74977" released by "delete_snapshot" :: held 2.041s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:21:20 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-261889e5-46a8-4a99-8d1d-35182ef988c8 tempest-VolumesSnapshotListTestJSON-286994546 None] Created reservations ['bbfc477b-0066-411c-886a-2a39977d7145', '9b456f00-dccb-4e79-ab83-7a4cd767a4eb', 'a6656599-de61-4325-80e1-63de88bb270d', '2f6674ee-601b-4b35-b6b7-47b81f52e3c6'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:21:20 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-261889e5-46a8-4a99-8d1d-35182ef988c8 tempest-VolumesSnapshotListTestJSON-286994546 None] Delete snapshot completed successfully. Nov 04 10:21:20 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-261889e5-46a8-4a99-8d1d-35182ef988c8 tempest-VolumesSnapshotListTestJSON-286994546 None] Lock "cinder-e76624f4-9bcc-4e76-b6be-114af48e731c-delete_snapshot" released by "delete_snapshot" :: held 2.251s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:21:21 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-b73e58d5-82b4-4041-8e1c-0a3e261d7c3e tempest-VolumesSnapshotListTestJSON-286994546 None] Acquiring lock "cinder-6cd7fd53-423f-4534-9925-6d2408c74977-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:21:21 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-b73e58d5-82b4-4041-8e1c-0a3e261d7c3e tempest-VolumesSnapshotListTestJSON-286994546 None] Lock "cinder-6cd7fd53-423f-4534-9925-6d2408c74977-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:21:21 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-b73e58d5-82b4-4041-8e1c-0a3e261d7c3e tempest-VolumesSnapshotListTestJSON-286994546 None] Acquiring lock "cinder-quobyte-6cd7fd53-423f-4534-9925-6d2408c74977" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:21:22 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-b73e58d5-82b4-4041-8e1c-0a3e261d7c3e tempest-VolumesSnapshotListTestJSON-286994546 None] Lock "cinder-quobyte-6cd7fd53-423f-4534-9925-6d2408c74977" acquired by "delete_volume" :: waited 0.031s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:21:22 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd9ee176-285f-4848-8a23-302926eb3bc5]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:21:22 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-b73e58d5-82b4-4041-8e1c-0a3e261d7c3e tempest-VolumesSnapshotListTestJSON-286994546 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6cd7fd53-423f-4534-9925-6d2408c74977 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:21:22 devstack sudo[97719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6cd7fd53-423f-4534-9925-6d2408c74977 Nov 04 10:21:22 devstack sudo[97719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:21:22 devstack sudo[97719]: pam_unix(sudo:session): session closed for user root Nov 04 10:21:22 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-b73e58d5-82b4-4041-8e1c-0a3e261d7c3e tempest-VolumesSnapshotListTestJSON-286994546 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6cd7fd53-423f-4534-9925-6d2408c74977" returned: 0 in 0.484s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:21:22 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-b73e58d5-82b4-4041-8e1c-0a3e261d7c3e tempest-VolumesSnapshotListTestJSON-286994546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6cd7fd53-423f-4534-9925-6d2408c74977 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:21:22 devstack sudo[97725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6cd7fd53-423f-4534-9925-6d2408c74977 Nov 04 10:21:22 devstack sudo[97725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:21:23 devstack sudo[97725]: pam_unix(sudo:session): session closed for user root Nov 04 10:21:23 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-b73e58d5-82b4-4041-8e1c-0a3e261d7c3e tempest-VolumesSnapshotListTestJSON-286994546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6cd7fd53-423f-4534-9925-6d2408c74977" returned: 0 in 0.731s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:21:23 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-b73e58d5-82b4-4041-8e1c-0a3e261d7c3e tempest-VolumesSnapshotListTestJSON-286994546 None] Lock "cinder-quobyte-6cd7fd53-423f-4534-9925-6d2408c74977" released by "delete_volume" :: held 1.342s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:21:23 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-b73e58d5-82b4-4041-8e1c-0a3e261d7c3e tempest-VolumesSnapshotListTestJSON-286994546 None] Created reservations ['bcee2e3d-a2c6-4ed4-9673-fa936bf1e5b4', '6f33a071-b4c9-4b4d-8b6c-fd58098dde3e', '61150bd6-54ba-4257-9520-dd9ca6b75e5a', 'ed67c83f-7a44-4149-ad84-115f8b6bd9e8'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:21:23 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-b73e58d5-82b4-4041-8e1c-0a3e261d7c3e tempest-VolumesSnapshotListTestJSON-286994546 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:21:23 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-b73e58d5-82b4-4041-8e1c-0a3e261d7c3e tempest-VolumesSnapshotListTestJSON-286994546 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:21:23 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-b73e58d5-82b4-4041-8e1c-0a3e261d7c3e tempest-VolumesSnapshotListTestJSON-286994546 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:21:23 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-b73e58d5-82b4-4041-8e1c-0a3e261d7c3e tempest-VolumesSnapshotListTestJSON-286994546 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:21:23 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-b73e58d5-82b4-4041-8e1c-0a3e261d7c3e tempest-VolumesSnapshotListTestJSON-286994546 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:21:23 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-b73e58d5-82b4-4041-8e1c-0a3e261d7c3e tempest-VolumesSnapshotListTestJSON-286994546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:21:23 devstack sudo[97779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:21:23 devstack sudo[97779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:21:24 devstack sudo[97779]: pam_unix(sudo:session): session closed for user root Nov 04 10:21:24 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-b73e58d5-82b4-4041-8e1c-0a3e261d7c3e tempest-VolumesSnapshotListTestJSON-286994546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.509s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:21:24 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-b73e58d5-82b4-4041-8e1c-0a3e261d7c3e tempest-VolumesSnapshotListTestJSON-286994546 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:21:24 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-b73e58d5-82b4-4041-8e1c-0a3e261d7c3e tempest-VolumesSnapshotListTestJSON-286994546 None] Deleted volume successfully. Nov 04 10:21:24 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-b73e58d5-82b4-4041-8e1c-0a3e261d7c3e tempest-VolumesSnapshotListTestJSON-286994546 None] Lock "cinder-6cd7fd53-423f-4534-9925-6d2408c74977-delete_volume" released by "delete_volume" :: held 2.359s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:21:28 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-a916b2f2-d195-4cce-9679-0308128aae0a tempest-GroupSnapshotsV319Test-926066498 None] Group tempest-GroupSnapshotsV319Test-Group-1382524726: creating Nov 04 10:21:28 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-a916b2f2-d195-4cce-9679-0308128aae0a tempest-GroupSnapshotsV319Test-926066498 None] Group tempest-GroupSnapshotsV319Test-Group-1382524726: created successfully Nov 04 10:21:28 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-a916b2f2-d195-4cce-9679-0308128aae0a tempest-GroupSnapshotsV319Test-926066498 None] Create group completed successfully. Nov 04 10:21:29 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-2762089b-a69c-44df-96c2-df92f113f83b tempest-GroupSnapshotsV319Test-926066498 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:21:29 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-2762089b-a69c-44df-96c2-df92f113f83b tempest-GroupSnapshotsV319Test-926066498 None] Flow 'volume_create_manager' (d5de0ace-1cae-415a-8121-37a81a4dac3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:21:30 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-2762089b-a69c-44df-96c2-df92f113f83b tempest-GroupSnapshotsV319Test-926066498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (292a7a09-7c45-4594-ac0b-5d57b446d64f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:21:30 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-2762089b-a69c-44df-96c2-df92f113f83b tempest-GroupSnapshotsV319Test-926066498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (292a7a09-7c45-4594-ac0b-5d57b446d64f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:21:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-76256244',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=06167a5c-5216-42d3-aa94-98d9393d9c7b,host='devstack@QuobyteHD#QuobyteHD',id=907c5d38-2e06-4d7a-a5f4-647e20b6d0ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e86b5040b854becafbf818b5b2589e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:21:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:21:30Z,use_quota=True,user_id='5ae49d65c08b464e899a4459ecbd7e2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cf8cbe2c-9fb3-4dc3-84d9-9b7916d4e4ed),volume_type_id=cf8cbe2c-9fb3-4dc3-84d9-9b7916d4e4ed)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:21:30 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-2762089b-a69c-44df-96c2-df92f113f83b tempest-GroupSnapshotsV319Test-926066498 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a151af68-736d-4f1a-b2b1-2341f5742e6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:21:30 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-2762089b-a69c-44df-96c2-df92f113f83b tempest-GroupSnapshotsV319Test-926066498 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a151af68-736d-4f1a-b2b1-2341f5742e6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:21:30 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-2762089b-a69c-44df-96c2-df92f113f83b tempest-GroupSnapshotsV319Test-926066498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8646be3-fb63-450e-a62e-4fe240c6be8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:21:30 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-2762089b-a69c-44df-96c2-df92f113f83b tempest-GroupSnapshotsV319Test-926066498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8646be3-fb63-450e-a62e-4fe240c6be8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '907c5d38-2e06-4d7a-a5f4-647e20b6d0ae', 'volume_name': 'volume-907c5d38-2e06-4d7a-a5f4-647e20b6d0ae', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:21:30 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-2762089b-a69c-44df-96c2-df92f113f83b tempest-GroupSnapshotsV319Test-926066498 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46c78135-8906-4182-8681-423998231188) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:21:30 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-2762089b-a69c-44df-96c2-df92f113f83b tempest-GroupSnapshotsV319Test-926066498 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46c78135-8906-4182-8681-423998231188) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:21:30 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-2762089b-a69c-44df-96c2-df92f113f83b tempest-GroupSnapshotsV319Test-926066498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a707a364-76f4-47fd-a5ee-f0dc7f9f4900) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:21:30 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-2762089b-a69c-44df-96c2-df92f113f83b tempest-GroupSnapshotsV319Test-926066498 None] Volume 907c5d38-2e06-4d7a-a5f4-647e20b6d0ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-907c5d38-2e06-4d7a-a5f4-647e20b6d0ae', 'volume_size': 1} Nov 04 10:21:30 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-2762089b-a69c-44df-96c2-df92f113f83b tempest-GroupSnapshotsV319Test-926066498 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:21:30 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-2762089b-a69c-44df-96c2-df92f113f83b tempest-GroupSnapshotsV319Test-926066498 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:21:30 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-2762089b-a69c-44df-96c2-df92f113f83b tempest-GroupSnapshotsV319Test-926066498 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=06167a5c-5216-42d3-aa94-98d9393d9c7b,created_at=2026-11-04T09:21:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-76256244',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=06167a5c-5216-42d3-aa94-98d9393d9c7b,host='devstack@QuobyteHD#QuobyteHD',id=907c5d38-2e06-4d7a-a5f4-647e20b6d0ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e86b5040b854becafbf818b5b2589e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:21:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:21:30Z,use_quota=True,user_id='5ae49d65c08b464e899a4459ecbd7e2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cf8cbe2c-9fb3-4dc3-84d9-9b7916d4e4ed),volume_type_id=cf8cbe2c-9fb3-4dc3-84d9-9b7916d4e4ed)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 10:21:30 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-2762089b-a69c-44df-96c2-df92f113f83b tempest-GroupSnapshotsV319Test-926066498 None] Creating volume 907c5d38-2e06-4d7a-a5f4-647e20b6d0ae {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:21:30 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-2762089b-a69c-44df-96c2-df92f113f83b tempest-GroupSnapshotsV319Test-926066498 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:21:30 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-2762089b-a69c-44df-96c2-df92f113f83b tempest-GroupSnapshotsV319Test-926066498 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:21:30 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-2762089b-a69c-44df-96c2-df92f113f83b tempest-GroupSnapshotsV319Test-926066498 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:21:30 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-2762089b-a69c-44df-96c2-df92f113f83b tempest-GroupSnapshotsV319Test-926066498 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:21:30 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-2762089b-a69c-44df-96c2-df92f113f83b tempest-GroupSnapshotsV319Test-926066498 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:21:30 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-2762089b-a69c-44df-96c2-df92f113f83b tempest-GroupSnapshotsV319Test-926066498 None] Selected osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:21:30 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-2762089b-a69c-44df-96c2-df92f113f83b tempest-GroupSnapshotsV319Test-926066498 None] casted to osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 Nov 04 10:21:30 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-2762089b-a69c-44df-96c2-df92f113f83b tempest-GroupSnapshotsV319Test-926066498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-907c5d38-2e06-4d7a-a5f4-647e20b6d0ae 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:21:30 devstack sudo[97823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-907c5d38-2e06-4d7a-a5f4-647e20b6d0ae 1073741824 Nov 04 10:21:30 devstack sudo[97823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:21:30 devstack sudo[97823]: pam_unix(sudo:session): session closed for user root Nov 04 10:21:30 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-2762089b-a69c-44df-96c2-df92f113f83b tempest-GroupSnapshotsV319Test-926066498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-907c5d38-2e06-4d7a-a5f4-647e20b6d0ae 1073741824" returned: 0 in 0.541s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:21:30 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-2762089b-a69c-44df-96c2-df92f113f83b tempest-GroupSnapshotsV319Test-926066498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-907c5d38-2e06-4d7a-a5f4-647e20b6d0ae {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:21:30 devstack sudo[97830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-907c5d38-2e06-4d7a-a5f4-647e20b6d0ae Nov 04 10:21:30 devstack sudo[97830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:21:30 devstack sudo[97830]: pam_unix(sudo:session): session closed for user root Nov 04 10:21:30 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-2762089b-a69c-44df-96c2-df92f113f83b tempest-GroupSnapshotsV319Test-926066498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-907c5d38-2e06-4d7a-a5f4-647e20b6d0ae" returned: 0 in 0.288s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:21:30 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-2762089b-a69c-44df-96c2-df92f113f83b tempest-GroupSnapshotsV319Test-926066498 None] <== create_volume: return (885ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 10:21:30 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-2762089b-a69c-44df-96c2-df92f113f83b tempest-GroupSnapshotsV319Test-926066498 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.888s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:21:30 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-2762089b-a69c-44df-96c2-df92f113f83b tempest-GroupSnapshotsV319Test-926066498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a707a364-76f4-47fd-a5ee-f0dc7f9f4900) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-907c5d38-2e06-4d7a-a5f4-647e20b6d0ae', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:21:30 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-2762089b-a69c-44df-96c2-df92f113f83b tempest-GroupSnapshotsV319Test-926066498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f47540b6-168c-4dfd-acf7-a897c0b6a968) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:21:31 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-2762089b-a69c-44df-96c2-df92f113f83b tempest-GroupSnapshotsV319Test-926066498 None] Volume volume-907c5d38-2e06-4d7a-a5f4-647e20b6d0ae (907c5d38-2e06-4d7a-a5f4-647e20b6d0ae): created successfully Nov 04 10:21:31 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-2762089b-a69c-44df-96c2-df92f113f83b tempest-GroupSnapshotsV319Test-926066498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f47540b6-168c-4dfd-acf7-a897c0b6a968) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:21:31 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-2762089b-a69c-44df-96c2-df92f113f83b tempest-GroupSnapshotsV319Test-926066498 None] Flow 'volume_create_manager' (d5de0ace-1cae-415a-8121-37a81a4dac3b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:21:31 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-2762089b-a69c-44df-96c2-df92f113f83b tempest-GroupSnapshotsV319Test-926066498 None] Created volume successfully. Nov 04 10:21:31 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-44927467-1025-44c5-a8e7-8f88f029cb4a tempest-GroupSnapshotsV319Test-926066498 None] GroupSnapshot 1cc5125e-268b-4cb7-aff0-1399b817b6fe: creating. Nov 04 10:21:31 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-44927467-1025-44c5-a8e7-8f88f029cb4a tempest-GroupSnapshotsV319Test-926066498 None] Group snapshot 1cc5125e-268b-4cb7-aff0-1399b817b6fe: creating. {{(pid=87068) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 04 10:21:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-44927467-1025-44c5-a8e7-8f88f029cb4a tempest-GroupSnapshotsV319Test-926066498 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:21:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-44927467-1025-44c5-a8e7-8f88f029cb4a tempest-GroupSnapshotsV319Test-926066498 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:21:31 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-44927467-1025-44c5-a8e7-8f88f029cb4a tempest-GroupSnapshotsV319Test-926066498 None] Creating offline snapshot 7beffc41-c6cb-41c2-b174-0bfcc910e580 of volume 907c5d38-2e06-4d7a-a5f4-647e20b6d0ae {{(pid=87068) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 10:21:31 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc0993c6-ea55-469c-8d24-082869eb4a2f]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:21:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-44927467-1025-44c5-a8e7-8f88f029cb4a tempest-GroupSnapshotsV319Test-926066498 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-907c5d38-2e06-4d7a-a5f4-647e20b6d0ae {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:21:32 devstack sudo[97834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-907c5d38-2e06-4d7a-a5f4-647e20b6d0ae Nov 04 10:21:32 devstack sudo[97834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:21:32 devstack sudo[97834]: pam_unix(sudo:session): session closed for user root Nov 04 10:21:32 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-44927467-1025-44c5-a8e7-8f88f029cb4a tempest-GroupSnapshotsV319Test-926066498 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-907c5d38-2e06-4d7a-a5f4-647e20b6d0ae" returned: 0 in 0.453s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:21:32 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-44927467-1025-44c5-a8e7-8f88f029cb4a tempest-GroupSnapshotsV319Test-926066498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-907c5d38-2e06-4d7a-a5f4-647e20b6d0ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-907c5d38-2e06-4d7a-a5f4-647e20b6d0ae.7beffc41-c6cb-41c2-b174-0bfcc910e580 1G {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:21:32 devstack sudo[97839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-907c5d38-2e06-4d7a-a5f4-647e20b6d0ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-907c5d38-2e06-4d7a-a5f4-647e20b6d0ae.7beffc41-c6cb-41c2-b174-0bfcc910e580 1G Nov 04 10:21:32 devstack sudo[97839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:21:32 devstack sudo[97839]: pam_unix(sudo:session): session closed for user root Nov 04 10:21:32 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-44927467-1025-44c5-a8e7-8f88f029cb4a tempest-GroupSnapshotsV319Test-926066498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-907c5d38-2e06-4d7a-a5f4-647e20b6d0ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-907c5d38-2e06-4d7a-a5f4-647e20b6d0ae.7beffc41-c6cb-41c2-b174-0bfcc910e580 1G" returned: 0 in 0.496s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:21:32 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-44927467-1025-44c5-a8e7-8f88f029cb4a tempest-GroupSnapshotsV319Test-926066498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-907c5d38-2e06-4d7a-a5f4-647e20b6d0ae -F qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-907c5d38-2e06-4d7a-a5f4-647e20b6d0ae.7beffc41-c6cb-41c2-b174-0bfcc910e580 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:21:32 devstack sudo[97846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-907c5d38-2e06-4d7a-a5f4-647e20b6d0ae -F qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-907c5d38-2e06-4d7a-a5f4-647e20b6d0ae.7beffc41-c6cb-41c2-b174-0bfcc910e580 Nov 04 10:21:32 devstack sudo[97846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:21:33 devstack sudo[97846]: pam_unix(sudo:session): session closed for user root Nov 04 10:21:33 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-44927467-1025-44c5-a8e7-8f88f029cb4a tempest-GroupSnapshotsV319Test-926066498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-907c5d38-2e06-4d7a-a5f4-647e20b6d0ae -F qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-907c5d38-2e06-4d7a-a5f4-647e20b6d0ae.7beffc41-c6cb-41c2-b174-0bfcc910e580" returned: 0 in 0.392s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:21:33 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-44927467-1025-44c5-a8e7-8f88f029cb4a tempest-GroupSnapshotsV319Test-926066498 None] /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-907c5d38-2e06-4d7a-a5f4-647e20b6d0ae.7beffc41-c6cb-41c2-b174-0bfcc910e580 is being set with open permissions: ugo+rw: NotImplementedError Nov 04 10:21:33 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-44927467-1025-44c5-a8e7-8f88f029cb4a tempest-GroupSnapshotsV319Test-926066498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-907c5d38-2e06-4d7a-a5f4-647e20b6d0ae.7beffc41-c6cb-41c2-b174-0bfcc910e580 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:21:33 devstack sudo[97851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-907c5d38-2e06-4d7a-a5f4-647e20b6d0ae.7beffc41-c6cb-41c2-b174-0bfcc910e580 Nov 04 10:21:33 devstack sudo[97851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:21:33 devstack sudo[97851]: pam_unix(sudo:session): session closed for user root Nov 04 10:21:33 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-44927467-1025-44c5-a8e7-8f88f029cb4a tempest-GroupSnapshotsV319Test-926066498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-907c5d38-2e06-4d7a-a5f4-647e20b6d0ae.7beffc41-c6cb-41c2-b174-0bfcc910e580" returned: 0 in 0.283s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:21:33 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-44927467-1025-44c5-a8e7-8f88f029cb4a tempest-GroupSnapshotsV319Test-926066498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-907c5d38-2e06-4d7a-a5f4-647e20b6d0ae.info {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:21:33 devstack sudo[97854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-907c5d38-2e06-4d7a-a5f4-647e20b6d0ae.info Nov 04 10:21:33 devstack sudo[97854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:21:33 devstack sudo[97854]: pam_unix(sudo:session): session closed for user root Nov 04 10:21:33 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-44927467-1025-44c5-a8e7-8f88f029cb4a tempest-GroupSnapshotsV319Test-926066498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-907c5d38-2e06-4d7a-a5f4-647e20b6d0ae.info" returned: 0 in 0.285s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:21:33 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-44927467-1025-44c5-a8e7-8f88f029cb4a tempest-GroupSnapshotsV319Test-926066498 None] /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-907c5d38-2e06-4d7a-a5f4-647e20b6d0ae.info is being set with open permissions: ugo+rw: NotImplementedError Nov 04 10:21:33 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-44927467-1025-44c5-a8e7-8f88f029cb4a tempest-GroupSnapshotsV319Test-926066498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-907c5d38-2e06-4d7a-a5f4-647e20b6d0ae.info {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:21:33 devstack sudo[97857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-907c5d38-2e06-4d7a-a5f4-647e20b6d0ae.info Nov 04 10:21:33 devstack sudo[97857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:21:34 devstack sudo[97857]: pam_unix(sudo:session): session closed for user root Nov 04 10:21:34 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-44927467-1025-44c5-a8e7-8f88f029cb4a tempest-GroupSnapshotsV319Test-926066498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-907c5d38-2e06-4d7a-a5f4-647e20b6d0ae.info" returned: 0 in 0.308s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:21:34 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-44927467-1025-44c5-a8e7-8f88f029cb4a tempest-GroupSnapshotsV319Test-926066498 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.347s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:21:34 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-44927467-1025-44c5-a8e7-8f88f029cb4a tempest-GroupSnapshotsV319Test-926066498 None] group_snapshot 1cc5125e-268b-4cb7-aff0-1399b817b6fe: created successfully Nov 04 10:21:35 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-12206a0f-6f9a-42ad-bb11-f38db6c00c41 tempest-GroupSnapshotsV319Test-926066498 None] group_snapshot 1cc5125e-268b-4cb7-aff0-1399b817b6fe: deleting Nov 04 10:21:35 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-12206a0f-6f9a-42ad-bb11-f38db6c00c41 tempest-GroupSnapshotsV319Test-926066498 None] group_snapshot 1cc5125e-268b-4cb7-aff0-1399b817b6fe: deleting {{(pid=87068) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 04 10:21:35 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-12206a0f-6f9a-42ad-bb11-f38db6c00c41 tempest-GroupSnapshotsV319Test-926066498 None] Acquiring lock "cinder-quobyte-907c5d38-2e06-4d7a-a5f4-647e20b6d0ae" by "delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:21:36 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-12206a0f-6f9a-42ad-bb11-f38db6c00c41 tempest-GroupSnapshotsV319Test-926066498 None] Lock "cinder-quobyte-907c5d38-2e06-4d7a-a5f4-647e20b6d0ae" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:21:36 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-12206a0f-6f9a-42ad-bb11-f38db6c00c41 tempest-GroupSnapshotsV319Test-926066498 None] Acquiring lock "cinder-quobyte-7beffc41-c6cb-41c2-b174-0bfcc910e580" by "_delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:21:36 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-12206a0f-6f9a-42ad-bb11-f38db6c00c41 tempest-GroupSnapshotsV319Test-926066498 None] Lock "cinder-quobyte-7beffc41-c6cb-41c2-b174-0bfcc910e580" acquired by "_delete_snapshot" :: waited 0.039s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:21:36 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-12206a0f-6f9a-42ad-bb11-f38db6c00c41 tempest-GroupSnapshotsV319Test-926066498 None] Deleting offline snapshot 7beffc41-c6cb-41c2-b174-0bfcc910e580 of volume 907c5d38-2e06-4d7a-a5f4-647e20b6d0ae {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 10:21:36 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-12206a0f-6f9a-42ad-bb11-f38db6c00c41 tempest-GroupSnapshotsV319Test-926066498 None] snapshot_file for this snap is: volume-907c5d38-2e06-4d7a-a5f4-647e20b6d0ae.7beffc41-c6cb-41c2-b174-0bfcc910e580 {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 10:21:36 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[004717f1-5b79-407b-86b0-839397d1e09b]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:21:36 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-12206a0f-6f9a-42ad-bb11-f38db6c00c41 tempest-GroupSnapshotsV319Test-926066498 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-907c5d38-2e06-4d7a-a5f4-647e20b6d0ae.7beffc41-c6cb-41c2-b174-0bfcc910e580 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:21:36 devstack sudo[97860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-907c5d38-2e06-4d7a-a5f4-647e20b6d0ae.7beffc41-c6cb-41c2-b174-0bfcc910e580 Nov 04 10:21:36 devstack sudo[97860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:21:36 devstack sudo[97860]: pam_unix(sudo:session): session closed for user root Nov 04 10:21:36 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-12206a0f-6f9a-42ad-bb11-f38db6c00c41 tempest-GroupSnapshotsV319Test-926066498 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-907c5d38-2e06-4d7a-a5f4-647e20b6d0ae.7beffc41-c6cb-41c2-b174-0bfcc910e580" returned: 0 in 0.484s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:21:36 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-12206a0f-6f9a-42ad-bb11-f38db6c00c41 tempest-GroupSnapshotsV319Test-926066498 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-907c5d38-2e06-4d7a-a5f4-647e20b6d0ae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87068) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 10:21:36 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd994a10-0cae-429a-852d-e738d1c33dc6]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:21:36 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-12206a0f-6f9a-42ad-bb11-f38db6c00c41 tempest-GroupSnapshotsV319Test-926066498 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-907c5d38-2e06-4d7a-a5f4-647e20b6d0ae {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:21:36 devstack sudo[97866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-907c5d38-2e06-4d7a-a5f4-647e20b6d0ae Nov 04 10:21:36 devstack sudo[97866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:21:37 devstack sudo[97866]: pam_unix(sudo:session): session closed for user root Nov 04 10:21:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-12206a0f-6f9a-42ad-bb11-f38db6c00c41 tempest-GroupSnapshotsV319Test-926066498 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-907c5d38-2e06-4d7a-a5f4-647e20b6d0ae" returned: 0 in 0.566s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:21:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-12206a0f-6f9a-42ad-bb11-f38db6c00c41 tempest-GroupSnapshotsV319Test-926066498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-907c5d38-2e06-4d7a-a5f4-647e20b6d0ae.7beffc41-c6cb-41c2-b174-0bfcc910e580 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:21:37 devstack sudo[97871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-907c5d38-2e06-4d7a-a5f4-647e20b6d0ae.7beffc41-c6cb-41c2-b174-0bfcc910e580 Nov 04 10:21:37 devstack sudo[97871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:21:37 devstack sudo[97871]: pam_unix(sudo:session): session closed for user root Nov 04 10:21:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-12206a0f-6f9a-42ad-bb11-f38db6c00c41 tempest-GroupSnapshotsV319Test-926066498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-907c5d38-2e06-4d7a-a5f4-647e20b6d0ae.7beffc41-c6cb-41c2-b174-0bfcc910e580" returned: 0 in 0.603s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:21:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-12206a0f-6f9a-42ad-bb11-f38db6c00c41 tempest-GroupSnapshotsV319Test-926066498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-907c5d38-2e06-4d7a-a5f4-647e20b6d0ae.7beffc41-c6cb-41c2-b174-0bfcc910e580 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:21:37 devstack sudo[97878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-907c5d38-2e06-4d7a-a5f4-647e20b6d0ae.7beffc41-c6cb-41c2-b174-0bfcc910e580 Nov 04 10:21:37 devstack sudo[97878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:21:38 devstack sudo[97878]: pam_unix(sudo:session): session closed for user root Nov 04 10:21:38 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-12206a0f-6f9a-42ad-bb11-f38db6c00c41 tempest-GroupSnapshotsV319Test-926066498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-907c5d38-2e06-4d7a-a5f4-647e20b6d0ae.7beffc41-c6cb-41c2-b174-0bfcc910e580" returned: 0 in 0.472s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:21:38 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-12206a0f-6f9a-42ad-bb11-f38db6c00c41 tempest-GroupSnapshotsV319Test-926066498 None] Lock "cinder-quobyte-7beffc41-c6cb-41c2-b174-0bfcc910e580" released by "_delete_snapshot" :: held 2.301s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:21:38 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-12206a0f-6f9a-42ad-bb11-f38db6c00c41 tempest-GroupSnapshotsV319Test-926066498 None] Lock "cinder-quobyte-907c5d38-2e06-4d7a-a5f4-647e20b6d0ae" released by "delete_snapshot" :: held 2.349s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:21:38 devstack cinder-volume[87068]: WARNING cinder.quota [None req-12206a0f-6f9a-42ad-bb11-f38db6c00c41 tempest-GroupSnapshotsV319Test-926066498 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-626929788 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-626929788, it is now deprecated. Please use the default quota class for default quota. Nov 04 10:21:38 devstack cinder-volume[87068]: WARNING cinder.quota [None req-12206a0f-6f9a-42ad-bb11-f38db6c00c41 tempest-GroupSnapshotsV319Test-926066498 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-626929788 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-626929788, it is now deprecated. Please use the default quota class for default quota. Nov 04 10:21:38 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-12206a0f-6f9a-42ad-bb11-f38db6c00c41 tempest-GroupSnapshotsV319Test-926066498 None] Created reservations ['7d8977de-155b-4624-af18-badf90c0219a', '4cbbabe7-f444-4ffc-837c-0b23b9dbe37b', 'c54079d7-9473-45ff-ad00-ab19d3b169fc', 'fecc92b0-a4eb-4b71-bb64-c1f586d6f78d'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:21:38 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-12206a0f-6f9a-42ad-bb11-f38db6c00c41 tempest-GroupSnapshotsV319Test-926066498 None] group_snapshot 1cc5125e-268b-4cb7-aff0-1399b817b6fe: deleted successfully Nov 04 10:21:39 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-cdd4d953-b6b7-4d55-b98f-ca5c7b3b9451 tempest-GroupSnapshotsV319Test-926066498 None] Acquiring lock "cinder-quobyte-907c5d38-2e06-4d7a-a5f4-647e20b6d0ae" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:21:39 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-cdd4d953-b6b7-4d55-b98f-ca5c7b3b9451 tempest-GroupSnapshotsV319Test-926066498 None] Lock "cinder-quobyte-907c5d38-2e06-4d7a-a5f4-647e20b6d0ae" acquired by "delete_volume" :: waited 0.020s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:21:39 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4b82266-cb58-4a3d-9021-288259c0da69]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:21:39 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-cdd4d953-b6b7-4d55-b98f-ca5c7b3b9451 tempest-GroupSnapshotsV319Test-926066498 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-907c5d38-2e06-4d7a-a5f4-647e20b6d0ae {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:21:40 devstack sudo[97882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-907c5d38-2e06-4d7a-a5f4-647e20b6d0ae Nov 04 10:21:40 devstack sudo[97882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:21:40 devstack sudo[97882]: pam_unix(sudo:session): session closed for user root Nov 04 10:21:40 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-cdd4d953-b6b7-4d55-b98f-ca5c7b3b9451 tempest-GroupSnapshotsV319Test-926066498 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-907c5d38-2e06-4d7a-a5f4-647e20b6d0ae" returned: 0 in 0.489s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:21:40 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-cdd4d953-b6b7-4d55-b98f-ca5c7b3b9451 tempest-GroupSnapshotsV319Test-926066498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-907c5d38-2e06-4d7a-a5f4-647e20b6d0ae {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:21:40 devstack sudo[97887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-907c5d38-2e06-4d7a-a5f4-647e20b6d0ae Nov 04 10:21:40 devstack sudo[97887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:21:40 devstack sudo[97887]: pam_unix(sudo:session): session closed for user root Nov 04 10:21:40 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-cdd4d953-b6b7-4d55-b98f-ca5c7b3b9451 tempest-GroupSnapshotsV319Test-926066498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-907c5d38-2e06-4d7a-a5f4-647e20b6d0ae" returned: 0 in 0.357s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:21:40 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-cdd4d953-b6b7-4d55-b98f-ca5c7b3b9451 tempest-GroupSnapshotsV319Test-926066498 None] Lock "cinder-quobyte-907c5d38-2e06-4d7a-a5f4-647e20b6d0ae" released by "delete_volume" :: held 0.968s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:21:40 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-cdd4d953-b6b7-4d55-b98f-ca5c7b3b9451 tempest-GroupSnapshotsV319Test-926066498 None] Created reservations ['3599abb4-d47b-4de2-b947-36b940959738'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:21:40 devstack cinder-volume[87068]: WARNING cinder.quota [None req-cdd4d953-b6b7-4d55-b98f-ca5c7b3b9451 tempest-GroupSnapshotsV319Test-926066498 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-626929788 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-626929788, it is now deprecated. Please use the default quota class for default quota. Nov 04 10:21:40 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-cdd4d953-b6b7-4d55-b98f-ca5c7b3b9451 tempest-GroupSnapshotsV319Test-926066498 None] Created reservations ['36d2ad92-c582-4780-9f3d-3a874849590b', '87cd7c3f-e66b-4b47-b073-2216a0f51d98', 'd1e8201c-98f9-4fb2-b614-e76a219310c3', '33d341da-96df-4e5b-896b-2e7731508a4e'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:21:41 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-cdd4d953-b6b7-4d55-b98f-ca5c7b3b9451 tempest-GroupSnapshotsV319Test-926066498 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:21:41 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-cdd4d953-b6b7-4d55-b98f-ca5c7b3b9451 tempest-GroupSnapshotsV319Test-926066498 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:21:41 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-cdd4d953-b6b7-4d55-b98f-ca5c7b3b9451 tempest-GroupSnapshotsV319Test-926066498 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:21:41 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-cdd4d953-b6b7-4d55-b98f-ca5c7b3b9451 tempest-GroupSnapshotsV319Test-926066498 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:21:41 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-cdd4d953-b6b7-4d55-b98f-ca5c7b3b9451 tempest-GroupSnapshotsV319Test-926066498 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:21:41 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-cdd4d953-b6b7-4d55-b98f-ca5c7b3b9451 tempest-GroupSnapshotsV319Test-926066498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:21:41 devstack sudo[97904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:21:41 devstack sudo[97904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:21:41 devstack sudo[97904]: pam_unix(sudo:session): session closed for user root Nov 04 10:21:41 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-cdd4d953-b6b7-4d55-b98f-ca5c7b3b9451 tempest-GroupSnapshotsV319Test-926066498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.460s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:21:41 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-cdd4d953-b6b7-4d55-b98f-ca5c7b3b9451 tempest-GroupSnapshotsV319Test-926066498 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:21:41 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-cdd4d953-b6b7-4d55-b98f-ca5c7b3b9451 tempest-GroupSnapshotsV319Test-926066498 None] Delete group completed successfully. Nov 04 10:21:44 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-7199f60c-8740-407c-99cf-127e15b52fc5 tempest-VolumesNegativeTest-519856752 None] Acquiring lock "cinder-c0720847-3817-45ce-9dc6-1c96e60bdb7f-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:21:44 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-7199f60c-8740-407c-99cf-127e15b52fc5 tempest-VolumesNegativeTest-519856752 None] Lock "cinder-c0720847-3817-45ce-9dc6-1c96e60bdb7f-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:21:44 devstack cinder-volume[87068]: DEBUG dbcounter [-] [87068] Writing DB stats cinder:SELECT=116,cinder:UPDATE=149,cinder:DELETE=12,cinder:INSERT=32 {{(pid=87068) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 10:21:44 devstack cinder-volume[87068]: DEBUG dbcounter [-] [87068] Writing DB stats cinder:SELECT=121,cinder:UPDATE=144,cinder:INSERT=41,cinder:DELETE=10 {{(pid=87068) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 10:21:44 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-7199f60c-8740-407c-99cf-127e15b52fc5 tempest-VolumesNegativeTest-519856752 None] Acquiring lock "cinder-quobyte-c0720847-3817-45ce-9dc6-1c96e60bdb7f" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:21:44 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-7199f60c-8740-407c-99cf-127e15b52fc5 tempest-VolumesNegativeTest-519856752 None] Lock "cinder-quobyte-c0720847-3817-45ce-9dc6-1c96e60bdb7f" acquired by "delete_volume" :: waited 0.022s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:21:44 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[52670b1b-27be-49f8-8bd5-0ba252ebffb7]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:21:44 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7199f60c-8740-407c-99cf-127e15b52fc5 tempest-VolumesNegativeTest-519856752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-c0720847-3817-45ce-9dc6-1c96e60bdb7f {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:21:44 devstack sudo[97932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-c0720847-3817-45ce-9dc6-1c96e60bdb7f Nov 04 10:21:44 devstack sudo[97932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:21:44 devstack sudo[97932]: pam_unix(sudo:session): session closed for user root Nov 04 10:21:44 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7199f60c-8740-407c-99cf-127e15b52fc5 tempest-VolumesNegativeTest-519856752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-c0720847-3817-45ce-9dc6-1c96e60bdb7f" returned: 0 in 0.403s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:21:44 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7199f60c-8740-407c-99cf-127e15b52fc5 tempest-VolumesNegativeTest-519856752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-c0720847-3817-45ce-9dc6-1c96e60bdb7f {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:21:44 devstack sudo[97937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-c0720847-3817-45ce-9dc6-1c96e60bdb7f Nov 04 10:21:44 devstack sudo[97937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:21:45 devstack sudo[97937]: pam_unix(sudo:session): session closed for user root Nov 04 10:21:45 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7199f60c-8740-407c-99cf-127e15b52fc5 tempest-VolumesNegativeTest-519856752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-c0720847-3817-45ce-9dc6-1c96e60bdb7f" returned: 0 in 0.279s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:21:45 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-7199f60c-8740-407c-99cf-127e15b52fc5 tempest-VolumesNegativeTest-519856752 None] Lock "cinder-quobyte-c0720847-3817-45ce-9dc6-1c96e60bdb7f" released by "delete_volume" :: held 0.739s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:21:45 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-7199f60c-8740-407c-99cf-127e15b52fc5 tempest-VolumesNegativeTest-519856752 None] Created reservations ['c07b4e91-b81f-4e1f-82da-89bbe493b0a7', '8d740867-6721-4c94-a954-fb60d68aa113', '99c3e227-7f33-4fad-ab83-ce7880e82245', 'da81895a-8b7e-4156-a7b0-0476401bf480'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:21:45 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-7199f60c-8740-407c-99cf-127e15b52fc5 tempest-VolumesNegativeTest-519856752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:21:45 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-7199f60c-8740-407c-99cf-127e15b52fc5 tempest-VolumesNegativeTest-519856752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:21:45 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-7199f60c-8740-407c-99cf-127e15b52fc5 tempest-VolumesNegativeTest-519856752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:21:45 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-7199f60c-8740-407c-99cf-127e15b52fc5 tempest-VolumesNegativeTest-519856752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:21:45 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-7199f60c-8740-407c-99cf-127e15b52fc5 tempest-VolumesNegativeTest-519856752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:21:45 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7199f60c-8740-407c-99cf-127e15b52fc5 tempest-VolumesNegativeTest-519856752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:21:45 devstack sudo[97940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:21:45 devstack sudo[97940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:21:45 devstack sudo[97940]: pam_unix(sudo:session): session closed for user root Nov 04 10:21:45 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7199f60c-8740-407c-99cf-127e15b52fc5 tempest-VolumesNegativeTest-519856752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.370s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:21:45 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-7199f60c-8740-407c-99cf-127e15b52fc5 tempest-VolumesNegativeTest-519856752 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:21:45 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-7199f60c-8740-407c-99cf-127e15b52fc5 tempest-VolumesNegativeTest-519856752 None] Deleted volume successfully. Nov 04 10:21:45 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-7199f60c-8740-407c-99cf-127e15b52fc5 tempest-VolumesNegativeTest-519856752 None] Lock "cinder-c0720847-3817-45ce-9dc6-1c96e60bdb7f-delete_volume" released by "delete_volume" :: held 1.414s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:21:53 devstack cinder-volume[87068]: DEBUG oslo_service.periodic_task [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87068) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 10:21:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:21:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:21:53 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:21:53 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:21:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:21:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:21:53 devstack sudo[97951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:21:53 devstack sudo[97951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:21:54 devstack sudo[97951]: pam_unix(sudo:session): session closed for user root Nov 04 10:21:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.317s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:21:54 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:21:54 devstack cinder-volume[87068]: DEBUG oslo_service.periodic_task [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Running periodic task VolumeManager._thread_info {{(pid=87068) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 10:21:54 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] thread count: 28 {{(pid=87068) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 04 10:21:54 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] thread info: [<_MainThread(MainThread, started 126275656192128)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87068) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 04 10:21:55 devstack cinder-volume[87068]: DEBUG dbcounter [-] [87068] Writing DB stats cinder:SELECT=5,cinder:INSERT=2,cinder:UPDATE=6 {{(pid=87068) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 10:21:55 devstack cinder-volume[87068]: DEBUG dbcounter [-] [87068] Writing DB stats cinder:SELECT=4,cinder:INSERT=2,cinder:UPDATE=9,cinder:DELETE=1 {{(pid=87068) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 10:22:05 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-be66f0f3-7c70-445a-8358-0740bca8a4f8 tempest-TestServerVolumeAttachmentScenario-2020619854 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:22:05 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-be66f0f3-7c70-445a-8358-0740bca8a4f8 tempest-TestServerVolumeAttachmentScenario-2020619854 None] Flow 'volume_create_manager' (432b5c28-4d1f-449f-a30e-d30f739b5b91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:22:05 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-be66f0f3-7c70-445a-8358-0740bca8a4f8 tempest-TestServerVolumeAttachmentScenario-2020619854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d54f9401-9038-45fe-b6ae-627b74cb0ec7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:22:05 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-be66f0f3-7c70-445a-8358-0740bca8a4f8 tempest-TestServerVolumeAttachmentScenario-2020619854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d54f9401-9038-45fe-b6ae-627b74cb0ec7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:22:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-664712147',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41398b59-eb96-4b87-ab99-f59cb633a7e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4956e6c04b04452e983cbe93532cb994',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:22:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:22:05Z,use_quota=True,user_id='f9cce229899b4c8389308940c2840507',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:22:05 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-be66f0f3-7c70-445a-8358-0740bca8a4f8 tempest-TestServerVolumeAttachmentScenario-2020619854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac39e1d0-eb3f-4e22-8750-b6169390c1eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:22:05 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-be66f0f3-7c70-445a-8358-0740bca8a4f8 tempest-TestServerVolumeAttachmentScenario-2020619854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac39e1d0-eb3f-4e22-8750-b6169390c1eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:22:05 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-be66f0f3-7c70-445a-8358-0740bca8a4f8 tempest-TestServerVolumeAttachmentScenario-2020619854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2b83182-5aaf-469a-a001-1a8360d4c041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:22:05 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-be66f0f3-7c70-445a-8358-0740bca8a4f8 tempest-TestServerVolumeAttachmentScenario-2020619854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2b83182-5aaf-469a-a001-1a8360d4c041) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41398b59-eb96-4b87-ab99-f59cb633a7e3', 'volume_name': 'volume-41398b59-eb96-4b87-ab99-f59cb633a7e3', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:22:05 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-be66f0f3-7c70-445a-8358-0740bca8a4f8 tempest-TestServerVolumeAttachmentScenario-2020619854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2de439f8-33ca-4352-9ea9-ab7c59c53b25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:22:05 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-be66f0f3-7c70-445a-8358-0740bca8a4f8 tempest-TestServerVolumeAttachmentScenario-2020619854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2de439f8-33ca-4352-9ea9-ab7c59c53b25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:22:05 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-be66f0f3-7c70-445a-8358-0740bca8a4f8 tempest-TestServerVolumeAttachmentScenario-2020619854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (060a91ce-8c3d-4fde-8193-45c2a7d7e005) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:22:05 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-be66f0f3-7c70-445a-8358-0740bca8a4f8 tempest-TestServerVolumeAttachmentScenario-2020619854 None] Volume 41398b59-eb96-4b87-ab99-f59cb633a7e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41398b59-eb96-4b87-ab99-f59cb633a7e3', 'volume_size': 1} Nov 04 10:22:05 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-be66f0f3-7c70-445a-8358-0740bca8a4f8 tempest-TestServerVolumeAttachmentScenario-2020619854 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:22:05 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-be66f0f3-7c70-445a-8358-0740bca8a4f8 tempest-TestServerVolumeAttachmentScenario-2020619854 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:22:05 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-be66f0f3-7c70-445a-8358-0740bca8a4f8 tempest-TestServerVolumeAttachmentScenario-2020619854 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:22:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-664712147',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41398b59-eb96-4b87-ab99-f59cb633a7e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4956e6c04b04452e983cbe93532cb994',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:22:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:22:05Z,use_quota=True,user_id='f9cce229899b4c8389308940c2840507',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 10:22:05 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-be66f0f3-7c70-445a-8358-0740bca8a4f8 tempest-TestServerVolumeAttachmentScenario-2020619854 None] Creating volume 41398b59-eb96-4b87-ab99-f59cb633a7e3 {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:22:05 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-be66f0f3-7c70-445a-8358-0740bca8a4f8 tempest-TestServerVolumeAttachmentScenario-2020619854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:22:05 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-be66f0f3-7c70-445a-8358-0740bca8a4f8 tempest-TestServerVolumeAttachmentScenario-2020619854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:22:05 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-be66f0f3-7c70-445a-8358-0740bca8a4f8 tempest-TestServerVolumeAttachmentScenario-2020619854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:22:05 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-be66f0f3-7c70-445a-8358-0740bca8a4f8 tempest-TestServerVolumeAttachmentScenario-2020619854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:22:05 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-be66f0f3-7c70-445a-8358-0740bca8a4f8 tempest-TestServerVolumeAttachmentScenario-2020619854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:22:05 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-be66f0f3-7c70-445a-8358-0740bca8a4f8 tempest-TestServerVolumeAttachmentScenario-2020619854 None] Selected osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:22:05 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-be66f0f3-7c70-445a-8358-0740bca8a4f8 tempest-TestServerVolumeAttachmentScenario-2020619854 None] casted to osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 Nov 04 10:22:05 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-be66f0f3-7c70-445a-8358-0740bca8a4f8 tempest-TestServerVolumeAttachmentScenario-2020619854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-41398b59-eb96-4b87-ab99-f59cb633a7e3 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:22:05 devstack sudo[97960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-41398b59-eb96-4b87-ab99-f59cb633a7e3 1073741824 Nov 04 10:22:05 devstack sudo[97960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:22:05 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-9370d281-4f34-414d-ae5b-80701456cc04 tempest-TestServerVolumeAttachmentScenario-2020619854 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:22:06 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-9370d281-4f34-414d-ae5b-80701456cc04 tempest-TestServerVolumeAttachmentScenario-2020619854 None] Flow 'volume_create_manager' (0f09b956-f478-46b2-9c6d-c2610680f277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:22:06 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-9370d281-4f34-414d-ae5b-80701456cc04 tempest-TestServerVolumeAttachmentScenario-2020619854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fb0aebe-e842-40ef-ae9b-4fcf8ac45c40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:22:06 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-9370d281-4f34-414d-ae5b-80701456cc04 tempest-TestServerVolumeAttachmentScenario-2020619854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fb0aebe-e842-40ef-ae9b-4fcf8ac45c40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:22:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-2074465115',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=290fec35-fe01-4ab8-a87e-becf9d587583,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4956e6c04b04452e983cbe93532cb994',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:22:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:22:06Z,use_quota=True,user_id='f9cce229899b4c8389308940c2840507',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:22:06 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-9370d281-4f34-414d-ae5b-80701456cc04 tempest-TestServerVolumeAttachmentScenario-2020619854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d70a3ea-3253-40bd-9684-6e17f1d464f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:22:06 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-9370d281-4f34-414d-ae5b-80701456cc04 tempest-TestServerVolumeAttachmentScenario-2020619854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d70a3ea-3253-40bd-9684-6e17f1d464f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:22:06 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-9370d281-4f34-414d-ae5b-80701456cc04 tempest-TestServerVolumeAttachmentScenario-2020619854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb4cebd4-cb27-48f4-ba11-5f5c677082ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:22:06 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-9370d281-4f34-414d-ae5b-80701456cc04 tempest-TestServerVolumeAttachmentScenario-2020619854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb4cebd4-cb27-48f4-ba11-5f5c677082ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '290fec35-fe01-4ab8-a87e-becf9d587583', 'volume_name': 'volume-290fec35-fe01-4ab8-a87e-becf9d587583', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:22:06 devstack sudo[97960]: pam_unix(sudo:session): session closed for user root Nov 04 10:22:06 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-9370d281-4f34-414d-ae5b-80701456cc04 tempest-TestServerVolumeAttachmentScenario-2020619854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efaf91f0-6379-410c-abf7-8416447d8083) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:22:06 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-9370d281-4f34-414d-ae5b-80701456cc04 tempest-TestServerVolumeAttachmentScenario-2020619854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efaf91f0-6379-410c-abf7-8416447d8083) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:22:06 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-9370d281-4f34-414d-ae5b-80701456cc04 tempest-TestServerVolumeAttachmentScenario-2020619854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03454452-8604-4e87-b54d-b744f524dddb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:22:06 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-9370d281-4f34-414d-ae5b-80701456cc04 tempest-TestServerVolumeAttachmentScenario-2020619854 None] Volume 290fec35-fe01-4ab8-a87e-becf9d587583: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-290fec35-fe01-4ab8-a87e-becf9d587583', 'volume_size': 1} Nov 04 10:22:06 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-9370d281-4f34-414d-ae5b-80701456cc04 tempest-TestServerVolumeAttachmentScenario-2020619854 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:22:06 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-be66f0f3-7c70-445a-8358-0740bca8a4f8 tempest-TestServerVolumeAttachmentScenario-2020619854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-41398b59-eb96-4b87-ab99-f59cb633a7e3 1073741824" returned: 0 in 0.612s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:22:06 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-be66f0f3-7c70-445a-8358-0740bca8a4f8 tempest-TestServerVolumeAttachmentScenario-2020619854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-41398b59-eb96-4b87-ab99-f59cb633a7e3 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:22:06 devstack sudo[97965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-41398b59-eb96-4b87-ab99-f59cb633a7e3 Nov 04 10:22:06 devstack sudo[97965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:22:06 devstack sudo[97965]: pam_unix(sudo:session): session closed for user root Nov 04 10:22:06 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-be66f0f3-7c70-445a-8358-0740bca8a4f8 tempest-TestServerVolumeAttachmentScenario-2020619854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-41398b59-eb96-4b87-ab99-f59cb633a7e3" returned: 0 in 0.388s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:22:06 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-be66f0f3-7c70-445a-8358-0740bca8a4f8 tempest-TestServerVolumeAttachmentScenario-2020619854 None] <== create_volume: return (1092ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 10:22:06 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-be66f0f3-7c70-445a-8358-0740bca8a4f8 tempest-TestServerVolumeAttachmentScenario-2020619854 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.097s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:22:06 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-9370d281-4f34-414d-ae5b-80701456cc04 tempest-TestServerVolumeAttachmentScenario-2020619854 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.472s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:22:06 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-9370d281-4f34-414d-ae5b-80701456cc04 tempest-TestServerVolumeAttachmentScenario-2020619854 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:22:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-2074465115',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=290fec35-fe01-4ab8-a87e-becf9d587583,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4956e6c04b04452e983cbe93532cb994',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:22:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:22:06Z,use_quota=True,user_id='f9cce229899b4c8389308940c2840507',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 10:22:06 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-9370d281-4f34-414d-ae5b-80701456cc04 tempest-TestServerVolumeAttachmentScenario-2020619854 None] Creating volume 290fec35-fe01-4ab8-a87e-becf9d587583 {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:22:06 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-9370d281-4f34-414d-ae5b-80701456cc04 tempest-TestServerVolumeAttachmentScenario-2020619854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:22:06 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-9370d281-4f34-414d-ae5b-80701456cc04 tempest-TestServerVolumeAttachmentScenario-2020619854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:22:06 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-9370d281-4f34-414d-ae5b-80701456cc04 tempest-TestServerVolumeAttachmentScenario-2020619854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:22:06 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-9370d281-4f34-414d-ae5b-80701456cc04 tempest-TestServerVolumeAttachmentScenario-2020619854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:22:06 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-9370d281-4f34-414d-ae5b-80701456cc04 tempest-TestServerVolumeAttachmentScenario-2020619854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:22:06 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-9370d281-4f34-414d-ae5b-80701456cc04 tempest-TestServerVolumeAttachmentScenario-2020619854 None] Selected osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:22:06 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-9370d281-4f34-414d-ae5b-80701456cc04 tempest-TestServerVolumeAttachmentScenario-2020619854 None] casted to osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 Nov 04 10:22:06 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-9370d281-4f34-414d-ae5b-80701456cc04 tempest-TestServerVolumeAttachmentScenario-2020619854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-290fec35-fe01-4ab8-a87e-becf9d587583 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:22:06 devstack sudo[97968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-290fec35-fe01-4ab8-a87e-becf9d587583 1073741824 Nov 04 10:22:06 devstack sudo[97968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:22:06 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-be66f0f3-7c70-445a-8358-0740bca8a4f8 tempest-TestServerVolumeAttachmentScenario-2020619854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (060a91ce-8c3d-4fde-8193-45c2a7d7e005) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41398b59-eb96-4b87-ab99-f59cb633a7e3', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:22:06 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-be66f0f3-7c70-445a-8358-0740bca8a4f8 tempest-TestServerVolumeAttachmentScenario-2020619854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95e86934-950a-48fa-986b-6811b218766f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:22:06 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-be66f0f3-7c70-445a-8358-0740bca8a4f8 tempest-TestServerVolumeAttachmentScenario-2020619854 None] Volume volume-41398b59-eb96-4b87-ab99-f59cb633a7e3 (41398b59-eb96-4b87-ab99-f59cb633a7e3): created successfully Nov 04 10:22:06 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-be66f0f3-7c70-445a-8358-0740bca8a4f8 tempest-TestServerVolumeAttachmentScenario-2020619854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95e86934-950a-48fa-986b-6811b218766f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:22:06 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-be66f0f3-7c70-445a-8358-0740bca8a4f8 tempest-TestServerVolumeAttachmentScenario-2020619854 None] Flow 'volume_create_manager' (432b5c28-4d1f-449f-a30e-d30f739b5b91) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:22:06 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-be66f0f3-7c70-445a-8358-0740bca8a4f8 tempest-TestServerVolumeAttachmentScenario-2020619854 None] Created volume successfully. Nov 04 10:22:07 devstack sudo[97968]: pam_unix(sudo:session): session closed for user root Nov 04 10:22:07 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-9370d281-4f34-414d-ae5b-80701456cc04 tempest-TestServerVolumeAttachmentScenario-2020619854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-290fec35-fe01-4ab8-a87e-becf9d587583 1073741824" returned: 0 in 0.720s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:22:07 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-9370d281-4f34-414d-ae5b-80701456cc04 tempest-TestServerVolumeAttachmentScenario-2020619854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-290fec35-fe01-4ab8-a87e-becf9d587583 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:22:07 devstack sudo[97974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-290fec35-fe01-4ab8-a87e-becf9d587583 Nov 04 10:22:07 devstack sudo[97974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:22:07 devstack sudo[97974]: pam_unix(sudo:session): session closed for user root Nov 04 10:22:07 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-9370d281-4f34-414d-ae5b-80701456cc04 tempest-TestServerVolumeAttachmentScenario-2020619854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-290fec35-fe01-4ab8-a87e-becf9d587583" returned: 0 in 0.418s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:22:07 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-9370d281-4f34-414d-ae5b-80701456cc04 tempest-TestServerVolumeAttachmentScenario-2020619854 None] <== create_volume: return (1208ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 10:22:07 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-9370d281-4f34-414d-ae5b-80701456cc04 tempest-TestServerVolumeAttachmentScenario-2020619854 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.215s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:22:07 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-9370d281-4f34-414d-ae5b-80701456cc04 tempest-TestServerVolumeAttachmentScenario-2020619854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03454452-8604-4e87-b54d-b744f524dddb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-290fec35-fe01-4ab8-a87e-becf9d587583', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:22:07 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-9370d281-4f34-414d-ae5b-80701456cc04 tempest-TestServerVolumeAttachmentScenario-2020619854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (debe7800-8e0f-4235-97f1-15f453abee3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:22:07 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-9370d281-4f34-414d-ae5b-80701456cc04 tempest-TestServerVolumeAttachmentScenario-2020619854 None] Volume volume-290fec35-fe01-4ab8-a87e-becf9d587583 (290fec35-fe01-4ab8-a87e-becf9d587583): created successfully Nov 04 10:22:07 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-9370d281-4f34-414d-ae5b-80701456cc04 tempest-TestServerVolumeAttachmentScenario-2020619854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (debe7800-8e0f-4235-97f1-15f453abee3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:22:07 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-9370d281-4f34-414d-ae5b-80701456cc04 tempest-TestServerVolumeAttachmentScenario-2020619854 None] Flow 'volume_create_manager' (0f09b956-f478-46b2-9c6d-c2610680f277) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:22:07 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-9370d281-4f34-414d-ae5b-80701456cc04 tempest-TestServerVolumeAttachmentScenario-2020619854 None] Created volume successfully. Nov 04 10:22:10 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-e0021ab7-cd8f-4ec6-963e-53538aa2398b tempest-GroupsV320Test-1412313559 None] Group tempest-GroupsV320Test-Group-1268610082: creating Nov 04 10:22:10 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-e0021ab7-cd8f-4ec6-963e-53538aa2398b tempest-GroupsV320Test-1412313559 None] Group tempest-GroupsV320Test-Group-1268610082: created successfully Nov 04 10:22:10 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-e0021ab7-cd8f-4ec6-963e-53538aa2398b tempest-GroupsV320Test-1412313559 None] Create group completed successfully. Nov 04 10:22:12 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-28990fe1-bea1-468b-bedf-9f54130d5835 tempest-GroupsV320Test-1412313559 None] Created reservations ['64b53da3-a8eb-4f23-a8f1-9c062dd4cf13'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:22:12 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-28990fe1-bea1-468b-bedf-9f54130d5835 tempest-GroupsV320Test-1412313559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:22:12 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-28990fe1-bea1-468b-bedf-9f54130d5835 tempest-GroupsV320Test-1412313559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:22:12 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-28990fe1-bea1-468b-bedf-9f54130d5835 tempest-GroupsV320Test-1412313559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:22:12 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-28990fe1-bea1-468b-bedf-9f54130d5835 tempest-GroupsV320Test-1412313559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:22:12 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-28990fe1-bea1-468b-bedf-9f54130d5835 tempest-GroupsV320Test-1412313559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:22:12 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-28990fe1-bea1-468b-bedf-9f54130d5835 tempest-GroupsV320Test-1412313559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:22:12 devstack sudo[98011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:22:12 devstack sudo[98011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:22:12 devstack sudo[98011]: pam_unix(sudo:session): session closed for user root Nov 04 10:22:12 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-28990fe1-bea1-468b-bedf-9f54130d5835 tempest-GroupsV320Test-1412313559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.571s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:22:12 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-28990fe1-bea1-468b-bedf-9f54130d5835 tempest-GroupsV320Test-1412313559 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:22:12 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-28990fe1-bea1-468b-bedf-9f54130d5835 tempest-GroupsV320Test-1412313559 None] Delete group completed successfully. Nov 04 10:22:22 devstack cinder-volume[87068]: DEBUG dbcounter [-] [87068] Writing DB stats cinder:SELECT=10,cinder:UPDATE=9,cinder:INSERT=2,cinder:DELETE=1 {{(pid=87068) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 10:22:22 devstack cinder-volume[87068]: DEBUG dbcounter [-] [87068] Writing DB stats cinder:SELECT=11,cinder:UPDATE=10,cinder:DELETE=1,cinder:INSERT=1 {{(pid=87068) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 10:22:31 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c36f31f-c1ef-488f-b23b-e39c7e6def62 tempest-TestInstancesWithCinderVolumes-304140490 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:22:31 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-9c36f31f-c1ef-488f-b23b-e39c7e6def62 tempest-TestInstancesWithCinderVolumes-304140490 None] Flow 'volume_create_manager' (ef2ab99a-9cf8-44c8-b3c4-6ebd86bf6c79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:22:31 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-9c36f31f-c1ef-488f-b23b-e39c7e6def62 tempest-TestInstancesWithCinderVolumes-304140490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecf32ede-bb1f-49e7-8b5b-0ea6ad287bb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:22:31 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-9c36f31f-c1ef-488f-b23b-e39c7e6def62 tempest-TestInstancesWithCinderVolumes-304140490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecf32ede-bb1f-49e7-8b5b-0ea6ad287bb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:22:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1240609448',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf4db3a1-74fe-47b0-bc85-688e825eeec2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b66642bac394c148c09a84f14ff0787',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:22:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:22:31Z,use_quota=True,user_id='1083fefceb464da8858edad15fad12fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0ddb0d2-a0a1-4d15-b678-30ce0d1b48f5),volume_type_id=e0ddb0d2-a0a1-4d15-b678-30ce0d1b48f5)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:22:31 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-9c36f31f-c1ef-488f-b23b-e39c7e6def62 tempest-TestInstancesWithCinderVolumes-304140490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (809351cd-9354-44fb-b6b6-78e86a218457) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:22:31 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-9c36f31f-c1ef-488f-b23b-e39c7e6def62 tempest-TestInstancesWithCinderVolumes-304140490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (809351cd-9354-44fb-b6b6-78e86a218457) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:22:31 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-9c36f31f-c1ef-488f-b23b-e39c7e6def62 tempest-TestInstancesWithCinderVolumes-304140490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8b61fbb-dd37-4717-a01c-2ea29ad2890a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:22:31 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-9c36f31f-c1ef-488f-b23b-e39c7e6def62 tempest-TestInstancesWithCinderVolumes-304140490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8b61fbb-dd37-4717-a01c-2ea29ad2890a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf4db3a1-74fe-47b0-bc85-688e825eeec2', 'volume_name': 'volume-cf4db3a1-74fe-47b0-bc85-688e825eeec2', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:22:31 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-9c36f31f-c1ef-488f-b23b-e39c7e6def62 tempest-TestInstancesWithCinderVolumes-304140490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e624979-e3c9-486e-9ff8-980b76c091c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:22:31 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-9c36f31f-c1ef-488f-b23b-e39c7e6def62 tempest-TestInstancesWithCinderVolumes-304140490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e624979-e3c9-486e-9ff8-980b76c091c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:22:31 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-9c36f31f-c1ef-488f-b23b-e39c7e6def62 tempest-TestInstancesWithCinderVolumes-304140490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f16920b8-b220-4cd4-bf77-8982cdb8ff5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:22:31 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-9c36f31f-c1ef-488f-b23b-e39c7e6def62 tempest-TestInstancesWithCinderVolumes-304140490 None] Volume cf4db3a1-74fe-47b0-bc85-688e825eeec2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf4db3a1-74fe-47b0-bc85-688e825eeec2', 'volume_size': 1} Nov 04 10:22:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-9c36f31f-c1ef-488f-b23b-e39c7e6def62 tempest-TestInstancesWithCinderVolumes-304140490 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:22:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-9c36f31f-c1ef-488f-b23b-e39c7e6def62 tempest-TestInstancesWithCinderVolumes-304140490 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:22:31 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-9c36f31f-c1ef-488f-b23b-e39c7e6def62 tempest-TestInstancesWithCinderVolumes-304140490 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:22:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1240609448',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf4db3a1-74fe-47b0-bc85-688e825eeec2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b66642bac394c148c09a84f14ff0787',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:22:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:22:31Z,use_quota=True,user_id='1083fefceb464da8858edad15fad12fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0ddb0d2-a0a1-4d15-b678-30ce0d1b48f5),volume_type_id=e0ddb0d2-a0a1-4d15-b678-30ce0d1b48f5)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 10:22:31 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-9c36f31f-c1ef-488f-b23b-e39c7e6def62 tempest-TestInstancesWithCinderVolumes-304140490 None] Creating volume cf4db3a1-74fe-47b0-bc85-688e825eeec2 {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:22:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-9c36f31f-c1ef-488f-b23b-e39c7e6def62 tempest-TestInstancesWithCinderVolumes-304140490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:22:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-9c36f31f-c1ef-488f-b23b-e39c7e6def62 tempest-TestInstancesWithCinderVolumes-304140490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:22:31 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-9c36f31f-c1ef-488f-b23b-e39c7e6def62 tempest-TestInstancesWithCinderVolumes-304140490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:22:31 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-9c36f31f-c1ef-488f-b23b-e39c7e6def62 tempest-TestInstancesWithCinderVolumes-304140490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:22:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-9c36f31f-c1ef-488f-b23b-e39c7e6def62 tempest-TestInstancesWithCinderVolumes-304140490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:22:31 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-9c36f31f-c1ef-488f-b23b-e39c7e6def62 tempest-TestInstancesWithCinderVolumes-304140490 None] Selected osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:22:31 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-9c36f31f-c1ef-488f-b23b-e39c7e6def62 tempest-TestInstancesWithCinderVolumes-304140490 None] casted to osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 Nov 04 10:22:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-9c36f31f-c1ef-488f-b23b-e39c7e6def62 tempest-TestInstancesWithCinderVolumes-304140490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-cf4db3a1-74fe-47b0-bc85-688e825eeec2 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:22:31 devstack sudo[98185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-cf4db3a1-74fe-47b0-bc85-688e825eeec2 1073741824 Nov 04 10:22:31 devstack sudo[98185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:22:32 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-b036c409-23b4-4c39-9d6f-52f9b0637c9f tempest-TestInstancesWithCinderVolumes-304140490 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:22:32 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-b036c409-23b4-4c39-9d6f-52f9b0637c9f tempest-TestInstancesWithCinderVolumes-304140490 None] Flow 'volume_create_manager' (4dc43630-7aba-472b-8cd5-cda5bbeff76a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:22:32 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-b036c409-23b4-4c39-9d6f-52f9b0637c9f tempest-TestInstancesWithCinderVolumes-304140490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68c78c5d-08a0-41d6-9cfc-9ea7b0ef111b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:22:32 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-b036c409-23b4-4c39-9d6f-52f9b0637c9f tempest-TestInstancesWithCinderVolumes-304140490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68c78c5d-08a0-41d6-9cfc-9ea7b0ef111b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:22:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-666505550',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1365d08d-723e-4f4d-98b6-48e57e761f8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b66642bac394c148c09a84f14ff0787',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:22:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:22:32Z,use_quota=True,user_id='1083fefceb464da8858edad15fad12fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a33f2a22-0bc0-4c8c-9e36-50367b615e6b),volume_type_id=a33f2a22-0bc0-4c8c-9e36-50367b615e6b)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:22:32 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-b036c409-23b4-4c39-9d6f-52f9b0637c9f tempest-TestInstancesWithCinderVolumes-304140490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (176bbf98-4a72-46c9-bfea-f39685a67dd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:22:32 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-b036c409-23b4-4c39-9d6f-52f9b0637c9f tempest-TestInstancesWithCinderVolumes-304140490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (176bbf98-4a72-46c9-bfea-f39685a67dd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:22:32 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-b036c409-23b4-4c39-9d6f-52f9b0637c9f tempest-TestInstancesWithCinderVolumes-304140490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b70ec36-6ed9-4555-b298-5a6d152a1432) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:22:32 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-b036c409-23b4-4c39-9d6f-52f9b0637c9f tempest-TestInstancesWithCinderVolumes-304140490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b70ec36-6ed9-4555-b298-5a6d152a1432) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1365d08d-723e-4f4d-98b6-48e57e761f8c', 'volume_name': 'volume-1365d08d-723e-4f4d-98b6-48e57e761f8c', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:22:32 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-b036c409-23b4-4c39-9d6f-52f9b0637c9f tempest-TestInstancesWithCinderVolumes-304140490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea44c079-ab4f-4cf7-aa9e-8cc390c25274) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:22:32 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-b036c409-23b4-4c39-9d6f-52f9b0637c9f tempest-TestInstancesWithCinderVolumes-304140490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea44c079-ab4f-4cf7-aa9e-8cc390c25274) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:22:32 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-b036c409-23b4-4c39-9d6f-52f9b0637c9f tempest-TestInstancesWithCinderVolumes-304140490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1aa5b44a-d5bf-45c4-b26e-a8118d42aa61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:22:32 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-b036c409-23b4-4c39-9d6f-52f9b0637c9f tempest-TestInstancesWithCinderVolumes-304140490 None] Volume 1365d08d-723e-4f4d-98b6-48e57e761f8c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1365d08d-723e-4f4d-98b6-48e57e761f8c', 'volume_size': 1} Nov 04 10:22:32 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-b036c409-23b4-4c39-9d6f-52f9b0637c9f tempest-TestInstancesWithCinderVolumes-304140490 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:22:32 devstack sudo[98185]: pam_unix(sudo:session): session closed for user root Nov 04 10:22:32 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-9c36f31f-c1ef-488f-b23b-e39c7e6def62 tempest-TestInstancesWithCinderVolumes-304140490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-cf4db3a1-74fe-47b0-bc85-688e825eeec2 1073741824" returned: 0 in 0.792s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:22:32 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-9c36f31f-c1ef-488f-b23b-e39c7e6def62 tempest-TestInstancesWithCinderVolumes-304140490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-cf4db3a1-74fe-47b0-bc85-688e825eeec2 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:22:32 devstack sudo[98192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-cf4db3a1-74fe-47b0-bc85-688e825eeec2 Nov 04 10:22:32 devstack sudo[98192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:22:32 devstack sudo[98192]: pam_unix(sudo:session): session closed for user root Nov 04 10:22:32 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-9c36f31f-c1ef-488f-b23b-e39c7e6def62 tempest-TestInstancesWithCinderVolumes-304140490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-cf4db3a1-74fe-47b0-bc85-688e825eeec2" returned: 0 in 0.463s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:22:32 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-9c36f31f-c1ef-488f-b23b-e39c7e6def62 tempest-TestInstancesWithCinderVolumes-304140490 None] <== create_volume: return (1315ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 10:22:32 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-9c36f31f-c1ef-488f-b23b-e39c7e6def62 tempest-TestInstancesWithCinderVolumes-304140490 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.325s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:22:32 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-b036c409-23b4-4c39-9d6f-52f9b0637c9f tempest-TestInstancesWithCinderVolumes-304140490 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.673s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:22:32 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-b036c409-23b4-4c39-9d6f-52f9b0637c9f tempest-TestInstancesWithCinderVolumes-304140490 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:22:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-666505550',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1365d08d-723e-4f4d-98b6-48e57e761f8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b66642bac394c148c09a84f14ff0787',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:22:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:22:32Z,use_quota=True,user_id='1083fefceb464da8858edad15fad12fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a33f2a22-0bc0-4c8c-9e36-50367b615e6b),volume_type_id=a33f2a22-0bc0-4c8c-9e36-50367b615e6b)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 10:22:32 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-b036c409-23b4-4c39-9d6f-52f9b0637c9f tempest-TestInstancesWithCinderVolumes-304140490 None] Creating volume 1365d08d-723e-4f4d-98b6-48e57e761f8c {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:22:32 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-b036c409-23b4-4c39-9d6f-52f9b0637c9f tempest-TestInstancesWithCinderVolumes-304140490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:22:32 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-b036c409-23b4-4c39-9d6f-52f9b0637c9f tempest-TestInstancesWithCinderVolumes-304140490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:22:32 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-b036c409-23b4-4c39-9d6f-52f9b0637c9f tempest-TestInstancesWithCinderVolumes-304140490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:22:32 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-b036c409-23b4-4c39-9d6f-52f9b0637c9f tempest-TestInstancesWithCinderVolumes-304140490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:22:32 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-b036c409-23b4-4c39-9d6f-52f9b0637c9f tempest-TestInstancesWithCinderVolumes-304140490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:22:32 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-b036c409-23b4-4c39-9d6f-52f9b0637c9f tempest-TestInstancesWithCinderVolumes-304140490 None] Selected osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:22:33 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-b036c409-23b4-4c39-9d6f-52f9b0637c9f tempest-TestInstancesWithCinderVolumes-304140490 None] casted to osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 Nov 04 10:22:33 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-b036c409-23b4-4c39-9d6f-52f9b0637c9f tempest-TestInstancesWithCinderVolumes-304140490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-1365d08d-723e-4f4d-98b6-48e57e761f8c 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:22:33 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-9c36f31f-c1ef-488f-b23b-e39c7e6def62 tempest-TestInstancesWithCinderVolumes-304140490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f16920b8-b220-4cd4-bf77-8982cdb8ff5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf4db3a1-74fe-47b0-bc85-688e825eeec2', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:22:33 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-9c36f31f-c1ef-488f-b23b-e39c7e6def62 tempest-TestInstancesWithCinderVolumes-304140490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e4cf258-9071-4ba6-abfc-6aa37049fb55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:22:33 devstack sudo[98195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-1365d08d-723e-4f4d-98b6-48e57e761f8c 1073741824 Nov 04 10:22:33 devstack sudo[98195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:22:33 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-9c36f31f-c1ef-488f-b23b-e39c7e6def62 tempest-TestInstancesWithCinderVolumes-304140490 None] Volume volume-cf4db3a1-74fe-47b0-bc85-688e825eeec2 (cf4db3a1-74fe-47b0-bc85-688e825eeec2): created successfully Nov 04 10:22:33 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-9c36f31f-c1ef-488f-b23b-e39c7e6def62 tempest-TestInstancesWithCinderVolumes-304140490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e4cf258-9071-4ba6-abfc-6aa37049fb55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:22:33 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-9c36f31f-c1ef-488f-b23b-e39c7e6def62 tempest-TestInstancesWithCinderVolumes-304140490 None] Flow 'volume_create_manager' (ef2ab99a-9cf8-44c8-b3c4-6ebd86bf6c79) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:22:33 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-9c36f31f-c1ef-488f-b23b-e39c7e6def62 tempest-TestInstancesWithCinderVolumes-304140490 None] Created volume successfully. Nov 04 10:22:33 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-21ea0d71-ff6d-42d6-9ac4-584d6ab424d1 tempest-TestInstancesWithCinderVolumes-304140490 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:22:33 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-21ea0d71-ff6d-42d6-9ac4-584d6ab424d1 tempest-TestInstancesWithCinderVolumes-304140490 None] Flow 'volume_create_manager' (14e07994-ec45-4b19-a023-b0dc89e3a7f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:22:33 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-21ea0d71-ff6d-42d6-9ac4-584d6ab424d1 tempest-TestInstancesWithCinderVolumes-304140490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2002af34-f5e6-47ea-89bc-d3c608fc327e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:22:33 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-21ea0d71-ff6d-42d6-9ac4-584d6ab424d1 tempest-TestInstancesWithCinderVolumes-304140490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2002af34-f5e6-47ea-89bc-d3c608fc327e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:22:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-77460254',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff5b195e-bcd9-40cf-9c47-d04cbdfef089,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b66642bac394c148c09a84f14ff0787',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:22:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:22:33Z,use_quota=True,user_id='1083fefceb464da8858edad15fad12fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(212145dc-3a86-440e-be04-76080e13d957),volume_type_id=212145dc-3a86-440e-be04-76080e13d957)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:22:33 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-21ea0d71-ff6d-42d6-9ac4-584d6ab424d1 tempest-TestInstancesWithCinderVolumes-304140490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f333ce2a-5716-4d5a-be95-52214eebf945) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:22:33 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-21ea0d71-ff6d-42d6-9ac4-584d6ab424d1 tempest-TestInstancesWithCinderVolumes-304140490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f333ce2a-5716-4d5a-be95-52214eebf945) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:22:33 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-21ea0d71-ff6d-42d6-9ac4-584d6ab424d1 tempest-TestInstancesWithCinderVolumes-304140490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86ace1db-8f57-48ec-9911-17f69be0c4aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:22:33 devstack cinder-volume[87068]: DEBUG cinder.image.glance [None req-21ea0d71-ff6d-42d6-9ac4-584d6ab424d1 tempest-TestInstancesWithCinderVolumes-304140490 None] Creating Keystone auth plugin from conf {{(pid=87068) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 04 10:22:33 devstack sudo[98195]: pam_unix(sudo:session): session closed for user root Nov 04 10:22:33 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-b036c409-23b4-4c39-9d6f-52f9b0637c9f tempest-TestInstancesWithCinderVolumes-304140490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-1365d08d-723e-4f4d-98b6-48e57e761f8c 1073741824" returned: 0 in 0.504s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:22:33 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-b036c409-23b4-4c39-9d6f-52f9b0637c9f tempest-TestInstancesWithCinderVolumes-304140490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-1365d08d-723e-4f4d-98b6-48e57e761f8c {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:22:33 devstack sudo[98201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-1365d08d-723e-4f4d-98b6-48e57e761f8c Nov 04 10:22:33 devstack sudo[98201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:22:33 devstack sudo[98201]: pam_unix(sudo:session): session closed for user root Nov 04 10:22:33 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-21ea0d71-ff6d-42d6-9ac4-584d6ab424d1 tempest-TestInstancesWithCinderVolumes-304140490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86ace1db-8f57-48ec-9911-17f69be0c4aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ff5b195e-bcd9-40cf-9c47-d04cbdfef089', 'volume_name': 'volume-ff5b195e-bcd9-40cf-9c47-d04cbdfef089', 'volume_size': 1, 'image_id': '961b9479-c5e3-45e2-a65e-0b4fd1d90e92', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/961b9479-c5e3-45e2-a65e-0b4fd1d90e92', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--525944725', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7b66642bac394c148c09a84f14ff0787', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '961b9479-c5e3-45e2-a65e-0b4fd1d90e92', 'created_at': datetime.datetime(2026, 11, 4, 9, 22, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 9, 22, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/961b9479-c5e3-45e2-a65e-0b4fd1d90e92/file', 'properties': {}}, 'image_service': }' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:22:33 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-21ea0d71-ff6d-42d6-9ac4-584d6ab424d1 tempest-TestInstancesWithCinderVolumes-304140490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e53460d3-77b5-4c78-b7ab-68a927a64008) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:22:33 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-21ea0d71-ff6d-42d6-9ac4-584d6ab424d1 tempest-TestInstancesWithCinderVolumes-304140490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e53460d3-77b5-4c78-b7ab-68a927a64008) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:22:33 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-21ea0d71-ff6d-42d6-9ac4-584d6ab424d1 tempest-TestInstancesWithCinderVolumes-304140490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e47012e-d6e4-444d-b644-0fe7565622c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:22:33 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-21ea0d71-ff6d-42d6-9ac4-584d6ab424d1 tempest-TestInstancesWithCinderVolumes-304140490 None] Volume ff5b195e-bcd9-40cf-9c47-d04cbdfef089: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ff5b195e-bcd9-40cf-9c47-d04cbdfef089', 'volume_size': 1, 'image_id': '961b9479-c5e3-45e2-a65e-0b4fd1d90e92', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/961b9479-c5e3-45e2-a65e-0b4fd1d90e92', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--525944725', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7b66642bac394c148c09a84f14ff0787', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '961b9479-c5e3-45e2-a65e-0b4fd1d90e92', 'created_at': datetime.datetime(2026, 11, 4, 9, 22, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 9, 22, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/961b9479-c5e3-45e2-a65e-0b4fd1d90e92/file', 'properties': {}}, 'image_service': } Nov 04 10:22:33 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-21ea0d71-ff6d-42d6-9ac4-584d6ab424d1 tempest-TestInstancesWithCinderVolumes-304140490 None] Trying to clone ff5b195e-bcd9-40cf-9c47-d04cbdfef089 from image 961b9479-c5e3-45e2-a65e-0b4fd1d90e92 at location (None, [{'url': 'file:///opt/stack/data/glance/images/961b9479-c5e3-45e2-a65e-0b4fd1d90e92', 'metadata': {}}]). {{(pid=87068) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 04 10:22:33 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-b036c409-23b4-4c39-9d6f-52f9b0637c9f tempest-TestInstancesWithCinderVolumes-304140490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-1365d08d-723e-4f4d-98b6-48e57e761f8c" returned: 0 in 0.336s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:22:33 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-b036c409-23b4-4c39-9d6f-52f9b0637c9f tempest-TestInstancesWithCinderVolumes-304140490 None] <== create_volume: return (907ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 10:22:33 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-b036c409-23b4-4c39-9d6f-52f9b0637c9f tempest-TestInstancesWithCinderVolumes-304140490 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.917s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:22:33 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-b036c409-23b4-4c39-9d6f-52f9b0637c9f tempest-TestInstancesWithCinderVolumes-304140490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1aa5b44a-d5bf-45c4-b26e-a8118d42aa61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1365d08d-723e-4f4d-98b6-48e57e761f8c', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:22:33 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-b036c409-23b4-4c39-9d6f-52f9b0637c9f tempest-TestInstancesWithCinderVolumes-304140490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b73a2f2-20b7-4758-9cf4-8a4cfc290558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:22:33 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-b036c409-23b4-4c39-9d6f-52f9b0637c9f tempest-TestInstancesWithCinderVolumes-304140490 None] Volume volume-1365d08d-723e-4f4d-98b6-48e57e761f8c (1365d08d-723e-4f4d-98b6-48e57e761f8c): created successfully Nov 04 10:22:33 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-b036c409-23b4-4c39-9d6f-52f9b0637c9f tempest-TestInstancesWithCinderVolumes-304140490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b73a2f2-20b7-4758-9cf4-8a4cfc290558) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:22:33 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-b036c409-23b4-4c39-9d6f-52f9b0637c9f tempest-TestInstancesWithCinderVolumes-304140490 None] Flow 'volume_create_manager' (4dc43630-7aba-472b-8cd5-cda5bbeff76a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:22:33 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-b036c409-23b4-4c39-9d6f-52f9b0637c9f tempest-TestInstancesWithCinderVolumes-304140490 None] Created volume successfully. Nov 04 10:22:37 devstack cinder-volume[87068]: DEBUG cinder.image.image_utils [None req-21ea0d71-ff6d-42d6-9ac4-584d6ab424d1 tempest-TestInstancesWithCinderVolumes-304140490 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_961b9479-c5e3-45e2-a65e-0b4fd1d90e92_79o332zvdevstack@QuobyteHD, size 20.69 MB, duration 3.30 sec {{(pid=87068) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 04 10:22:37 devstack cinder-volume[87068]: INFO cinder.image.image_utils [None req-21ea0d71-ff6d-42d6-9ac4-584d6ab424d1 tempest-TestInstancesWithCinderVolumes-304140490 None] Image download 20.69 MB at 6.26 MB/s Nov 04 10:22:37 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[fac99ff0-ecec-4140-a942-455278d415a6]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:22:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-21ea0d71-ff6d-42d6-9ac4-584d6ab424d1 tempest-TestInstancesWithCinderVolumes-304140490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_961b9479-c5e3-45e2-a65e-0b4fd1d90e92_79o332zvdevstack@QuobyteHD {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:22:37 devstack sudo[98204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_961b9479-c5e3-45e2-a65e-0b4fd1d90e92_79o332zvdevstack@QuobyteHD Nov 04 10:22:37 devstack sudo[98204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:22:37 devstack sudo[98204]: pam_unix(sudo:session): session closed for user root Nov 04 10:22:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-21ea0d71-ff6d-42d6-9ac4-584d6ab424d1 tempest-TestInstancesWithCinderVolumes-304140490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_961b9479-c5e3-45e2-a65e-0b4fd1d90e92_79o332zvdevstack@QuobyteHD" returned: 0 in 0.382s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:22:37 devstack cinder-volume[87068]: DEBUG cinder.image.image_utils [None req-21ea0d71-ff6d-42d6-9ac4-584d6ab424d1 tempest-TestInstancesWithCinderVolumes-304140490 None] Temporary image 961b9479-c5e3-45e2-a65e-0b4fd1d90e92 is fetched for user 1083fefceb464da8858edad15fad12fd. {{(pid=87068) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 04 10:22:37 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b27a063-1252-4cc8-b430-e2d357a55ae5]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:22:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-21ea0d71-ff6d-42d6-9ac4-584d6ab424d1 tempest-TestInstancesWithCinderVolumes-304140490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_961b9479-c5e3-45e2-a65e-0b4fd1d90e92_79o332zvdevstack@QuobyteHD {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:22:37 devstack sudo[98211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_961b9479-c5e3-45e2-a65e-0b4fd1d90e92_79o332zvdevstack@QuobyteHD Nov 04 10:22:37 devstack sudo[98211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:22:38 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0b0af3f-a5ab-4364-b869-102629ba731a tempest-VolumeQuotasAdminTestJSON-1589377281 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:22:38 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-d0b0af3f-a5ab-4364-b869-102629ba731a tempest-VolumeQuotasAdminTestJSON-1589377281 None] Flow 'volume_create_manager' (782fa5a2-9514-43e7-83be-265e0b521a3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:22:38 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-d0b0af3f-a5ab-4364-b869-102629ba731a tempest-VolumeQuotasAdminTestJSON-1589377281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b8179a0-340b-4edf-b7f6-21ef1e8641b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:22:38 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-d0b0af3f-a5ab-4364-b869-102629ba731a tempest-VolumeQuotasAdminTestJSON-1589377281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b8179a0-340b-4edf-b7f6-21ef1e8641b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:22:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1000694484',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fdc5403-1987-45e3-94de-fe9caaabb5c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70514e5afc8d43b18c190fd5b439517e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:22:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:22:38Z,use_quota=True,user_id='890a1a9211c64debb0150840fa77f610',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:22:38 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-d0b0af3f-a5ab-4364-b869-102629ba731a tempest-VolumeQuotasAdminTestJSON-1589377281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd293d23-69d9-4b21-9e76-b14f9b09cf5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:22:38 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-d0b0af3f-a5ab-4364-b869-102629ba731a tempest-VolumeQuotasAdminTestJSON-1589377281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd293d23-69d9-4b21-9e76-b14f9b09cf5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:22:38 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-d0b0af3f-a5ab-4364-b869-102629ba731a tempest-VolumeQuotasAdminTestJSON-1589377281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (644a50fb-2a09-4f97-a80b-fcfa21d4bfce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:22:38 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-d0b0af3f-a5ab-4364-b869-102629ba731a tempest-VolumeQuotasAdminTestJSON-1589377281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (644a50fb-2a09-4f97-a80b-fcfa21d4bfce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0fdc5403-1987-45e3-94de-fe9caaabb5c6', 'volume_name': 'volume-0fdc5403-1987-45e3-94de-fe9caaabb5c6', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:22:38 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-d0b0af3f-a5ab-4364-b869-102629ba731a tempest-VolumeQuotasAdminTestJSON-1589377281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (255f5da2-6ab5-4672-90fc-b8d401178db0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:22:38 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-d0b0af3f-a5ab-4364-b869-102629ba731a tempest-VolumeQuotasAdminTestJSON-1589377281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (255f5da2-6ab5-4672-90fc-b8d401178db0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:22:38 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-d0b0af3f-a5ab-4364-b869-102629ba731a tempest-VolumeQuotasAdminTestJSON-1589377281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d53f111-d4f6-4ee1-b50c-1a89295207b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:22:38 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-d0b0af3f-a5ab-4364-b869-102629ba731a tempest-VolumeQuotasAdminTestJSON-1589377281 None] Volume 0fdc5403-1987-45e3-94de-fe9caaabb5c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0fdc5403-1987-45e3-94de-fe9caaabb5c6', 'volume_size': 1} Nov 04 10:22:38 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-d0b0af3f-a5ab-4364-b869-102629ba731a tempest-VolumeQuotasAdminTestJSON-1589377281 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:22:38 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-d0b0af3f-a5ab-4364-b869-102629ba731a tempest-VolumeQuotasAdminTestJSON-1589377281 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:22:38 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-d0b0af3f-a5ab-4364-b869-102629ba731a tempest-VolumeQuotasAdminTestJSON-1589377281 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:22:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1000694484',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fdc5403-1987-45e3-94de-fe9caaabb5c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70514e5afc8d43b18c190fd5b439517e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:22:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:22:38Z,use_quota=True,user_id='890a1a9211c64debb0150840fa77f610',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 10:22:38 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-d0b0af3f-a5ab-4364-b869-102629ba731a tempest-VolumeQuotasAdminTestJSON-1589377281 None] Creating volume 0fdc5403-1987-45e3-94de-fe9caaabb5c6 {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:22:38 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-d0b0af3f-a5ab-4364-b869-102629ba731a tempest-VolumeQuotasAdminTestJSON-1589377281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:22:38 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-d0b0af3f-a5ab-4364-b869-102629ba731a tempest-VolumeQuotasAdminTestJSON-1589377281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:22:38 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-d0b0af3f-a5ab-4364-b869-102629ba731a tempest-VolumeQuotasAdminTestJSON-1589377281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:22:38 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-d0b0af3f-a5ab-4364-b869-102629ba731a tempest-VolumeQuotasAdminTestJSON-1589377281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:22:38 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-d0b0af3f-a5ab-4364-b869-102629ba731a tempest-VolumeQuotasAdminTestJSON-1589377281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:22:38 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-d0b0af3f-a5ab-4364-b869-102629ba731a tempest-VolumeQuotasAdminTestJSON-1589377281 None] Selected osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:22:38 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-d0b0af3f-a5ab-4364-b869-102629ba731a tempest-VolumeQuotasAdminTestJSON-1589377281 None] casted to osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 Nov 04 10:22:38 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d0b0af3f-a5ab-4364-b869-102629ba731a tempest-VolumeQuotasAdminTestJSON-1589377281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-0fdc5403-1987-45e3-94de-fe9caaabb5c6 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:22:38 devstack sudo[98250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-0fdc5403-1987-45e3-94de-fe9caaabb5c6 1073741824 Nov 04 10:22:38 devstack sudo[98250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:22:38 devstack sudo[98211]: pam_unix(sudo:session): session closed for user root Nov 04 10:22:38 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-21ea0d71-ff6d-42d6-9ac4-584d6ab424d1 tempest-TestInstancesWithCinderVolumes-304140490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_961b9479-c5e3-45e2-a65e-0b4fd1d90e92_79o332zvdevstack@QuobyteHD" returned: 0 in 0.527s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:22:38 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-21ea0d71-ff6d-42d6-9ac4-584d6ab424d1 tempest-TestInstancesWithCinderVolumes-304140490 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:22:38 devstack sudo[98250]: pam_unix(sudo:session): session closed for user root Nov 04 10:22:38 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d0b0af3f-a5ab-4364-b869-102629ba731a tempest-VolumeQuotasAdminTestJSON-1589377281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-0fdc5403-1987-45e3-94de-fe9caaabb5c6 1073741824" returned: 0 in 0.485s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:22:38 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d0b0af3f-a5ab-4364-b869-102629ba731a tempest-VolumeQuotasAdminTestJSON-1589377281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-0fdc5403-1987-45e3-94de-fe9caaabb5c6 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:22:38 devstack sudo[98259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-0fdc5403-1987-45e3-94de-fe9caaabb5c6 Nov 04 10:22:38 devstack sudo[98259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:22:38 devstack sudo[98259]: pam_unix(sudo:session): session closed for user root Nov 04 10:22:38 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d0b0af3f-a5ab-4364-b869-102629ba731a tempest-VolumeQuotasAdminTestJSON-1589377281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-0fdc5403-1987-45e3-94de-fe9caaabb5c6" returned: 0 in 0.254s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:22:38 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-d0b0af3f-a5ab-4364-b869-102629ba731a tempest-VolumeQuotasAdminTestJSON-1589377281 None] <== create_volume: return (779ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 10:22:38 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-d0b0af3f-a5ab-4364-b869-102629ba731a tempest-VolumeQuotasAdminTestJSON-1589377281 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.783s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:22:38 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-21ea0d71-ff6d-42d6-9ac4-584d6ab424d1 tempest-TestInstancesWithCinderVolumes-304140490 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.632s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:22:38 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-21ea0d71-ff6d-42d6-9ac4-584d6ab424d1 tempest-TestInstancesWithCinderVolumes-304140490 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:22:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-77460254',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff5b195e-bcd9-40cf-9c47-d04cbdfef089,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b66642bac394c148c09a84f14ff0787',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:22:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:22:33Z,use_quota=True,user_id='1083fefceb464da8858edad15fad12fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(212145dc-3a86-440e-be04-76080e13d957),volume_type_id=212145dc-3a86-440e-be04-76080e13d957)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 10:22:38 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-21ea0d71-ff6d-42d6-9ac4-584d6ab424d1 tempest-TestInstancesWithCinderVolumes-304140490 None] Creating volume ff5b195e-bcd9-40cf-9c47-d04cbdfef089 {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:22:38 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-21ea0d71-ff6d-42d6-9ac4-584d6ab424d1 tempest-TestInstancesWithCinderVolumes-304140490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:22:38 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-21ea0d71-ff6d-42d6-9ac4-584d6ab424d1 tempest-TestInstancesWithCinderVolumes-304140490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:22:38 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-21ea0d71-ff6d-42d6-9ac4-584d6ab424d1 tempest-TestInstancesWithCinderVolumes-304140490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:22:38 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-21ea0d71-ff6d-42d6-9ac4-584d6ab424d1 tempest-TestInstancesWithCinderVolumes-304140490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:22:38 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-21ea0d71-ff6d-42d6-9ac4-584d6ab424d1 tempest-TestInstancesWithCinderVolumes-304140490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:22:38 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-21ea0d71-ff6d-42d6-9ac4-584d6ab424d1 tempest-TestInstancesWithCinderVolumes-304140490 None] Selected osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:22:38 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-21ea0d71-ff6d-42d6-9ac4-584d6ab424d1 tempest-TestInstancesWithCinderVolumes-304140490 None] casted to osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 Nov 04 10:22:38 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-21ea0d71-ff6d-42d6-9ac4-584d6ab424d1 tempest-TestInstancesWithCinderVolumes-304140490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-ff5b195e-bcd9-40cf-9c47-d04cbdfef089 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:22:38 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-d0b0af3f-a5ab-4364-b869-102629ba731a tempest-VolumeQuotasAdminTestJSON-1589377281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d53f111-d4f6-4ee1-b50c-1a89295207b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0fdc5403-1987-45e3-94de-fe9caaabb5c6', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:22:38 devstack sudo[98262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-ff5b195e-bcd9-40cf-9c47-d04cbdfef089 1073741824 Nov 04 10:22:38 devstack sudo[98262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:22:38 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-d0b0af3f-a5ab-4364-b869-102629ba731a tempest-VolumeQuotasAdminTestJSON-1589377281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ab5b365-116a-41b5-bcd4-66034e30f02a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:22:38 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-d0b0af3f-a5ab-4364-b869-102629ba731a tempest-VolumeQuotasAdminTestJSON-1589377281 None] Volume volume-0fdc5403-1987-45e3-94de-fe9caaabb5c6 (0fdc5403-1987-45e3-94de-fe9caaabb5c6): created successfully Nov 04 10:22:38 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-d0b0af3f-a5ab-4364-b869-102629ba731a tempest-VolumeQuotasAdminTestJSON-1589377281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ab5b365-116a-41b5-bcd4-66034e30f02a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:22:38 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-d0b0af3f-a5ab-4364-b869-102629ba731a tempest-VolumeQuotasAdminTestJSON-1589377281 None] Flow 'volume_create_manager' (782fa5a2-9514-43e7-83be-265e0b521a3e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:22:39 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-d0b0af3f-a5ab-4364-b869-102629ba731a tempest-VolumeQuotasAdminTestJSON-1589377281 None] Created volume successfully. Nov 04 10:22:39 devstack sudo[98262]: pam_unix(sudo:session): session closed for user root Nov 04 10:22:39 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-21ea0d71-ff6d-42d6-9ac4-584d6ab424d1 tempest-TestInstancesWithCinderVolumes-304140490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-ff5b195e-bcd9-40cf-9c47-d04cbdfef089 1073741824" returned: 0 in 0.445s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:22:39 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-21ea0d71-ff6d-42d6-9ac4-584d6ab424d1 tempest-TestInstancesWithCinderVolumes-304140490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-ff5b195e-bcd9-40cf-9c47-d04cbdfef089 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:22:39 devstack sudo[98268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-ff5b195e-bcd9-40cf-9c47-d04cbdfef089 Nov 04 10:22:39 devstack sudo[98268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:22:39 devstack sudo[98268]: pam_unix(sudo:session): session closed for user root Nov 04 10:22:39 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-21ea0d71-ff6d-42d6-9ac4-584d6ab424d1 tempest-TestInstancesWithCinderVolumes-304140490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-ff5b195e-bcd9-40cf-9c47-d04cbdfef089" returned: 0 in 0.250s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:22:39 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-21ea0d71-ff6d-42d6-9ac4-584d6ab424d1 tempest-TestInstancesWithCinderVolumes-304140490 None] <== create_volume: return (734ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 10:22:39 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-21ea0d71-ff6d-42d6-9ac4-584d6ab424d1 tempest-TestInstancesWithCinderVolumes-304140490 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.736s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:22:39 devstack cinder-volume[87068]: DEBUG cinder.volume.volume_utils [None req-21ea0d71-ff6d-42d6-9ac4-584d6ab424d1 tempest-TestInstancesWithCinderVolumes-304140490 None] Attempting download of 961b9479-c5e3-45e2-a65e-0b4fd1d90e92 ((None, [{'url': 'file:///opt/stack/data/glance/images/961b9479-c5e3-45e2-a65e-0b4fd1d90e92', 'metadata': {}}])) to volume ff5b195e-bcd9-40cf-9c47-d04cbdfef089. {{(pid=87068) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 04 10:22:39 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bb1b235-bca4-4a54-843d-5d8b231a3e49]: (4, 'raw') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:22:39 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-21ea0d71-ff6d-42d6-9ac4-584d6ab424d1 tempest-TestInstancesWithCinderVolumes-304140490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_961b9479-c5e3-45e2-a65e-0b4fd1d90e92_dod7yi0x {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:22:39 devstack sudo[98271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_961b9479-c5e3-45e2-a65e-0b4fd1d90e92_dod7yi0x Nov 04 10:22:39 devstack sudo[98271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:22:40 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-759534f3-9d18-4907-bbff-d234303464b8 tempest-VolumeQuotasAdminTestJSON-1589377281 None] Acquiring lock "cinder-0fdc5403-1987-45e3-94de-fe9caaabb5c6-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:22:40 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-759534f3-9d18-4907-bbff-d234303464b8 tempest-VolumeQuotasAdminTestJSON-1589377281 None] Lock "cinder-0fdc5403-1987-45e3-94de-fe9caaabb5c6-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:22:40 devstack sudo[98271]: pam_unix(sudo:session): session closed for user root Nov 04 10:22:40 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-21ea0d71-ff6d-42d6-9ac4-584d6ab424d1 tempest-TestInstancesWithCinderVolumes-304140490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_961b9479-c5e3-45e2-a65e-0b4fd1d90e92_dod7yi0x" returned: 0 in 0.379s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:22:40 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-21ea0d71-ff6d-42d6-9ac4-584d6ab424d1 tempest-TestInstancesWithCinderVolumes-304140490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_961b9479-c5e3-45e2-a65e-0b4fd1d90e92_dod7yi0x {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:22:40 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-759534f3-9d18-4907-bbff-d234303464b8 tempest-VolumeQuotasAdminTestJSON-1589377281 None] Acquiring lock "cinder-quobyte-0fdc5403-1987-45e3-94de-fe9caaabb5c6" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:22:40 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-759534f3-9d18-4907-bbff-d234303464b8 tempest-VolumeQuotasAdminTestJSON-1589377281 None] Lock "cinder-quobyte-0fdc5403-1987-45e3-94de-fe9caaabb5c6" acquired by "delete_volume" :: waited 0.016s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:22:40 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[5585cf68-abf9-4a15-a1a2-ddb79fa79cda]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:22:40 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-759534f3-9d18-4907-bbff-d234303464b8 tempest-VolumeQuotasAdminTestJSON-1589377281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-0fdc5403-1987-45e3-94de-fe9caaabb5c6 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:22:40 devstack sudo[98275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_961b9479-c5e3-45e2-a65e-0b4fd1d90e92_dod7yi0x Nov 04 10:22:40 devstack sudo[98275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:22:40 devstack sudo[98276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-0fdc5403-1987-45e3-94de-fe9caaabb5c6 Nov 04 10:22:40 devstack sudo[98276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:22:40 devstack sudo[98275]: pam_unix(sudo:session): session closed for user root Nov 04 10:22:40 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-21ea0d71-ff6d-42d6-9ac4-584d6ab424d1 tempest-TestInstancesWithCinderVolumes-304140490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_961b9479-c5e3-45e2-a65e-0b4fd1d90e92_dod7yi0x" returned: 1 in 0.320s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:22:40 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-21ea0d71-ff6d-42d6-9ac4-584d6ab424d1 tempest-TestInstancesWithCinderVolumes-304140490 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_961b9479-c5e3-45e2-a65e-0b4fd1d90e92_dod7yi0x' failed. Not Retrying. {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 04 10:22:40 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eaf91da-04f6-49cf-8825-2a597a93dd8d]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:22:40 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-21ea0d71-ff6d-42d6-9ac4-584d6ab424d1 tempest-TestInstancesWithCinderVolumes-304140490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_961b9479-c5e3-45e2-a65e-0b4fd1d90e92_79o332zvdevstack@QuobyteHD {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:22:40 devstack sudo[98276]: pam_unix(sudo:session): session closed for user root Nov 04 10:22:40 devstack sudo[98281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_961b9479-c5e3-45e2-a65e-0b4fd1d90e92_79o332zvdevstack@QuobyteHD Nov 04 10:22:40 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-759534f3-9d18-4907-bbff-d234303464b8 tempest-VolumeQuotasAdminTestJSON-1589377281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-0fdc5403-1987-45e3-94de-fe9caaabb5c6" returned: 0 in 0.368s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:22:40 devstack sudo[98281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:22:40 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-759534f3-9d18-4907-bbff-d234303464b8 tempest-VolumeQuotasAdminTestJSON-1589377281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-0fdc5403-1987-45e3-94de-fe9caaabb5c6 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:22:40 devstack sudo[98286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-0fdc5403-1987-45e3-94de-fe9caaabb5c6 Nov 04 10:22:40 devstack sudo[98286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:22:40 devstack sudo[98281]: pam_unix(sudo:session): session closed for user root Nov 04 10:22:40 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-21ea0d71-ff6d-42d6-9ac4-584d6ab424d1 tempest-TestInstancesWithCinderVolumes-304140490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_961b9479-c5e3-45e2-a65e-0b4fd1d90e92_79o332zvdevstack@QuobyteHD" returned: 0 in 0.341s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:22:40 devstack cinder-volume[87068]: DEBUG cinder.image.image_utils [None req-21ea0d71-ff6d-42d6-9ac4-584d6ab424d1 tempest-TestInstancesWithCinderVolumes-304140490 None] 961b9479-c5e3-45e2-a65e-0b4fd1d90e92 was qcow2, converting to qcow2 {{(pid=87068) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 04 10:22:40 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-21ea0d71-ff6d-42d6-9ac4-584d6ab424d1 tempest-TestInstancesWithCinderVolumes-304140490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_961b9479-c5e3-45e2-a65e-0b4fd1d90e92_79o332zvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-ff5b195e-bcd9-40cf-9c47-d04cbdfef089 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:22:40 devstack sudo[98286]: pam_unix(sudo:session): session closed for user root Nov 04 10:22:40 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-759534f3-9d18-4907-bbff-d234303464b8 tempest-VolumeQuotasAdminTestJSON-1589377281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-0fdc5403-1987-45e3-94de-fe9caaabb5c6" returned: 0 in 0.243s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:22:40 devstack sudo[98292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_961b9479-c5e3-45e2-a65e-0b4fd1d90e92_79o332zvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-ff5b195e-bcd9-40cf-9c47-d04cbdfef089 Nov 04 10:22:40 devstack sudo[98292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:22:40 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-759534f3-9d18-4907-bbff-d234303464b8 tempest-VolumeQuotasAdminTestJSON-1589377281 None] Lock "cinder-quobyte-0fdc5403-1987-45e3-94de-fe9caaabb5c6" released by "delete_volume" :: held 0.659s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:22:40 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-759534f3-9d18-4907-bbff-d234303464b8 tempest-VolumeQuotasAdminTestJSON-1589377281 None] Created reservations ['14080542-0e9c-452f-82ed-66d5bbccd5c7', '9d79dbc5-6882-4601-a0a9-df49a3d47565', 'dc1775bb-d8f7-4e0e-aa99-e5ac86120de7', '46fc5a6d-3b6b-4a7d-9a6a-5fd6619b8a7e'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:22:40 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-759534f3-9d18-4907-bbff-d234303464b8 tempest-VolumeQuotasAdminTestJSON-1589377281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:22:40 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-759534f3-9d18-4907-bbff-d234303464b8 tempest-VolumeQuotasAdminTestJSON-1589377281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:22:40 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-759534f3-9d18-4907-bbff-d234303464b8 tempest-VolumeQuotasAdminTestJSON-1589377281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:22:40 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-759534f3-9d18-4907-bbff-d234303464b8 tempest-VolumeQuotasAdminTestJSON-1589377281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:22:40 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-759534f3-9d18-4907-bbff-d234303464b8 tempest-VolumeQuotasAdminTestJSON-1589377281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:22:40 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-759534f3-9d18-4907-bbff-d234303464b8 tempest-VolumeQuotasAdminTestJSON-1589377281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:22:40 devstack sudo[98294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:22:40 devstack sudo[98294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:22:41 devstack sudo[98294]: pam_unix(sudo:session): session closed for user root Nov 04 10:22:41 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-759534f3-9d18-4907-bbff-d234303464b8 tempest-VolumeQuotasAdminTestJSON-1589377281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.242s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:22:41 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-759534f3-9d18-4907-bbff-d234303464b8 tempest-VolumeQuotasAdminTestJSON-1589377281 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:22:41 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-759534f3-9d18-4907-bbff-d234303464b8 tempest-VolumeQuotasAdminTestJSON-1589377281 None] Deleted volume successfully. Nov 04 10:22:41 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-759534f3-9d18-4907-bbff-d234303464b8 tempest-VolumeQuotasAdminTestJSON-1589377281 None] Lock "cinder-0fdc5403-1987-45e3-94de-fe9caaabb5c6-delete_volume" released by "delete_volume" :: held 1.124s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:22:41 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-064f6206-6775-4a9c-bd54-87d57c80b4dc tempest-VolumeQuotasAdminTestJSON-1589377281 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:22:41 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-064f6206-6775-4a9c-bd54-87d57c80b4dc tempest-VolumeQuotasAdminTestJSON-1589377281 None] Flow 'volume_create_manager' (c13fe415-310a-4a2f-bc34-e1c49c63c6d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:22:41 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-064f6206-6775-4a9c-bd54-87d57c80b4dc tempest-VolumeQuotasAdminTestJSON-1589377281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15e38048-7283-46be-874c-fd01bda002cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:22:41 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-064f6206-6775-4a9c-bd54-87d57c80b4dc tempest-VolumeQuotasAdminTestJSON-1589377281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15e38048-7283-46be-874c-fd01bda002cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:22:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1361937269',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82194ff5-c905-412e-bc8d-7979872fd097,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70514e5afc8d43b18c190fd5b439517e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:22:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:22:42Z,use_quota=True,user_id='890a1a9211c64debb0150840fa77f610',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:22:41 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-064f6206-6775-4a9c-bd54-87d57c80b4dc tempest-VolumeQuotasAdminTestJSON-1589377281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fe0cb3d-e951-4d79-b98a-674f59638f84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:22:41 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-064f6206-6775-4a9c-bd54-87d57c80b4dc tempest-VolumeQuotasAdminTestJSON-1589377281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fe0cb3d-e951-4d79-b98a-674f59638f84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:22:41 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-064f6206-6775-4a9c-bd54-87d57c80b4dc tempest-VolumeQuotasAdminTestJSON-1589377281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (570cf936-7d31-4aef-8201-17676e82c3d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:22:41 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-064f6206-6775-4a9c-bd54-87d57c80b4dc tempest-VolumeQuotasAdminTestJSON-1589377281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (570cf936-7d31-4aef-8201-17676e82c3d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82194ff5-c905-412e-bc8d-7979872fd097', 'volume_name': 'volume-82194ff5-c905-412e-bc8d-7979872fd097', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:22:41 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-064f6206-6775-4a9c-bd54-87d57c80b4dc tempest-VolumeQuotasAdminTestJSON-1589377281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (168a848a-ca7c-4019-b4fe-cba95fd8c9af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:22:41 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-064f6206-6775-4a9c-bd54-87d57c80b4dc tempest-VolumeQuotasAdminTestJSON-1589377281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (168a848a-ca7c-4019-b4fe-cba95fd8c9af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:22:41 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-064f6206-6775-4a9c-bd54-87d57c80b4dc tempest-VolumeQuotasAdminTestJSON-1589377281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3e870b4-2f36-4ecc-b6f5-90f20f52df91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:22:41 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-064f6206-6775-4a9c-bd54-87d57c80b4dc tempest-VolumeQuotasAdminTestJSON-1589377281 None] Volume 82194ff5-c905-412e-bc8d-7979872fd097: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82194ff5-c905-412e-bc8d-7979872fd097', 'volume_size': 1} Nov 04 10:22:41 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-064f6206-6775-4a9c-bd54-87d57c80b4dc tempest-VolumeQuotasAdminTestJSON-1589377281 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:22:41 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-064f6206-6775-4a9c-bd54-87d57c80b4dc tempest-VolumeQuotasAdminTestJSON-1589377281 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:22:41 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-064f6206-6775-4a9c-bd54-87d57c80b4dc tempest-VolumeQuotasAdminTestJSON-1589377281 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:22:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1361937269',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82194ff5-c905-412e-bc8d-7979872fd097,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70514e5afc8d43b18c190fd5b439517e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:22:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:22:42Z,use_quota=True,user_id='890a1a9211c64debb0150840fa77f610',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 10:22:41 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-064f6206-6775-4a9c-bd54-87d57c80b4dc tempest-VolumeQuotasAdminTestJSON-1589377281 None] Creating volume 82194ff5-c905-412e-bc8d-7979872fd097 {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:22:41 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-064f6206-6775-4a9c-bd54-87d57c80b4dc tempest-VolumeQuotasAdminTestJSON-1589377281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:22:41 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-064f6206-6775-4a9c-bd54-87d57c80b4dc tempest-VolumeQuotasAdminTestJSON-1589377281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:22:41 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-064f6206-6775-4a9c-bd54-87d57c80b4dc tempest-VolumeQuotasAdminTestJSON-1589377281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:22:41 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-064f6206-6775-4a9c-bd54-87d57c80b4dc tempest-VolumeQuotasAdminTestJSON-1589377281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:22:41 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-064f6206-6775-4a9c-bd54-87d57c80b4dc tempest-VolumeQuotasAdminTestJSON-1589377281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:22:41 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-064f6206-6775-4a9c-bd54-87d57c80b4dc tempest-VolumeQuotasAdminTestJSON-1589377281 None] Selected osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:22:41 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-064f6206-6775-4a9c-bd54-87d57c80b4dc tempest-VolumeQuotasAdminTestJSON-1589377281 None] casted to osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 Nov 04 10:22:41 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-064f6206-6775-4a9c-bd54-87d57c80b4dc tempest-VolumeQuotasAdminTestJSON-1589377281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-82194ff5-c905-412e-bc8d-7979872fd097 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:22:41 devstack sudo[98306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-82194ff5-c905-412e-bc8d-7979872fd097 1073741824 Nov 04 10:22:41 devstack sudo[98306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:22:42 devstack sudo[98306]: pam_unix(sudo:session): session closed for user root Nov 04 10:22:42 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-064f6206-6775-4a9c-bd54-87d57c80b4dc tempest-VolumeQuotasAdminTestJSON-1589377281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-82194ff5-c905-412e-bc8d-7979872fd097 1073741824" returned: 0 in 0.662s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:22:42 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-064f6206-6775-4a9c-bd54-87d57c80b4dc tempest-VolumeQuotasAdminTestJSON-1589377281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-82194ff5-c905-412e-bc8d-7979872fd097 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:22:42 devstack sudo[98358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-82194ff5-c905-412e-bc8d-7979872fd097 Nov 04 10:22:42 devstack sudo[98358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:22:42 devstack sudo[98358]: pam_unix(sudo:session): session closed for user root Nov 04 10:22:42 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-064f6206-6775-4a9c-bd54-87d57c80b4dc tempest-VolumeQuotasAdminTestJSON-1589377281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-82194ff5-c905-412e-bc8d-7979872fd097" returned: 0 in 0.344s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:22:42 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-064f6206-6775-4a9c-bd54-87d57c80b4dc tempest-VolumeQuotasAdminTestJSON-1589377281 None] <== create_volume: return (1062ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 10:22:42 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-064f6206-6775-4a9c-bd54-87d57c80b4dc tempest-VolumeQuotasAdminTestJSON-1589377281 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.064s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:22:42 devstack sudo[98292]: pam_unix(sudo:session): session closed for user root Nov 04 10:22:43 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-064f6206-6775-4a9c-bd54-87d57c80b4dc tempest-VolumeQuotasAdminTestJSON-1589377281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3e870b4-2f36-4ecc-b6f5-90f20f52df91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82194ff5-c905-412e-bc8d-7979872fd097', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:22:43 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-064f6206-6775-4a9c-bd54-87d57c80b4dc tempest-VolumeQuotasAdminTestJSON-1589377281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (158d0331-1074-4abf-8348-0970e693d2db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:22:43 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-21ea0d71-ff6d-42d6-9ac4-584d6ab424d1 tempest-TestInstancesWithCinderVolumes-304140490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_961b9479-c5e3-45e2-a65e-0b4fd1d90e92_79o332zvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-ff5b195e-bcd9-40cf-9c47-d04cbdfef089" returned: 0 in 2.231s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:22:43 devstack cinder-volume[87068]: DEBUG cinder.image.image_utils [None req-21ea0d71-ff6d-42d6-9ac4-584d6ab424d1 tempest-TestInstancesWithCinderVolumes-304140490 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_961b9479-c5e3-45e2-a65e-0b4fd1d90e92_79o332zvdevstack@QuobyteHD, size 112.00 MB, duration 2.23 sec, destination /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-ff5b195e-bcd9-40cf-9c47-d04cbdfef089 {{(pid=87068) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 04 10:22:43 devstack cinder-volume[87068]: INFO cinder.image.image_utils [None req-21ea0d71-ff6d-42d6-9ac4-584d6ab424d1 tempest-TestInstancesWithCinderVolumes-304140490 None] Converted 112.00 MB image at 50.15 MB/s Nov 04 10:22:43 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-21ea0d71-ff6d-42d6-9ac4-584d6ab424d1 tempest-TestInstancesWithCinderVolumes-304140490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-ff5b195e-bcd9-40cf-9c47-d04cbdfef089 1G {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:22:43 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-064f6206-6775-4a9c-bd54-87d57c80b4dc tempest-VolumeQuotasAdminTestJSON-1589377281 None] Volume volume-82194ff5-c905-412e-bc8d-7979872fd097 (82194ff5-c905-412e-bc8d-7979872fd097): created successfully Nov 04 10:22:43 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-064f6206-6775-4a9c-bd54-87d57c80b4dc tempest-VolumeQuotasAdminTestJSON-1589377281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (158d0331-1074-4abf-8348-0970e693d2db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:22:43 devstack sudo[98371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-ff5b195e-bcd9-40cf-9c47-d04cbdfef089 1G Nov 04 10:22:43 devstack sudo[98371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:22:43 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-064f6206-6775-4a9c-bd54-87d57c80b4dc tempest-VolumeQuotasAdminTestJSON-1589377281 None] Flow 'volume_create_manager' (c13fe415-310a-4a2f-bc34-e1c49c63c6d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:22:43 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-064f6206-6775-4a9c-bd54-87d57c80b4dc tempest-VolumeQuotasAdminTestJSON-1589377281 None] Created volume successfully. Nov 04 10:22:43 devstack sudo[98371]: pam_unix(sudo:session): session closed for user root Nov 04 10:22:43 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-21ea0d71-ff6d-42d6-9ac4-584d6ab424d1 tempest-TestInstancesWithCinderVolumes-304140490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-ff5b195e-bcd9-40cf-9c47-d04cbdfef089 1G" returned: 0 in 0.399s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:22:43 devstack cinder-volume[87068]: DEBUG cinder.volume.volume_utils [None req-21ea0d71-ff6d-42d6-9ac4-584d6ab424d1 tempest-TestInstancesWithCinderVolumes-304140490 None] Downloaded image 961b9479-c5e3-45e2-a65e-0b4fd1d90e92 ((None, [{'url': 'file:///opt/stack/data/glance/images/961b9479-c5e3-45e2-a65e-0b4fd1d90e92', 'metadata': {}}])) to volume ff5b195e-bcd9-40cf-9c47-d04cbdfef089 successfully. {{(pid=87068) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 04 10:22:43 devstack cinder-volume[87068]: DEBUG cinder.image.image_utils [None req-21ea0d71-ff6d-42d6-9ac4-584d6ab424d1 tempest-TestInstancesWithCinderVolumes-304140490 None] Temporary image 961b9479-c5e3-45e2-a65e-0b4fd1d90e92 for user 1083fefceb464da8858edad15fad12fd is deleted. {{(pid=87068) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 04 10:22:43 devstack cinder-volume[87068]: DEBUG cinder.volume.volume_utils [None req-21ea0d71-ff6d-42d6-9ac4-584d6ab424d1 tempest-TestInstancesWithCinderVolumes-304140490 None] Marking volume ff5b195e-bcd9-40cf-9c47-d04cbdfef089 as bootable. {{(pid=87068) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 04 10:22:43 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-21ea0d71-ff6d-42d6-9ac4-584d6ab424d1 tempest-TestInstancesWithCinderVolumes-304140490 None] Copying metadata from image 961b9479-c5e3-45e2-a65e-0b4fd1d90e92 to ff5b195e-bcd9-40cf-9c47-d04cbdfef089. {{(pid=87068) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 04 10:22:43 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-21ea0d71-ff6d-42d6-9ac4-584d6ab424d1 tempest-TestInstancesWithCinderVolumes-304140490 None] Creating volume glance metadata for volume ff5b195e-bcd9-40cf-9c47-d04cbdfef089 backed by image 961b9479-c5e3-45e2-a65e-0b4fd1d90e92 with: {'image_id': '961b9479-c5e3-45e2-a65e-0b4fd1d90e92', 'image_name': 'tempest-scenario-img--525944725', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87068) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 04 10:22:43 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-4beae6fc-2f0a-4437-b71a-c12d570ea8aa tempest-TestServerVolumeAttachScenarioOldVersion-9121358 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:22:43 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-4beae6fc-2f0a-4437-b71a-c12d570ea8aa tempest-TestServerVolumeAttachScenarioOldVersion-9121358 None] Flow 'volume_create_manager' (6db26c2c-4992-44f9-be04-0225b58ec508) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:22:43 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-4beae6fc-2f0a-4437-b71a-c12d570ea8aa tempest-TestServerVolumeAttachScenarioOldVersion-9121358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03e11989-e4ee-44c8-8354-4ad4634b070b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:22:43 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-4beae6fc-2f0a-4437-b71a-c12d570ea8aa tempest-TestServerVolumeAttachScenarioOldVersion-9121358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03e11989-e4ee-44c8-8354-4ad4634b070b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:22:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1015454627',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b463a299-f1b4-4783-902c-198c8a447cec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a78b256cb0724c66ab9247350f390a82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:22:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:22:43Z,use_quota=True,user_id='96d45c5561a04bd9baace89cb58b6d6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:22:43 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-4beae6fc-2f0a-4437-b71a-c12d570ea8aa tempest-TestServerVolumeAttachScenarioOldVersion-9121358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97eb2ceb-3869-461c-a264-74747bcca8c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:22:43 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-4beae6fc-2f0a-4437-b71a-c12d570ea8aa tempest-TestServerVolumeAttachScenarioOldVersion-9121358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97eb2ceb-3869-461c-a264-74747bcca8c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:22:43 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-4beae6fc-2f0a-4437-b71a-c12d570ea8aa tempest-TestServerVolumeAttachScenarioOldVersion-9121358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3e19c0c-4995-4172-9ff5-a4f60a0fec7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:22:43 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-4beae6fc-2f0a-4437-b71a-c12d570ea8aa tempest-TestServerVolumeAttachScenarioOldVersion-9121358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3e19c0c-4995-4172-9ff5-a4f60a0fec7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b463a299-f1b4-4783-902c-198c8a447cec', 'volume_name': 'volume-b463a299-f1b4-4783-902c-198c8a447cec', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:22:43 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-4beae6fc-2f0a-4437-b71a-c12d570ea8aa tempest-TestServerVolumeAttachScenarioOldVersion-9121358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59c8d223-7b8a-41b0-b9da-5eee7b468063) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:22:43 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-4beae6fc-2f0a-4437-b71a-c12d570ea8aa tempest-TestServerVolumeAttachScenarioOldVersion-9121358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59c8d223-7b8a-41b0-b9da-5eee7b468063) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:22:43 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-4beae6fc-2f0a-4437-b71a-c12d570ea8aa tempest-TestServerVolumeAttachScenarioOldVersion-9121358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (060387f8-2955-456c-ad1b-fac0c53c3e1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:22:43 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-4beae6fc-2f0a-4437-b71a-c12d570ea8aa tempest-TestServerVolumeAttachScenarioOldVersion-9121358 None] Volume b463a299-f1b4-4783-902c-198c8a447cec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b463a299-f1b4-4783-902c-198c8a447cec', 'volume_size': 1} Nov 04 10:22:43 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-4beae6fc-2f0a-4437-b71a-c12d570ea8aa tempest-TestServerVolumeAttachScenarioOldVersion-9121358 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:22:43 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-4beae6fc-2f0a-4437-b71a-c12d570ea8aa tempest-TestServerVolumeAttachScenarioOldVersion-9121358 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:22:43 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-4beae6fc-2f0a-4437-b71a-c12d570ea8aa tempest-TestServerVolumeAttachScenarioOldVersion-9121358 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:22:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1015454627',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b463a299-f1b4-4783-902c-198c8a447cec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a78b256cb0724c66ab9247350f390a82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:22:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:22:43Z,use_quota=True,user_id='96d45c5561a04bd9baace89cb58b6d6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 10:22:43 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-4beae6fc-2f0a-4437-b71a-c12d570ea8aa tempest-TestServerVolumeAttachScenarioOldVersion-9121358 None] Creating volume b463a299-f1b4-4783-902c-198c8a447cec {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:22:43 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-4beae6fc-2f0a-4437-b71a-c12d570ea8aa tempest-TestServerVolumeAttachScenarioOldVersion-9121358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:22:43 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-4beae6fc-2f0a-4437-b71a-c12d570ea8aa tempest-TestServerVolumeAttachScenarioOldVersion-9121358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:22:43 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-4beae6fc-2f0a-4437-b71a-c12d570ea8aa tempest-TestServerVolumeAttachScenarioOldVersion-9121358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:22:43 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-4beae6fc-2f0a-4437-b71a-c12d570ea8aa tempest-TestServerVolumeAttachScenarioOldVersion-9121358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:22:43 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-4beae6fc-2f0a-4437-b71a-c12d570ea8aa tempest-TestServerVolumeAttachScenarioOldVersion-9121358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:22:43 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-4beae6fc-2f0a-4437-b71a-c12d570ea8aa tempest-TestServerVolumeAttachScenarioOldVersion-9121358 None] Selected osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:22:43 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-4beae6fc-2f0a-4437-b71a-c12d570ea8aa tempest-TestServerVolumeAttachScenarioOldVersion-9121358 None] casted to osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 Nov 04 10:22:43 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-4beae6fc-2f0a-4437-b71a-c12d570ea8aa tempest-TestServerVolumeAttachScenarioOldVersion-9121358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b463a299-f1b4-4783-902c-198c8a447cec 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:22:43 devstack sudo[98378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b463a299-f1b4-4783-902c-198c8a447cec 1073741824 Nov 04 10:22:43 devstack sudo[98378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:22:43 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-21ea0d71-ff6d-42d6-9ac4-584d6ab424d1 tempest-TestInstancesWithCinderVolumes-304140490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e47012e-d6e4-444d-b644-0fe7565622c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff5b195e-bcd9-40cf-9c47-d04cbdfef089', 'volume_size': 1, 'image_id': '961b9479-c5e3-45e2-a65e-0b4fd1d90e92', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/961b9479-c5e3-45e2-a65e-0b4fd1d90e92', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--525944725', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7b66642bac394c148c09a84f14ff0787', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '961b9479-c5e3-45e2-a65e-0b4fd1d90e92', 'created_at': datetime.datetime(2026, 11, 4, 9, 22, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 9, 22, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/961b9479-c5e3-45e2-a65e-0b4fd1d90e92/file', 'properties': {}}, 'image_service': }' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:22:43 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-21ea0d71-ff6d-42d6-9ac4-584d6ab424d1 tempest-TestInstancesWithCinderVolumes-304140490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1ffc8b8-cb22-4314-9e44-0b3d6eb9f08f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:22:43 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-21ea0d71-ff6d-42d6-9ac4-584d6ab424d1 tempest-TestInstancesWithCinderVolumes-304140490 None] Volume volume-ff5b195e-bcd9-40cf-9c47-d04cbdfef089 (ff5b195e-bcd9-40cf-9c47-d04cbdfef089): created successfully Nov 04 10:22:43 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-21ea0d71-ff6d-42d6-9ac4-584d6ab424d1 tempest-TestInstancesWithCinderVolumes-304140490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1ffc8b8-cb22-4314-9e44-0b3d6eb9f08f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:22:43 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-21ea0d71-ff6d-42d6-9ac4-584d6ab424d1 tempest-TestInstancesWithCinderVolumes-304140490 None] Flow 'volume_create_manager' (14e07994-ec45-4b19-a023-b0dc89e3a7f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:22:43 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-21ea0d71-ff6d-42d6-9ac4-584d6ab424d1 tempest-TestInstancesWithCinderVolumes-304140490 None] Created volume successfully. Nov 04 10:22:44 devstack sudo[98378]: pam_unix(sudo:session): session closed for user root Nov 04 10:22:44 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-4beae6fc-2f0a-4437-b71a-c12d570ea8aa tempest-TestServerVolumeAttachScenarioOldVersion-9121358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b463a299-f1b4-4783-902c-198c8a447cec 1073741824" returned: 0 in 0.574s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:22:44 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-4beae6fc-2f0a-4437-b71a-c12d570ea8aa tempest-TestServerVolumeAttachScenarioOldVersion-9121358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b463a299-f1b4-4783-902c-198c8a447cec {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:22:44 devstack sudo[98384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b463a299-f1b4-4783-902c-198c8a447cec Nov 04 10:22:44 devstack sudo[98384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:22:44 devstack sudo[98384]: pam_unix(sudo:session): session closed for user root Nov 04 10:22:44 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-4beae6fc-2f0a-4437-b71a-c12d570ea8aa tempest-TestServerVolumeAttachScenarioOldVersion-9121358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b463a299-f1b4-4783-902c-198c8a447cec" returned: 0 in 0.300s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:22:44 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-4beae6fc-2f0a-4437-b71a-c12d570ea8aa tempest-TestServerVolumeAttachScenarioOldVersion-9121358 None] <== create_volume: return (929ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 10:22:44 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-4beae6fc-2f0a-4437-b71a-c12d570ea8aa tempest-TestServerVolumeAttachScenarioOldVersion-9121358 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.933s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:22:44 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-4beae6fc-2f0a-4437-b71a-c12d570ea8aa tempest-TestServerVolumeAttachScenarioOldVersion-9121358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (060387f8-2955-456c-ad1b-fac0c53c3e1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b463a299-f1b4-4783-902c-198c8a447cec', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:22:44 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-4beae6fc-2f0a-4437-b71a-c12d570ea8aa tempest-TestServerVolumeAttachScenarioOldVersion-9121358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d0162fc-398c-44dd-9d79-a040f9e6022b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:22:44 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-4beae6fc-2f0a-4437-b71a-c12d570ea8aa tempest-TestServerVolumeAttachScenarioOldVersion-9121358 None] Volume volume-b463a299-f1b4-4783-902c-198c8a447cec (b463a299-f1b4-4783-902c-198c8a447cec): created successfully Nov 04 10:22:44 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-4beae6fc-2f0a-4437-b71a-c12d570ea8aa tempest-TestServerVolumeAttachScenarioOldVersion-9121358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d0162fc-398c-44dd-9d79-a040f9e6022b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:22:44 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-4beae6fc-2f0a-4437-b71a-c12d570ea8aa tempest-TestServerVolumeAttachScenarioOldVersion-9121358 None] Flow 'volume_create_manager' (6db26c2c-4992-44f9-be04-0225b58ec508) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:22:44 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-4beae6fc-2f0a-4437-b71a-c12d570ea8aa tempest-TestServerVolumeAttachScenarioOldVersion-9121358 None] Created volume successfully. Nov 04 10:22:44 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-ad9387aa-b868-44e0-a68f-364252dcdbca tempest-VolumeQuotasAdminTestJSON-61769109 None] Transfer volume completed successfully. Nov 04 10:22:45 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-cbda517f-69e4-4559-ace3-ff6696ed3d1b tempest-VolumeQuotasAdminTestJSON-799318861 None] Acquiring lock "cinder-82194ff5-c905-412e-bc8d-7979872fd097-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:22:45 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-cbda517f-69e4-4559-ace3-ff6696ed3d1b tempest-VolumeQuotasAdminTestJSON-799318861 None] Lock "cinder-82194ff5-c905-412e-bc8d-7979872fd097-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:22:45 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-cbda517f-69e4-4559-ace3-ff6696ed3d1b tempest-VolumeQuotasAdminTestJSON-799318861 None] Acquiring lock "cinder-quobyte-82194ff5-c905-412e-bc8d-7979872fd097" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:22:45 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-cbda517f-69e4-4559-ace3-ff6696ed3d1b tempest-VolumeQuotasAdminTestJSON-799318861 None] Lock "cinder-quobyte-82194ff5-c905-412e-bc8d-7979872fd097" acquired by "delete_volume" :: waited 0.021s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:22:45 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a043f9f-b7a1-4ebf-9d2e-0a4a67d733cf]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:22:45 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-cbda517f-69e4-4559-ace3-ff6696ed3d1b tempest-VolumeQuotasAdminTestJSON-799318861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-82194ff5-c905-412e-bc8d-7979872fd097 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:22:45 devstack sudo[98387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-82194ff5-c905-412e-bc8d-7979872fd097 Nov 04 10:22:45 devstack sudo[98387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:22:46 devstack sudo[98387]: pam_unix(sudo:session): session closed for user root Nov 04 10:22:46 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-cbda517f-69e4-4559-ace3-ff6696ed3d1b tempest-VolumeQuotasAdminTestJSON-799318861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-82194ff5-c905-412e-bc8d-7979872fd097" returned: 0 in 0.521s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:22:46 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-cbda517f-69e4-4559-ace3-ff6696ed3d1b tempest-VolumeQuotasAdminTestJSON-799318861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-82194ff5-c905-412e-bc8d-7979872fd097 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:22:46 devstack sudo[98397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-82194ff5-c905-412e-bc8d-7979872fd097 Nov 04 10:22:46 devstack sudo[98397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:22:46 devstack sudo[98397]: pam_unix(sudo:session): session closed for user root Nov 04 10:22:46 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-cbda517f-69e4-4559-ace3-ff6696ed3d1b tempest-VolumeQuotasAdminTestJSON-799318861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-82194ff5-c905-412e-bc8d-7979872fd097" returned: 0 in 0.439s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:22:46 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-cbda517f-69e4-4559-ace3-ff6696ed3d1b tempest-VolumeQuotasAdminTestJSON-799318861 None] Lock "cinder-quobyte-82194ff5-c905-412e-bc8d-7979872fd097" released by "delete_volume" :: held 1.050s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:22:46 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-cbda517f-69e4-4559-ace3-ff6696ed3d1b tempest-VolumeQuotasAdminTestJSON-799318861 None] Created reservations ['ea914229-9261-4440-a9a4-da4429cde161', 'bdb52065-e0d4-4c93-a6a4-849011e6d3ae', '30deab20-751a-48b0-be0e-9edb437c9b5c', '0cdb2fa2-8744-40c9-9cc4-a84afe74ddc3'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:22:46 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-cbda517f-69e4-4559-ace3-ff6696ed3d1b tempest-VolumeQuotasAdminTestJSON-799318861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:22:46 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-cbda517f-69e4-4559-ace3-ff6696ed3d1b tempest-VolumeQuotasAdminTestJSON-799318861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:22:46 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-cbda517f-69e4-4559-ace3-ff6696ed3d1b tempest-VolumeQuotasAdminTestJSON-799318861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:22:46 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-cbda517f-69e4-4559-ace3-ff6696ed3d1b tempest-VolumeQuotasAdminTestJSON-799318861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:22:46 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-cbda517f-69e4-4559-ace3-ff6696ed3d1b tempest-VolumeQuotasAdminTestJSON-799318861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:22:46 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-cbda517f-69e4-4559-ace3-ff6696ed3d1b tempest-VolumeQuotasAdminTestJSON-799318861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:22:46 devstack sudo[98416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:22:46 devstack sudo[98416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:22:46 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [req-e8aa6f0c-66ae-46fa-b592-6b070afa93e9 req-e9500e64-1028-4f42-8ce8-2a81b00b9d1f tempest-TestServerVolumeAttachScenarioOldVersion-9121358 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:22:46 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [req-e8aa6f0c-66ae-46fa-b592-6b070afa93e9 req-e9500e64-1028-4f42-8ce8-2a81b00b9d1f tempest-TestServerVolumeAttachScenarioOldVersion-9121358 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:22:46 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [req-e8aa6f0c-66ae-46fa-b592-6b070afa93e9 req-e9500e64-1028-4f42-8ce8-2a81b00b9d1f tempest-TestServerVolumeAttachScenarioOldVersion-9121358 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:22:46 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [req-e8aa6f0c-66ae-46fa-b592-6b070afa93e9 req-e9500e64-1028-4f42-8ce8-2a81b00b9d1f tempest-TestServerVolumeAttachScenarioOldVersion-9121358 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034', 'name': 'volume-b463a299-f1b4-4783-902c-198c8a447cec', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1c646d6a-bb70-4de1-91b0-109d25705911', 'enforce_multipath': True} {{(pid=87068) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 04 10:22:46 devstack cinder-volume[87068]: INFO cinder.volume.manager [req-e8aa6f0c-66ae-46fa-b592-6b070afa93e9 req-e9500e64-1028-4f42-8ce8-2a81b00b9d1f tempest-TestServerVolumeAttachScenarioOldVersion-9121358 None] attachment_update completed successfully. Nov 04 10:22:47 devstack sudo[98416]: pam_unix(sudo:session): session closed for user root Nov 04 10:22:47 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-cbda517f-69e4-4559-ace3-ff6696ed3d1b tempest-VolumeQuotasAdminTestJSON-799318861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.311s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:22:47 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-cbda517f-69e4-4559-ace3-ff6696ed3d1b tempest-VolumeQuotasAdminTestJSON-799318861 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:22:47 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-cbda517f-69e4-4559-ace3-ff6696ed3d1b tempest-VolumeQuotasAdminTestJSON-799318861 None] Deleted volume successfully. Nov 04 10:22:47 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-cbda517f-69e4-4559-ace3-ff6696ed3d1b tempest-VolumeQuotasAdminTestJSON-799318861 None] Lock "cinder-82194ff5-c905-412e-bc8d-7979872fd097-delete_volume" released by "delete_volume" :: held 1.778s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:22:48 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [req-9b91b8cc-caa6-4c5b-8657-ebdc56619269 req-a8e84411-3edf-4bc0-81ee-ffcbf0da59ea tempest-TestInstancesWithCinderVolumes-304140490 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:22:48 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [req-9b91b8cc-caa6-4c5b-8657-ebdc56619269 req-a8e84411-3edf-4bc0-81ee-ffcbf0da59ea tempest-TestInstancesWithCinderVolumes-304140490 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:22:48 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [req-9b91b8cc-caa6-4c5b-8657-ebdc56619269 req-a8e84411-3edf-4bc0-81ee-ffcbf0da59ea tempest-TestInstancesWithCinderVolumes-304140490 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:22:48 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [req-9b91b8cc-caa6-4c5b-8657-ebdc56619269 req-a8e84411-3edf-4bc0-81ee-ffcbf0da59ea tempest-TestInstancesWithCinderVolumes-304140490 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034', 'name': 'volume-ff5b195e-bcd9-40cf-9c47-d04cbdfef089', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd54c8659-7d66-4989-9829-a13a4c080f23', 'enforce_multipath': True} {{(pid=87068) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 04 10:22:48 devstack cinder-volume[87068]: INFO cinder.volume.manager [req-9b91b8cc-caa6-4c5b-8657-ebdc56619269 req-a8e84411-3edf-4bc0-81ee-ffcbf0da59ea tempest-TestInstancesWithCinderVolumes-304140490 None] attachment_update completed successfully. Nov 04 10:22:50 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [req-d9042ec2-4800-4f50-b2f5-c3874d1a9202 req-dc209640-dbd8-41d6-a10b-92ec184fc6a3 tempest-TestServerVolumeAttachmentScenario-2020619854 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:22:50 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [req-d9042ec2-4800-4f50-b2f5-c3874d1a9202 req-dc209640-dbd8-41d6-a10b-92ec184fc6a3 tempest-TestServerVolumeAttachmentScenario-2020619854 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:22:50 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [req-d9042ec2-4800-4f50-b2f5-c3874d1a9202 req-dc209640-dbd8-41d6-a10b-92ec184fc6a3 tempest-TestServerVolumeAttachmentScenario-2020619854 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.031s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:22:50 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [req-d9042ec2-4800-4f50-b2f5-c3874d1a9202 req-dc209640-dbd8-41d6-a10b-92ec184fc6a3 tempest-TestServerVolumeAttachmentScenario-2020619854 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034', 'name': 'volume-41398b59-eb96-4b87-ab99-f59cb633a7e3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '665db58f-1797-4fe3-8b4e-d8907e61b8c5', 'enforce_multipath': True} {{(pid=87068) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 04 10:22:50 devstack cinder-volume[87068]: INFO cinder.volume.manager [req-d9042ec2-4800-4f50-b2f5-c3874d1a9202 req-dc209640-dbd8-41d6-a10b-92ec184fc6a3 tempest-TestServerVolumeAttachmentScenario-2020619854 None] attachment_update completed successfully. Nov 04 10:22:51 devstack cinder-volume[87068]: INFO cinder.volume.manager [req-ae0c30e5-80e6-4010-b946-65d0c10d7e31 req-8c9cbfaa-926e-4a80-b8bc-40cc69d7a1e9 tempest-TestServerVolumeAttachScenarioOldVersion-9121358 None] Terminate volume connection completed successfully. Nov 04 10:22:51 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [req-ae0c30e5-80e6-4010-b946-65d0c10d7e31 req-8c9cbfaa-926e-4a80-b8bc-40cc69d7a1e9 tempest-TestServerVolumeAttachScenarioOldVersion-9121358 None] Deleting attachment 1c646d6a-bb70-4de1-91b0-109d25705911. {{(pid=87068) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 04 10:22:52 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-b6e61164-bda1-4676-a954-740ab72503ea tempest-TestServerVolumeAttachScenarioOldVersion-9121358 None] Acquiring lock "cinder-b463a299-f1b4-4783-902c-198c8a447cec-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:22:52 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-b6e61164-bda1-4676-a954-740ab72503ea tempest-TestServerVolumeAttachScenarioOldVersion-9121358 None] Lock "cinder-b463a299-f1b4-4783-902c-198c8a447cec-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:22:52 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-b6e61164-bda1-4676-a954-740ab72503ea tempest-TestServerVolumeAttachScenarioOldVersion-9121358 None] Acquiring lock "cinder-quobyte-b463a299-f1b4-4783-902c-198c8a447cec" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:22:52 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-b6e61164-bda1-4676-a954-740ab72503ea tempest-TestServerVolumeAttachScenarioOldVersion-9121358 None] Lock "cinder-quobyte-b463a299-f1b4-4783-902c-198c8a447cec" acquired by "delete_volume" :: waited 0.031s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:22:52 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[94050c25-b996-4432-b86e-5bd4737ec550]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:22:52 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-b6e61164-bda1-4676-a954-740ab72503ea tempest-TestServerVolumeAttachScenarioOldVersion-9121358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b463a299-f1b4-4783-902c-198c8a447cec {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:22:52 devstack sudo[98908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b463a299-f1b4-4783-902c-198c8a447cec Nov 04 10:22:52 devstack sudo[98908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:22:53 devstack sudo[98908]: pam_unix(sudo:session): session closed for user root Nov 04 10:22:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-b6e61164-bda1-4676-a954-740ab72503ea tempest-TestServerVolumeAttachScenarioOldVersion-9121358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b463a299-f1b4-4783-902c-198c8a447cec" returned: 0 in 0.841s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:22:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-b6e61164-bda1-4676-a954-740ab72503ea tempest-TestServerVolumeAttachScenarioOldVersion-9121358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b463a299-f1b4-4783-902c-198c8a447cec {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:22:53 devstack sudo[98932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b463a299-f1b4-4783-902c-198c8a447cec Nov 04 10:22:53 devstack sudo[98932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:22:53 devstack cinder-volume[87068]: DEBUG oslo_service.periodic_task [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87068) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 10:22:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:22:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:22:53 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:22:53 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:22:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:22:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:22:53 devstack sudo[98935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:22:53 devstack sudo[98935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:22:53 devstack sudo[98932]: pam_unix(sudo:session): session closed for user root Nov 04 10:22:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-b6e61164-bda1-4676-a954-740ab72503ea tempest-TestServerVolumeAttachScenarioOldVersion-9121358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b463a299-f1b4-4783-902c-198c8a447cec" returned: 0 in 0.391s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:22:53 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-b6e61164-bda1-4676-a954-740ab72503ea tempest-TestServerVolumeAttachScenarioOldVersion-9121358 None] Lock "cinder-quobyte-b463a299-f1b4-4783-902c-198c8a447cec" released by "delete_volume" :: held 1.371s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:22:53 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-b6e61164-bda1-4676-a954-740ab72503ea tempest-TestServerVolumeAttachScenarioOldVersion-9121358 None] Created reservations ['a1c6e165-40c8-4f69-a140-9993a8d93602', 'c411aeb1-d1c7-412b-9b62-29716590eefd', 'f09e38db-3c27-4ec3-b185-cb3a32e9276d', '2042a152-3774-4e6d-8564-bff826b61745'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:22:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-b6e61164-bda1-4676-a954-740ab72503ea tempest-TestServerVolumeAttachScenarioOldVersion-9121358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:22:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-b6e61164-bda1-4676-a954-740ab72503ea tempest-TestServerVolumeAttachScenarioOldVersion-9121358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:22:54 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-b6e61164-bda1-4676-a954-740ab72503ea tempest-TestServerVolumeAttachScenarioOldVersion-9121358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:22:54 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-b6e61164-bda1-4676-a954-740ab72503ea tempest-TestServerVolumeAttachScenarioOldVersion-9121358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:22:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-b6e61164-bda1-4676-a954-740ab72503ea tempest-TestServerVolumeAttachScenarioOldVersion-9121358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:22:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-b6e61164-bda1-4676-a954-740ab72503ea tempest-TestServerVolumeAttachScenarioOldVersion-9121358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:22:54 devstack sudo[98941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:22:54 devstack sudo[98941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:22:54 devstack sudo[98935]: pam_unix(sudo:session): session closed for user root Nov 04 10:22:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.593s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:22:54 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:22:54 devstack cinder-volume[87068]: DEBUG oslo_service.periodic_task [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Running periodic task VolumeManager._thread_info {{(pid=87068) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 10:22:54 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] thread count: 28 {{(pid=87068) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 04 10:22:54 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] thread info: [<_MainThread(MainThread, started 126275656192128)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87068) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 04 10:22:54 devstack sudo[98941]: pam_unix(sudo:session): session closed for user root Nov 04 10:22:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-b6e61164-bda1-4676-a954-740ab72503ea tempest-TestServerVolumeAttachScenarioOldVersion-9121358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.598s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:22:54 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-b6e61164-bda1-4676-a954-740ab72503ea tempest-TestServerVolumeAttachScenarioOldVersion-9121358 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:22:54 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-b6e61164-bda1-4676-a954-740ab72503ea tempest-TestServerVolumeAttachScenarioOldVersion-9121358 None] Deleted volume successfully. Nov 04 10:22:54 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-b6e61164-bda1-4676-a954-740ab72503ea tempest-TestServerVolumeAttachScenarioOldVersion-9121358 None] Lock "cinder-b463a299-f1b4-4783-902c-198c8a447cec-delete_volume" released by "delete_volume" :: held 2.459s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:23:00 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [req-e669a079-f1e1-4ed2-b079-1b4eebec8544 req-954fe251-d0c0-49cb-8e46-f03ced521c8f tempest-TestServerVolumeAttachmentScenario-2020619854 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:23:00 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [req-e669a079-f1e1-4ed2-b079-1b4eebec8544 req-954fe251-d0c0-49cb-8e46-f03ced521c8f tempest-TestServerVolumeAttachmentScenario-2020619854 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:23:00 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [req-e669a079-f1e1-4ed2-b079-1b4eebec8544 req-954fe251-d0c0-49cb-8e46-f03ced521c8f tempest-TestServerVolumeAttachmentScenario-2020619854 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.038s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:23:00 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [req-e669a079-f1e1-4ed2-b079-1b4eebec8544 req-954fe251-d0c0-49cb-8e46-f03ced521c8f tempest-TestServerVolumeAttachmentScenario-2020619854 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034', 'name': 'volume-290fec35-fe01-4ab8-a87e-becf9d587583', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '37edf49a-10ee-4190-8c3d-c6f30fab397a', 'enforce_multipath': True} {{(pid=87068) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 04 10:23:00 devstack cinder-volume[87068]: INFO cinder.volume.manager [req-e669a079-f1e1-4ed2-b079-1b4eebec8544 req-954fe251-d0c0-49cb-8e46-f03ced521c8f tempest-TestServerVolumeAttachmentScenario-2020619854 None] attachment_update completed successfully. Nov 04 10:23:03 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-28a30282-172c-4b04-ad37-fac6f469fee2 tempest-VolumeRetypeWithoutMigrationTest-1732327509 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:23:03 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-28a30282-172c-4b04-ad37-fac6f469fee2 tempest-VolumeRetypeWithoutMigrationTest-1732327509 None] Flow 'volume_create_manager' (7495d22a-4c72-4d6d-b2e3-6affdf393c3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:23:03 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-28a30282-172c-4b04-ad37-fac6f469fee2 tempest-VolumeRetypeWithoutMigrationTest-1732327509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d613276-1a62-42ee-88e5-76d0ca933719) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:23:03 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-28a30282-172c-4b04-ad37-fac6f469fee2 tempest-VolumeRetypeWithoutMigrationTest-1732327509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d613276-1a62-42ee-88e5-76d0ca933719) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:23:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1550680161',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b74dcd96-b15c-47fa-a6a6-5fabdaf5f002,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3592cbbfba9a4eb0a3bfaf5e23fa074e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:23:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:23:03Z,use_quota=True,user_id='b73e59277a1a458196895976c82617d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(af35d0a2-f4c2-4cba-986e-0eb7a400799f),volume_type_id=af35d0a2-f4c2-4cba-986e-0eb7a400799f)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:23:03 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-28a30282-172c-4b04-ad37-fac6f469fee2 tempest-VolumeRetypeWithoutMigrationTest-1732327509 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f55f48f-3a9f-4f00-ad6a-2cfd1b7f0482) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:23:03 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-28a30282-172c-4b04-ad37-fac6f469fee2 tempest-VolumeRetypeWithoutMigrationTest-1732327509 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f55f48f-3a9f-4f00-ad6a-2cfd1b7f0482) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:23:03 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-28a30282-172c-4b04-ad37-fac6f469fee2 tempest-VolumeRetypeWithoutMigrationTest-1732327509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43d5eaa9-0903-4786-82e9-ec439735d6b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:23:03 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-28a30282-172c-4b04-ad37-fac6f469fee2 tempest-VolumeRetypeWithoutMigrationTest-1732327509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43d5eaa9-0903-4786-82e9-ec439735d6b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b74dcd96-b15c-47fa-a6a6-5fabdaf5f002', 'volume_name': 'volume-b74dcd96-b15c-47fa-a6a6-5fabdaf5f002', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:23:03 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-28a30282-172c-4b04-ad37-fac6f469fee2 tempest-VolumeRetypeWithoutMigrationTest-1732327509 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (518431db-e27d-43c4-8962-1f4be81527f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:23:03 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-28a30282-172c-4b04-ad37-fac6f469fee2 tempest-VolumeRetypeWithoutMigrationTest-1732327509 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (518431db-e27d-43c4-8962-1f4be81527f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:23:03 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-28a30282-172c-4b04-ad37-fac6f469fee2 tempest-VolumeRetypeWithoutMigrationTest-1732327509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a452e1ca-ce47-4401-be0c-75947d43f44c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:23:03 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-28a30282-172c-4b04-ad37-fac6f469fee2 tempest-VolumeRetypeWithoutMigrationTest-1732327509 None] Volume b74dcd96-b15c-47fa-a6a6-5fabdaf5f002: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b74dcd96-b15c-47fa-a6a6-5fabdaf5f002', 'volume_size': 1} Nov 04 10:23:03 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-28a30282-172c-4b04-ad37-fac6f469fee2 tempest-VolumeRetypeWithoutMigrationTest-1732327509 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:23:03 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-28a30282-172c-4b04-ad37-fac6f469fee2 tempest-VolumeRetypeWithoutMigrationTest-1732327509 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:23:03 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-28a30282-172c-4b04-ad37-fac6f469fee2 tempest-VolumeRetypeWithoutMigrationTest-1732327509 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:23:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1550680161',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b74dcd96-b15c-47fa-a6a6-5fabdaf5f002,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3592cbbfba9a4eb0a3bfaf5e23fa074e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:23:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:23:03Z,use_quota=True,user_id='b73e59277a1a458196895976c82617d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(af35d0a2-f4c2-4cba-986e-0eb7a400799f),volume_type_id=af35d0a2-f4c2-4cba-986e-0eb7a400799f)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 10:23:03 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-28a30282-172c-4b04-ad37-fac6f469fee2 tempest-VolumeRetypeWithoutMigrationTest-1732327509 None] Creating volume b74dcd96-b15c-47fa-a6a6-5fabdaf5f002 {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:23:03 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-28a30282-172c-4b04-ad37-fac6f469fee2 tempest-VolumeRetypeWithoutMigrationTest-1732327509 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:23:03 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-28a30282-172c-4b04-ad37-fac6f469fee2 tempest-VolumeRetypeWithoutMigrationTest-1732327509 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:23:03 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-28a30282-172c-4b04-ad37-fac6f469fee2 tempest-VolumeRetypeWithoutMigrationTest-1732327509 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:23:03 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-28a30282-172c-4b04-ad37-fac6f469fee2 tempest-VolumeRetypeWithoutMigrationTest-1732327509 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:23:03 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-28a30282-172c-4b04-ad37-fac6f469fee2 tempest-VolumeRetypeWithoutMigrationTest-1732327509 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:23:03 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-28a30282-172c-4b04-ad37-fac6f469fee2 tempest-VolumeRetypeWithoutMigrationTest-1732327509 None] Selected osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:23:03 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-28a30282-172c-4b04-ad37-fac6f469fee2 tempest-VolumeRetypeWithoutMigrationTest-1732327509 None] casted to osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 Nov 04 10:23:03 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-28a30282-172c-4b04-ad37-fac6f469fee2 tempest-VolumeRetypeWithoutMigrationTest-1732327509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b74dcd96-b15c-47fa-a6a6-5fabdaf5f002 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:23:03 devstack sudo[98987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b74dcd96-b15c-47fa-a6a6-5fabdaf5f002 1073741824 Nov 04 10:23:03 devstack sudo[98987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:23:03 devstack cinder-volume[87068]: INFO cinder.volume.manager [req-57d6c71b-c931-4368-9a26-6ec17c4b6be0 req-ef5d7f16-46a4-4715-b785-9e098d910fc3 tempest-TestServerVolumeAttachmentScenario-2020619854 None] Terminate volume connection completed successfully. Nov 04 10:23:03 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [req-57d6c71b-c931-4368-9a26-6ec17c4b6be0 req-ef5d7f16-46a4-4715-b785-9e098d910fc3 tempest-TestServerVolumeAttachmentScenario-2020619854 None] Deleting attachment 37edf49a-10ee-4190-8c3d-c6f30fab397a. {{(pid=87068) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 04 10:23:04 devstack sudo[98987]: pam_unix(sudo:session): session closed for user root Nov 04 10:23:04 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-28a30282-172c-4b04-ad37-fac6f469fee2 tempest-VolumeRetypeWithoutMigrationTest-1732327509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b74dcd96-b15c-47fa-a6a6-5fabdaf5f002 1073741824" returned: 0 in 1.086s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:23:04 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-28a30282-172c-4b04-ad37-fac6f469fee2 tempest-VolumeRetypeWithoutMigrationTest-1732327509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b74dcd96-b15c-47fa-a6a6-5fabdaf5f002 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:23:04 devstack sudo[98996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b74dcd96-b15c-47fa-a6a6-5fabdaf5f002 Nov 04 10:23:04 devstack sudo[98996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:23:05 devstack sudo[98996]: pam_unix(sudo:session): session closed for user root Nov 04 10:23:05 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-28a30282-172c-4b04-ad37-fac6f469fee2 tempest-VolumeRetypeWithoutMigrationTest-1732327509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b74dcd96-b15c-47fa-a6a6-5fabdaf5f002" returned: 0 in 0.523s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:23:05 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-28a30282-172c-4b04-ad37-fac6f469fee2 tempest-VolumeRetypeWithoutMigrationTest-1732327509 None] <== create_volume: return (1711ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 10:23:05 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-28a30282-172c-4b04-ad37-fac6f469fee2 tempest-VolumeRetypeWithoutMigrationTest-1732327509 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.719s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:23:05 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-28a30282-172c-4b04-ad37-fac6f469fee2 tempest-VolumeRetypeWithoutMigrationTest-1732327509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a452e1ca-ce47-4401-be0c-75947d43f44c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b74dcd96-b15c-47fa-a6a6-5fabdaf5f002', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:23:05 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-28a30282-172c-4b04-ad37-fac6f469fee2 tempest-VolumeRetypeWithoutMigrationTest-1732327509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34c4a8b9-541d-4123-a10e-ae80e25a0825) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:23:05 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-28a30282-172c-4b04-ad37-fac6f469fee2 tempest-VolumeRetypeWithoutMigrationTest-1732327509 None] Volume volume-b74dcd96-b15c-47fa-a6a6-5fabdaf5f002 (b74dcd96-b15c-47fa-a6a6-5fabdaf5f002): created successfully Nov 04 10:23:05 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-28a30282-172c-4b04-ad37-fac6f469fee2 tempest-VolumeRetypeWithoutMigrationTest-1732327509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34c4a8b9-541d-4123-a10e-ae80e25a0825) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:23:05 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-28a30282-172c-4b04-ad37-fac6f469fee2 tempest-VolumeRetypeWithoutMigrationTest-1732327509 None] Flow 'volume_create_manager' (7495d22a-4c72-4d6d-b2e3-6affdf393c3f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:23:05 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-28a30282-172c-4b04-ad37-fac6f469fee2 tempest-VolumeRetypeWithoutMigrationTest-1732327509 None] Created volume successfully. Nov 04 10:23:06 devstack cinder-volume[87068]: INFO cinder.volume.manager [req-00c92e68-507e-4776-b681-c2be964d1e92 req-e50674a7-cb6b-4d27-a2a8-5afd871bbf64 tempest-TestServerVolumeAttachmentScenario-2020619854 None] Terminate volume connection completed successfully. Nov 04 10:23:06 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [req-00c92e68-507e-4776-b681-c2be964d1e92 req-e50674a7-cb6b-4d27-a2a8-5afd871bbf64 tempest-TestServerVolumeAttachmentScenario-2020619854 None] Deleting attachment 665db58f-1797-4fe3-8b4e-d8907e61b8c5. {{(pid=87068) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 04 10:23:06 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-e7265ba8-3d16-44d6-b54e-6d7ccd7c73a8 tempest-VolumeRetypeWithoutMigrationTest-1732327509 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:23:06 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-e7265ba8-3d16-44d6-b54e-6d7ccd7c73a8 tempest-VolumeRetypeWithoutMigrationTest-1732327509 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:23:06 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-e7265ba8-3d16-44d6-b54e-6d7ccd7c73a8 tempest-VolumeRetypeWithoutMigrationTest-1732327509 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:23:06 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-e7265ba8-3d16-44d6-b54e-6d7ccd7c73a8 tempest-VolumeRetypeWithoutMigrationTest-1732327509 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:23:06 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-e7265ba8-3d16-44d6-b54e-6d7ccd7c73a8 tempest-VolumeRetypeWithoutMigrationTest-1732327509 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:23:06 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-e7265ba8-3d16-44d6-b54e-6d7ccd7c73a8 tempest-VolumeRetypeWithoutMigrationTest-1732327509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:23:06 devstack sudo[99001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:23:06 devstack sudo[99001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:23:06 devstack sudo[99001]: pam_unix(sudo:session): session closed for user root Nov 04 10:23:06 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-e7265ba8-3d16-44d6-b54e-6d7ccd7c73a8 tempest-VolumeRetypeWithoutMigrationTest-1732327509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.402s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:23:06 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-e7265ba8-3d16-44d6-b54e-6d7ccd7c73a8 tempest-VolumeRetypeWithoutMigrationTest-1732327509 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:23:06 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-e7265ba8-3d16-44d6-b54e-6d7ccd7c73a8 tempest-VolumeRetypeWithoutMigrationTest-1732327509 None] Retype volume completed successfully. Nov 04 10:23:07 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-51fabf16-e4f2-419d-aac7-9da4716f0af2 tempest-VolumeRetypeWithoutMigrationTest-1732327509 None] Acquiring lock "cinder-b74dcd96-b15c-47fa-a6a6-5fabdaf5f002-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:23:08 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-51fabf16-e4f2-419d-aac7-9da4716f0af2 tempest-VolumeRetypeWithoutMigrationTest-1732327509 None] Lock "cinder-b74dcd96-b15c-47fa-a6a6-5fabdaf5f002-delete_volume" acquired by "delete_volume" :: waited 0.081s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:23:08 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-51fabf16-e4f2-419d-aac7-9da4716f0af2 tempest-VolumeRetypeWithoutMigrationTest-1732327509 None] Acquiring lock "cinder-quobyte-b74dcd96-b15c-47fa-a6a6-5fabdaf5f002" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:23:08 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-51fabf16-e4f2-419d-aac7-9da4716f0af2 tempest-VolumeRetypeWithoutMigrationTest-1732327509 None] Lock "cinder-quobyte-b74dcd96-b15c-47fa-a6a6-5fabdaf5f002" acquired by "delete_volume" :: waited 0.041s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:23:08 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[f260d072-edcf-46d1-993f-6a74c4cc4d41]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:23:08 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-51fabf16-e4f2-419d-aac7-9da4716f0af2 tempest-VolumeRetypeWithoutMigrationTest-1732327509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b74dcd96-b15c-47fa-a6a6-5fabdaf5f002 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:23:08 devstack sudo[99048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b74dcd96-b15c-47fa-a6a6-5fabdaf5f002 Nov 04 10:23:08 devstack sudo[99048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:23:09 devstack sudo[99048]: pam_unix(sudo:session): session closed for user root Nov 04 10:23:09 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-51fabf16-e4f2-419d-aac7-9da4716f0af2 tempest-VolumeRetypeWithoutMigrationTest-1732327509 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b74dcd96-b15c-47fa-a6a6-5fabdaf5f002" returned: 0 in 0.761s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:23:09 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-51fabf16-e4f2-419d-aac7-9da4716f0af2 tempest-VolumeRetypeWithoutMigrationTest-1732327509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b74dcd96-b15c-47fa-a6a6-5fabdaf5f002 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:23:09 devstack sudo[99054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b74dcd96-b15c-47fa-a6a6-5fabdaf5f002 Nov 04 10:23:09 devstack sudo[99054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:23:09 devstack sudo[99054]: pam_unix(sudo:session): session closed for user root Nov 04 10:23:09 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-51fabf16-e4f2-419d-aac7-9da4716f0af2 tempest-VolumeRetypeWithoutMigrationTest-1732327509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b74dcd96-b15c-47fa-a6a6-5fabdaf5f002" returned: 0 in 0.452s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:23:09 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-51fabf16-e4f2-419d-aac7-9da4716f0af2 tempest-VolumeRetypeWithoutMigrationTest-1732327509 None] Lock "cinder-quobyte-b74dcd96-b15c-47fa-a6a6-5fabdaf5f002" released by "delete_volume" :: held 1.291s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:23:09 devstack cinder-volume[87068]: WARNING cinder.quota [None req-51fabf16-e4f2-419d-aac7-9da4716f0af2 tempest-VolumeRetypeWithoutMigrationTest-1732327509 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Nov 04 10:23:09 devstack cinder-volume[87068]: WARNING cinder.quota [None req-51fabf16-e4f2-419d-aac7-9da4716f0af2 tempest-VolumeRetypeWithoutMigrationTest-1732327509 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Nov 04 10:23:09 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-51fabf16-e4f2-419d-aac7-9da4716f0af2 tempest-VolumeRetypeWithoutMigrationTest-1732327509 None] Created reservations ['23f2f12c-6d97-4bd3-bc45-41581bde3221', 'b6525385-fdbe-47b0-9204-f0df5d6e31b0', '92f9fa57-0a5b-4627-b7e9-2b779d876b04', 'a32f03f7-f3b4-41e7-b3a0-10c81240622b'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:23:09 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-51fabf16-e4f2-419d-aac7-9da4716f0af2 tempest-VolumeRetypeWithoutMigrationTest-1732327509 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:23:09 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-51fabf16-e4f2-419d-aac7-9da4716f0af2 tempest-VolumeRetypeWithoutMigrationTest-1732327509 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:23:09 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-51fabf16-e4f2-419d-aac7-9da4716f0af2 tempest-VolumeRetypeWithoutMigrationTest-1732327509 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:23:09 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-51fabf16-e4f2-419d-aac7-9da4716f0af2 tempest-VolumeRetypeWithoutMigrationTest-1732327509 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:23:09 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-51fabf16-e4f2-419d-aac7-9da4716f0af2 tempest-VolumeRetypeWithoutMigrationTest-1732327509 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:23:09 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-51fabf16-e4f2-419d-aac7-9da4716f0af2 tempest-VolumeRetypeWithoutMigrationTest-1732327509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:23:09 devstack sudo[99059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:23:09 devstack sudo[99059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:23:10 devstack sudo[99059]: pam_unix(sudo:session): session closed for user root Nov 04 10:23:10 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-51fabf16-e4f2-419d-aac7-9da4716f0af2 tempest-VolumeRetypeWithoutMigrationTest-1732327509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.727s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:23:10 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-51fabf16-e4f2-419d-aac7-9da4716f0af2 tempest-VolumeRetypeWithoutMigrationTest-1732327509 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:23:10 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-51fabf16-e4f2-419d-aac7-9da4716f0af2 tempest-VolumeRetypeWithoutMigrationTest-1732327509 None] Deleted volume successfully. Nov 04 10:23:10 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-51fabf16-e4f2-419d-aac7-9da4716f0af2 tempest-VolumeRetypeWithoutMigrationTest-1732327509 None] Lock "cinder-b74dcd96-b15c-47fa-a6a6-5fabdaf5f002-delete_volume" released by "delete_volume" :: held 2.496s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:23:13 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-a4a58547-1e57-4e38-80d1-ec0d52087e65 tempest-TestServerVolumeAttachmentScenario-2020619854 None] Acquiring lock "cinder-290fec35-fe01-4ab8-a87e-becf9d587583-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:23:13 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-a4a58547-1e57-4e38-80d1-ec0d52087e65 tempest-TestServerVolumeAttachmentScenario-2020619854 None] Lock "cinder-290fec35-fe01-4ab8-a87e-becf9d587583-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:23:13 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-a4a58547-1e57-4e38-80d1-ec0d52087e65 tempest-TestServerVolumeAttachmentScenario-2020619854 None] Acquiring lock "cinder-quobyte-290fec35-fe01-4ab8-a87e-becf9d587583" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:23:13 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-a4a58547-1e57-4e38-80d1-ec0d52087e65 tempest-TestServerVolumeAttachmentScenario-2020619854 None] Lock "cinder-quobyte-290fec35-fe01-4ab8-a87e-becf9d587583" acquired by "delete_volume" :: waited 0.024s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:23:13 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e93e1ae-4f3d-4690-bddf-5bf8c389fb29]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:23:13 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-a4a58547-1e57-4e38-80d1-ec0d52087e65 tempest-TestServerVolumeAttachmentScenario-2020619854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-290fec35-fe01-4ab8-a87e-becf9d587583 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:23:13 devstack sudo[99069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-290fec35-fe01-4ab8-a87e-becf9d587583 Nov 04 10:23:13 devstack sudo[99069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:23:13 devstack sudo[99069]: pam_unix(sudo:session): session closed for user root Nov 04 10:23:13 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-a4a58547-1e57-4e38-80d1-ec0d52087e65 tempest-TestServerVolumeAttachmentScenario-2020619854 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-290fec35-fe01-4ab8-a87e-becf9d587583" returned: 0 in 0.612s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:23:13 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-a4a58547-1e57-4e38-80d1-ec0d52087e65 tempest-TestServerVolumeAttachmentScenario-2020619854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-290fec35-fe01-4ab8-a87e-becf9d587583 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:23:13 devstack sudo[99079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-290fec35-fe01-4ab8-a87e-becf9d587583 Nov 04 10:23:13 devstack sudo[99079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:23:14 devstack sudo[99079]: pam_unix(sudo:session): session closed for user root Nov 04 10:23:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-a4a58547-1e57-4e38-80d1-ec0d52087e65 tempest-TestServerVolumeAttachmentScenario-2020619854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-290fec35-fe01-4ab8-a87e-becf9d587583" returned: 0 in 0.325s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:23:14 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-a4a58547-1e57-4e38-80d1-ec0d52087e65 tempest-TestServerVolumeAttachmentScenario-2020619854 None] Lock "cinder-quobyte-290fec35-fe01-4ab8-a87e-becf9d587583" released by "delete_volume" :: held 1.000s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:23:14 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-a4a58547-1e57-4e38-80d1-ec0d52087e65 tempest-TestServerVolumeAttachmentScenario-2020619854 None] Created reservations ['30f4bc44-0f2f-4203-aebb-96482c49a0f0', '4b60e2f1-f5cc-4645-8f7e-846bcdb06f96', '64f1dc3e-9750-464b-b6a6-aefaa2a566a9', '54d5a427-407f-4917-8fc1-e5243b6841a2'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:23:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-a4a58547-1e57-4e38-80d1-ec0d52087e65 tempest-TestServerVolumeAttachmentScenario-2020619854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:23:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-a4a58547-1e57-4e38-80d1-ec0d52087e65 tempest-TestServerVolumeAttachmentScenario-2020619854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:23:14 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-a4a58547-1e57-4e38-80d1-ec0d52087e65 tempest-TestServerVolumeAttachmentScenario-2020619854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:23:14 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-a4a58547-1e57-4e38-80d1-ec0d52087e65 tempest-TestServerVolumeAttachmentScenario-2020619854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:23:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-a4a58547-1e57-4e38-80d1-ec0d52087e65 tempest-TestServerVolumeAttachmentScenario-2020619854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:23:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-a4a58547-1e57-4e38-80d1-ec0d52087e65 tempest-TestServerVolumeAttachmentScenario-2020619854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:23:14 devstack sudo[99082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:23:14 devstack sudo[99082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:23:14 devstack sudo[99082]: pam_unix(sudo:session): session closed for user root Nov 04 10:23:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-a4a58547-1e57-4e38-80d1-ec0d52087e65 tempest-TestServerVolumeAttachmentScenario-2020619854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.337s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:23:14 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-a4a58547-1e57-4e38-80d1-ec0d52087e65 tempest-TestServerVolumeAttachmentScenario-2020619854 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:23:14 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-a4a58547-1e57-4e38-80d1-ec0d52087e65 tempest-TestServerVolumeAttachmentScenario-2020619854 None] Deleted volume successfully. Nov 04 10:23:14 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-a4a58547-1e57-4e38-80d1-ec0d52087e65 tempest-TestServerVolumeAttachmentScenario-2020619854 None] Lock "cinder-290fec35-fe01-4ab8-a87e-becf9d587583-delete_volume" released by "delete_volume" :: held 1.652s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:23:15 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-16b5a94b-7b93-4d4a-9e6f-b7fb77e6082e tempest-TestServerVolumeAttachmentScenario-2020619854 None] Acquiring lock "cinder-41398b59-eb96-4b87-ab99-f59cb633a7e3-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:23:15 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-16b5a94b-7b93-4d4a-9e6f-b7fb77e6082e tempest-TestServerVolumeAttachmentScenario-2020619854 None] Lock "cinder-41398b59-eb96-4b87-ab99-f59cb633a7e3-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:23:15 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-16b5a94b-7b93-4d4a-9e6f-b7fb77e6082e tempest-TestServerVolumeAttachmentScenario-2020619854 None] Acquiring lock "cinder-quobyte-41398b59-eb96-4b87-ab99-f59cb633a7e3" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:23:15 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-16b5a94b-7b93-4d4a-9e6f-b7fb77e6082e tempest-TestServerVolumeAttachmentScenario-2020619854 None] Lock "cinder-quobyte-41398b59-eb96-4b87-ab99-f59cb633a7e3" acquired by "delete_volume" :: waited 0.020s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:23:15 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[d595c4fa-3613-4825-84f8-b9b2f94b3b3e]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:23:15 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-16b5a94b-7b93-4d4a-9e6f-b7fb77e6082e tempest-TestServerVolumeAttachmentScenario-2020619854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-41398b59-eb96-4b87-ab99-f59cb633a7e3 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:23:15 devstack sudo[99086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-41398b59-eb96-4b87-ab99-f59cb633a7e3 Nov 04 10:23:15 devstack sudo[99086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:23:16 devstack sudo[99086]: pam_unix(sudo:session): session closed for user root Nov 04 10:23:16 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-16b5a94b-7b93-4d4a-9e6f-b7fb77e6082e tempest-TestServerVolumeAttachmentScenario-2020619854 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-41398b59-eb96-4b87-ab99-f59cb633a7e3" returned: 0 in 0.477s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:23:16 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-16b5a94b-7b93-4d4a-9e6f-b7fb77e6082e tempest-TestServerVolumeAttachmentScenario-2020619854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-41398b59-eb96-4b87-ab99-f59cb633a7e3 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:23:16 devstack sudo[99091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-41398b59-eb96-4b87-ab99-f59cb633a7e3 Nov 04 10:23:16 devstack sudo[99091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:23:16 devstack sudo[99091]: pam_unix(sudo:session): session closed for user root Nov 04 10:23:16 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-16b5a94b-7b93-4d4a-9e6f-b7fb77e6082e tempest-TestServerVolumeAttachmentScenario-2020619854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-41398b59-eb96-4b87-ab99-f59cb633a7e3" returned: 0 in 0.269s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:23:16 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-16b5a94b-7b93-4d4a-9e6f-b7fb77e6082e tempest-TestServerVolumeAttachmentScenario-2020619854 None] Lock "cinder-quobyte-41398b59-eb96-4b87-ab99-f59cb633a7e3" released by "delete_volume" :: held 0.796s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:23:16 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-16b5a94b-7b93-4d4a-9e6f-b7fb77e6082e tempest-TestServerVolumeAttachmentScenario-2020619854 None] Created reservations ['0f78834d-2998-423e-8b2c-63f9a32d81bf', '3a8295ef-464d-465c-aae1-88e39c89f497', 'd8e82e74-316b-4375-8e1e-b80772f57c8c', 'b167b071-a690-46ee-87bc-e84bb2f7cf28'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:23:16 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-16b5a94b-7b93-4d4a-9e6f-b7fb77e6082e tempest-TestServerVolumeAttachmentScenario-2020619854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:23:16 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-16b5a94b-7b93-4d4a-9e6f-b7fb77e6082e tempest-TestServerVolumeAttachmentScenario-2020619854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:23:16 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-16b5a94b-7b93-4d4a-9e6f-b7fb77e6082e tempest-TestServerVolumeAttachmentScenario-2020619854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:23:16 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-16b5a94b-7b93-4d4a-9e6f-b7fb77e6082e tempest-TestServerVolumeAttachmentScenario-2020619854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:23:16 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-16b5a94b-7b93-4d4a-9e6f-b7fb77e6082e tempest-TestServerVolumeAttachmentScenario-2020619854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:23:16 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-16b5a94b-7b93-4d4a-9e6f-b7fb77e6082e tempest-TestServerVolumeAttachmentScenario-2020619854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:23:16 devstack sudo[99094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:23:16 devstack sudo[99094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:23:16 devstack sudo[99094]: pam_unix(sudo:session): session closed for user root Nov 04 10:23:16 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-16b5a94b-7b93-4d4a-9e6f-b7fb77e6082e tempest-TestServerVolumeAttachmentScenario-2020619854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.292s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:23:16 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-16b5a94b-7b93-4d4a-9e6f-b7fb77e6082e tempest-TestServerVolumeAttachmentScenario-2020619854 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:23:16 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-16b5a94b-7b93-4d4a-9e6f-b7fb77e6082e tempest-TestServerVolumeAttachmentScenario-2020619854 None] Deleted volume successfully. Nov 04 10:23:16 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-16b5a94b-7b93-4d4a-9e6f-b7fb77e6082e tempest-TestServerVolumeAttachmentScenario-2020619854 None] Lock "cinder-41398b59-eb96-4b87-ab99-f59cb633a7e3-delete_volume" released by "delete_volume" :: held 1.377s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:23:20 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-db7f39d4-5d24-405c-a7c7-a6f23fc1d27a tempest-VolumeSnapshotQuotasNegativeTestJSON-792803542 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:23:20 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-db7f39d4-5d24-405c-a7c7-a6f23fc1d27a tempest-VolumeSnapshotQuotasNegativeTestJSON-792803542 None] Flow 'volume_create_manager' (f1df0ef2-ddf6-4f2b-823b-ab7d7ed6bd3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:23:20 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-db7f39d4-5d24-405c-a7c7-a6f23fc1d27a tempest-VolumeSnapshotQuotasNegativeTestJSON-792803542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (feb07201-7c28-4a9b-a801-ddb734366706) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:23:20 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-db7f39d4-5d24-405c-a7c7-a6f23fc1d27a tempest-VolumeSnapshotQuotasNegativeTestJSON-792803542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (feb07201-7c28-4a9b-a801-ddb734366706) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:23:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-336606473',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cd11a71-a51a-4b9b-b11d-87ce279c4069,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a45d426a5d74c66b4cf3f8ffc3716bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:23:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:23:20Z,use_quota=True,user_id='900f4990a7ec4c08a9c98cad91e59a03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:23:20 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-db7f39d4-5d24-405c-a7c7-a6f23fc1d27a tempest-VolumeSnapshotQuotasNegativeTestJSON-792803542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff49729d-0438-4cb3-9f2f-509566ea9817) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:23:20 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-db7f39d4-5d24-405c-a7c7-a6f23fc1d27a tempest-VolumeSnapshotQuotasNegativeTestJSON-792803542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff49729d-0438-4cb3-9f2f-509566ea9817) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:23:20 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-db7f39d4-5d24-405c-a7c7-a6f23fc1d27a tempest-VolumeSnapshotQuotasNegativeTestJSON-792803542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56698431-a894-4a55-9fb3-4314f3fa9d5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:23:20 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-db7f39d4-5d24-405c-a7c7-a6f23fc1d27a tempest-VolumeSnapshotQuotasNegativeTestJSON-792803542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56698431-a894-4a55-9fb3-4314f3fa9d5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7cd11a71-a51a-4b9b-b11d-87ce279c4069', 'volume_name': 'volume-7cd11a71-a51a-4b9b-b11d-87ce279c4069', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:23:20 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-db7f39d4-5d24-405c-a7c7-a6f23fc1d27a tempest-VolumeSnapshotQuotasNegativeTestJSON-792803542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad130361-8035-4330-9cc9-57943a35fa4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:23:20 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-db7f39d4-5d24-405c-a7c7-a6f23fc1d27a tempest-VolumeSnapshotQuotasNegativeTestJSON-792803542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad130361-8035-4330-9cc9-57943a35fa4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:23:20 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-db7f39d4-5d24-405c-a7c7-a6f23fc1d27a tempest-VolumeSnapshotQuotasNegativeTestJSON-792803542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1379f06b-3510-4592-a314-8b4a549796d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:23:20 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-db7f39d4-5d24-405c-a7c7-a6f23fc1d27a tempest-VolumeSnapshotQuotasNegativeTestJSON-792803542 None] Volume 7cd11a71-a51a-4b9b-b11d-87ce279c4069: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7cd11a71-a51a-4b9b-b11d-87ce279c4069', 'volume_size': 1} Nov 04 10:23:20 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-db7f39d4-5d24-405c-a7c7-a6f23fc1d27a tempest-VolumeSnapshotQuotasNegativeTestJSON-792803542 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:23:20 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-db7f39d4-5d24-405c-a7c7-a6f23fc1d27a tempest-VolumeSnapshotQuotasNegativeTestJSON-792803542 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:23:20 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-db7f39d4-5d24-405c-a7c7-a6f23fc1d27a tempest-VolumeSnapshotQuotasNegativeTestJSON-792803542 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:23:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-336606473',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cd11a71-a51a-4b9b-b11d-87ce279c4069,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a45d426a5d74c66b4cf3f8ffc3716bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:23:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:23:20Z,use_quota=True,user_id='900f4990a7ec4c08a9c98cad91e59a03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 10:23:20 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-db7f39d4-5d24-405c-a7c7-a6f23fc1d27a tempest-VolumeSnapshotQuotasNegativeTestJSON-792803542 None] Creating volume 7cd11a71-a51a-4b9b-b11d-87ce279c4069 {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:23:20 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-db7f39d4-5d24-405c-a7c7-a6f23fc1d27a tempest-VolumeSnapshotQuotasNegativeTestJSON-792803542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:23:20 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-db7f39d4-5d24-405c-a7c7-a6f23fc1d27a tempest-VolumeSnapshotQuotasNegativeTestJSON-792803542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:23:20 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-db7f39d4-5d24-405c-a7c7-a6f23fc1d27a tempest-VolumeSnapshotQuotasNegativeTestJSON-792803542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:23:20 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-db7f39d4-5d24-405c-a7c7-a6f23fc1d27a tempest-VolumeSnapshotQuotasNegativeTestJSON-792803542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:23:20 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-db7f39d4-5d24-405c-a7c7-a6f23fc1d27a tempest-VolumeSnapshotQuotasNegativeTestJSON-792803542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:23:20 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-db7f39d4-5d24-405c-a7c7-a6f23fc1d27a tempest-VolumeSnapshotQuotasNegativeTestJSON-792803542 None] Selected osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:23:20 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-db7f39d4-5d24-405c-a7c7-a6f23fc1d27a tempest-VolumeSnapshotQuotasNegativeTestJSON-792803542 None] casted to osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 Nov 04 10:23:20 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-db7f39d4-5d24-405c-a7c7-a6f23fc1d27a tempest-VolumeSnapshotQuotasNegativeTestJSON-792803542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-7cd11a71-a51a-4b9b-b11d-87ce279c4069 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:23:20 devstack sudo[99099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-7cd11a71-a51a-4b9b-b11d-87ce279c4069 1073741824 Nov 04 10:23:20 devstack sudo[99099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:23:21 devstack sudo[99099]: pam_unix(sudo:session): session closed for user root Nov 04 10:23:21 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-db7f39d4-5d24-405c-a7c7-a6f23fc1d27a tempest-VolumeSnapshotQuotasNegativeTestJSON-792803542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-7cd11a71-a51a-4b9b-b11d-87ce279c4069 1073741824" returned: 0 in 0.718s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:23:21 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-db7f39d4-5d24-405c-a7c7-a6f23fc1d27a tempest-VolumeSnapshotQuotasNegativeTestJSON-792803542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-7cd11a71-a51a-4b9b-b11d-87ce279c4069 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:23:21 devstack sudo[99106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-7cd11a71-a51a-4b9b-b11d-87ce279c4069 Nov 04 10:23:21 devstack sudo[99106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:23:21 devstack sudo[99106]: pam_unix(sudo:session): session closed for user root Nov 04 10:23:21 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-db7f39d4-5d24-405c-a7c7-a6f23fc1d27a tempest-VolumeSnapshotQuotasNegativeTestJSON-792803542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-7cd11a71-a51a-4b9b-b11d-87ce279c4069" returned: 0 in 0.341s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:23:21 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-db7f39d4-5d24-405c-a7c7-a6f23fc1d27a tempest-VolumeSnapshotQuotasNegativeTestJSON-792803542 None] <== create_volume: return (1124ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 10:23:21 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-db7f39d4-5d24-405c-a7c7-a6f23fc1d27a tempest-VolumeSnapshotQuotasNegativeTestJSON-792803542 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.131s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:23:21 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-db7f39d4-5d24-405c-a7c7-a6f23fc1d27a tempest-VolumeSnapshotQuotasNegativeTestJSON-792803542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1379f06b-3510-4592-a314-8b4a549796d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7cd11a71-a51a-4b9b-b11d-87ce279c4069', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:23:21 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-db7f39d4-5d24-405c-a7c7-a6f23fc1d27a tempest-VolumeSnapshotQuotasNegativeTestJSON-792803542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6906ba65-be38-4f5d-8433-46ab8b5884d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:23:21 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-db7f39d4-5d24-405c-a7c7-a6f23fc1d27a tempest-VolumeSnapshotQuotasNegativeTestJSON-792803542 None] Volume volume-7cd11a71-a51a-4b9b-b11d-87ce279c4069 (7cd11a71-a51a-4b9b-b11d-87ce279c4069): created successfully Nov 04 10:23:21 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-db7f39d4-5d24-405c-a7c7-a6f23fc1d27a tempest-VolumeSnapshotQuotasNegativeTestJSON-792803542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6906ba65-be38-4f5d-8433-46ab8b5884d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:23:21 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-db7f39d4-5d24-405c-a7c7-a6f23fc1d27a tempest-VolumeSnapshotQuotasNegativeTestJSON-792803542 None] Flow 'volume_create_manager' (f1df0ef2-ddf6-4f2b-823b-ab7d7ed6bd3a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:23:21 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-db7f39d4-5d24-405c-a7c7-a6f23fc1d27a tempest-VolumeSnapshotQuotasNegativeTestJSON-792803542 None] Created volume successfully. Nov 04 10:23:22 devstack cinder-volume[87068]: DEBUG dbcounter [-] [87068] Writing DB stats cinder:UPDATE=88,cinder:SELECT=97,cinder:INSERT=21,cinder:DELETE=2 {{(pid=87068) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 10:23:23 devstack cinder-volume[87068]: DEBUG dbcounter [-] [87068] Writing DB stats cinder:SELECT=80,cinder:UPDATE=81,cinder:DELETE=12,cinder:INSERT=20 {{(pid=87068) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 10:23:23 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-7b6f3425-59b0-41ec-adf4-0ec21d931845 tempest-VolumeSnapshotQuotasNegativeTestJSON-792803542 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:23:23 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-7b6f3425-59b0-41ec-adf4-0ec21d931845 tempest-VolumeSnapshotQuotasNegativeTestJSON-792803542 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:23:23 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-7b6f3425-59b0-41ec-adf4-0ec21d931845 tempest-VolumeSnapshotQuotasNegativeTestJSON-792803542 None] Creating offline snapshot 86a1f43e-4b6c-4cb2-ae29-963910d117b7 of volume 7cd11a71-a51a-4b9b-b11d-87ce279c4069 {{(pid=87068) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 10:23:23 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[70486abc-d628-41e4-9b13-946898ccccd8]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:23:23 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7b6f3425-59b0-41ec-adf4-0ec21d931845 tempest-VolumeSnapshotQuotasNegativeTestJSON-792803542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-7cd11a71-a51a-4b9b-b11d-87ce279c4069 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:23:23 devstack sudo[99126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-7cd11a71-a51a-4b9b-b11d-87ce279c4069 Nov 04 10:23:23 devstack sudo[99126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:23:23 devstack sudo[99126]: pam_unix(sudo:session): session closed for user root Nov 04 10:23:23 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7b6f3425-59b0-41ec-adf4-0ec21d931845 tempest-VolumeSnapshotQuotasNegativeTestJSON-792803542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-7cd11a71-a51a-4b9b-b11d-87ce279c4069" returned: 0 in 0.606s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:23:23 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7b6f3425-59b0-41ec-adf4-0ec21d931845 tempest-VolumeSnapshotQuotasNegativeTestJSON-792803542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-7cd11a71-a51a-4b9b-b11d-87ce279c4069,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-7cd11a71-a51a-4b9b-b11d-87ce279c4069.86a1f43e-4b6c-4cb2-ae29-963910d117b7 1G {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:23:23 devstack sudo[99139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-7cd11a71-a51a-4b9b-b11d-87ce279c4069,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-7cd11a71-a51a-4b9b-b11d-87ce279c4069.86a1f43e-4b6c-4cb2-ae29-963910d117b7 1G Nov 04 10:23:23 devstack sudo[99139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:23:23 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [req-f99bafc8-d984-4501-919a-f3d4557f12e9 req-0464599d-cb86-409b-b975-4cae59622be6 tempest-TestInstancesWithCinderVolumes-304140490 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:23:24 devstack sudo[99139]: pam_unix(sudo:session): session closed for user root Nov 04 10:23:24 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7b6f3425-59b0-41ec-adf4-0ec21d931845 tempest-VolumeSnapshotQuotasNegativeTestJSON-792803542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-7cd11a71-a51a-4b9b-b11d-87ce279c4069,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-7cd11a71-a51a-4b9b-b11d-87ce279c4069.86a1f43e-4b6c-4cb2-ae29-963910d117b7 1G" returned: 0 in 0.520s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:23:24 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7b6f3425-59b0-41ec-adf4-0ec21d931845 tempest-VolumeSnapshotQuotasNegativeTestJSON-792803542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7cd11a71-a51a-4b9b-b11d-87ce279c4069 -F qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-7cd11a71-a51a-4b9b-b11d-87ce279c4069.86a1f43e-4b6c-4cb2-ae29-963910d117b7 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:23:24 devstack sudo[99145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7cd11a71-a51a-4b9b-b11d-87ce279c4069 -F qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-7cd11a71-a51a-4b9b-b11d-87ce279c4069.86a1f43e-4b6c-4cb2-ae29-963910d117b7 Nov 04 10:23:24 devstack sudo[99145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:23:24 devstack sudo[99145]: pam_unix(sudo:session): session closed for user root Nov 04 10:23:24 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7b6f3425-59b0-41ec-adf4-0ec21d931845 tempest-VolumeSnapshotQuotasNegativeTestJSON-792803542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7cd11a71-a51a-4b9b-b11d-87ce279c4069 -F qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-7cd11a71-a51a-4b9b-b11d-87ce279c4069.86a1f43e-4b6c-4cb2-ae29-963910d117b7" returned: 0 in 0.356s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:23:24 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-7b6f3425-59b0-41ec-adf4-0ec21d931845 tempest-VolumeSnapshotQuotasNegativeTestJSON-792803542 None] /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-7cd11a71-a51a-4b9b-b11d-87ce279c4069.86a1f43e-4b6c-4cb2-ae29-963910d117b7 is being set with open permissions: ugo+rw Nov 04 10:23:24 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7b6f3425-59b0-41ec-adf4-0ec21d931845 tempest-VolumeSnapshotQuotasNegativeTestJSON-792803542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-7cd11a71-a51a-4b9b-b11d-87ce279c4069.86a1f43e-4b6c-4cb2-ae29-963910d117b7 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:23:24 devstack sudo[99151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-7cd11a71-a51a-4b9b-b11d-87ce279c4069.86a1f43e-4b6c-4cb2-ae29-963910d117b7 Nov 04 10:23:24 devstack sudo[99151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:23:24 devstack sudo[99151]: pam_unix(sudo:session): session closed for user root Nov 04 10:23:24 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7b6f3425-59b0-41ec-adf4-0ec21d931845 tempest-VolumeSnapshotQuotasNegativeTestJSON-792803542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-7cd11a71-a51a-4b9b-b11d-87ce279c4069.86a1f43e-4b6c-4cb2-ae29-963910d117b7" returned: 0 in 0.256s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:23:24 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7b6f3425-59b0-41ec-adf4-0ec21d931845 tempest-VolumeSnapshotQuotasNegativeTestJSON-792803542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-7cd11a71-a51a-4b9b-b11d-87ce279c4069.info {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:23:24 devstack sudo[99154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-7cd11a71-a51a-4b9b-b11d-87ce279c4069.info Nov 04 10:23:24 devstack sudo[99154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:23:25 devstack sudo[99154]: pam_unix(sudo:session): session closed for user root Nov 04 10:23:25 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7b6f3425-59b0-41ec-adf4-0ec21d931845 tempest-VolumeSnapshotQuotasNegativeTestJSON-792803542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-7cd11a71-a51a-4b9b-b11d-87ce279c4069.info" returned: 0 in 0.283s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:23:25 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-7b6f3425-59b0-41ec-adf4-0ec21d931845 tempest-VolumeSnapshotQuotasNegativeTestJSON-792803542 None] /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-7cd11a71-a51a-4b9b-b11d-87ce279c4069.info is being set with open permissions: ugo+rw Nov 04 10:23:25 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7b6f3425-59b0-41ec-adf4-0ec21d931845 tempest-VolumeSnapshotQuotasNegativeTestJSON-792803542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-7cd11a71-a51a-4b9b-b11d-87ce279c4069.info {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:23:25 devstack sudo[99157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-7cd11a71-a51a-4b9b-b11d-87ce279c4069.info Nov 04 10:23:25 devstack sudo[99157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:23:25 devstack sudo[99157]: pam_unix(sudo:session): session closed for user root Nov 04 10:23:25 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7b6f3425-59b0-41ec-adf4-0ec21d931845 tempest-VolumeSnapshotQuotasNegativeTestJSON-792803542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-7cd11a71-a51a-4b9b-b11d-87ce279c4069.info" returned: 0 in 0.260s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:23:25 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-7b6f3425-59b0-41ec-adf4-0ec21d931845 tempest-VolumeSnapshotQuotasNegativeTestJSON-792803542 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.428s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:23:25 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [req-f99bafc8-d984-4501-919a-f3d4557f12e9 req-0464599d-cb86-409b-b975-4cae59622be6 tempest-TestInstancesWithCinderVolumes-304140490 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.619s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:23:25 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [req-f99bafc8-d984-4501-919a-f3d4557f12e9 req-0464599d-cb86-409b-b975-4cae59622be6 tempest-TestInstancesWithCinderVolumes-304140490 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.042s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:23:25 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-7b6f3425-59b0-41ec-adf4-0ec21d931845 tempest-VolumeSnapshotQuotasNegativeTestJSON-792803542 None] Create snapshot completed successfully Nov 04 10:23:25 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [req-f99bafc8-d984-4501-919a-f3d4557f12e9 req-0464599d-cb86-409b-b975-4cae59622be6 tempest-TestInstancesWithCinderVolumes-304140490 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034', 'name': 'volume-cf4db3a1-74fe-47b0-bc85-688e825eeec2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ab02e4e5-ee60-4f08-9c74-700d95ad1681', 'enforce_multipath': True} {{(pid=87068) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 04 10:23:25 devstack cinder-volume[87068]: INFO cinder.volume.manager [req-f99bafc8-d984-4501-919a-f3d4557f12e9 req-0464599d-cb86-409b-b975-4cae59622be6 tempest-TestInstancesWithCinderVolumes-304140490 None] attachment_update completed successfully. Nov 04 10:23:26 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-1ff3ce02-f838-4c4b-a294-b5735ba53b17 tempest-VolumeSnapshotQuotasNegativeTestJSON-792803542 None] Acquiring lock "cinder-86a1f43e-4b6c-4cb2-ae29-963910d117b7-delete_snapshot" by "delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:23:26 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-1ff3ce02-f838-4c4b-a294-b5735ba53b17 tempest-VolumeSnapshotQuotasNegativeTestJSON-792803542 None] Lock "cinder-86a1f43e-4b6c-4cb2-ae29-963910d117b7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:23:26 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-1ff3ce02-f838-4c4b-a294-b5735ba53b17 tempest-VolumeSnapshotQuotasNegativeTestJSON-792803542 None] Acquiring lock "cinder-quobyte-7cd11a71-a51a-4b9b-b11d-87ce279c4069" by "delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:23:26 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-1ff3ce02-f838-4c4b-a294-b5735ba53b17 tempest-VolumeSnapshotQuotasNegativeTestJSON-792803542 None] Lock "cinder-quobyte-7cd11a71-a51a-4b9b-b11d-87ce279c4069" acquired by "delete_snapshot" :: waited 0.058s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:23:26 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-1ff3ce02-f838-4c4b-a294-b5735ba53b17 tempest-VolumeSnapshotQuotasNegativeTestJSON-792803542 None] Acquiring lock "cinder-quobyte-86a1f43e-4b6c-4cb2-ae29-963910d117b7" by "_delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:23:26 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-1ff3ce02-f838-4c4b-a294-b5735ba53b17 tempest-VolumeSnapshotQuotasNegativeTestJSON-792803542 None] Lock "cinder-quobyte-86a1f43e-4b6c-4cb2-ae29-963910d117b7" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:23:26 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-1ff3ce02-f838-4c4b-a294-b5735ba53b17 tempest-VolumeSnapshotQuotasNegativeTestJSON-792803542 None] Deleting offline snapshot 86a1f43e-4b6c-4cb2-ae29-963910d117b7 of volume 7cd11a71-a51a-4b9b-b11d-87ce279c4069 {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 10:23:26 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-1ff3ce02-f838-4c4b-a294-b5735ba53b17 tempest-VolumeSnapshotQuotasNegativeTestJSON-792803542 None] snapshot_file for this snap is: volume-7cd11a71-a51a-4b9b-b11d-87ce279c4069.86a1f43e-4b6c-4cb2-ae29-963910d117b7 {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 10:23:26 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9b89f98-69c8-4ed2-9981-c822b9f582f5]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:23:26 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-1ff3ce02-f838-4c4b-a294-b5735ba53b17 tempest-VolumeSnapshotQuotasNegativeTestJSON-792803542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-7cd11a71-a51a-4b9b-b11d-87ce279c4069.86a1f43e-4b6c-4cb2-ae29-963910d117b7 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:23:26 devstack sudo[99163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-7cd11a71-a51a-4b9b-b11d-87ce279c4069.86a1f43e-4b6c-4cb2-ae29-963910d117b7 Nov 04 10:23:26 devstack sudo[99163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:23:27 devstack sudo[99163]: pam_unix(sudo:session): session closed for user root Nov 04 10:23:27 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-1ff3ce02-f838-4c4b-a294-b5735ba53b17 tempest-VolumeSnapshotQuotasNegativeTestJSON-792803542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-7cd11a71-a51a-4b9b-b11d-87ce279c4069.86a1f43e-4b6c-4cb2-ae29-963910d117b7" returned: 0 in 0.508s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:23:27 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-1ff3ce02-f838-4c4b-a294-b5735ba53b17 tempest-VolumeSnapshotQuotasNegativeTestJSON-792803542 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7cd11a71-a51a-4b9b-b11d-87ce279c4069(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87068) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 10:23:27 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[c73992c7-e658-4de2-a9d2-ad3cc581410b]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:23:27 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-1ff3ce02-f838-4c4b-a294-b5735ba53b17 tempest-VolumeSnapshotQuotasNegativeTestJSON-792803542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-7cd11a71-a51a-4b9b-b11d-87ce279c4069 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:23:27 devstack sudo[99174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-7cd11a71-a51a-4b9b-b11d-87ce279c4069 Nov 04 10:23:27 devstack sudo[99174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:23:28 devstack sudo[99174]: pam_unix(sudo:session): session closed for user root Nov 04 10:23:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-1ff3ce02-f838-4c4b-a294-b5735ba53b17 tempest-VolumeSnapshotQuotasNegativeTestJSON-792803542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-7cd11a71-a51a-4b9b-b11d-87ce279c4069" returned: 0 in 0.724s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:23:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-1ff3ce02-f838-4c4b-a294-b5735ba53b17 tempest-VolumeSnapshotQuotasNegativeTestJSON-792803542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-7cd11a71-a51a-4b9b-b11d-87ce279c4069.86a1f43e-4b6c-4cb2-ae29-963910d117b7 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:23:28 devstack sudo[99185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-7cd11a71-a51a-4b9b-b11d-87ce279c4069.86a1f43e-4b6c-4cb2-ae29-963910d117b7 Nov 04 10:23:28 devstack sudo[99185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:23:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [req-c115aa04-8803-432d-82d6-a4b422320731 req-05f850fd-2a90-4122-917c-3a7f5d6c407a tempest-TestInstancesWithCinderVolumes-304140490 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:23:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [req-c115aa04-8803-432d-82d6-a4b422320731 req-05f850fd-2a90-4122-917c-3a7f5d6c407a tempest-TestInstancesWithCinderVolumes-304140490 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:23:28 devstack sudo[99185]: pam_unix(sudo:session): session closed for user root Nov 04 10:23:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-1ff3ce02-f838-4c4b-a294-b5735ba53b17 tempest-VolumeSnapshotQuotasNegativeTestJSON-792803542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-7cd11a71-a51a-4b9b-b11d-87ce279c4069.86a1f43e-4b6c-4cb2-ae29-963910d117b7" returned: 0 in 0.482s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:23:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-1ff3ce02-f838-4c4b-a294-b5735ba53b17 tempest-VolumeSnapshotQuotasNegativeTestJSON-792803542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-7cd11a71-a51a-4b9b-b11d-87ce279c4069.86a1f43e-4b6c-4cb2-ae29-963910d117b7 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:23:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [req-c115aa04-8803-432d-82d6-a4b422320731 req-05f850fd-2a90-4122-917c-3a7f5d6c407a tempest-TestInstancesWithCinderVolumes-304140490 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.032s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:23:28 devstack sudo[99199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-7cd11a71-a51a-4b9b-b11d-87ce279c4069.86a1f43e-4b6c-4cb2-ae29-963910d117b7 Nov 04 10:23:28 devstack sudo[99199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:23:28 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [req-c115aa04-8803-432d-82d6-a4b422320731 req-05f850fd-2a90-4122-917c-3a7f5d6c407a tempest-TestInstancesWithCinderVolumes-304140490 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034', 'name': 'volume-1365d08d-723e-4f4d-98b6-48e57e761f8c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e4bd7df0-511a-4d8f-90fc-72039091e9eb', 'enforce_multipath': True} {{(pid=87068) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 04 10:23:28 devstack cinder-volume[87068]: INFO cinder.volume.manager [req-c115aa04-8803-432d-82d6-a4b422320731 req-05f850fd-2a90-4122-917c-3a7f5d6c407a tempest-TestInstancesWithCinderVolumes-304140490 None] attachment_update completed successfully. Nov 04 10:23:28 devstack sudo[99199]: pam_unix(sudo:session): session closed for user root Nov 04 10:23:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-1ff3ce02-f838-4c4b-a294-b5735ba53b17 tempest-VolumeSnapshotQuotasNegativeTestJSON-792803542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-7cd11a71-a51a-4b9b-b11d-87ce279c4069.86a1f43e-4b6c-4cb2-ae29-963910d117b7" returned: 0 in 0.329s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:23:29 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-1ff3ce02-f838-4c4b-a294-b5735ba53b17 tempest-VolumeSnapshotQuotasNegativeTestJSON-792803542 None] Lock "cinder-quobyte-86a1f43e-4b6c-4cb2-ae29-963910d117b7" released by "_delete_snapshot" :: held 2.209s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:23:29 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-1ff3ce02-f838-4c4b-a294-b5735ba53b17 tempest-VolumeSnapshotQuotasNegativeTestJSON-792803542 None] Lock "cinder-quobyte-7cd11a71-a51a-4b9b-b11d-87ce279c4069" released by "delete_snapshot" :: held 2.247s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:23:29 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-1ff3ce02-f838-4c4b-a294-b5735ba53b17 tempest-VolumeSnapshotQuotasNegativeTestJSON-792803542 None] Created reservations ['aa336ff0-daf7-4047-86e1-2f252497672d', 'a7f8c660-dc4a-4ace-9d3d-ca86b396c03a', '5724ce4b-189d-4cf0-8683-a5c4c98aabeb', '28a7fad3-1478-4e45-8bc6-b822b155aa87'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:23:29 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-1ff3ce02-f838-4c4b-a294-b5735ba53b17 tempest-VolumeSnapshotQuotasNegativeTestJSON-792803542 None] Delete snapshot completed successfully. Nov 04 10:23:29 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-1ff3ce02-f838-4c4b-a294-b5735ba53b17 tempest-VolumeSnapshotQuotasNegativeTestJSON-792803542 None] Lock "cinder-86a1f43e-4b6c-4cb2-ae29-963910d117b7-delete_snapshot" released by "delete_snapshot" :: held 2.469s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:23:30 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-0d1143fa-9f4f-43a1-87fa-612903380ac6 tempest-VolumeSnapshotQuotasNegativeTestJSON-792803542 None] Acquiring lock "cinder-7cd11a71-a51a-4b9b-b11d-87ce279c4069-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:23:30 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-0d1143fa-9f4f-43a1-87fa-612903380ac6 tempest-VolumeSnapshotQuotasNegativeTestJSON-792803542 None] Lock "cinder-7cd11a71-a51a-4b9b-b11d-87ce279c4069-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:23:30 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-0d1143fa-9f4f-43a1-87fa-612903380ac6 tempest-VolumeSnapshotQuotasNegativeTestJSON-792803542 None] Acquiring lock "cinder-quobyte-7cd11a71-a51a-4b9b-b11d-87ce279c4069" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:23:30 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-0d1143fa-9f4f-43a1-87fa-612903380ac6 tempest-VolumeSnapshotQuotasNegativeTestJSON-792803542 None] Lock "cinder-quobyte-7cd11a71-a51a-4b9b-b11d-87ce279c4069" acquired by "delete_volume" :: waited 0.022s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:23:30 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[6113c0e8-1e7e-4517-ad6b-ecc866687249]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:23:30 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-0d1143fa-9f4f-43a1-87fa-612903380ac6 tempest-VolumeSnapshotQuotasNegativeTestJSON-792803542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-7cd11a71-a51a-4b9b-b11d-87ce279c4069 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:23:30 devstack sudo[99206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-7cd11a71-a51a-4b9b-b11d-87ce279c4069 Nov 04 10:23:30 devstack sudo[99206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:23:30 devstack sudo[99206]: pam_unix(sudo:session): session closed for user root Nov 04 10:23:30 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-0d1143fa-9f4f-43a1-87fa-612903380ac6 tempest-VolumeSnapshotQuotasNegativeTestJSON-792803542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-7cd11a71-a51a-4b9b-b11d-87ce279c4069" returned: 0 in 0.457s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:23:30 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-0d1143fa-9f4f-43a1-87fa-612903380ac6 tempest-VolumeSnapshotQuotasNegativeTestJSON-792803542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-7cd11a71-a51a-4b9b-b11d-87ce279c4069 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:23:30 devstack sudo[99217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-7cd11a71-a51a-4b9b-b11d-87ce279c4069 Nov 04 10:23:30 devstack sudo[99217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:23:31 devstack sudo[99217]: pam_unix(sudo:session): session closed for user root Nov 04 10:23:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-0d1143fa-9f4f-43a1-87fa-612903380ac6 tempest-VolumeSnapshotQuotasNegativeTestJSON-792803542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-7cd11a71-a51a-4b9b-b11d-87ce279c4069" returned: 0 in 0.382s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:23:31 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-0d1143fa-9f4f-43a1-87fa-612903380ac6 tempest-VolumeSnapshotQuotasNegativeTestJSON-792803542 None] Lock "cinder-quobyte-7cd11a71-a51a-4b9b-b11d-87ce279c4069" released by "delete_volume" :: held 0.936s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:23:31 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-0d1143fa-9f4f-43a1-87fa-612903380ac6 tempest-VolumeSnapshotQuotasNegativeTestJSON-792803542 None] Created reservations ['79d8ef66-7ac2-4735-932a-a1e13a463bd8', '722e9c24-3ed3-46df-b643-ccbef92423f3', 'e53cc414-e16b-45f0-a775-0e066dda7820', '26c48540-da17-432c-b68c-95046a101c69'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:23:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-0d1143fa-9f4f-43a1-87fa-612903380ac6 tempest-VolumeSnapshotQuotasNegativeTestJSON-792803542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:23:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-0d1143fa-9f4f-43a1-87fa-612903380ac6 tempest-VolumeSnapshotQuotasNegativeTestJSON-792803542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:23:31 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-0d1143fa-9f4f-43a1-87fa-612903380ac6 tempest-VolumeSnapshotQuotasNegativeTestJSON-792803542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:23:31 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-0d1143fa-9f4f-43a1-87fa-612903380ac6 tempest-VolumeSnapshotQuotasNegativeTestJSON-792803542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:23:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-0d1143fa-9f4f-43a1-87fa-612903380ac6 tempest-VolumeSnapshotQuotasNegativeTestJSON-792803542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:23:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-0d1143fa-9f4f-43a1-87fa-612903380ac6 tempest-VolumeSnapshotQuotasNegativeTestJSON-792803542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:23:31 devstack sudo[99222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:23:31 devstack sudo[99222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:23:31 devstack sudo[99222]: pam_unix(sudo:session): session closed for user root Nov 04 10:23:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-0d1143fa-9f4f-43a1-87fa-612903380ac6 tempest-VolumeSnapshotQuotasNegativeTestJSON-792803542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.380s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:23:31 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-0d1143fa-9f4f-43a1-87fa-612903380ac6 tempest-VolumeSnapshotQuotasNegativeTestJSON-792803542 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:23:31 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-0d1143fa-9f4f-43a1-87fa-612903380ac6 tempest-VolumeSnapshotQuotasNegativeTestJSON-792803542 None] Deleted volume successfully. Nov 04 10:23:31 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-0d1143fa-9f4f-43a1-87fa-612903380ac6 tempest-VolumeSnapshotQuotasNegativeTestJSON-792803542 None] Lock "cinder-7cd11a71-a51a-4b9b-b11d-87ce279c4069-delete_volume" released by "delete_volume" :: held 1.636s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:23:35 devstack cinder-volume[87068]: INFO cinder.volume.manager [req-daf666bc-f324-470c-96f1-06c273c70f29 req-24f17ee2-aa1e-43a8-8fc5-27f8fb4058c8 tempest-TestInstancesWithCinderVolumes-304140490 None] Terminate volume connection completed successfully. Nov 04 10:23:35 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [req-daf666bc-f324-470c-96f1-06c273c70f29 req-24f17ee2-aa1e-43a8-8fc5-27f8fb4058c8 tempest-TestInstancesWithCinderVolumes-304140490 None] Deleting attachment ab02e4e5-ee60-4f08-9c74-700d95ad1681. {{(pid=87068) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 04 10:23:36 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-f7e72f2e-0034-4052-ba13-788812a6c297 tempest-TestInstancesWithCinderVolumes-304140490 None] Acquiring lock "cinder-cf4db3a1-74fe-47b0-bc85-688e825eeec2-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:23:36 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-f7e72f2e-0034-4052-ba13-788812a6c297 tempest-TestInstancesWithCinderVolumes-304140490 None] Lock "cinder-cf4db3a1-74fe-47b0-bc85-688e825eeec2-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:23:36 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-f7e72f2e-0034-4052-ba13-788812a6c297 tempest-TestInstancesWithCinderVolumes-304140490 None] Acquiring lock "cinder-quobyte-cf4db3a1-74fe-47b0-bc85-688e825eeec2" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:23:36 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-f7e72f2e-0034-4052-ba13-788812a6c297 tempest-TestInstancesWithCinderVolumes-304140490 None] Lock "cinder-quobyte-cf4db3a1-74fe-47b0-bc85-688e825eeec2" acquired by "delete_volume" :: waited 0.017s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:23:36 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b3e47ae-9ac9-4051-b0c6-f3234bc8556d]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:23:36 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f7e72f2e-0034-4052-ba13-788812a6c297 tempest-TestInstancesWithCinderVolumes-304140490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-cf4db3a1-74fe-47b0-bc85-688e825eeec2 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:23:36 devstack sudo[99256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-cf4db3a1-74fe-47b0-bc85-688e825eeec2 Nov 04 10:23:36 devstack sudo[99256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:23:36 devstack sudo[99256]: pam_unix(sudo:session): session closed for user root Nov 04 10:23:36 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f7e72f2e-0034-4052-ba13-788812a6c297 tempest-TestInstancesWithCinderVolumes-304140490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-cf4db3a1-74fe-47b0-bc85-688e825eeec2" returned: 0 in 0.489s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:23:36 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f7e72f2e-0034-4052-ba13-788812a6c297 tempest-TestInstancesWithCinderVolumes-304140490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-cf4db3a1-74fe-47b0-bc85-688e825eeec2 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:23:36 devstack sudo[99262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-cf4db3a1-74fe-47b0-bc85-688e825eeec2 Nov 04 10:23:36 devstack sudo[99262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:23:37 devstack sudo[99262]: pam_unix(sudo:session): session closed for user root Nov 04 10:23:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f7e72f2e-0034-4052-ba13-788812a6c297 tempest-TestInstancesWithCinderVolumes-304140490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-cf4db3a1-74fe-47b0-bc85-688e825eeec2" returned: 0 in 0.519s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:23:37 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-f7e72f2e-0034-4052-ba13-788812a6c297 tempest-TestInstancesWithCinderVolumes-304140490 None] Lock "cinder-quobyte-cf4db3a1-74fe-47b0-bc85-688e825eeec2" released by "delete_volume" :: held 1.090s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:23:37 devstack cinder-volume[87068]: WARNING cinder.quota [None req-f7e72f2e-0034-4052-ba13-788812a6c297 tempest-TestInstancesWithCinderVolumes-304140490 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-748876681-935613483 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-748876681-935613483, it is now deprecated. Please use the default quota class for default quota. Nov 04 10:23:37 devstack cinder-volume[87068]: WARNING cinder.quota [None req-f7e72f2e-0034-4052-ba13-788812a6c297 tempest-TestInstancesWithCinderVolumes-304140490 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-748876681-935613483 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-748876681-935613483, it is now deprecated. Please use the default quota class for default quota. Nov 04 10:23:37 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-f7e72f2e-0034-4052-ba13-788812a6c297 tempest-TestInstancesWithCinderVolumes-304140490 None] Created reservations ['8563cb5b-57dc-4d27-80c8-9adf30eb035d', 'e5d976a2-eed8-4d0b-a19c-69b596f88e73', 'd2e39aef-1116-4447-8e75-9aa6830388f9', 'b629ed65-fe2d-45b5-93d2-ce004bc7295c'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:23:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-f7e72f2e-0034-4052-ba13-788812a6c297 tempest-TestInstancesWithCinderVolumes-304140490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:23:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-f7e72f2e-0034-4052-ba13-788812a6c297 tempest-TestInstancesWithCinderVolumes-304140490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:23:37 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-f7e72f2e-0034-4052-ba13-788812a6c297 tempest-TestInstancesWithCinderVolumes-304140490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:23:37 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-f7e72f2e-0034-4052-ba13-788812a6c297 tempest-TestInstancesWithCinderVolumes-304140490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:23:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-f7e72f2e-0034-4052-ba13-788812a6c297 tempest-TestInstancesWithCinderVolumes-304140490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:23:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f7e72f2e-0034-4052-ba13-788812a6c297 tempest-TestInstancesWithCinderVolumes-304140490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:23:37 devstack sudo[99265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:23:37 devstack sudo[99265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:23:37 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa6dd4ec-85f2-4916-8af6-eed8a4bd08f5 tempest-VolumeAndVolumeTypeFromImageTest-250915193 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:23:37 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-fa6dd4ec-85f2-4916-8af6-eed8a4bd08f5 tempest-VolumeAndVolumeTypeFromImageTest-250915193 None] Flow 'volume_create_manager' (8f5164e3-ccec-4e63-aa04-aef6185304cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:23:37 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-fa6dd4ec-85f2-4916-8af6-eed8a4bd08f5 tempest-VolumeAndVolumeTypeFromImageTest-250915193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bce3a544-2fd6-4f24-812b-23f3b55c9244) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:23:38 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-fa6dd4ec-85f2-4916-8af6-eed8a4bd08f5 tempest-VolumeAndVolumeTypeFromImageTest-250915193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bce3a544-2fd6-4f24-812b-23f3b55c9244) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:23:37Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f0ddcf5-52f5-4271-8632-e182e73e2a3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c3f4df9a9884d21a6693cda517d6a32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:23:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:23:38Z,use_quota=True,user_id='1175d8f6d98248ab84a45818ef464aae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be3f4e5a-b2ff-425b-a354-d163039f117b),volume_type_id=be3f4e5a-b2ff-425b-a354-d163039f117b)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:23:38 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-fa6dd4ec-85f2-4916-8af6-eed8a4bd08f5 tempest-VolumeAndVolumeTypeFromImageTest-250915193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9753883e-a092-4fc4-8f53-37668bc4247d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:23:38 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-fa6dd4ec-85f2-4916-8af6-eed8a4bd08f5 tempest-VolumeAndVolumeTypeFromImageTest-250915193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9753883e-a092-4fc4-8f53-37668bc4247d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:23:38 devstack sudo[99265]: pam_unix(sudo:session): session closed for user root Nov 04 10:23:38 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-fa6dd4ec-85f2-4916-8af6-eed8a4bd08f5 tempest-VolumeAndVolumeTypeFromImageTest-250915193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ce0ef81-41f4-4031-9112-a6efd5084d3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:23:38 devstack cinder-volume[87068]: DEBUG cinder.image.glance [None req-fa6dd4ec-85f2-4916-8af6-eed8a4bd08f5 tempest-VolumeAndVolumeTypeFromImageTest-250915193 None] Creating Keystone auth plugin from conf {{(pid=87068) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 04 10:23:38 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f7e72f2e-0034-4052-ba13-788812a6c297 tempest-TestInstancesWithCinderVolumes-304140490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.342s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:23:38 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-f7e72f2e-0034-4052-ba13-788812a6c297 tempest-TestInstancesWithCinderVolumes-304140490 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:23:38 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-f7e72f2e-0034-4052-ba13-788812a6c297 tempest-TestInstancesWithCinderVolumes-304140490 None] Deleted volume successfully. Nov 04 10:23:38 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-f7e72f2e-0034-4052-ba13-788812a6c297 tempest-TestInstancesWithCinderVolumes-304140490 None] Lock "cinder-cf4db3a1-74fe-47b0-bc85-688e825eeec2-delete_volume" released by "delete_volume" :: held 1.838s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:23:38 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-fa6dd4ec-85f2-4916-8af6-eed8a4bd08f5 tempest-VolumeAndVolumeTypeFromImageTest-250915193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ce0ef81-41f4-4031-9112-a6efd5084d3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '1f0ddcf5-52f5-4271-8632-e182e73e2a3a', 'volume_name': 'volume-1f0ddcf5-52f5-4271-8632-e182e73e2a3a', 'volume_size': 1, 'image_id': '754ff541-bfd1-48ef-908b-c7cf05c5415c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/754ff541-bfd1-48ef-908b-c7cf05c5415c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f10f4b275a98496dc52bd645f5bfef6b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '7c3f4df9a9884d21a6693cda517d6a32', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '743c8816b7dee70ffc22d808d56ba547aa1b96c1a0f8e63bd53d45c54695104c9b37acf3c739474ed054bf4991319b741826c636d44b2289669c89e9ab0cc080', 'id': '754ff541-bfd1-48ef-908b-c7cf05c5415c', 'created_at': datetime.datetime(2026, 11, 4, 9, 23, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 9, 23, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/754ff541-bfd1-48ef-908b-c7cf05c5415c/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:23:38 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-fa6dd4ec-85f2-4916-8af6-eed8a4bd08f5 tempest-VolumeAndVolumeTypeFromImageTest-250915193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbc607f8-e1ba-4ef1-a444-ac57d3321a44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:23:38 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-fa6dd4ec-85f2-4916-8af6-eed8a4bd08f5 tempest-VolumeAndVolumeTypeFromImageTest-250915193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbc607f8-e1ba-4ef1-a444-ac57d3321a44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:23:38 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-fa6dd4ec-85f2-4916-8af6-eed8a4bd08f5 tempest-VolumeAndVolumeTypeFromImageTest-250915193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e70ca64-10a2-4c36-a25f-49287c1efa6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:23:38 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-fa6dd4ec-85f2-4916-8af6-eed8a4bd08f5 tempest-VolumeAndVolumeTypeFromImageTest-250915193 None] Volume 1f0ddcf5-52f5-4271-8632-e182e73e2a3a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-1f0ddcf5-52f5-4271-8632-e182e73e2a3a', 'volume_size': 1, 'image_id': '754ff541-bfd1-48ef-908b-c7cf05c5415c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/754ff541-bfd1-48ef-908b-c7cf05c5415c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f10f4b275a98496dc52bd645f5bfef6b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '7c3f4df9a9884d21a6693cda517d6a32', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '743c8816b7dee70ffc22d808d56ba547aa1b96c1a0f8e63bd53d45c54695104c9b37acf3c739474ed054bf4991319b741826c636d44b2289669c89e9ab0cc080', 'id': '754ff541-bfd1-48ef-908b-c7cf05c5415c', 'created_at': datetime.datetime(2026, 11, 4, 9, 23, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 9, 23, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/754ff541-bfd1-48ef-908b-c7cf05c5415c/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Nov 04 10:23:38 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa6dd4ec-85f2-4916-8af6-eed8a4bd08f5 tempest-VolumeAndVolumeTypeFromImageTest-250915193 None] Trying to clone 1f0ddcf5-52f5-4271-8632-e182e73e2a3a from image 754ff541-bfd1-48ef-908b-c7cf05c5415c at location (None, [{'url': 'file:///opt/stack/data/glance/images/754ff541-bfd1-48ef-908b-c7cf05c5415c', 'metadata': {}}]). {{(pid=87068) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 04 10:23:38 devstack cinder-volume[87068]: DEBUG cinder.image.image_utils [None req-fa6dd4ec-85f2-4916-8af6-eed8a4bd08f5 tempest-VolumeAndVolumeTypeFromImageTest-250915193 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_754ff541-bfd1-48ef-908b-c7cf05c5415c_ephgbxccdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87068) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 04 10:23:38 devstack cinder-volume[87068]: INFO cinder.image.image_utils [None req-fa6dd4ec-85f2-4916-8af6-eed8a4bd08f5 tempest-VolumeAndVolumeTypeFromImageTest-250915193 None] Image download 0.00 MB at 0.00 MB/s Nov 04 10:23:38 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[31d9370e-e1c9-43a6-a767-1854a4ed8e0b]: (4, 'raw') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:23:38 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-fa6dd4ec-85f2-4916-8af6-eed8a4bd08f5 tempest-VolumeAndVolumeTypeFromImageTest-250915193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_754ff541-bfd1-48ef-908b-c7cf05c5415c_ephgbxccdevstack@QuobyteHD {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:23:39 devstack sudo[99272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_754ff541-bfd1-48ef-908b-c7cf05c5415c_ephgbxccdevstack@QuobyteHD Nov 04 10:23:39 devstack sudo[99272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:23:39 devstack sudo[99272]: pam_unix(sudo:session): session closed for user root Nov 04 10:23:39 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-fa6dd4ec-85f2-4916-8af6-eed8a4bd08f5 tempest-VolumeAndVolumeTypeFromImageTest-250915193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_754ff541-bfd1-48ef-908b-c7cf05c5415c_ephgbxccdevstack@QuobyteHD" returned: 0 in 0.454s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:23:39 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-fa6dd4ec-85f2-4916-8af6-eed8a4bd08f5 tempest-VolumeAndVolumeTypeFromImageTest-250915193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_754ff541-bfd1-48ef-908b-c7cf05c5415c_ephgbxccdevstack@QuobyteHD {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:23:39 devstack sudo[99283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_754ff541-bfd1-48ef-908b-c7cf05c5415c_ephgbxccdevstack@QuobyteHD Nov 04 10:23:39 devstack sudo[99283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:23:39 devstack sudo[99283]: pam_unix(sudo:session): session closed for user root Nov 04 10:23:39 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-fa6dd4ec-85f2-4916-8af6-eed8a4bd08f5 tempest-VolumeAndVolumeTypeFromImageTest-250915193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_754ff541-bfd1-48ef-908b-c7cf05c5415c_ephgbxccdevstack@QuobyteHD" returned: 1 in 0.430s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:23:39 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-fa6dd4ec-85f2-4916-8af6-eed8a4bd08f5 tempest-VolumeAndVolumeTypeFromImageTest-250915193 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_754ff541-bfd1-48ef-908b-c7cf05c5415c_ephgbxccdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 04 10:23:39 devstack cinder-volume[87068]: DEBUG cinder.image.image_utils [None req-fa6dd4ec-85f2-4916-8af6-eed8a4bd08f5 tempest-VolumeAndVolumeTypeFromImageTest-250915193 None] Temporary image 754ff541-bfd1-48ef-908b-c7cf05c5415c is fetched for user 1175d8f6d98248ab84a45818ef464aae. {{(pid=87068) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 04 10:23:39 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c5a16d2-bfcf-4fb7-a08e-1bc39f3dd66c]: (4, 'raw') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:23:39 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-fa6dd4ec-85f2-4916-8af6-eed8a4bd08f5 tempest-VolumeAndVolumeTypeFromImageTest-250915193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_754ff541-bfd1-48ef-908b-c7cf05c5415c_ephgbxccdevstack@QuobyteHD {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:23:40 devstack sudo[99298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_754ff541-bfd1-48ef-908b-c7cf05c5415c_ephgbxccdevstack@QuobyteHD Nov 04 10:23:40 devstack sudo[99298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:23:40 devstack sudo[99298]: pam_unix(sudo:session): session closed for user root Nov 04 10:23:40 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-fa6dd4ec-85f2-4916-8af6-eed8a4bd08f5 tempest-VolumeAndVolumeTypeFromImageTest-250915193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_754ff541-bfd1-48ef-908b-c7cf05c5415c_ephgbxccdevstack@QuobyteHD" returned: 0 in 0.426s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:23:40 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-fa6dd4ec-85f2-4916-8af6-eed8a4bd08f5 tempest-VolumeAndVolumeTypeFromImageTest-250915193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_754ff541-bfd1-48ef-908b-c7cf05c5415c_ephgbxccdevstack@QuobyteHD {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:23:40 devstack sudo[99302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_754ff541-bfd1-48ef-908b-c7cf05c5415c_ephgbxccdevstack@QuobyteHD Nov 04 10:23:40 devstack sudo[99302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:23:40 devstack sudo[99302]: pam_unix(sudo:session): session closed for user root Nov 04 10:23:40 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-fa6dd4ec-85f2-4916-8af6-eed8a4bd08f5 tempest-VolumeAndVolumeTypeFromImageTest-250915193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_754ff541-bfd1-48ef-908b-c7cf05c5415c_ephgbxccdevstack@QuobyteHD" returned: 1 in 0.466s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:23:40 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-fa6dd4ec-85f2-4916-8af6-eed8a4bd08f5 tempest-VolumeAndVolumeTypeFromImageTest-250915193 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_754ff541-bfd1-48ef-908b-c7cf05c5415c_ephgbxccdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 04 10:23:40 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-fa6dd4ec-85f2-4916-8af6-eed8a4bd08f5 tempest-VolumeAndVolumeTypeFromImageTest-250915193 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:23:40 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-fa6dd4ec-85f2-4916-8af6-eed8a4bd08f5 tempest-VolumeAndVolumeTypeFromImageTest-250915193 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:23:40 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-fa6dd4ec-85f2-4916-8af6-eed8a4bd08f5 tempest-VolumeAndVolumeTypeFromImageTest-250915193 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:23:37Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f0ddcf5-52f5-4271-8632-e182e73e2a3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c3f4df9a9884d21a6693cda517d6a32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:23:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:23:38Z,use_quota=True,user_id='1175d8f6d98248ab84a45818ef464aae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be3f4e5a-b2ff-425b-a354-d163039f117b),volume_type_id=be3f4e5a-b2ff-425b-a354-d163039f117b)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 10:23:40 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-fa6dd4ec-85f2-4916-8af6-eed8a4bd08f5 tempest-VolumeAndVolumeTypeFromImageTest-250915193 None] Creating volume 1f0ddcf5-52f5-4271-8632-e182e73e2a3a {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:23:40 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-fa6dd4ec-85f2-4916-8af6-eed8a4bd08f5 tempest-VolumeAndVolumeTypeFromImageTest-250915193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:23:40 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-fa6dd4ec-85f2-4916-8af6-eed8a4bd08f5 tempest-VolumeAndVolumeTypeFromImageTest-250915193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:23:40 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-fa6dd4ec-85f2-4916-8af6-eed8a4bd08f5 tempest-VolumeAndVolumeTypeFromImageTest-250915193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:23:40 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-fa6dd4ec-85f2-4916-8af6-eed8a4bd08f5 tempest-VolumeAndVolumeTypeFromImageTest-250915193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:23:40 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-fa6dd4ec-85f2-4916-8af6-eed8a4bd08f5 tempest-VolumeAndVolumeTypeFromImageTest-250915193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:23:40 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-fa6dd4ec-85f2-4916-8af6-eed8a4bd08f5 tempest-VolumeAndVolumeTypeFromImageTest-250915193 None] Selected osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:23:40 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-fa6dd4ec-85f2-4916-8af6-eed8a4bd08f5 tempest-VolumeAndVolumeTypeFromImageTest-250915193 None] casted to osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 Nov 04 10:23:40 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-fa6dd4ec-85f2-4916-8af6-eed8a4bd08f5 tempest-VolumeAndVolumeTypeFromImageTest-250915193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-1f0ddcf5-52f5-4271-8632-e182e73e2a3a 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:23:40 devstack sudo[99309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-1f0ddcf5-52f5-4271-8632-e182e73e2a3a 1073741824 Nov 04 10:23:40 devstack sudo[99309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:23:40 devstack cinder-volume[87068]: INFO cinder.volume.manager [req-44469482-96dd-445b-a883-9db74b09feac req-a2a5da74-7273-483f-b6c1-1efa13b75631 tempest-TestInstancesWithCinderVolumes-304140490 None] Terminate volume connection completed successfully. Nov 04 10:23:40 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [req-44469482-96dd-445b-a883-9db74b09feac req-a2a5da74-7273-483f-b6c1-1efa13b75631 tempest-TestInstancesWithCinderVolumes-304140490 None] Deleting attachment e4bd7df0-511a-4d8f-90fc-72039091e9eb. {{(pid=87068) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 04 10:23:41 devstack sudo[99309]: pam_unix(sudo:session): session closed for user root Nov 04 10:23:41 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-fa6dd4ec-85f2-4916-8af6-eed8a4bd08f5 tempest-VolumeAndVolumeTypeFromImageTest-250915193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-1f0ddcf5-52f5-4271-8632-e182e73e2a3a 1073741824" returned: 0 in 0.547s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:23:41 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-fa6dd4ec-85f2-4916-8af6-eed8a4bd08f5 tempest-VolumeAndVolumeTypeFromImageTest-250915193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-1f0ddcf5-52f5-4271-8632-e182e73e2a3a {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:23:41 devstack sudo[99315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-1f0ddcf5-52f5-4271-8632-e182e73e2a3a Nov 04 10:23:41 devstack sudo[99315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:23:41 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-192a9d0d-c17d-438b-a04d-db55b5a62690 tempest-TestInstancesWithCinderVolumes-304140490 None] Acquiring lock "cinder-1365d08d-723e-4f4d-98b6-48e57e761f8c-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:23:41 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-192a9d0d-c17d-438b-a04d-db55b5a62690 tempest-TestInstancesWithCinderVolumes-304140490 None] Lock "cinder-1365d08d-723e-4f4d-98b6-48e57e761f8c-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:23:41 devstack sudo[99315]: pam_unix(sudo:session): session closed for user root Nov 04 10:23:41 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-fa6dd4ec-85f2-4916-8af6-eed8a4bd08f5 tempest-VolumeAndVolumeTypeFromImageTest-250915193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-1f0ddcf5-52f5-4271-8632-e182e73e2a3a" returned: 0 in 0.323s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:23:41 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-fa6dd4ec-85f2-4916-8af6-eed8a4bd08f5 tempest-VolumeAndVolumeTypeFromImageTest-250915193 None] <== create_volume: return (924ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 10:23:41 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-fa6dd4ec-85f2-4916-8af6-eed8a4bd08f5 tempest-VolumeAndVolumeTypeFromImageTest-250915193 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.930s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:23:41 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-192a9d0d-c17d-438b-a04d-db55b5a62690 tempest-TestInstancesWithCinderVolumes-304140490 None] Acquiring lock "cinder-quobyte-1365d08d-723e-4f4d-98b6-48e57e761f8c" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:23:41 devstack cinder-volume[87068]: DEBUG cinder.volume.volume_utils [None req-fa6dd4ec-85f2-4916-8af6-eed8a4bd08f5 tempest-VolumeAndVolumeTypeFromImageTest-250915193 None] Attempting download of 754ff541-bfd1-48ef-908b-c7cf05c5415c ((None, [{'url': 'file:///opt/stack/data/glance/images/754ff541-bfd1-48ef-908b-c7cf05c5415c', 'metadata': {}}])) to volume 1f0ddcf5-52f5-4271-8632-e182e73e2a3a. {{(pid=87068) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 04 10:23:41 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-192a9d0d-c17d-438b-a04d-db55b5a62690 tempest-TestInstancesWithCinderVolumes-304140490 None] Lock "cinder-quobyte-1365d08d-723e-4f4d-98b6-48e57e761f8c" acquired by "delete_volume" :: waited 0.028s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:23:41 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[10f46f5c-0fa9-4c0d-9df0-3ea99b81ce3e]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:23:41 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-192a9d0d-c17d-438b-a04d-db55b5a62690 tempest-TestInstancesWithCinderVolumes-304140490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-1365d08d-723e-4f4d-98b6-48e57e761f8c {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:23:41 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[a79e4435-89ec-4170-9c4a-20028f9f908c]: (4, 'raw') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:23:41 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-fa6dd4ec-85f2-4916-8af6-eed8a4bd08f5 tempest-VolumeAndVolumeTypeFromImageTest-250915193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_754ff541-bfd1-48ef-908b-c7cf05c5415c_02ydjog0 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:23:42 devstack sudo[99318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-1365d08d-723e-4f4d-98b6-48e57e761f8c Nov 04 10:23:42 devstack sudo[99318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:23:42 devstack sudo[99319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_754ff541-bfd1-48ef-908b-c7cf05c5415c_02ydjog0 Nov 04 10:23:42 devstack sudo[99319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:23:42 devstack sudo[99319]: pam_unix(sudo:session): session closed for user root Nov 04 10:23:42 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-fa6dd4ec-85f2-4916-8af6-eed8a4bd08f5 tempest-VolumeAndVolumeTypeFromImageTest-250915193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_754ff541-bfd1-48ef-908b-c7cf05c5415c_02ydjog0" returned: 0 in 0.504s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:23:42 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-fa6dd4ec-85f2-4916-8af6-eed8a4bd08f5 tempest-VolumeAndVolumeTypeFromImageTest-250915193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_754ff541-bfd1-48ef-908b-c7cf05c5415c_02ydjog0 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:23:42 devstack sudo[99318]: pam_unix(sudo:session): session closed for user root Nov 04 10:23:42 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-192a9d0d-c17d-438b-a04d-db55b5a62690 tempest-TestInstancesWithCinderVolumes-304140490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-1365d08d-723e-4f4d-98b6-48e57e761f8c" returned: 0 in 0.544s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:23:42 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-192a9d0d-c17d-438b-a04d-db55b5a62690 tempest-TestInstancesWithCinderVolumes-304140490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-1365d08d-723e-4f4d-98b6-48e57e761f8c {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:23:42 devstack sudo[99328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-1365d08d-723e-4f4d-98b6-48e57e761f8c Nov 04 10:23:42 devstack sudo[99328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:23:42 devstack sudo[99327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_754ff541-bfd1-48ef-908b-c7cf05c5415c_02ydjog0 Nov 04 10:23:42 devstack sudo[99327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:23:42 devstack sudo[99328]: pam_unix(sudo:session): session closed for user root Nov 04 10:23:42 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-192a9d0d-c17d-438b-a04d-db55b5a62690 tempest-TestInstancesWithCinderVolumes-304140490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-1365d08d-723e-4f4d-98b6-48e57e761f8c" returned: 0 in 0.451s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:23:42 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-192a9d0d-c17d-438b-a04d-db55b5a62690 tempest-TestInstancesWithCinderVolumes-304140490 None] Lock "cinder-quobyte-1365d08d-723e-4f4d-98b6-48e57e761f8c" released by "delete_volume" :: held 1.072s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:23:43 devstack cinder-volume[87068]: WARNING cinder.quota [None req-192a9d0d-c17d-438b-a04d-db55b5a62690 tempest-TestInstancesWithCinderVolumes-304140490 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1018397250-2059105015 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1018397250-2059105015, it is now deprecated. Please use the default quota class for default quota. Nov 04 10:23:43 devstack cinder-volume[87068]: WARNING cinder.quota [None req-192a9d0d-c17d-438b-a04d-db55b5a62690 tempest-TestInstancesWithCinderVolumes-304140490 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1018397250-2059105015 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1018397250-2059105015, it is now deprecated. Please use the default quota class for default quota. Nov 04 10:23:43 devstack sudo[99327]: pam_unix(sudo:session): session closed for user root Nov 04 10:23:43 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-fa6dd4ec-85f2-4916-8af6-eed8a4bd08f5 tempest-VolumeAndVolumeTypeFromImageTest-250915193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_754ff541-bfd1-48ef-908b-c7cf05c5415c_02ydjog0" returned: 1 in 0.648s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:23:43 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-fa6dd4ec-85f2-4916-8af6-eed8a4bd08f5 tempest-VolumeAndVolumeTypeFromImageTest-250915193 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_754ff541-bfd1-48ef-908b-c7cf05c5415c_02ydjog0' failed. Not Retrying. {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 04 10:23:43 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3c9ecf6-d5d1-459e-a3ec-190334bc542f]: (4, 'raw') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:23:43 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-fa6dd4ec-85f2-4916-8af6-eed8a4bd08f5 tempest-VolumeAndVolumeTypeFromImageTest-250915193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_754ff541-bfd1-48ef-908b-c7cf05c5415c_ephgbxccdevstack@QuobyteHD {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:23:43 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-192a9d0d-c17d-438b-a04d-db55b5a62690 tempest-TestInstancesWithCinderVolumes-304140490 None] Created reservations ['dd634242-93e8-4033-ba59-d06a20354841', '7b7c8bba-d9da-4041-8fc2-0acc1a0aa6ea', '93cf382c-e9a5-4551-9bb9-aa5e787f5b74', '1091ba5b-bd9b-4e65-b6ae-e6328754a794'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:23:43 devstack sudo[99369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_754ff541-bfd1-48ef-908b-c7cf05c5415c_ephgbxccdevstack@QuobyteHD Nov 04 10:23:43 devstack sudo[99369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:23:43 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-192a9d0d-c17d-438b-a04d-db55b5a62690 tempest-TestInstancesWithCinderVolumes-304140490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:23:43 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-192a9d0d-c17d-438b-a04d-db55b5a62690 tempest-TestInstancesWithCinderVolumes-304140490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:23:43 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-192a9d0d-c17d-438b-a04d-db55b5a62690 tempest-TestInstancesWithCinderVolumes-304140490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:23:43 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-192a9d0d-c17d-438b-a04d-db55b5a62690 tempest-TestInstancesWithCinderVolumes-304140490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:23:43 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-192a9d0d-c17d-438b-a04d-db55b5a62690 tempest-TestInstancesWithCinderVolumes-304140490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:23:43 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-192a9d0d-c17d-438b-a04d-db55b5a62690 tempest-TestInstancesWithCinderVolumes-304140490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:23:43 devstack sudo[99373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:23:43 devstack sudo[99373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:23:43 devstack sudo[99369]: pam_unix(sudo:session): session closed for user root Nov 04 10:23:43 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-fa6dd4ec-85f2-4916-8af6-eed8a4bd08f5 tempest-VolumeAndVolumeTypeFromImageTest-250915193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_754ff541-bfd1-48ef-908b-c7cf05c5415c_ephgbxccdevstack@QuobyteHD" returned: 0 in 0.681s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:23:43 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-fa6dd4ec-85f2-4916-8af6-eed8a4bd08f5 tempest-VolumeAndVolumeTypeFromImageTest-250915193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_754ff541-bfd1-48ef-908b-c7cf05c5415c_ephgbxccdevstack@QuobyteHD {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:23:43 devstack sudo[99373]: pam_unix(sudo:session): session closed for user root Nov 04 10:23:43 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-192a9d0d-c17d-438b-a04d-db55b5a62690 tempest-TestInstancesWithCinderVolumes-304140490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.477s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:23:43 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-192a9d0d-c17d-438b-a04d-db55b5a62690 tempest-TestInstancesWithCinderVolumes-304140490 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:23:43 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-192a9d0d-c17d-438b-a04d-db55b5a62690 tempest-TestInstancesWithCinderVolumes-304140490 None] Deleted volume successfully. Nov 04 10:23:44 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-192a9d0d-c17d-438b-a04d-db55b5a62690 tempest-TestInstancesWithCinderVolumes-304140490 None] Lock "cinder-1365d08d-723e-4f4d-98b6-48e57e761f8c-delete_volume" released by "delete_volume" :: held 2.249s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:23:44 devstack sudo[99380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_754ff541-bfd1-48ef-908b-c7cf05c5415c_ephgbxccdevstack@QuobyteHD Nov 04 10:23:44 devstack sudo[99380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:23:44 devstack sudo[99380]: pam_unix(sudo:session): session closed for user root Nov 04 10:23:44 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-fa6dd4ec-85f2-4916-8af6-eed8a4bd08f5 tempest-VolumeAndVolumeTypeFromImageTest-250915193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_754ff541-bfd1-48ef-908b-c7cf05c5415c_ephgbxccdevstack@QuobyteHD" returned: 1 in 0.491s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:23:44 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-fa6dd4ec-85f2-4916-8af6-eed8a4bd08f5 tempest-VolumeAndVolumeTypeFromImageTest-250915193 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_754ff541-bfd1-48ef-908b-c7cf05c5415c_ephgbxccdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 04 10:23:44 devstack cinder-volume[87068]: DEBUG cinder.image.image_utils [None req-fa6dd4ec-85f2-4916-8af6-eed8a4bd08f5 tempest-VolumeAndVolumeTypeFromImageTest-250915193 None] 754ff541-bfd1-48ef-908b-c7cf05c5415c was raw, converting to qcow2 {{(pid=87068) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 04 10:23:44 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-fa6dd4ec-85f2-4916-8af6-eed8a4bd08f5 tempest-VolumeAndVolumeTypeFromImageTest-250915193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_754ff541-bfd1-48ef-908b-c7cf05c5415c_ephgbxccdevstack@QuobyteHD /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-1f0ddcf5-52f5-4271-8632-e182e73e2a3a {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:23:44 devstack sudo[99386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_754ff541-bfd1-48ef-908b-c7cf05c5415c_ephgbxccdevstack@QuobyteHD /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-1f0ddcf5-52f5-4271-8632-e182e73e2a3a Nov 04 10:23:44 devstack sudo[99386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:23:44 devstack sudo[99386]: pam_unix(sudo:session): session closed for user root Nov 04 10:23:44 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-fa6dd4ec-85f2-4916-8af6-eed8a4bd08f5 tempest-VolumeAndVolumeTypeFromImageTest-250915193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_754ff541-bfd1-48ef-908b-c7cf05c5415c_ephgbxccdevstack@QuobyteHD /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-1f0ddcf5-52f5-4271-8632-e182e73e2a3a" returned: 0 in 0.543s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:23:44 devstack cinder-volume[87068]: DEBUG cinder.image.image_utils [None req-fa6dd4ec-85f2-4916-8af6-eed8a4bd08f5 tempest-VolumeAndVolumeTypeFromImageTest-250915193 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_754ff541-bfd1-48ef-908b-c7cf05c5415c_ephgbxccdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-1f0ddcf5-52f5-4271-8632-e182e73e2a3a {{(pid=87068) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 04 10:23:44 devstack cinder-volume[87068]: INFO cinder.image.image_utils [None req-fa6dd4ec-85f2-4916-8af6-eed8a4bd08f5 tempest-VolumeAndVolumeTypeFromImageTest-250915193 None] Converted 0.00 MB image at 0.00 MB/s Nov 04 10:23:44 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-fa6dd4ec-85f2-4916-8af6-eed8a4bd08f5 tempest-VolumeAndVolumeTypeFromImageTest-250915193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-1f0ddcf5-52f5-4271-8632-e182e73e2a3a 1G {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:23:44 devstack sudo[99392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-1f0ddcf5-52f5-4271-8632-e182e73e2a3a 1G Nov 04 10:23:44 devstack sudo[99392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:23:45 devstack sudo[99392]: pam_unix(sudo:session): session closed for user root Nov 04 10:23:45 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-fa6dd4ec-85f2-4916-8af6-eed8a4bd08f5 tempest-VolumeAndVolumeTypeFromImageTest-250915193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-1f0ddcf5-52f5-4271-8632-e182e73e2a3a 1G" returned: 0 in 0.516s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:23:45 devstack cinder-volume[87068]: DEBUG cinder.volume.volume_utils [None req-fa6dd4ec-85f2-4916-8af6-eed8a4bd08f5 tempest-VolumeAndVolumeTypeFromImageTest-250915193 None] Downloaded image 754ff541-bfd1-48ef-908b-c7cf05c5415c ((None, [{'url': 'file:///opt/stack/data/glance/images/754ff541-bfd1-48ef-908b-c7cf05c5415c', 'metadata': {}}])) to volume 1f0ddcf5-52f5-4271-8632-e182e73e2a3a successfully. {{(pid=87068) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 04 10:23:45 devstack cinder-volume[87068]: DEBUG cinder.image.image_utils [None req-fa6dd4ec-85f2-4916-8af6-eed8a4bd08f5 tempest-VolumeAndVolumeTypeFromImageTest-250915193 None] Temporary image 754ff541-bfd1-48ef-908b-c7cf05c5415c for user 1175d8f6d98248ab84a45818ef464aae is deleted. {{(pid=87068) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 04 10:23:45 devstack cinder-volume[87068]: DEBUG cinder.volume.volume_utils [None req-fa6dd4ec-85f2-4916-8af6-eed8a4bd08f5 tempest-VolumeAndVolumeTypeFromImageTest-250915193 None] Marking volume 1f0ddcf5-52f5-4271-8632-e182e73e2a3a as bootable. {{(pid=87068) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 04 10:23:45 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa6dd4ec-85f2-4916-8af6-eed8a4bd08f5 tempest-VolumeAndVolumeTypeFromImageTest-250915193 None] Copying metadata from image 754ff541-bfd1-48ef-908b-c7cf05c5415c to 1f0ddcf5-52f5-4271-8632-e182e73e2a3a. {{(pid=87068) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 04 10:23:45 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa6dd4ec-85f2-4916-8af6-eed8a4bd08f5 tempest-VolumeAndVolumeTypeFromImageTest-250915193 None] Creating volume glance metadata for volume 1f0ddcf5-52f5-4271-8632-e182e73e2a3a backed by image 754ff541-bfd1-48ef-908b-c7cf05c5415c with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '754ff541-bfd1-48ef-908b-c7cf05c5415c', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'f10f4b275a98496dc52bd645f5bfef6b', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87068) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 04 10:23:45 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-fa6dd4ec-85f2-4916-8af6-eed8a4bd08f5 tempest-VolumeAndVolumeTypeFromImageTest-250915193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e70ca64-10a2-4c36-a25f-49287c1efa6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f0ddcf5-52f5-4271-8632-e182e73e2a3a', 'volume_size': 1, 'image_id': '754ff541-bfd1-48ef-908b-c7cf05c5415c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/754ff541-bfd1-48ef-908b-c7cf05c5415c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f10f4b275a98496dc52bd645f5bfef6b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '7c3f4df9a9884d21a6693cda517d6a32', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '743c8816b7dee70ffc22d808d56ba547aa1b96c1a0f8e63bd53d45c54695104c9b37acf3c739474ed054bf4991319b741826c636d44b2289669c89e9ab0cc080', 'id': '754ff541-bfd1-48ef-908b-c7cf05c5415c', 'created_at': datetime.datetime(2026, 11, 4, 9, 23, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 9, 23, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/754ff541-bfd1-48ef-908b-c7cf05c5415c/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:23:45 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-fa6dd4ec-85f2-4916-8af6-eed8a4bd08f5 tempest-VolumeAndVolumeTypeFromImageTest-250915193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44bf8d3b-2ce6-4a21-acc2-2f75a8b73eed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:23:45 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-fa6dd4ec-85f2-4916-8af6-eed8a4bd08f5 tempest-VolumeAndVolumeTypeFromImageTest-250915193 None] Volume volume-1f0ddcf5-52f5-4271-8632-e182e73e2a3a (1f0ddcf5-52f5-4271-8632-e182e73e2a3a): created successfully Nov 04 10:23:45 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-fa6dd4ec-85f2-4916-8af6-eed8a4bd08f5 tempest-VolumeAndVolumeTypeFromImageTest-250915193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44bf8d3b-2ce6-4a21-acc2-2f75a8b73eed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:23:45 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-fa6dd4ec-85f2-4916-8af6-eed8a4bd08f5 tempest-VolumeAndVolumeTypeFromImageTest-250915193 None] Flow 'volume_create_manager' (8f5164e3-ccec-4e63-aa04-aef6185304cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:23:45 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-fa6dd4ec-85f2-4916-8af6-eed8a4bd08f5 tempest-VolumeAndVolumeTypeFromImageTest-250915193 None] Created volume successfully. Nov 04 10:23:45 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-c29b3d47-cd10-474f-9b8a-d2f84bbf403d tempest-VolumeAndVolumeTypeFromImageTest-250915193 None] Acquiring lock "cinder-1f0ddcf5-52f5-4271-8632-e182e73e2a3a-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:23:45 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-c29b3d47-cd10-474f-9b8a-d2f84bbf403d tempest-VolumeAndVolumeTypeFromImageTest-250915193 None] Lock "cinder-1f0ddcf5-52f5-4271-8632-e182e73e2a3a-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:23:45 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-c29b3d47-cd10-474f-9b8a-d2f84bbf403d tempest-VolumeAndVolumeTypeFromImageTest-250915193 None] Acquiring lock "cinder-quobyte-1f0ddcf5-52f5-4271-8632-e182e73e2a3a" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:23:45 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-c29b3d47-cd10-474f-9b8a-d2f84bbf403d tempest-VolumeAndVolumeTypeFromImageTest-250915193 None] Lock "cinder-quobyte-1f0ddcf5-52f5-4271-8632-e182e73e2a3a" acquired by "delete_volume" :: waited 0.034s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:23:45 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[dafd1582-a74a-4412-a076-30f6e7dfca49]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:23:45 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c29b3d47-cd10-474f-9b8a-d2f84bbf403d tempest-VolumeAndVolumeTypeFromImageTest-250915193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-1f0ddcf5-52f5-4271-8632-e182e73e2a3a {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:23:45 devstack sudo[99398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-1f0ddcf5-52f5-4271-8632-e182e73e2a3a Nov 04 10:23:45 devstack sudo[99398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:23:46 devstack sudo[99398]: pam_unix(sudo:session): session closed for user root Nov 04 10:23:46 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c29b3d47-cd10-474f-9b8a-d2f84bbf403d tempest-VolumeAndVolumeTypeFromImageTest-250915193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-1f0ddcf5-52f5-4271-8632-e182e73e2a3a" returned: 0 in 0.459s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:23:46 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c29b3d47-cd10-474f-9b8a-d2f84bbf403d tempest-VolumeAndVolumeTypeFromImageTest-250915193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-1f0ddcf5-52f5-4271-8632-e182e73e2a3a {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:23:46 devstack sudo[99403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-1f0ddcf5-52f5-4271-8632-e182e73e2a3a Nov 04 10:23:46 devstack sudo[99403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:23:46 devstack sudo[99403]: pam_unix(sudo:session): session closed for user root Nov 04 10:23:46 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c29b3d47-cd10-474f-9b8a-d2f84bbf403d tempest-VolumeAndVolumeTypeFromImageTest-250915193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-1f0ddcf5-52f5-4271-8632-e182e73e2a3a" returned: 0 in 0.364s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:23:46 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-c29b3d47-cd10-474f-9b8a-d2f84bbf403d tempest-VolumeAndVolumeTypeFromImageTest-250915193 None] Lock "cinder-quobyte-1f0ddcf5-52f5-4271-8632-e182e73e2a3a" released by "delete_volume" :: held 0.882s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:23:46 devstack cinder-volume[87068]: WARNING cinder.quota [None req-c29b3d47-cd10-474f-9b8a-d2f84bbf403d tempest-VolumeAndVolumeTypeFromImageTest-250915193 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Nov 04 10:23:46 devstack cinder-volume[87068]: WARNING cinder.quota [None req-c29b3d47-cd10-474f-9b8a-d2f84bbf403d tempest-VolumeAndVolumeTypeFromImageTest-250915193 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Nov 04 10:23:46 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-c29b3d47-cd10-474f-9b8a-d2f84bbf403d tempest-VolumeAndVolumeTypeFromImageTest-250915193 None] Created reservations ['b0f65a50-891c-488b-b2b9-57d299344026', 'e2c38d78-8bec-4524-8b80-87ac2f76db3f', 'ba7b3121-b2b2-497f-bddc-e43d6607ff5d', 'd1c3e121-cf66-48e0-8747-0a204d509296'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:23:46 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-c29b3d47-cd10-474f-9b8a-d2f84bbf403d tempest-VolumeAndVolumeTypeFromImageTest-250915193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:23:46 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-c29b3d47-cd10-474f-9b8a-d2f84bbf403d tempest-VolumeAndVolumeTypeFromImageTest-250915193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:23:46 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-c29b3d47-cd10-474f-9b8a-d2f84bbf403d tempest-VolumeAndVolumeTypeFromImageTest-250915193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:23:46 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-c29b3d47-cd10-474f-9b8a-d2f84bbf403d tempest-VolumeAndVolumeTypeFromImageTest-250915193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:23:46 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-c29b3d47-cd10-474f-9b8a-d2f84bbf403d tempest-VolumeAndVolumeTypeFromImageTest-250915193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:23:46 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c29b3d47-cd10-474f-9b8a-d2f84bbf403d tempest-VolumeAndVolumeTypeFromImageTest-250915193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:23:46 devstack sudo[99413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:23:46 devstack sudo[99413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:23:47 devstack sudo[99413]: pam_unix(sudo:session): session closed for user root Nov 04 10:23:47 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c29b3d47-cd10-474f-9b8a-d2f84bbf403d tempest-VolumeAndVolumeTypeFromImageTest-250915193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.540s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:23:47 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-c29b3d47-cd10-474f-9b8a-d2f84bbf403d tempest-VolumeAndVolumeTypeFromImageTest-250915193 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:23:47 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-c29b3d47-cd10-474f-9b8a-d2f84bbf403d tempest-VolumeAndVolumeTypeFromImageTest-250915193 None] Deleted volume successfully. Nov 04 10:23:47 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-c29b3d47-cd10-474f-9b8a-d2f84bbf403d tempest-VolumeAndVolumeTypeFromImageTest-250915193 None] Lock "cinder-1f0ddcf5-52f5-4271-8632-e182e73e2a3a-delete_volume" released by "delete_volume" :: held 1.871s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:23:51 devstack cinder-volume[87068]: INFO cinder.volume.manager [req-ccadc961-6954-45c8-b3cd-12084d6841a0 req-e11597e3-300b-41b8-bd87-902b8070c1b2 tempest-TestInstancesWithCinderVolumes-304140490 None] Terminate volume connection completed successfully. Nov 04 10:23:51 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [req-ccadc961-6954-45c8-b3cd-12084d6841a0 req-e11597e3-300b-41b8-bd87-902b8070c1b2 tempest-TestInstancesWithCinderVolumes-304140490 None] Deleting attachment d54c8659-7d66-4989-9829-a13a4c080f23. {{(pid=87068) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 04 10:23:53 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-68b5267e-578a-4c81-9a53-f210ffa5a441 tempest-TestInstancesWithCinderVolumes-304140490 None] Acquiring lock "cinder-ff5b195e-bcd9-40cf-9c47-d04cbdfef089-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:23:53 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-68b5267e-578a-4c81-9a53-f210ffa5a441 tempest-TestInstancesWithCinderVolumes-304140490 None] Lock "cinder-ff5b195e-bcd9-40cf-9c47-d04cbdfef089-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:23:53 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-68b5267e-578a-4c81-9a53-f210ffa5a441 tempest-TestInstancesWithCinderVolumes-304140490 None] Acquiring lock "cinder-quobyte-ff5b195e-bcd9-40cf-9c47-d04cbdfef089" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:23:53 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-68b5267e-578a-4c81-9a53-f210ffa5a441 tempest-TestInstancesWithCinderVolumes-304140490 None] Lock "cinder-quobyte-ff5b195e-bcd9-40cf-9c47-d04cbdfef089" acquired by "delete_volume" :: waited 0.021s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:23:53 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[34af3e2c-1614-4ff2-b375-1c308c41e55c]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:23:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-68b5267e-578a-4c81-9a53-f210ffa5a441 tempest-TestInstancesWithCinderVolumes-304140490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-ff5b195e-bcd9-40cf-9c47-d04cbdfef089 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:23:53 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-bbeeaa56-c374-4e98-95ea-8bf31a7d9287 tempest-TestImageHashVerification-1997351595 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:23:53 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-bbeeaa56-c374-4e98-95ea-8bf31a7d9287 tempest-TestImageHashVerification-1997351595 None] Flow 'volume_create_manager' (442bf801-4224-492b-bfe1-4e1082f5b236) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:23:53 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-bbeeaa56-c374-4e98-95ea-8bf31a7d9287 tempest-TestImageHashVerification-1997351595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a76a8435-04c8-412a-a9f3-85abc9431afb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:23:53 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-bbeeaa56-c374-4e98-95ea-8bf31a7d9287 tempest-TestImageHashVerification-1997351595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a76a8435-04c8-412a-a9f3-85abc9431afb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:23:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1272558016',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4a19f54-e4c9-4e3f-9227-6c280b8f6cf7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8650661b4d3a4e0b98efc7ae72cb92d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:23:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:23:54Z,use_quota=True,user_id='43455256515e448896d31a8a8af97a43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:23:53 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-bbeeaa56-c374-4e98-95ea-8bf31a7d9287 tempest-TestImageHashVerification-1997351595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a79fc4fd-c119-4d59-8158-7bea333bf7dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:23:53 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-bbeeaa56-c374-4e98-95ea-8bf31a7d9287 tempest-TestImageHashVerification-1997351595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a79fc4fd-c119-4d59-8158-7bea333bf7dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:23:53 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-bbeeaa56-c374-4e98-95ea-8bf31a7d9287 tempest-TestImageHashVerification-1997351595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c36ecf85-6e00-4436-a44b-a4735f19a420) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:23:53 devstack sudo[99441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-ff5b195e-bcd9-40cf-9c47-d04cbdfef089 Nov 04 10:23:53 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-bbeeaa56-c374-4e98-95ea-8bf31a7d9287 tempest-TestImageHashVerification-1997351595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c36ecf85-6e00-4436-a44b-a4735f19a420) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b4a19f54-e4c9-4e3f-9227-6c280b8f6cf7', 'volume_name': 'volume-b4a19f54-e4c9-4e3f-9227-6c280b8f6cf7', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:23:53 devstack sudo[99441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:23:53 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-bbeeaa56-c374-4e98-95ea-8bf31a7d9287 tempest-TestImageHashVerification-1997351595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3826c775-e1cd-4db1-89b5-3695089c5206) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:23:53 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-bbeeaa56-c374-4e98-95ea-8bf31a7d9287 tempest-TestImageHashVerification-1997351595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3826c775-e1cd-4db1-89b5-3695089c5206) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:23:53 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-bbeeaa56-c374-4e98-95ea-8bf31a7d9287 tempest-TestImageHashVerification-1997351595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e21cc66-7a48-4c39-ac4e-f2c9a22f79f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:23:53 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-bbeeaa56-c374-4e98-95ea-8bf31a7d9287 tempest-TestImageHashVerification-1997351595 None] Volume b4a19f54-e4c9-4e3f-9227-6c280b8f6cf7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b4a19f54-e4c9-4e3f-9227-6c280b8f6cf7', 'volume_size': 1} Nov 04 10:23:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-bbeeaa56-c374-4e98-95ea-8bf31a7d9287 tempest-TestImageHashVerification-1997351595 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:23:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-bbeeaa56-c374-4e98-95ea-8bf31a7d9287 tempest-TestImageHashVerification-1997351595 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:23:53 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-bbeeaa56-c374-4e98-95ea-8bf31a7d9287 tempest-TestImageHashVerification-1997351595 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:23:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1272558016',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4a19f54-e4c9-4e3f-9227-6c280b8f6cf7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8650661b4d3a4e0b98efc7ae72cb92d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:23:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:23:54Z,use_quota=True,user_id='43455256515e448896d31a8a8af97a43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 10:23:53 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-bbeeaa56-c374-4e98-95ea-8bf31a7d9287 tempest-TestImageHashVerification-1997351595 None] Creating volume b4a19f54-e4c9-4e3f-9227-6c280b8f6cf7 {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:23:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-bbeeaa56-c374-4e98-95ea-8bf31a7d9287 tempest-TestImageHashVerification-1997351595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:23:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-bbeeaa56-c374-4e98-95ea-8bf31a7d9287 tempest-TestImageHashVerification-1997351595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:23:53 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-bbeeaa56-c374-4e98-95ea-8bf31a7d9287 tempest-TestImageHashVerification-1997351595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:23:53 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-bbeeaa56-c374-4e98-95ea-8bf31a7d9287 tempest-TestImageHashVerification-1997351595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:23:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-bbeeaa56-c374-4e98-95ea-8bf31a7d9287 tempest-TestImageHashVerification-1997351595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:23:53 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-bbeeaa56-c374-4e98-95ea-8bf31a7d9287 tempest-TestImageHashVerification-1997351595 None] Selected osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:23:53 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-bbeeaa56-c374-4e98-95ea-8bf31a7d9287 tempest-TestImageHashVerification-1997351595 None] casted to osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 Nov 04 10:23:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-bbeeaa56-c374-4e98-95ea-8bf31a7d9287 tempest-TestImageHashVerification-1997351595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b4a19f54-e4c9-4e3f-9227-6c280b8f6cf7 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:23:53 devstack cinder-volume[87068]: DEBUG oslo_service.periodic_task [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87068) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 10:23:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:23:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:23:53 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:23:53 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:23:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:23:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:23:53 devstack sudo[99443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b4a19f54-e4c9-4e3f-9227-6c280b8f6cf7 1073741824 Nov 04 10:23:53 devstack sudo[99443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:23:53 devstack sudo[99444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:23:53 devstack sudo[99444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:23:54 devstack sudo[99444]: pam_unix(sudo:session): session closed for user root Nov 04 10:23:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.292s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:23:54 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:23:54 devstack cinder-volume[87068]: DEBUG oslo_service.periodic_task [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Running periodic task VolumeManager._thread_info {{(pid=87068) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 10:23:54 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] thread count: 28 {{(pid=87068) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 04 10:23:54 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] thread info: [<_MainThread(MainThread, started 126275656192128)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87068) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 04 10:23:54 devstack sudo[99441]: pam_unix(sudo:session): session closed for user root Nov 04 10:23:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-68b5267e-578a-4c81-9a53-f210ffa5a441 tempest-TestInstancesWithCinderVolumes-304140490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-ff5b195e-bcd9-40cf-9c47-d04cbdfef089" returned: 0 in 0.578s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:23:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-68b5267e-578a-4c81-9a53-f210ffa5a441 tempest-TestInstancesWithCinderVolumes-304140490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-ff5b195e-bcd9-40cf-9c47-d04cbdfef089 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:23:54 devstack sudo[99454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-ff5b195e-bcd9-40cf-9c47-d04cbdfef089 Nov 04 10:23:54 devstack sudo[99454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:23:54 devstack sudo[99443]: pam_unix(sudo:session): session closed for user root Nov 04 10:23:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-bbeeaa56-c374-4e98-95ea-8bf31a7d9287 tempest-TestImageHashVerification-1997351595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b4a19f54-e4c9-4e3f-9227-6c280b8f6cf7 1073741824" returned: 0 in 0.639s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:23:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-bbeeaa56-c374-4e98-95ea-8bf31a7d9287 tempest-TestImageHashVerification-1997351595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b4a19f54-e4c9-4e3f-9227-6c280b8f6cf7 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:23:54 devstack sudo[99459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b4a19f54-e4c9-4e3f-9227-6c280b8f6cf7 Nov 04 10:23:54 devstack sudo[99459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:23:54 devstack sudo[99454]: pam_unix(sudo:session): session closed for user root Nov 04 10:23:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-68b5267e-578a-4c81-9a53-f210ffa5a441 tempest-TestInstancesWithCinderVolumes-304140490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-ff5b195e-bcd9-40cf-9c47-d04cbdfef089" returned: 0 in 0.311s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:23:54 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-68b5267e-578a-4c81-9a53-f210ffa5a441 tempest-TestInstancesWithCinderVolumes-304140490 None] Lock "cinder-quobyte-ff5b195e-bcd9-40cf-9c47-d04cbdfef089" released by "delete_volume" :: held 0.951s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:23:54 devstack cinder-volume[87068]: WARNING cinder.quota [None req-68b5267e-578a-4c81-9a53-f210ffa5a441 tempest-TestInstancesWithCinderVolumes-304140490 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1823908966-1503182850 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1823908966-1503182850, it is now deprecated. Please use the default quota class for default quota. Nov 04 10:23:54 devstack cinder-volume[87068]: WARNING cinder.quota [None req-68b5267e-578a-4c81-9a53-f210ffa5a441 tempest-TestInstancesWithCinderVolumes-304140490 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1823908966-1503182850 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1823908966-1503182850, it is now deprecated. Please use the default quota class for default quota. Nov 04 10:23:54 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-68b5267e-578a-4c81-9a53-f210ffa5a441 tempest-TestInstancesWithCinderVolumes-304140490 None] Created reservations ['347fa405-b65a-472a-b2ba-4c988c9dde58', 'ce18a11b-bd4d-4af4-887d-cbc063e2f11b', '4600006c-5b28-4d22-b451-98dad9d1e340', '4478cfbc-c3a2-4ac3-b12e-b4f0604e524e'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:23:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-68b5267e-578a-4c81-9a53-f210ffa5a441 tempest-TestInstancesWithCinderVolumes-304140490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:23:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-68b5267e-578a-4c81-9a53-f210ffa5a441 tempest-TestInstancesWithCinderVolumes-304140490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:23:54 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-68b5267e-578a-4c81-9a53-f210ffa5a441 tempest-TestInstancesWithCinderVolumes-304140490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:23:54 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-68b5267e-578a-4c81-9a53-f210ffa5a441 tempest-TestInstancesWithCinderVolumes-304140490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:23:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-68b5267e-578a-4c81-9a53-f210ffa5a441 tempest-TestInstancesWithCinderVolumes-304140490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:23:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-68b5267e-578a-4c81-9a53-f210ffa5a441 tempest-TestInstancesWithCinderVolumes-304140490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:23:54 devstack sudo[99461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:23:54 devstack sudo[99461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:23:54 devstack sudo[99459]: pam_unix(sudo:session): session closed for user root Nov 04 10:23:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-bbeeaa56-c374-4e98-95ea-8bf31a7d9287 tempest-TestImageHashVerification-1997351595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b4a19f54-e4c9-4e3f-9227-6c280b8f6cf7" returned: 0 in 0.374s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:23:54 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-bbeeaa56-c374-4e98-95ea-8bf31a7d9287 tempest-TestImageHashVerification-1997351595 None] <== create_volume: return (1067ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 10:23:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-bbeeaa56-c374-4e98-95ea-8bf31a7d9287 tempest-TestImageHashVerification-1997351595 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.069s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:23:54 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-bbeeaa56-c374-4e98-95ea-8bf31a7d9287 tempest-TestImageHashVerification-1997351595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e21cc66-7a48-4c39-ac4e-f2c9a22f79f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4a19f54-e4c9-4e3f-9227-6c280b8f6cf7', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:23:54 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-bbeeaa56-c374-4e98-95ea-8bf31a7d9287 tempest-TestImageHashVerification-1997351595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4661fba-53bb-4ce1-a259-804045bae7bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:23:54 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-bbeeaa56-c374-4e98-95ea-8bf31a7d9287 tempest-TestImageHashVerification-1997351595 None] Volume volume-b4a19f54-e4c9-4e3f-9227-6c280b8f6cf7 (b4a19f54-e4c9-4e3f-9227-6c280b8f6cf7): created successfully Nov 04 10:23:54 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-bbeeaa56-c374-4e98-95ea-8bf31a7d9287 tempest-TestImageHashVerification-1997351595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4661fba-53bb-4ce1-a259-804045bae7bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:23:54 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-bbeeaa56-c374-4e98-95ea-8bf31a7d9287 tempest-TestImageHashVerification-1997351595 None] Flow 'volume_create_manager' (442bf801-4224-492b-bfe1-4e1082f5b236) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:23:54 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-bbeeaa56-c374-4e98-95ea-8bf31a7d9287 tempest-TestImageHashVerification-1997351595 None] Created volume successfully. Nov 04 10:23:54 devstack sudo[99461]: pam_unix(sudo:session): session closed for user root Nov 04 10:23:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-68b5267e-578a-4c81-9a53-f210ffa5a441 tempest-TestInstancesWithCinderVolumes-304140490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.321s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:23:54 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-68b5267e-578a-4c81-9a53-f210ffa5a441 tempest-TestInstancesWithCinderVolumes-304140490 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:23:55 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-68b5267e-578a-4c81-9a53-f210ffa5a441 tempest-TestInstancesWithCinderVolumes-304140490 None] Deleted volume successfully. Nov 04 10:23:55 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-68b5267e-578a-4c81-9a53-f210ffa5a441 tempest-TestInstancesWithCinderVolumes-304140490 None] Lock "cinder-ff5b195e-bcd9-40cf-9c47-d04cbdfef089-delete_volume" released by "delete_volume" :: held 1.550s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:23:55 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb529008-9ddb-407b-a580-13425c17d492 tempest-VolumesImageMetadata-590657171 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:23:55 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-fb529008-9ddb-407b-a580-13425c17d492 tempest-VolumesImageMetadata-590657171 None] Flow 'volume_create_manager' (100ecd9d-fe19-4f9f-abac-831576bc2903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:23:55 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-fb529008-9ddb-407b-a580-13425c17d492 tempest-VolumesImageMetadata-590657171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (936f4cdb-d1b1-4107-9049-4fbd9e7f584f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:23:55 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-fb529008-9ddb-407b-a580-13425c17d492 tempest-VolumesImageMetadata-590657171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (936f4cdb-d1b1-4107-9049-4fbd9e7f584f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:23:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1037135823',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=118fa43c-a8f3-4c53-8153-e701ebc6eb7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='474eb1bd981a4bcaa0333cb338597308',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:23:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:23:55Z,use_quota=True,user_id='4e66abe1a91c49c6a3cdd7465a18f94d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:23:55 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-fb529008-9ddb-407b-a580-13425c17d492 tempest-VolumesImageMetadata-590657171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (277c2cc0-983c-44a6-957d-a44368d561e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:23:55 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-fb529008-9ddb-407b-a580-13425c17d492 tempest-VolumesImageMetadata-590657171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (277c2cc0-983c-44a6-957d-a44368d561e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:23:55 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-fb529008-9ddb-407b-a580-13425c17d492 tempest-VolumesImageMetadata-590657171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83e3296e-61ac-4e1a-9e00-a8064a9ee2d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:23:55 devstack cinder-volume[87068]: DEBUG cinder.image.glance [None req-fb529008-9ddb-407b-a580-13425c17d492 tempest-VolumesImageMetadata-590657171 None] Creating Keystone auth plugin from conf {{(pid=87068) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 04 10:23:55 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-fb529008-9ddb-407b-a580-13425c17d492 tempest-VolumesImageMetadata-590657171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83e3296e-61ac-4e1a-9e00-a8064a9ee2d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '118fa43c-a8f3-4c53-8153-e701ebc6eb7c', 'volume_name': 'volume-118fa43c-a8f3-4c53-8153-e701ebc6eb7c', 'volume_size': 1, 'image_id': 'c589a328-f3ed-418a-8877-e90bfc4cf133', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c589a328-f3ed-418a-8877-e90bfc4cf133', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '046e78417f874f20873c25a0eb7adc65', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c589a328-f3ed-418a-8877-e90bfc4cf133', 'created_at': datetime.datetime(2026, 11, 4, 9, 4, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 9, 5, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c589a328-f3ed-418a-8877-e90bfc4cf133/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:23:55 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-fb529008-9ddb-407b-a580-13425c17d492 tempest-VolumesImageMetadata-590657171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abe17cc6-3afd-486a-b83e-2b63ee8fa641) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:23:55 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-fb529008-9ddb-407b-a580-13425c17d492 tempest-VolumesImageMetadata-590657171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abe17cc6-3afd-486a-b83e-2b63ee8fa641) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:23:55 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-fb529008-9ddb-407b-a580-13425c17d492 tempest-VolumesImageMetadata-590657171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1473b2a6-ec94-4eb9-a1d3-93fd891b6b1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:23:55 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-fb529008-9ddb-407b-a580-13425c17d492 tempest-VolumesImageMetadata-590657171 None] Volume 118fa43c-a8f3-4c53-8153-e701ebc6eb7c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-118fa43c-a8f3-4c53-8153-e701ebc6eb7c', 'volume_size': 1, 'image_id': 'c589a328-f3ed-418a-8877-e90bfc4cf133', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c589a328-f3ed-418a-8877-e90bfc4cf133', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '046e78417f874f20873c25a0eb7adc65', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c589a328-f3ed-418a-8877-e90bfc4cf133', 'created_at': datetime.datetime(2026, 11, 4, 9, 4, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 9, 5, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c589a328-f3ed-418a-8877-e90bfc4cf133/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 04 10:23:55 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb529008-9ddb-407b-a580-13425c17d492 tempest-VolumesImageMetadata-590657171 None] Trying to clone 118fa43c-a8f3-4c53-8153-e701ebc6eb7c from image c589a328-f3ed-418a-8877-e90bfc4cf133 at location (None, [{'url': 'file:///opt/stack/data/glance/images/c589a328-f3ed-418a-8877-e90bfc4cf133', 'metadata': {}}]). {{(pid=87068) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 04 10:23:55 devstack cinder-volume[87068]: DEBUG cinder.image.image_utils [None req-fb529008-9ddb-407b-a580-13425c17d492 tempest-VolumesImageMetadata-590657171 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c589a328-f3ed-418a-8877-e90bfc4cf133_7h2ndwx1devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87068) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 04 10:23:55 devstack cinder-volume[87068]: INFO cinder.image.image_utils [None req-fb529008-9ddb-407b-a580-13425c17d492 tempest-VolumesImageMetadata-590657171 None] Image download 20.69 MB at 20.69 MB/s Nov 04 10:23:56 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec243f26-2a21-40dd-b824-1a9a4bd59fc5]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:23:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-fb529008-9ddb-407b-a580-13425c17d492 tempest-VolumesImageMetadata-590657171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c589a328-f3ed-418a-8877-e90bfc4cf133_7h2ndwx1devstack@QuobyteHD {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:23:56 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-0607b30d-35a5-4b9e-8227-5592f25a0a36 tempest-CinderUnicodeTest-836021135 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:23:56 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-0607b30d-35a5-4b9e-8227-5592f25a0a36 tempest-CinderUnicodeTest-836021135 None] Flow 'volume_create_manager' (7ed43c6b-5b03-4a87-9bc7-e19cc85729ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:23:56 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-0607b30d-35a5-4b9e-8227-5592f25a0a36 tempest-CinderUnicodeTest-836021135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32789f83-39a8-46e4-8c3c-77c49bac623c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:23:56 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-0607b30d-35a5-4b9e-8227-5592f25a0a36 tempest-CinderUnicodeTest-836021135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32789f83-39a8-46e4-8c3c-77c49bac623c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:23:56Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b968946a-1341-4aee-b752-98cc352ff891,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3017f2d2c96947209a579c32f62ed273',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:23:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:23:56Z,use_quota=True,user_id='b190182c4a5f46fc971af153c71d8001',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:23:56 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-0607b30d-35a5-4b9e-8227-5592f25a0a36 tempest-CinderUnicodeTest-836021135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54fad8bd-a064-4141-b7ae-a67ea3d813cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:23:56 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-0607b30d-35a5-4b9e-8227-5592f25a0a36 tempest-CinderUnicodeTest-836021135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54fad8bd-a064-4141-b7ae-a67ea3d813cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:23:56 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-0607b30d-35a5-4b9e-8227-5592f25a0a36 tempest-CinderUnicodeTest-836021135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cb237fd-7d89-4852-84f3-21723df4dae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:23:56 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-0607b30d-35a5-4b9e-8227-5592f25a0a36 tempest-CinderUnicodeTest-836021135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cb237fd-7d89-4852-84f3-21723df4dae9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b968946a-1341-4aee-b752-98cc352ff891', 'volume_name': 'volume-b968946a-1341-4aee-b752-98cc352ff891', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:23:56 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-0607b30d-35a5-4b9e-8227-5592f25a0a36 tempest-CinderUnicodeTest-836021135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e0a7886-f5f7-48f5-a72f-f9e3fb32ecdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:23:56 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-0607b30d-35a5-4b9e-8227-5592f25a0a36 tempest-CinderUnicodeTest-836021135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e0a7886-f5f7-48f5-a72f-f9e3fb32ecdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:23:56 devstack sudo[99467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c589a328-f3ed-418a-8877-e90bfc4cf133_7h2ndwx1devstack@QuobyteHD Nov 04 10:23:56 devstack sudo[99467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:23:56 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-0607b30d-35a5-4b9e-8227-5592f25a0a36 tempest-CinderUnicodeTest-836021135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a7f319c-fd13-4863-b3f4-bfae2c1394a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:23:56 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-0607b30d-35a5-4b9e-8227-5592f25a0a36 tempest-CinderUnicodeTest-836021135 None] Volume b968946a-1341-4aee-b752-98cc352ff891: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b968946a-1341-4aee-b752-98cc352ff891', 'volume_size': 1} Nov 04 10:23:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-0607b30d-35a5-4b9e-8227-5592f25a0a36 tempest-CinderUnicodeTest-836021135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:23:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-0607b30d-35a5-4b9e-8227-5592f25a0a36 tempest-CinderUnicodeTest-836021135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:23:56 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-0607b30d-35a5-4b9e-8227-5592f25a0a36 tempest-CinderUnicodeTest-836021135 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:23:56Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b968946a-1341-4aee-b752-98cc352ff891,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3017f2d2c96947209a579c32f62ed273',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:23:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:23:56Z,use_quota=True,user_id='b190182c4a5f46fc971af153c71d8001',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 10:23:56 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-0607b30d-35a5-4b9e-8227-5592f25a0a36 tempest-CinderUnicodeTest-836021135 None] Creating volume b968946a-1341-4aee-b752-98cc352ff891 {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:23:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-0607b30d-35a5-4b9e-8227-5592f25a0a36 tempest-CinderUnicodeTest-836021135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:23:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-0607b30d-35a5-4b9e-8227-5592f25a0a36 tempest-CinderUnicodeTest-836021135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:23:56 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-0607b30d-35a5-4b9e-8227-5592f25a0a36 tempest-CinderUnicodeTest-836021135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:23:56 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-0607b30d-35a5-4b9e-8227-5592f25a0a36 tempest-CinderUnicodeTest-836021135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:23:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-0607b30d-35a5-4b9e-8227-5592f25a0a36 tempest-CinderUnicodeTest-836021135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:23:56 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-0607b30d-35a5-4b9e-8227-5592f25a0a36 tempest-CinderUnicodeTest-836021135 None] Selected osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:23:56 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-0607b30d-35a5-4b9e-8227-5592f25a0a36 tempest-CinderUnicodeTest-836021135 None] casted to osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 Nov 04 10:23:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-0607b30d-35a5-4b9e-8227-5592f25a0a36 tempest-CinderUnicodeTest-836021135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b968946a-1341-4aee-b752-98cc352ff891 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:23:56 devstack sudo[99469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b968946a-1341-4aee-b752-98cc352ff891 1073741824 Nov 04 10:23:56 devstack sudo[99469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:23:56 devstack sudo[99467]: pam_unix(sudo:session): session closed for user root Nov 04 10:23:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-fb529008-9ddb-407b-a580-13425c17d492 tempest-VolumesImageMetadata-590657171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c589a328-f3ed-418a-8877-e90bfc4cf133_7h2ndwx1devstack@QuobyteHD" returned: 0 in 0.416s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:23:56 devstack cinder-volume[87068]: DEBUG cinder.image.image_utils [None req-fb529008-9ddb-407b-a580-13425c17d492 tempest-VolumesImageMetadata-590657171 None] Temporary image c589a328-f3ed-418a-8877-e90bfc4cf133 is fetched for user 4e66abe1a91c49c6a3cdd7465a18f94d. {{(pid=87068) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 04 10:23:56 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cd10aad-1489-4e41-9e91-220bb8c98e84]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:23:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-fb529008-9ddb-407b-a580-13425c17d492 tempest-VolumesImageMetadata-590657171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c589a328-f3ed-418a-8877-e90bfc4cf133_7h2ndwx1devstack@QuobyteHD {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:23:56 devstack sudo[99477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c589a328-f3ed-418a-8877-e90bfc4cf133_7h2ndwx1devstack@QuobyteHD Nov 04 10:23:56 devstack sudo[99477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:23:56 devstack sudo[99469]: pam_unix(sudo:session): session closed for user root Nov 04 10:23:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-0607b30d-35a5-4b9e-8227-5592f25a0a36 tempest-CinderUnicodeTest-836021135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b968946a-1341-4aee-b752-98cc352ff891 1073741824" returned: 0 in 0.570s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:23:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-0607b30d-35a5-4b9e-8227-5592f25a0a36 tempest-CinderUnicodeTest-836021135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b968946a-1341-4aee-b752-98cc352ff891 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:23:56 devstack sudo[99480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b968946a-1341-4aee-b752-98cc352ff891 Nov 04 10:23:56 devstack sudo[99480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:23:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-bf4c4520-9c4f-4d9d-bdf4-39b3b011e5d7 tempest-TestImageHashVerification-1997351595 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:23:57 devstack sudo[99477]: pam_unix(sudo:session): session closed for user root Nov 04 10:23:57 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-fb529008-9ddb-407b-a580-13425c17d492 tempest-VolumesImageMetadata-590657171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c589a328-f3ed-418a-8877-e90bfc4cf133_7h2ndwx1devstack@QuobyteHD" returned: 0 in 0.453s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:23:57 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-fb529008-9ddb-407b-a580-13425c17d492 tempest-VolumesImageMetadata-590657171 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:23:57 devstack sudo[99480]: pam_unix(sudo:session): session closed for user root Nov 04 10:23:57 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-0607b30d-35a5-4b9e-8227-5592f25a0a36 tempest-CinderUnicodeTest-836021135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b968946a-1341-4aee-b752-98cc352ff891" returned: 0 in 0.330s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:23:57 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-0607b30d-35a5-4b9e-8227-5592f25a0a36 tempest-CinderUnicodeTest-836021135 None] <== create_volume: return (961ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 10:23:57 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-0607b30d-35a5-4b9e-8227-5592f25a0a36 tempest-CinderUnicodeTest-836021135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.965s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:23:57 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-bf4c4520-9c4f-4d9d-bdf4-39b3b011e5d7 tempest-TestImageHashVerification-1997351595 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.194s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:23:57 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-0607b30d-35a5-4b9e-8227-5592f25a0a36 tempest-CinderUnicodeTest-836021135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a7f319c-fd13-4863-b3f4-bfae2c1394a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b968946a-1341-4aee-b752-98cc352ff891', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:23:57 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-0607b30d-35a5-4b9e-8227-5592f25a0a36 tempest-CinderUnicodeTest-836021135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecb76d80-786f-409d-982e-a506d069fd95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:23:57 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a6c2a52-6da2-4ad1-a629-f233fccde36e]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:23:57 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-bf4c4520-9c4f-4d9d-bdf4-39b3b011e5d7 tempest-TestImageHashVerification-1997351595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b4a19f54-e4c9-4e3f-9227-6c280b8f6cf7 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:23:57 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-0607b30d-35a5-4b9e-8227-5592f25a0a36 tempest-CinderUnicodeTest-836021135 None] Volume volume-b968946a-1341-4aee-b752-98cc352ff891 (b968946a-1341-4aee-b752-98cc352ff891): created successfully Nov 04 10:23:57 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-0607b30d-35a5-4b9e-8227-5592f25a0a36 tempest-CinderUnicodeTest-836021135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecb76d80-786f-409d-982e-a506d069fd95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:23:57 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-0607b30d-35a5-4b9e-8227-5592f25a0a36 tempest-CinderUnicodeTest-836021135 None] Flow 'volume_create_manager' (7ed43c6b-5b03-4a87-9bc7-e19cc85729ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:23:57 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-0607b30d-35a5-4b9e-8227-5592f25a0a36 tempest-CinderUnicodeTest-836021135 None] Created volume successfully. Nov 04 10:23:57 devstack sudo[99486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b4a19f54-e4c9-4e3f-9227-6c280b8f6cf7 Nov 04 10:23:57 devstack sudo[99486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:23:57 devstack sudo[99486]: pam_unix(sudo:session): session closed for user root Nov 04 10:23:57 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-bf4c4520-9c4f-4d9d-bdf4-39b3b011e5d7 tempest-TestImageHashVerification-1997351595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b4a19f54-e4c9-4e3f-9227-6c280b8f6cf7" returned: 0 in 0.409s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:23:57 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cec3e72-e7f7-453d-a2c5-8f4ed217c301]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:23:57 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-bf4c4520-9c4f-4d9d-bdf4-39b3b011e5d7 tempest-TestImageHashVerification-1997351595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b4a19f54-e4c9-4e3f-9227-6c280b8f6cf7 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:23:57 devstack sudo[99492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b4a19f54-e4c9-4e3f-9227-6c280b8f6cf7 Nov 04 10:23:57 devstack sudo[99492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:23:58 devstack sudo[99492]: pam_unix(sudo:session): session closed for user root Nov 04 10:23:58 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-bf4c4520-9c4f-4d9d-bdf4-39b3b011e5d7 tempest-TestImageHashVerification-1997351595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b4a19f54-e4c9-4e3f-9227-6c280b8f6cf7" returned: 0 in 0.384s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:23:58 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-bf4c4520-9c4f-4d9d-bdf4-39b3b011e5d7 tempest-TestImageHashVerification-1997351595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b4a19f54-e4c9-4e3f-9227-6c280b8f6cf7 /opt/stack/data/cinder/conversion/b4a19f54-e4c9-4e3f-9227-6c280b8f6cf7.temp_image.630b6549-f38f-4838-8cbb-183388a43eab6cboe8gv.img {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:23:58 devstack sudo[99497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b4a19f54-e4c9-4e3f-9227-6c280b8f6cf7 /opt/stack/data/cinder/conversion/b4a19f54-e4c9-4e3f-9227-6c280b8f6cf7.temp_image.630b6549-f38f-4838-8cbb-183388a43eab6cboe8gv.img Nov 04 10:23:58 devstack sudo[99497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:23:59 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-1586fe2c-ebe4-41aa-b069-6092599e5e3b tempest-CinderUnicodeTest-836021135 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:23:59 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1586fe2c-ebe4-41aa-b069-6092599e5e3b tempest-CinderUnicodeTest-836021135 None] Flow 'volume_create_manager' (f2e3623e-0b68-474f-ac07-d1579fad4d58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:23:59 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1586fe2c-ebe4-41aa-b069-6092599e5e3b tempest-CinderUnicodeTest-836021135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1408fccc-1b9a-4f6b-a2e1-b9ccdb9661e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:23:59 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1586fe2c-ebe4-41aa-b069-6092599e5e3b tempest-CinderUnicodeTest-836021135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1408fccc-1b9a-4f6b-a2e1-b9ccdb9661e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:23:58Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-493619752',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=856eb0d4-07ac-4902-903a-4a9d16dda0d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3017f2d2c96947209a579c32f62ed273',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:23:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:23:59Z,use_quota=True,user_id='b190182c4a5f46fc971af153c71d8001',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:23:59 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1586fe2c-ebe4-41aa-b069-6092599e5e3b tempest-CinderUnicodeTest-836021135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1638d34e-37dc-417d-9a40-c217b355a8ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:23:59 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1586fe2c-ebe4-41aa-b069-6092599e5e3b tempest-CinderUnicodeTest-836021135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1638d34e-37dc-417d-9a40-c217b355a8ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:23:59 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1586fe2c-ebe4-41aa-b069-6092599e5e3b tempest-CinderUnicodeTest-836021135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (042d53fd-49c7-460d-8172-28d7f5109628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:23:59 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1586fe2c-ebe4-41aa-b069-6092599e5e3b tempest-CinderUnicodeTest-836021135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (042d53fd-49c7-460d-8172-28d7f5109628) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '856eb0d4-07ac-4902-903a-4a9d16dda0d4', 'volume_name': 'volume-856eb0d4-07ac-4902-903a-4a9d16dda0d4', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:23:59 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1586fe2c-ebe4-41aa-b069-6092599e5e3b tempest-CinderUnicodeTest-836021135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45666112-7bd8-45d4-a3cb-89f00144c7b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:23:59 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1586fe2c-ebe4-41aa-b069-6092599e5e3b tempest-CinderUnicodeTest-836021135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45666112-7bd8-45d4-a3cb-89f00144c7b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:23:59 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1586fe2c-ebe4-41aa-b069-6092599e5e3b tempest-CinderUnicodeTest-836021135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fff42a3-db92-4848-a0ba-3fe44decf629) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:23:59 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-1586fe2c-ebe4-41aa-b069-6092599e5e3b tempest-CinderUnicodeTest-836021135 None] Volume 856eb0d4-07ac-4902-903a-4a9d16dda0d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-856eb0d4-07ac-4902-903a-4a9d16dda0d4', 'volume_size': 1} Nov 04 10:23:59 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-1586fe2c-ebe4-41aa-b069-6092599e5e3b tempest-CinderUnicodeTest-836021135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:24:05 devstack sudo[99497]: pam_unix(sudo:session): session closed for user root Nov 04 10:24:05 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-bf4c4520-9c4f-4d9d-bdf4-39b3b011e5d7 tempest-TestImageHashVerification-1997351595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b4a19f54-e4c9-4e3f-9227-6c280b8f6cf7 /opt/stack/data/cinder/conversion/b4a19f54-e4c9-4e3f-9227-6c280b8f6cf7.temp_image.630b6549-f38f-4838-8cbb-183388a43eab6cboe8gv.img" returned: 0 in 7.378s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:24:05 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6aa6956-d932-491f-a408-9c16b1130d80]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:24:05 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-bf4c4520-9c4f-4d9d-bdf4-39b3b011e5d7 tempest-TestImageHashVerification-1997351595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b4a19f54-e4c9-4e3f-9227-6c280b8f6cf7 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:24:05 devstack sudo[99514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b4a19f54-e4c9-4e3f-9227-6c280b8f6cf7 Nov 04 10:24:05 devstack sudo[99514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:24:05 devstack sudo[99514]: pam_unix(sudo:session): session closed for user root Nov 04 10:24:05 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-bf4c4520-9c4f-4d9d-bdf4-39b3b011e5d7 tempest-TestImageHashVerification-1997351595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b4a19f54-e4c9-4e3f-9227-6c280b8f6cf7" returned: 0 in 0.556s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:24:05 devstack cinder-volume[87068]: DEBUG cinder.image.image_utils [None req-bf4c4520-9c4f-4d9d-bdf4-39b3b011e5d7 tempest-TestImageHashVerification-1997351595 None] Image conversion details: src /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b4a19f54-e4c9-4e3f-9227-6c280b8f6cf7, size 1024.00 MB, duration 7.38 sec, destination /opt/stack/data/cinder/conversion/b4a19f54-e4c9-4e3f-9227-6c280b8f6cf7.temp_image.630b6549-f38f-4838-8cbb-183388a43eab6cboe8gv.img {{(pid=87068) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 04 10:24:05 devstack cinder-volume[87068]: INFO cinder.image.image_utils [None req-bf4c4520-9c4f-4d9d-bdf4-39b3b011e5d7 tempest-TestImageHashVerification-1997351595 None] Converted 1024.00 MB image at 138.77 MB/s Nov 04 10:24:06 devstack cinder-volume[87068]: DEBUG cinder.image.image_utils [None req-bf4c4520-9c4f-4d9d-bdf4-39b3b011e5d7 tempest-TestImageHashVerification-1997351595 None] 630b6549-f38f-4838-8cbb-183388a43eab was raw, no need to convert to raw {{(pid=87068) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Nov 04 10:24:16 devstack cinder-volume[87068]: DEBUG dbcounter [-] [87068] Writing DB stats cinder:SELECT=59,cinder:UPDATE=56,cinder:INSERT=22,cinder:DELETE=4 {{(pid=87068) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 10:24:16 devstack cinder-volume[87068]: DEBUG dbcounter [-] [87068] Writing DB stats cinder:SELECT=74,cinder:UPDATE=67,cinder:INSERT=17,cinder:DELETE=5 {{(pid=87068) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 10:24:27 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-bf4c4520-9c4f-4d9d-bdf4-39b3b011e5d7 tempest-TestImageHashVerification-1997351595 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 29.903s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:24:27 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-bf4c4520-9c4f-4d9d-bdf4-39b3b011e5d7 tempest-TestImageHashVerification-1997351595 None] Uploaded volume to glance image-id: 630b6549-f38f-4838-8cbb-183388a43eab. {{(pid=87068) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Nov 04 10:24:27 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-fb529008-9ddb-407b-a580-13425c17d492 tempest-VolumesImageMetadata-590657171 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 30.024s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:24:27 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-fb529008-9ddb-407b-a580-13425c17d492 tempest-VolumesImageMetadata-590657171 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:23:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1037135823',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=118fa43c-a8f3-4c53-8153-e701ebc6eb7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='474eb1bd981a4bcaa0333cb338597308',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:23:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:23:55Z,use_quota=True,user_id='4e66abe1a91c49c6a3cdd7465a18f94d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 10:24:27 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-fb529008-9ddb-407b-a580-13425c17d492 tempest-VolumesImageMetadata-590657171 None] Creating volume 118fa43c-a8f3-4c53-8153-e701ebc6eb7c {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:24:27 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-fb529008-9ddb-407b-a580-13425c17d492 tempest-VolumesImageMetadata-590657171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:24:27 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-fb529008-9ddb-407b-a580-13425c17d492 tempest-VolumesImageMetadata-590657171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:24:27 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-fb529008-9ddb-407b-a580-13425c17d492 tempest-VolumesImageMetadata-590657171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:24:27 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-fb529008-9ddb-407b-a580-13425c17d492 tempest-VolumesImageMetadata-590657171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:24:27 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-fb529008-9ddb-407b-a580-13425c17d492 tempest-VolumesImageMetadata-590657171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:24:27 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-fb529008-9ddb-407b-a580-13425c17d492 tempest-VolumesImageMetadata-590657171 None] Selected osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:24:27 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-fb529008-9ddb-407b-a580-13425c17d492 tempest-VolumesImageMetadata-590657171 None] casted to osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 Nov 04 10:24:27 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-fb529008-9ddb-407b-a580-13425c17d492 tempest-VolumesImageMetadata-590657171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-118fa43c-a8f3-4c53-8153-e701ebc6eb7c 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:24:27 devstack sudo[99524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-118fa43c-a8f3-4c53-8153-e701ebc6eb7c 1073741824 Nov 04 10:24:27 devstack sudo[99524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:24:27 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-bf4c4520-9c4f-4d9d-bdf4-39b3b011e5d7 tempest-TestImageHashVerification-1997351595 None] Copy volume to image completed successfully. Nov 04 10:24:27 devstack sudo[99524]: pam_unix(sudo:session): session closed for user root Nov 04 10:24:27 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-fb529008-9ddb-407b-a580-13425c17d492 tempest-VolumesImageMetadata-590657171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-118fa43c-a8f3-4c53-8153-e701ebc6eb7c 1073741824" returned: 0 in 0.566s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:24:27 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-fb529008-9ddb-407b-a580-13425c17d492 tempest-VolumesImageMetadata-590657171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-118fa43c-a8f3-4c53-8153-e701ebc6eb7c {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:24:27 devstack sudo[99529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-118fa43c-a8f3-4c53-8153-e701ebc6eb7c Nov 04 10:24:27 devstack sudo[99529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:24:27 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-5a5e1da9-b14f-4dba-bf06-11bbae1b8d2c tempest-TestImageHashVerification-1997351595 None] Acquiring lock "cinder-b4a19f54-e4c9-4e3f-9227-6c280b8f6cf7-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:24:27 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-5a5e1da9-b14f-4dba-bf06-11bbae1b8d2c tempest-TestImageHashVerification-1997351595 None] Lock "cinder-b4a19f54-e4c9-4e3f-9227-6c280b8f6cf7-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:24:28 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-5a5e1da9-b14f-4dba-bf06-11bbae1b8d2c tempest-TestImageHashVerification-1997351595 None] Acquiring lock "cinder-quobyte-b4a19f54-e4c9-4e3f-9227-6c280b8f6cf7" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:24:28 devstack sudo[99529]: pam_unix(sudo:session): session closed for user root Nov 04 10:24:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-fb529008-9ddb-407b-a580-13425c17d492 tempest-VolumesImageMetadata-590657171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-118fa43c-a8f3-4c53-8153-e701ebc6eb7c" returned: 0 in 0.347s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:24:28 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-fb529008-9ddb-407b-a580-13425c17d492 tempest-VolumesImageMetadata-590657171 None] <== create_volume: return (956ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 10:24:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-fb529008-9ddb-407b-a580-13425c17d492 tempest-VolumesImageMetadata-590657171 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.959s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:24:28 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-5a5e1da9-b14f-4dba-bf06-11bbae1b8d2c tempest-TestImageHashVerification-1997351595 None] Lock "cinder-quobyte-b4a19f54-e4c9-4e3f-9227-6c280b8f6cf7" acquired by "delete_volume" :: waited 0.024s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:24:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-1586fe2c-ebe4-41aa-b069-6092599e5e3b tempest-CinderUnicodeTest-836021135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 28.920s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:24:28 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-1586fe2c-ebe4-41aa-b069-6092599e5e3b tempest-CinderUnicodeTest-836021135 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:23:58Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-493619752',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=856eb0d4-07ac-4902-903a-4a9d16dda0d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3017f2d2c96947209a579c32f62ed273',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:23:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:23:59Z,use_quota=True,user_id='b190182c4a5f46fc971af153c71d8001',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 10:24:28 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-1586fe2c-ebe4-41aa-b069-6092599e5e3b tempest-CinderUnicodeTest-836021135 None] Creating volume 856eb0d4-07ac-4902-903a-4a9d16dda0d4 {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:24:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-1586fe2c-ebe4-41aa-b069-6092599e5e3b tempest-CinderUnicodeTest-836021135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:24:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-1586fe2c-ebe4-41aa-b069-6092599e5e3b tempest-CinderUnicodeTest-836021135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:24:28 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-1586fe2c-ebe4-41aa-b069-6092599e5e3b tempest-CinderUnicodeTest-836021135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:24:28 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-1586fe2c-ebe4-41aa-b069-6092599e5e3b tempest-CinderUnicodeTest-836021135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:24:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-1586fe2c-ebe4-41aa-b069-6092599e5e3b tempest-CinderUnicodeTest-836021135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:24:28 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-1586fe2c-ebe4-41aa-b069-6092599e5e3b tempest-CinderUnicodeTest-836021135 None] Selected osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:24:28 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-1586fe2c-ebe4-41aa-b069-6092599e5e3b tempest-CinderUnicodeTest-836021135 None] casted to osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 Nov 04 10:24:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-1586fe2c-ebe4-41aa-b069-6092599e5e3b tempest-CinderUnicodeTest-836021135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-856eb0d4-07ac-4902-903a-4a9d16dda0d4 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:24:28 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[cae89d91-31e9-4edc-aa1f-c38479a881e2]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:24:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-5a5e1da9-b14f-4dba-bf06-11bbae1b8d2c tempest-TestImageHashVerification-1997351595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b4a19f54-e4c9-4e3f-9227-6c280b8f6cf7 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:24:28 devstack sudo[99532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-856eb0d4-07ac-4902-903a-4a9d16dda0d4 1073741824 Nov 04 10:24:28 devstack sudo[99532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:24:28 devstack cinder-volume[87068]: DEBUG cinder.volume.volume_utils [None req-fb529008-9ddb-407b-a580-13425c17d492 tempest-VolumesImageMetadata-590657171 None] Attempting download of c589a328-f3ed-418a-8877-e90bfc4cf133 ((None, [{'url': 'file:///opt/stack/data/glance/images/c589a328-f3ed-418a-8877-e90bfc4cf133', 'metadata': {}}])) to volume 118fa43c-a8f3-4c53-8153-e701ebc6eb7c. {{(pid=87068) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 04 10:24:28 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[2318b6d3-1df1-4b37-8282-232b1e152323]: (4, 'raw') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:24:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-fb529008-9ddb-407b-a580-13425c17d492 tempest-VolumesImageMetadata-590657171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c589a328-f3ed-418a-8877-e90bfc4cf133_17d96tpb {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:24:28 devstack sudo[99533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b4a19f54-e4c9-4e3f-9227-6c280b8f6cf7 Nov 04 10:24:28 devstack sudo[99533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:24:28 devstack sudo[99536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c589a328-f3ed-418a-8877-e90bfc4cf133_17d96tpb Nov 04 10:24:28 devstack sudo[99536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:24:28 devstack sudo[99533]: pam_unix(sudo:session): session closed for user root Nov 04 10:24:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-5a5e1da9-b14f-4dba-bf06-11bbae1b8d2c tempest-TestImageHashVerification-1997351595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b4a19f54-e4c9-4e3f-9227-6c280b8f6cf7" returned: 0 in 0.450s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:24:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-5a5e1da9-b14f-4dba-bf06-11bbae1b8d2c tempest-TestImageHashVerification-1997351595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b4a19f54-e4c9-4e3f-9227-6c280b8f6cf7 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:24:28 devstack sudo[99532]: pam_unix(sudo:session): session closed for user root Nov 04 10:24:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-1586fe2c-ebe4-41aa-b069-6092599e5e3b tempest-CinderUnicodeTest-836021135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-856eb0d4-07ac-4902-903a-4a9d16dda0d4 1073741824" returned: 0 in 0.489s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:24:28 devstack sudo[99547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b4a19f54-e4c9-4e3f-9227-6c280b8f6cf7 Nov 04 10:24:28 devstack sudo[99547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:24:28 devstack sudo[99536]: pam_unix(sudo:session): session closed for user root Nov 04 10:24:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-fb529008-9ddb-407b-a580-13425c17d492 tempest-VolumesImageMetadata-590657171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c589a328-f3ed-418a-8877-e90bfc4cf133_17d96tpb" returned: 0 in 0.384s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:24:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-fb529008-9ddb-407b-a580-13425c17d492 tempest-VolumesImageMetadata-590657171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c589a328-f3ed-418a-8877-e90bfc4cf133_17d96tpb {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:24:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-1586fe2c-ebe4-41aa-b069-6092599e5e3b tempest-CinderUnicodeTest-836021135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-856eb0d4-07ac-4902-903a-4a9d16dda0d4 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:24:28 devstack sudo[99550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-856eb0d4-07ac-4902-903a-4a9d16dda0d4 Nov 04 10:24:28 devstack sudo[99550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:24:28 devstack sudo[99549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c589a328-f3ed-418a-8877-e90bfc4cf133_17d96tpb Nov 04 10:24:28 devstack sudo[99549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:24:28 devstack sudo[99547]: pam_unix(sudo:session): session closed for user root Nov 04 10:24:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-5a5e1da9-b14f-4dba-bf06-11bbae1b8d2c tempest-TestImageHashVerification-1997351595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b4a19f54-e4c9-4e3f-9227-6c280b8f6cf7" returned: 0 in 0.335s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:24:28 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-5a5e1da9-b14f-4dba-bf06-11bbae1b8d2c tempest-TestImageHashVerification-1997351595 None] Lock "cinder-quobyte-b4a19f54-e4c9-4e3f-9227-6c280b8f6cf7" released by "delete_volume" :: held 0.861s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:24:28 devstack sudo[99550]: pam_unix(sudo:session): session closed for user root Nov 04 10:24:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-1586fe2c-ebe4-41aa-b069-6092599e5e3b tempest-CinderUnicodeTest-836021135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-856eb0d4-07ac-4902-903a-4a9d16dda0d4" returned: 0 in 0.302s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:24:28 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-1586fe2c-ebe4-41aa-b069-6092599e5e3b tempest-CinderUnicodeTest-836021135 None] <== create_volume: return (879ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 10:24:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-1586fe2c-ebe4-41aa-b069-6092599e5e3b tempest-CinderUnicodeTest-836021135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.883s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:24:28 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1586fe2c-ebe4-41aa-b069-6092599e5e3b tempest-CinderUnicodeTest-836021135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fff42a3-db92-4848-a0ba-3fe44decf629) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-856eb0d4-07ac-4902-903a-4a9d16dda0d4', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:24:28 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1586fe2c-ebe4-41aa-b069-6092599e5e3b tempest-CinderUnicodeTest-836021135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8138f91-bdba-42f9-b780-b1f1c49cf87d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:24:29 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-1586fe2c-ebe4-41aa-b069-6092599e5e3b tempest-CinderUnicodeTest-836021135 None] Volume volume-856eb0d4-07ac-4902-903a-4a9d16dda0d4 (856eb0d4-07ac-4902-903a-4a9d16dda0d4): created successfully Nov 04 10:24:29 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1586fe2c-ebe4-41aa-b069-6092599e5e3b tempest-CinderUnicodeTest-836021135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8138f91-bdba-42f9-b780-b1f1c49cf87d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:24:29 devstack sudo[99549]: pam_unix(sudo:session): session closed for user root Nov 04 10:24:29 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1586fe2c-ebe4-41aa-b069-6092599e5e3b tempest-CinderUnicodeTest-836021135 None] Flow 'volume_create_manager' (f2e3623e-0b68-474f-ac07-d1579fad4d58) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:24:29 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-5a5e1da9-b14f-4dba-bf06-11bbae1b8d2c tempest-TestImageHashVerification-1997351595 None] Created reservations ['2c113911-80f0-483e-ad1b-44c63867ee18', '9bda1159-26cc-48d7-b934-00f40980d993', '6c4d967e-c24f-44e6-8470-c4e4183d5da5', '6852627a-e9ab-471d-954b-153f0408ad0d'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:24:29 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-fb529008-9ddb-407b-a580-13425c17d492 tempest-VolumesImageMetadata-590657171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c589a328-f3ed-418a-8877-e90bfc4cf133_17d96tpb" returned: 1 in 0.424s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:24:29 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-fb529008-9ddb-407b-a580-13425c17d492 tempest-VolumesImageMetadata-590657171 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c589a328-f3ed-418a-8877-e90bfc4cf133_17d96tpb' failed. Not Retrying. {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 04 10:24:29 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[98bb6eb1-9322-41a9-ad18-68dc3caa17bd]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:24:29 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-fb529008-9ddb-407b-a580-13425c17d492 tempest-VolumesImageMetadata-590657171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c589a328-f3ed-418a-8877-e90bfc4cf133_7h2ndwx1devstack@QuobyteHD {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:24:29 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-1586fe2c-ebe4-41aa-b069-6092599e5e3b tempest-CinderUnicodeTest-836021135 None] Created volume successfully. Nov 04 10:24:29 devstack sudo[99559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c589a328-f3ed-418a-8877-e90bfc4cf133_7h2ndwx1devstack@QuobyteHD Nov 04 10:24:29 devstack sudo[99559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:24:29 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-5a5e1da9-b14f-4dba-bf06-11bbae1b8d2c tempest-TestImageHashVerification-1997351595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:24:29 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-5a5e1da9-b14f-4dba-bf06-11bbae1b8d2c tempest-TestImageHashVerification-1997351595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:24:29 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-5a5e1da9-b14f-4dba-bf06-11bbae1b8d2c tempest-TestImageHashVerification-1997351595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:24:29 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-5a5e1da9-b14f-4dba-bf06-11bbae1b8d2c tempest-TestImageHashVerification-1997351595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:24:29 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-5a5e1da9-b14f-4dba-bf06-11bbae1b8d2c tempest-TestImageHashVerification-1997351595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:24:29 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-5a5e1da9-b14f-4dba-bf06-11bbae1b8d2c tempest-TestImageHashVerification-1997351595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:24:29 devstack sudo[99561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:24:29 devstack sudo[99561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:24:29 devstack sudo[99559]: pam_unix(sudo:session): session closed for user root Nov 04 10:24:29 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-fb529008-9ddb-407b-a580-13425c17d492 tempest-VolumesImageMetadata-590657171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c589a328-f3ed-418a-8877-e90bfc4cf133_7h2ndwx1devstack@QuobyteHD" returned: 0 in 0.619s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:24:29 devstack cinder-volume[87068]: DEBUG cinder.image.image_utils [None req-fb529008-9ddb-407b-a580-13425c17d492 tempest-VolumesImageMetadata-590657171 None] c589a328-f3ed-418a-8877-e90bfc4cf133 was qcow2, converting to qcow2 {{(pid=87068) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 04 10:24:29 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-fb529008-9ddb-407b-a580-13425c17d492 tempest-VolumesImageMetadata-590657171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c589a328-f3ed-418a-8877-e90bfc4cf133_7h2ndwx1devstack@QuobyteHD /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-118fa43c-a8f3-4c53-8153-e701ebc6eb7c {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:24:29 devstack sudo[99561]: pam_unix(sudo:session): session closed for user root Nov 04 10:24:29 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-5a5e1da9-b14f-4dba-bf06-11bbae1b8d2c tempest-TestImageHashVerification-1997351595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.497s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:24:29 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-5a5e1da9-b14f-4dba-bf06-11bbae1b8d2c tempest-TestImageHashVerification-1997351595 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:24:29 devstack sudo[99568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c589a328-f3ed-418a-8877-e90bfc4cf133_7h2ndwx1devstack@QuobyteHD /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-118fa43c-a8f3-4c53-8153-e701ebc6eb7c Nov 04 10:24:29 devstack sudo[99568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:24:29 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-5a5e1da9-b14f-4dba-bf06-11bbae1b8d2c tempest-TestImageHashVerification-1997351595 None] Deleted volume successfully. Nov 04 10:24:29 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-5a5e1da9-b14f-4dba-bf06-11bbae1b8d2c tempest-TestImageHashVerification-1997351595 None] Lock "cinder-b4a19f54-e4c9-4e3f-9227-6c280b8f6cf7-delete_volume" released by "delete_volume" :: held 1.818s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:24:30 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-6507dd05-f704-48ac-af54-331f60165c09 tempest-CinderUnicodeTest-836021135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:24:30 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-6507dd05-f704-48ac-af54-331f60165c09 tempest-CinderUnicodeTest-836021135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:24:30 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-6507dd05-f704-48ac-af54-331f60165c09 tempest-CinderUnicodeTest-836021135 None] Creating offline snapshot dc46a2cf-bf73-4341-9efc-43696156a30d of volume 856eb0d4-07ac-4902-903a-4a9d16dda0d4 {{(pid=87068) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 10:24:30 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[aac99520-e858-426a-a2b0-510d024ef70e]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:24:30 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6507dd05-f704-48ac-af54-331f60165c09 tempest-CinderUnicodeTest-836021135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-856eb0d4-07ac-4902-903a-4a9d16dda0d4 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:24:30 devstack sudo[99573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-856eb0d4-07ac-4902-903a-4a9d16dda0d4 Nov 04 10:24:30 devstack sudo[99573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:24:30 devstack sudo[99573]: pam_unix(sudo:session): session closed for user root Nov 04 10:24:30 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6507dd05-f704-48ac-af54-331f60165c09 tempest-CinderUnicodeTest-836021135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-856eb0d4-07ac-4902-903a-4a9d16dda0d4" returned: 0 in 0.584s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:24:30 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6507dd05-f704-48ac-af54-331f60165c09 tempest-CinderUnicodeTest-836021135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-856eb0d4-07ac-4902-903a-4a9d16dda0d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-856eb0d4-07ac-4902-903a-4a9d16dda0d4.dc46a2cf-bf73-4341-9efc-43696156a30d 1G {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:24:30 devstack sudo[99583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-856eb0d4-07ac-4902-903a-4a9d16dda0d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-856eb0d4-07ac-4902-903a-4a9d16dda0d4.dc46a2cf-bf73-4341-9efc-43696156a30d 1G Nov 04 10:24:30 devstack sudo[99583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:24:31 devstack sudo[99583]: pam_unix(sudo:session): session closed for user root Nov 04 10:24:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6507dd05-f704-48ac-af54-331f60165c09 tempest-CinderUnicodeTest-836021135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-856eb0d4-07ac-4902-903a-4a9d16dda0d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-856eb0d4-07ac-4902-903a-4a9d16dda0d4.dc46a2cf-bf73-4341-9efc-43696156a30d 1G" returned: 0 in 0.643s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:24:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6507dd05-f704-48ac-af54-331f60165c09 tempest-CinderUnicodeTest-836021135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-856eb0d4-07ac-4902-903a-4a9d16dda0d4 -F qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-856eb0d4-07ac-4902-903a-4a9d16dda0d4.dc46a2cf-bf73-4341-9efc-43696156a30d {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:24:31 devstack sudo[99589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-856eb0d4-07ac-4902-903a-4a9d16dda0d4 -F qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-856eb0d4-07ac-4902-903a-4a9d16dda0d4.dc46a2cf-bf73-4341-9efc-43696156a30d Nov 04 10:24:31 devstack sudo[99589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:24:31 devstack sudo[99589]: pam_unix(sudo:session): session closed for user root Nov 04 10:24:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6507dd05-f704-48ac-af54-331f60165c09 tempest-CinderUnicodeTest-836021135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-856eb0d4-07ac-4902-903a-4a9d16dda0d4 -F qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-856eb0d4-07ac-4902-903a-4a9d16dda0d4.dc46a2cf-bf73-4341-9efc-43696156a30d" returned: 0 in 0.503s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:24:31 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-6507dd05-f704-48ac-af54-331f60165c09 tempest-CinderUnicodeTest-836021135 None] /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-856eb0d4-07ac-4902-903a-4a9d16dda0d4.dc46a2cf-bf73-4341-9efc-43696156a30d is being set with open permissions: ugo+rw Nov 04 10:24:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6507dd05-f704-48ac-af54-331f60165c09 tempest-CinderUnicodeTest-836021135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-856eb0d4-07ac-4902-903a-4a9d16dda0d4.dc46a2cf-bf73-4341-9efc-43696156a30d {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:24:31 devstack sudo[99595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-856eb0d4-07ac-4902-903a-4a9d16dda0d4.dc46a2cf-bf73-4341-9efc-43696156a30d Nov 04 10:24:31 devstack sudo[99595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:24:32 devstack sudo[99595]: pam_unix(sudo:session): session closed for user root Nov 04 10:24:32 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6507dd05-f704-48ac-af54-331f60165c09 tempest-CinderUnicodeTest-836021135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-856eb0d4-07ac-4902-903a-4a9d16dda0d4.dc46a2cf-bf73-4341-9efc-43696156a30d" returned: 0 in 0.350s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:24:32 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6507dd05-f704-48ac-af54-331f60165c09 tempest-CinderUnicodeTest-836021135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-856eb0d4-07ac-4902-903a-4a9d16dda0d4.info {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:24:32 devstack sudo[99598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-856eb0d4-07ac-4902-903a-4a9d16dda0d4.info Nov 04 10:24:32 devstack sudo[99598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:24:32 devstack sudo[99568]: pam_unix(sudo:session): session closed for user root Nov 04 10:24:32 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-fb529008-9ddb-407b-a580-13425c17d492 tempest-VolumesImageMetadata-590657171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c589a328-f3ed-418a-8877-e90bfc4cf133_7h2ndwx1devstack@QuobyteHD /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-118fa43c-a8f3-4c53-8153-e701ebc6eb7c" returned: 0 in 2.794s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:24:32 devstack cinder-volume[87068]: DEBUG cinder.image.image_utils [None req-fb529008-9ddb-407b-a580-13425c17d492 tempest-VolumesImageMetadata-590657171 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c589a328-f3ed-418a-8877-e90bfc4cf133_7h2ndwx1devstack@QuobyteHD, size 112.00 MB, duration 2.80 sec, destination /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-118fa43c-a8f3-4c53-8153-e701ebc6eb7c {{(pid=87068) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 04 10:24:32 devstack cinder-volume[87068]: INFO cinder.image.image_utils [None req-fb529008-9ddb-407b-a580-13425c17d492 tempest-VolumesImageMetadata-590657171 None] Converted 112.00 MB image at 40.04 MB/s Nov 04 10:24:32 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-fb529008-9ddb-407b-a580-13425c17d492 tempest-VolumesImageMetadata-590657171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-118fa43c-a8f3-4c53-8153-e701ebc6eb7c 1G {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:24:32 devstack sudo[99600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-118fa43c-a8f3-4c53-8153-e701ebc6eb7c 1G Nov 04 10:24:32 devstack sudo[99600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:24:32 devstack sudo[99598]: pam_unix(sudo:session): session closed for user root Nov 04 10:24:32 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6507dd05-f704-48ac-af54-331f60165c09 tempest-CinderUnicodeTest-836021135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-856eb0d4-07ac-4902-903a-4a9d16dda0d4.info" returned: 0 in 0.426s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:24:32 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-6507dd05-f704-48ac-af54-331f60165c09 tempest-CinderUnicodeTest-836021135 None] /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-856eb0d4-07ac-4902-903a-4a9d16dda0d4.info is being set with open permissions: ugo+rw Nov 04 10:24:32 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6507dd05-f704-48ac-af54-331f60165c09 tempest-CinderUnicodeTest-836021135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-856eb0d4-07ac-4902-903a-4a9d16dda0d4.info {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:24:32 devstack sudo[99604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-856eb0d4-07ac-4902-903a-4a9d16dda0d4.info Nov 04 10:24:32 devstack sudo[99604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:24:32 devstack sudo[99600]: pam_unix(sudo:session): session closed for user root Nov 04 10:24:32 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-fb529008-9ddb-407b-a580-13425c17d492 tempest-VolumesImageMetadata-590657171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-118fa43c-a8f3-4c53-8153-e701ebc6eb7c 1G" returned: 0 in 0.453s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:24:32 devstack cinder-volume[87068]: DEBUG cinder.volume.volume_utils [None req-fb529008-9ddb-407b-a580-13425c17d492 tempest-VolumesImageMetadata-590657171 None] Downloaded image c589a328-f3ed-418a-8877-e90bfc4cf133 ((None, [{'url': 'file:///opt/stack/data/glance/images/c589a328-f3ed-418a-8877-e90bfc4cf133', 'metadata': {}}])) to volume 118fa43c-a8f3-4c53-8153-e701ebc6eb7c successfully. {{(pid=87068) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 04 10:24:32 devstack cinder-volume[87068]: DEBUG cinder.image.image_utils [None req-fb529008-9ddb-407b-a580-13425c17d492 tempest-VolumesImageMetadata-590657171 None] Temporary image c589a328-f3ed-418a-8877-e90bfc4cf133 for user 4e66abe1a91c49c6a3cdd7465a18f94d is deleted. {{(pid=87068) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 04 10:24:32 devstack cinder-volume[87068]: DEBUG cinder.volume.volume_utils [None req-fb529008-9ddb-407b-a580-13425c17d492 tempest-VolumesImageMetadata-590657171 None] Marking volume 118fa43c-a8f3-4c53-8153-e701ebc6eb7c as bootable. {{(pid=87068) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 04 10:24:32 devstack sudo[99604]: pam_unix(sudo:session): session closed for user root Nov 04 10:24:32 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb529008-9ddb-407b-a580-13425c17d492 tempest-VolumesImageMetadata-590657171 None] Copying metadata from image c589a328-f3ed-418a-8877-e90bfc4cf133 to 118fa43c-a8f3-4c53-8153-e701ebc6eb7c. {{(pid=87068) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 04 10:24:32 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb529008-9ddb-407b-a580-13425c17d492 tempest-VolumesImageMetadata-590657171 None] Creating volume glance metadata for volume 118fa43c-a8f3-4c53-8153-e701ebc6eb7c backed by image c589a328-f3ed-418a-8877-e90bfc4cf133 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'c589a328-f3ed-418a-8877-e90bfc4cf133', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87068) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 04 10:24:32 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6507dd05-f704-48ac-af54-331f60165c09 tempest-CinderUnicodeTest-836021135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-856eb0d4-07ac-4902-903a-4a9d16dda0d4.info" returned: 0 in 0.296s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:24:32 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-6507dd05-f704-48ac-af54-331f60165c09 tempest-CinderUnicodeTest-836021135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.957s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:24:33 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-6507dd05-f704-48ac-af54-331f60165c09 tempest-CinderUnicodeTest-836021135 None] Create snapshot completed successfully Nov 04 10:24:33 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-fb529008-9ddb-407b-a580-13425c17d492 tempest-VolumesImageMetadata-590657171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1473b2a6-ec94-4eb9-a1d3-93fd891b6b1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-118fa43c-a8f3-4c53-8153-e701ebc6eb7c', 'volume_size': 1, 'image_id': 'c589a328-f3ed-418a-8877-e90bfc4cf133', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c589a328-f3ed-418a-8877-e90bfc4cf133', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '046e78417f874f20873c25a0eb7adc65', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c589a328-f3ed-418a-8877-e90bfc4cf133', 'created_at': datetime.datetime(2026, 11, 4, 9, 4, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 9, 5, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c589a328-f3ed-418a-8877-e90bfc4cf133/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:24:33 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-fb529008-9ddb-407b-a580-13425c17d492 tempest-VolumesImageMetadata-590657171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d72d5390-753e-4874-b197-0c94ad32a6ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:24:33 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-fb529008-9ddb-407b-a580-13425c17d492 tempest-VolumesImageMetadata-590657171 None] Volume volume-118fa43c-a8f3-4c53-8153-e701ebc6eb7c (118fa43c-a8f3-4c53-8153-e701ebc6eb7c): created successfully Nov 04 10:24:33 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-fb529008-9ddb-407b-a580-13425c17d492 tempest-VolumesImageMetadata-590657171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d72d5390-753e-4874-b197-0c94ad32a6ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:24:33 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-fb529008-9ddb-407b-a580-13425c17d492 tempest-VolumesImageMetadata-590657171 None] Flow 'volume_create_manager' (100ecd9d-fe19-4f9f-abac-831576bc2903) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:24:33 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-637099f1-7518-41c8-9d21-a8c5f35f9c52 tempest-CinderUnicodeTest-836021135 None] Acquiring lock "cinder-dc46a2cf-bf73-4341-9efc-43696156a30d-delete_snapshot" by "delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:24:33 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-fb529008-9ddb-407b-a580-13425c17d492 tempest-VolumesImageMetadata-590657171 None] Created volume successfully. Nov 04 10:24:33 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-637099f1-7518-41c8-9d21-a8c5f35f9c52 tempest-CinderUnicodeTest-836021135 None] Lock "cinder-dc46a2cf-bf73-4341-9efc-43696156a30d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:24:33 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-637099f1-7518-41c8-9d21-a8c5f35f9c52 tempest-CinderUnicodeTest-836021135 None] Acquiring lock "cinder-quobyte-856eb0d4-07ac-4902-903a-4a9d16dda0d4" by "delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:24:33 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-637099f1-7518-41c8-9d21-a8c5f35f9c52 tempest-CinderUnicodeTest-836021135 None] Lock "cinder-quobyte-856eb0d4-07ac-4902-903a-4a9d16dda0d4" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:24:33 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-637099f1-7518-41c8-9d21-a8c5f35f9c52 tempest-CinderUnicodeTest-836021135 None] Acquiring lock "cinder-quobyte-dc46a2cf-bf73-4341-9efc-43696156a30d" by "_delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:24:33 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-637099f1-7518-41c8-9d21-a8c5f35f9c52 tempest-CinderUnicodeTest-836021135 None] Lock "cinder-quobyte-dc46a2cf-bf73-4341-9efc-43696156a30d" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:24:33 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-637099f1-7518-41c8-9d21-a8c5f35f9c52 tempest-CinderUnicodeTest-836021135 None] Deleting offline snapshot dc46a2cf-bf73-4341-9efc-43696156a30d of volume 856eb0d4-07ac-4902-903a-4a9d16dda0d4 {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 10:24:33 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-637099f1-7518-41c8-9d21-a8c5f35f9c52 tempest-CinderUnicodeTest-836021135 None] snapshot_file for this snap is: volume-856eb0d4-07ac-4902-903a-4a9d16dda0d4.dc46a2cf-bf73-4341-9efc-43696156a30d {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 10:24:33 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca963e06-4a2e-4b91-8db6-55935e0da871]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:24:33 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-637099f1-7518-41c8-9d21-a8c5f35f9c52 tempest-CinderUnicodeTest-836021135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-856eb0d4-07ac-4902-903a-4a9d16dda0d4.dc46a2cf-bf73-4341-9efc-43696156a30d {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:24:33 devstack sudo[99611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-856eb0d4-07ac-4902-903a-4a9d16dda0d4.dc46a2cf-bf73-4341-9efc-43696156a30d Nov 04 10:24:33 devstack sudo[99611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:24:33 devstack sudo[99611]: pam_unix(sudo:session): session closed for user root Nov 04 10:24:33 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-637099f1-7518-41c8-9d21-a8c5f35f9c52 tempest-CinderUnicodeTest-836021135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-856eb0d4-07ac-4902-903a-4a9d16dda0d4.dc46a2cf-bf73-4341-9efc-43696156a30d" returned: 0 in 0.439s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:24:33 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-637099f1-7518-41c8-9d21-a8c5f35f9c52 tempest-CinderUnicodeTest-836021135 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-856eb0d4-07ac-4902-903a-4a9d16dda0d4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87068) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 10:24:33 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e035329-bce0-4cd3-8ad1-d779fb9eba42]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:24:33 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-637099f1-7518-41c8-9d21-a8c5f35f9c52 tempest-CinderUnicodeTest-836021135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-856eb0d4-07ac-4902-903a-4a9d16dda0d4 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:24:33 devstack sudo[99616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-856eb0d4-07ac-4902-903a-4a9d16dda0d4 Nov 04 10:24:33 devstack sudo[99616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:24:34 devstack sudo[99616]: pam_unix(sudo:session): session closed for user root Nov 04 10:24:34 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-637099f1-7518-41c8-9d21-a8c5f35f9c52 tempest-CinderUnicodeTest-836021135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-856eb0d4-07ac-4902-903a-4a9d16dda0d4" returned: 0 in 0.550s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:24:34 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-637099f1-7518-41c8-9d21-a8c5f35f9c52 tempest-CinderUnicodeTest-836021135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-856eb0d4-07ac-4902-903a-4a9d16dda0d4.dc46a2cf-bf73-4341-9efc-43696156a30d {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:24:34 devstack sudo[99621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-856eb0d4-07ac-4902-903a-4a9d16dda0d4.dc46a2cf-bf73-4341-9efc-43696156a30d Nov 04 10:24:34 devstack sudo[99621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:24:34 devstack sudo[99621]: pam_unix(sudo:session): session closed for user root Nov 04 10:24:34 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-637099f1-7518-41c8-9d21-a8c5f35f9c52 tempest-CinderUnicodeTest-836021135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-856eb0d4-07ac-4902-903a-4a9d16dda0d4.dc46a2cf-bf73-4341-9efc-43696156a30d" returned: 0 in 0.425s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:24:34 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-637099f1-7518-41c8-9d21-a8c5f35f9c52 tempest-CinderUnicodeTest-836021135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-856eb0d4-07ac-4902-903a-4a9d16dda0d4.dc46a2cf-bf73-4341-9efc-43696156a30d {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:24:34 devstack sudo[99626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-856eb0d4-07ac-4902-903a-4a9d16dda0d4.dc46a2cf-bf73-4341-9efc-43696156a30d Nov 04 10:24:34 devstack sudo[99626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:24:35 devstack sudo[99626]: pam_unix(sudo:session): session closed for user root Nov 04 10:24:35 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-637099f1-7518-41c8-9d21-a8c5f35f9c52 tempest-CinderUnicodeTest-836021135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-856eb0d4-07ac-4902-903a-4a9d16dda0d4.dc46a2cf-bf73-4341-9efc-43696156a30d" returned: 0 in 0.393s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:24:35 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-637099f1-7518-41c8-9d21-a8c5f35f9c52 tempest-CinderUnicodeTest-836021135 None] Lock "cinder-quobyte-dc46a2cf-bf73-4341-9efc-43696156a30d" released by "_delete_snapshot" :: held 1.965s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:24:35 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-637099f1-7518-41c8-9d21-a8c5f35f9c52 tempest-CinderUnicodeTest-836021135 None] Lock "cinder-quobyte-856eb0d4-07ac-4902-903a-4a9d16dda0d4" released by "delete_snapshot" :: held 1.994s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:24:35 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-fd02126f-4307-4350-bc90-899550be1fcc tempest-VolumesImageMetadata-590657171 None] Acquiring lock "cinder-118fa43c-a8f3-4c53-8153-e701ebc6eb7c-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:24:35 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-fd02126f-4307-4350-bc90-899550be1fcc tempest-VolumesImageMetadata-590657171 None] Lock "cinder-118fa43c-a8f3-4c53-8153-e701ebc6eb7c-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:24:35 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-fd02126f-4307-4350-bc90-899550be1fcc tempest-VolumesImageMetadata-590657171 None] Acquiring lock "cinder-quobyte-118fa43c-a8f3-4c53-8153-e701ebc6eb7c" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:24:35 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-637099f1-7518-41c8-9d21-a8c5f35f9c52 tempest-CinderUnicodeTest-836021135 None] Created reservations ['a7dae743-50ab-4119-8f03-820a14bc4b6e', 'a6b92523-731b-45d2-b530-942c3e53d241', '97defe80-9974-4c1c-9dcf-477f32483a83', '6072744d-9d60-494e-bb73-4aeaaf15a6ee'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:24:35 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-fd02126f-4307-4350-bc90-899550be1fcc tempest-VolumesImageMetadata-590657171 None] Lock "cinder-quobyte-118fa43c-a8f3-4c53-8153-e701ebc6eb7c" acquired by "delete_volume" :: waited 0.033s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:24:35 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[f75a04ae-9fae-4c28-ab97-6605b670f26e]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:24:35 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-fd02126f-4307-4350-bc90-899550be1fcc tempest-VolumesImageMetadata-590657171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-118fa43c-a8f3-4c53-8153-e701ebc6eb7c {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:24:35 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-637099f1-7518-41c8-9d21-a8c5f35f9c52 tempest-CinderUnicodeTest-836021135 None] Delete snapshot completed successfully. Nov 04 10:24:35 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-637099f1-7518-41c8-9d21-a8c5f35f9c52 tempest-CinderUnicodeTest-836021135 None] Lock "cinder-dc46a2cf-bf73-4341-9efc-43696156a30d-delete_snapshot" released by "delete_snapshot" :: held 2.288s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:24:35 devstack sudo[99630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-118fa43c-a8f3-4c53-8153-e701ebc6eb7c Nov 04 10:24:35 devstack sudo[99630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:24:36 devstack sudo[99630]: pam_unix(sudo:session): session closed for user root Nov 04 10:24:36 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-fd02126f-4307-4350-bc90-899550be1fcc tempest-VolumesImageMetadata-590657171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-118fa43c-a8f3-4c53-8153-e701ebc6eb7c" returned: 0 in 0.454s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:24:36 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-fd02126f-4307-4350-bc90-899550be1fcc tempest-VolumesImageMetadata-590657171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-118fa43c-a8f3-4c53-8153-e701ebc6eb7c {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:24:36 devstack sudo[99636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-118fa43c-a8f3-4c53-8153-e701ebc6eb7c Nov 04 10:24:36 devstack sudo[99636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:24:36 devstack sudo[99636]: pam_unix(sudo:session): session closed for user root Nov 04 10:24:36 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-fd02126f-4307-4350-bc90-899550be1fcc tempest-VolumesImageMetadata-590657171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-118fa43c-a8f3-4c53-8153-e701ebc6eb7c" returned: 0 in 0.283s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:24:36 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-fd02126f-4307-4350-bc90-899550be1fcc tempest-VolumesImageMetadata-590657171 None] Lock "cinder-quobyte-118fa43c-a8f3-4c53-8153-e701ebc6eb7c" released by "delete_volume" :: held 0.802s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:24:36 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-fd02126f-4307-4350-bc90-899550be1fcc tempest-VolumesImageMetadata-590657171 None] Created reservations ['36cb934b-eab8-493e-961f-5fe0f2a1fc69', '9220d565-e309-4be7-9057-7049287db940', '4d1ef437-8b12-48d0-930b-931c64f852cc', '6f4df860-9344-4e20-a8c2-efaa906275e4'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:24:36 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-fd02126f-4307-4350-bc90-899550be1fcc tempest-VolumesImageMetadata-590657171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:24:36 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-fd02126f-4307-4350-bc90-899550be1fcc tempest-VolumesImageMetadata-590657171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:24:36 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-fd02126f-4307-4350-bc90-899550be1fcc tempest-VolumesImageMetadata-590657171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:24:36 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-fd02126f-4307-4350-bc90-899550be1fcc tempest-VolumesImageMetadata-590657171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:24:36 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-fd02126f-4307-4350-bc90-899550be1fcc tempest-VolumesImageMetadata-590657171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:24:36 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-fd02126f-4307-4350-bc90-899550be1fcc tempest-VolumesImageMetadata-590657171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:24:36 devstack sudo[99639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:24:36 devstack sudo[99639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:24:36 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-82b05785-1cc7-447a-b1b5-7883c1a70019 tempest-CinderUnicodeTest-836021135 None] Acquiring lock "cinder-856eb0d4-07ac-4902-903a-4a9d16dda0d4-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:24:36 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-82b05785-1cc7-447a-b1b5-7883c1a70019 tempest-CinderUnicodeTest-836021135 None] Lock "cinder-856eb0d4-07ac-4902-903a-4a9d16dda0d4-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:24:36 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-82b05785-1cc7-447a-b1b5-7883c1a70019 tempest-CinderUnicodeTest-836021135 None] Acquiring lock "cinder-quobyte-856eb0d4-07ac-4902-903a-4a9d16dda0d4" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:24:36 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-82b05785-1cc7-447a-b1b5-7883c1a70019 tempest-CinderUnicodeTest-836021135 None] Lock "cinder-quobyte-856eb0d4-07ac-4902-903a-4a9d16dda0d4" acquired by "delete_volume" :: waited 0.022s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:24:36 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f360e7d-0c06-4c77-8937-5ec437d0c7b5]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:24:36 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-82b05785-1cc7-447a-b1b5-7883c1a70019 tempest-CinderUnicodeTest-836021135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-856eb0d4-07ac-4902-903a-4a9d16dda0d4 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:24:36 devstack sudo[99639]: pam_unix(sudo:session): session closed for user root Nov 04 10:24:36 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-fd02126f-4307-4350-bc90-899550be1fcc tempest-VolumesImageMetadata-590657171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.396s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:24:36 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-fd02126f-4307-4350-bc90-899550be1fcc tempest-VolumesImageMetadata-590657171 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:24:36 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-fd02126f-4307-4350-bc90-899550be1fcc tempest-VolumesImageMetadata-590657171 None] Deleted volume successfully. Nov 04 10:24:36 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-fd02126f-4307-4350-bc90-899550be1fcc tempest-VolumesImageMetadata-590657171 None] Lock "cinder-118fa43c-a8f3-4c53-8153-e701ebc6eb7c-delete_volume" released by "delete_volume" :: held 1.575s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:24:37 devstack sudo[99642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-856eb0d4-07ac-4902-903a-4a9d16dda0d4 Nov 04 10:24:37 devstack sudo[99642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:24:37 devstack sudo[99642]: pam_unix(sudo:session): session closed for user root Nov 04 10:24:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-82b05785-1cc7-447a-b1b5-7883c1a70019 tempest-CinderUnicodeTest-836021135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-856eb0d4-07ac-4902-903a-4a9d16dda0d4" returned: 0 in 0.589s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:24:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-82b05785-1cc7-447a-b1b5-7883c1a70019 tempest-CinderUnicodeTest-836021135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-856eb0d4-07ac-4902-903a-4a9d16dda0d4 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:24:37 devstack sudo[99648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-856eb0d4-07ac-4902-903a-4a9d16dda0d4 Nov 04 10:24:37 devstack sudo[99648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:24:37 devstack sudo[99648]: pam_unix(sudo:session): session closed for user root Nov 04 10:24:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-82b05785-1cc7-447a-b1b5-7883c1a70019 tempest-CinderUnicodeTest-836021135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-856eb0d4-07ac-4902-903a-4a9d16dda0d4" returned: 0 in 0.357s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:24:37 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-82b05785-1cc7-447a-b1b5-7883c1a70019 tempest-CinderUnicodeTest-836021135 None] Lock "cinder-quobyte-856eb0d4-07ac-4902-903a-4a9d16dda0d4" released by "delete_volume" :: held 1.063s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:24:37 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-82b05785-1cc7-447a-b1b5-7883c1a70019 tempest-CinderUnicodeTest-836021135 None] Created reservations ['9182b415-199b-4108-ab33-750aa665ebc4', 'd145224f-044d-4cba-9df7-b7c2c5aa4655', 'c818b911-2724-4753-9b38-536db025f36d', '92316c76-2bab-449d-a483-5c621eeacf7b'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:24:38 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-82b05785-1cc7-447a-b1b5-7883c1a70019 tempest-CinderUnicodeTest-836021135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:24:38 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-82b05785-1cc7-447a-b1b5-7883c1a70019 tempest-CinderUnicodeTest-836021135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:24:38 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-82b05785-1cc7-447a-b1b5-7883c1a70019 tempest-CinderUnicodeTest-836021135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:24:38 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-82b05785-1cc7-447a-b1b5-7883c1a70019 tempest-CinderUnicodeTest-836021135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:24:38 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-82b05785-1cc7-447a-b1b5-7883c1a70019 tempest-CinderUnicodeTest-836021135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:24:38 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-82b05785-1cc7-447a-b1b5-7883c1a70019 tempest-CinderUnicodeTest-836021135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:24:38 devstack sudo[99651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:24:38 devstack sudo[99651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:24:38 devstack sudo[99651]: pam_unix(sudo:session): session closed for user root Nov 04 10:24:38 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-82b05785-1cc7-447a-b1b5-7883c1a70019 tempest-CinderUnicodeTest-836021135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.331s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:24:38 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-82b05785-1cc7-447a-b1b5-7883c1a70019 tempest-CinderUnicodeTest-836021135 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:24:38 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-82b05785-1cc7-447a-b1b5-7883c1a70019 tempest-CinderUnicodeTest-836021135 None] Deleted volume successfully. Nov 04 10:24:38 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-82b05785-1cc7-447a-b1b5-7883c1a70019 tempest-CinderUnicodeTest-836021135 None] Lock "cinder-856eb0d4-07ac-4902-903a-4a9d16dda0d4-delete_volume" released by "delete_volume" :: held 1.991s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:24:39 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-10cb16f1-7c64-4811-86e6-5d7297227c65 tempest-CinderUnicodeTest-836021135 None] Acquiring lock "cinder-b968946a-1341-4aee-b752-98cc352ff891-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:24:39 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-10cb16f1-7c64-4811-86e6-5d7297227c65 tempest-CinderUnicodeTest-836021135 None] Lock "cinder-b968946a-1341-4aee-b752-98cc352ff891-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:24:39 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-10cb16f1-7c64-4811-86e6-5d7297227c65 tempest-CinderUnicodeTest-836021135 None] Acquiring lock "cinder-quobyte-b968946a-1341-4aee-b752-98cc352ff891" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:24:39 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-10cb16f1-7c64-4811-86e6-5d7297227c65 tempest-CinderUnicodeTest-836021135 None] Lock "cinder-quobyte-b968946a-1341-4aee-b752-98cc352ff891" acquired by "delete_volume" :: waited 0.016s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:24:39 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a20b4e3-10ea-4898-b46a-f30ad43472b7]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:24:39 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-10cb16f1-7c64-4811-86e6-5d7297227c65 tempest-CinderUnicodeTest-836021135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b968946a-1341-4aee-b752-98cc352ff891 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:24:39 devstack sudo[99654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b968946a-1341-4aee-b752-98cc352ff891 Nov 04 10:24:39 devstack sudo[99654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:24:39 devstack sudo[99654]: pam_unix(sudo:session): session closed for user root Nov 04 10:24:39 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-10cb16f1-7c64-4811-86e6-5d7297227c65 tempest-CinderUnicodeTest-836021135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b968946a-1341-4aee-b752-98cc352ff891" returned: 0 in 0.471s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:24:39 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-10cb16f1-7c64-4811-86e6-5d7297227c65 tempest-CinderUnicodeTest-836021135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b968946a-1341-4aee-b752-98cc352ff891 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:24:39 devstack sudo[99659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b968946a-1341-4aee-b752-98cc352ff891 Nov 04 10:24:39 devstack sudo[99659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:24:40 devstack sudo[99659]: pam_unix(sudo:session): session closed for user root Nov 04 10:24:40 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-10cb16f1-7c64-4811-86e6-5d7297227c65 tempest-CinderUnicodeTest-836021135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b968946a-1341-4aee-b752-98cc352ff891" returned: 0 in 0.328s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:24:40 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-10cb16f1-7c64-4811-86e6-5d7297227c65 tempest-CinderUnicodeTest-836021135 None] Lock "cinder-quobyte-b968946a-1341-4aee-b752-98cc352ff891" released by "delete_volume" :: held 0.885s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:24:40 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-10cb16f1-7c64-4811-86e6-5d7297227c65 tempest-CinderUnicodeTest-836021135 None] Created reservations ['80daae0c-0c1c-4a9f-a5e0-8ec2fe225241', '97326bb7-739d-4f3a-9da7-a0f3d8258c41', 'c005a4d9-e81c-450a-80e6-9aa6436f53e3', '36e27d7b-6b3f-49d6-a9e3-d2eb7b0af508'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:24:40 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-10cb16f1-7c64-4811-86e6-5d7297227c65 tempest-CinderUnicodeTest-836021135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:24:40 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-10cb16f1-7c64-4811-86e6-5d7297227c65 tempest-CinderUnicodeTest-836021135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:24:40 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-10cb16f1-7c64-4811-86e6-5d7297227c65 tempest-CinderUnicodeTest-836021135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:24:40 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-10cb16f1-7c64-4811-86e6-5d7297227c65 tempest-CinderUnicodeTest-836021135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:24:40 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-10cb16f1-7c64-4811-86e6-5d7297227c65 tempest-CinderUnicodeTest-836021135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:24:40 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-10cb16f1-7c64-4811-86e6-5d7297227c65 tempest-CinderUnicodeTest-836021135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:24:40 devstack sudo[99662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:24:40 devstack sudo[99662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:24:40 devstack sudo[99662]: pam_unix(sudo:session): session closed for user root Nov 04 10:24:40 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-10cb16f1-7c64-4811-86e6-5d7297227c65 tempest-CinderUnicodeTest-836021135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.270s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:24:40 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-10cb16f1-7c64-4811-86e6-5d7297227c65 tempest-CinderUnicodeTest-836021135 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:24:40 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-10cb16f1-7c64-4811-86e6-5d7297227c65 tempest-CinderUnicodeTest-836021135 None] Deleted volume successfully. Nov 04 10:24:40 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-10cb16f1-7c64-4811-86e6-5d7297227c65 tempest-CinderUnicodeTest-836021135 None] Lock "cinder-b968946a-1341-4aee-b752-98cc352ff891-delete_volume" released by "delete_volume" :: held 1.503s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:24:49 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-066607ef-13bc-49be-ac4a-952768fb733a tempest-CreateVolumesFromImageTest-778005494 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:24:49 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-066607ef-13bc-49be-ac4a-952768fb733a tempest-CreateVolumesFromImageTest-778005494 None] Flow 'volume_create_manager' (b1f3c465-b3f3-434c-a706-24b0e75e92f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:24:49 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-066607ef-13bc-49be-ac4a-952768fb733a tempest-CreateVolumesFromImageTest-778005494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07becb4a-3c0b-4a92-8b3a-99efb91025c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:24:49 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-066607ef-13bc-49be-ac4a-952768fb733a tempest-CreateVolumesFromImageTest-778005494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07becb4a-3c0b-4a92-8b3a-99efb91025c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:24:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-250424704',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=251b1ccf-1f0a-4a27-94e4-332e026494c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75d3be08579343f799a00ca97efc27a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:24:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:24:49Z,use_quota=True,user_id='4929488fcbbe4dbdbead0a79f015b817',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:24:49 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-066607ef-13bc-49be-ac4a-952768fb733a tempest-CreateVolumesFromImageTest-778005494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf593c33-e56f-4c13-b3b3-9085de0b3179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:24:49 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-066607ef-13bc-49be-ac4a-952768fb733a tempest-CreateVolumesFromImageTest-778005494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf593c33-e56f-4c13-b3b3-9085de0b3179) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:24:49 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-066607ef-13bc-49be-ac4a-952768fb733a tempest-CreateVolumesFromImageTest-778005494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (844f9944-f591-492b-89a6-833526bbc88e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:24:49 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-066607ef-13bc-49be-ac4a-952768fb733a tempest-CreateVolumesFromImageTest-778005494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (844f9944-f591-492b-89a6-833526bbc88e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '251b1ccf-1f0a-4a27-94e4-332e026494c4', 'volume_name': 'volume-251b1ccf-1f0a-4a27-94e4-332e026494c4', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:24:49 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-066607ef-13bc-49be-ac4a-952768fb733a tempest-CreateVolumesFromImageTest-778005494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01027b84-3219-4959-9967-0dc8353a2a84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:24:49 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-066607ef-13bc-49be-ac4a-952768fb733a tempest-CreateVolumesFromImageTest-778005494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01027b84-3219-4959-9967-0dc8353a2a84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:24:49 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-066607ef-13bc-49be-ac4a-952768fb733a tempest-CreateVolumesFromImageTest-778005494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d873331c-515d-44a9-b0d5-46aa22de5f04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:24:49 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-066607ef-13bc-49be-ac4a-952768fb733a tempest-CreateVolumesFromImageTest-778005494 None] Volume 251b1ccf-1f0a-4a27-94e4-332e026494c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-251b1ccf-1f0a-4a27-94e4-332e026494c4', 'volume_size': 1} Nov 04 10:24:49 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-066607ef-13bc-49be-ac4a-952768fb733a tempest-CreateVolumesFromImageTest-778005494 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:24:49 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-066607ef-13bc-49be-ac4a-952768fb733a tempest-CreateVolumesFromImageTest-778005494 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:24:49 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-066607ef-13bc-49be-ac4a-952768fb733a tempest-CreateVolumesFromImageTest-778005494 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:24:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-250424704',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=251b1ccf-1f0a-4a27-94e4-332e026494c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75d3be08579343f799a00ca97efc27a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:24:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:24:49Z,use_quota=True,user_id='4929488fcbbe4dbdbead0a79f015b817',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 10:24:49 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-066607ef-13bc-49be-ac4a-952768fb733a tempest-CreateVolumesFromImageTest-778005494 None] Creating volume 251b1ccf-1f0a-4a27-94e4-332e026494c4 {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:24:49 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-066607ef-13bc-49be-ac4a-952768fb733a tempest-CreateVolumesFromImageTest-778005494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:24:49 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-066607ef-13bc-49be-ac4a-952768fb733a tempest-CreateVolumesFromImageTest-778005494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:24:49 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-066607ef-13bc-49be-ac4a-952768fb733a tempest-CreateVolumesFromImageTest-778005494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:24:49 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-066607ef-13bc-49be-ac4a-952768fb733a tempest-CreateVolumesFromImageTest-778005494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:24:49 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-066607ef-13bc-49be-ac4a-952768fb733a tempest-CreateVolumesFromImageTest-778005494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:24:49 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-066607ef-13bc-49be-ac4a-952768fb733a tempest-CreateVolumesFromImageTest-778005494 None] Selected osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:24:49 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-066607ef-13bc-49be-ac4a-952768fb733a tempest-CreateVolumesFromImageTest-778005494 None] casted to osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 Nov 04 10:24:49 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-066607ef-13bc-49be-ac4a-952768fb733a tempest-CreateVolumesFromImageTest-778005494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-251b1ccf-1f0a-4a27-94e4-332e026494c4 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:24:49 devstack sudo[99745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-251b1ccf-1f0a-4a27-94e4-332e026494c4 1073741824 Nov 04 10:24:49 devstack sudo[99745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:24:49 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7406cad-cdee-48d2-abe7-f817670274be tempest-VolumesDeleteCascade-2146450032 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:24:49 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c7406cad-cdee-48d2-abe7-f817670274be tempest-VolumesDeleteCascade-2146450032 None] Flow 'volume_create_manager' (5c9ee025-2fca-4950-81f5-bf8173f68b34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:24:49 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c7406cad-cdee-48d2-abe7-f817670274be tempest-VolumesDeleteCascade-2146450032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (024e2ae1-8c20-4c91-a342-b9d0b0b12bad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:24:49 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c7406cad-cdee-48d2-abe7-f817670274be tempest-VolumesDeleteCascade-2146450032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (024e2ae1-8c20-4c91-a342-b9d0b0b12bad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:24:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1680738489',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f2c1287-1b56-4b7d-9024-b22e833093b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fdc968ee22341bdaa6192576bfcb30d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:24:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:24:49Z,use_quota=True,user_id='b760fe208cb04e798444643a284ba280',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:24:49 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c7406cad-cdee-48d2-abe7-f817670274be tempest-VolumesDeleteCascade-2146450032 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb88317d-4ed0-463a-9a7c-0e179b4e01db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:24:49 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c7406cad-cdee-48d2-abe7-f817670274be tempest-VolumesDeleteCascade-2146450032 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb88317d-4ed0-463a-9a7c-0e179b4e01db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:24:49 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c7406cad-cdee-48d2-abe7-f817670274be tempest-VolumesDeleteCascade-2146450032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (763d54c8-47a2-4051-96ce-ebeb860371a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:24:49 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c7406cad-cdee-48d2-abe7-f817670274be tempest-VolumesDeleteCascade-2146450032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (763d54c8-47a2-4051-96ce-ebeb860371a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f2c1287-1b56-4b7d-9024-b22e833093b3', 'volume_name': 'volume-1f2c1287-1b56-4b7d-9024-b22e833093b3', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:24:49 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c7406cad-cdee-48d2-abe7-f817670274be tempest-VolumesDeleteCascade-2146450032 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb5b177d-ee95-404f-a8cc-06968f509d88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:24:49 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c7406cad-cdee-48d2-abe7-f817670274be tempest-VolumesDeleteCascade-2146450032 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb5b177d-ee95-404f-a8cc-06968f509d88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:24:49 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c7406cad-cdee-48d2-abe7-f817670274be tempest-VolumesDeleteCascade-2146450032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffe1ce06-e084-4aaa-a527-7fcc2196f62f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:24:49 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-c7406cad-cdee-48d2-abe7-f817670274be tempest-VolumesDeleteCascade-2146450032 None] Volume 1f2c1287-1b56-4b7d-9024-b22e833093b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f2c1287-1b56-4b7d-9024-b22e833093b3', 'volume_size': 1} Nov 04 10:24:49 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-c7406cad-cdee-48d2-abe7-f817670274be tempest-VolumesDeleteCascade-2146450032 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:24:50 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-3bb3127f-4ec9-428f-b4bd-e5c7ef7cc8fb tempest-CreateVolumesFromImageTest-778005494 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:24:50 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-3bb3127f-4ec9-428f-b4bd-e5c7ef7cc8fb tempest-CreateVolumesFromImageTest-778005494 None] Flow 'volume_create_manager' (41bb0d1e-2f2e-40e4-ba10-366dcc64bb35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:24:50 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-3bb3127f-4ec9-428f-b4bd-e5c7ef7cc8fb tempest-CreateVolumesFromImageTest-778005494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fda1115-dd6c-4cf1-a1cd-3908b7ea665f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:24:50 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-3bb3127f-4ec9-428f-b4bd-e5c7ef7cc8fb tempest-CreateVolumesFromImageTest-778005494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fda1115-dd6c-4cf1-a1cd-3908b7ea665f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:24:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1272624383',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78259178-f7f1-4156-93fa-d4f503e7e95c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75d3be08579343f799a00ca97efc27a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:24:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:24:50Z,use_quota=True,user_id='4929488fcbbe4dbdbead0a79f015b817',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:24:50 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-3bb3127f-4ec9-428f-b4bd-e5c7ef7cc8fb tempest-CreateVolumesFromImageTest-778005494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac88dec2-3379-4505-978a-ee11fb8f0680) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:24:50 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-3bb3127f-4ec9-428f-b4bd-e5c7ef7cc8fb tempest-CreateVolumesFromImageTest-778005494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac88dec2-3379-4505-978a-ee11fb8f0680) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:24:50 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-3bb3127f-4ec9-428f-b4bd-e5c7ef7cc8fb tempest-CreateVolumesFromImageTest-778005494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64484b52-bbec-41c6-903e-5fbb27cf40ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:24:50 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-3bb3127f-4ec9-428f-b4bd-e5c7ef7cc8fb tempest-CreateVolumesFromImageTest-778005494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64484b52-bbec-41c6-903e-5fbb27cf40ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '78259178-f7f1-4156-93fa-d4f503e7e95c', 'volume_name': 'volume-78259178-f7f1-4156-93fa-d4f503e7e95c', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:24:50 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-3bb3127f-4ec9-428f-b4bd-e5c7ef7cc8fb tempest-CreateVolumesFromImageTest-778005494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea5870bb-e7f0-47f2-b798-0ce243fd08aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:24:50 devstack sudo[99745]: pam_unix(sudo:session): session closed for user root Nov 04 10:24:50 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-3bb3127f-4ec9-428f-b4bd-e5c7ef7cc8fb tempest-CreateVolumesFromImageTest-778005494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea5870bb-e7f0-47f2-b798-0ce243fd08aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:24:50 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-3bb3127f-4ec9-428f-b4bd-e5c7ef7cc8fb tempest-CreateVolumesFromImageTest-778005494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9a9ba26-3078-4b6f-a73a-37118796b03d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:24:50 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-3bb3127f-4ec9-428f-b4bd-e5c7ef7cc8fb tempest-CreateVolumesFromImageTest-778005494 None] Volume 78259178-f7f1-4156-93fa-d4f503e7e95c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-78259178-f7f1-4156-93fa-d4f503e7e95c', 'volume_size': 1} Nov 04 10:24:50 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-3bb3127f-4ec9-428f-b4bd-e5c7ef7cc8fb tempest-CreateVolumesFromImageTest-778005494 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:24:50 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-066607ef-13bc-49be-ac4a-952768fb733a tempest-CreateVolumesFromImageTest-778005494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-251b1ccf-1f0a-4a27-94e4-332e026494c4 1073741824" returned: 0 in 1.034s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:24:50 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-066607ef-13bc-49be-ac4a-952768fb733a tempest-CreateVolumesFromImageTest-778005494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-251b1ccf-1f0a-4a27-94e4-332e026494c4 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:24:50 devstack sudo[99792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-251b1ccf-1f0a-4a27-94e4-332e026494c4 Nov 04 10:24:50 devstack sudo[99792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:24:51 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-8179918c-09b0-44cf-ba49-8608fea0be16 tempest-CreateVolumesFromImageTest-778005494 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:24:51 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-8179918c-09b0-44cf-ba49-8608fea0be16 tempest-CreateVolumesFromImageTest-778005494 None] Flow 'volume_create_manager' (2a3dea06-bfa8-43fd-b8bb-1b7c93675168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:24:51 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-8179918c-09b0-44cf-ba49-8608fea0be16 tempest-CreateVolumesFromImageTest-778005494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4656249-5178-4220-9dfa-a5008d682e16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:24:51 devstack sudo[99792]: pam_unix(sudo:session): session closed for user root Nov 04 10:24:51 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-8179918c-09b0-44cf-ba49-8608fea0be16 tempest-CreateVolumesFromImageTest-778005494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4656249-5178-4220-9dfa-a5008d682e16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:24:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2061378629',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5901325b-1c80-4989-b43f-fc29f9e23257,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75d3be08579343f799a00ca97efc27a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:24:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:24:51Z,use_quota=True,user_id='4929488fcbbe4dbdbead0a79f015b817',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:24:51 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-8179918c-09b0-44cf-ba49-8608fea0be16 tempest-CreateVolumesFromImageTest-778005494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df993f26-95be-424d-91fa-38309b9f99cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:24:51 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-8179918c-09b0-44cf-ba49-8608fea0be16 tempest-CreateVolumesFromImageTest-778005494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df993f26-95be-424d-91fa-38309b9f99cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:24:51 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-8179918c-09b0-44cf-ba49-8608fea0be16 tempest-CreateVolumesFromImageTest-778005494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f727714e-052f-4489-a4c5-09a5961a3b25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:24:51 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-8179918c-09b0-44cf-ba49-8608fea0be16 tempest-CreateVolumesFromImageTest-778005494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f727714e-052f-4489-a4c5-09a5961a3b25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5901325b-1c80-4989-b43f-fc29f9e23257', 'volume_name': 'volume-5901325b-1c80-4989-b43f-fc29f9e23257', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:24:51 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-8179918c-09b0-44cf-ba49-8608fea0be16 tempest-CreateVolumesFromImageTest-778005494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4b22cd8-b9ea-41d4-9fe5-b713867be49d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:24:51 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-8179918c-09b0-44cf-ba49-8608fea0be16 tempest-CreateVolumesFromImageTest-778005494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4b22cd8-b9ea-41d4-9fe5-b713867be49d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:24:51 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-8179918c-09b0-44cf-ba49-8608fea0be16 tempest-CreateVolumesFromImageTest-778005494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (975b3783-2ac5-410e-822c-7adc88372296) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:24:51 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-8179918c-09b0-44cf-ba49-8608fea0be16 tempest-CreateVolumesFromImageTest-778005494 None] Volume 5901325b-1c80-4989-b43f-fc29f9e23257: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5901325b-1c80-4989-b43f-fc29f9e23257', 'volume_size': 1} Nov 04 10:24:51 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-8179918c-09b0-44cf-ba49-8608fea0be16 tempest-CreateVolumesFromImageTest-778005494 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:24:51 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-066607ef-13bc-49be-ac4a-952768fb733a tempest-CreateVolumesFromImageTest-778005494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-251b1ccf-1f0a-4a27-94e4-332e026494c4" returned: 0 in 1.154s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:24:51 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-066607ef-13bc-49be-ac4a-952768fb733a tempest-CreateVolumesFromImageTest-778005494 None] <== create_volume: return (2295ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 10:24:51 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-066607ef-13bc-49be-ac4a-952768fb733a tempest-CreateVolumesFromImageTest-778005494 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.298s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:24:51 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-c7406cad-cdee-48d2-abe7-f817670274be tempest-VolumesDeleteCascade-2146450032 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.932s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:24:51 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-c7406cad-cdee-48d2-abe7-f817670274be tempest-VolumesDeleteCascade-2146450032 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:24:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1680738489',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f2c1287-1b56-4b7d-9024-b22e833093b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fdc968ee22341bdaa6192576bfcb30d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:24:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:24:49Z,use_quota=True,user_id='b760fe208cb04e798444643a284ba280',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 10:24:51 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-c7406cad-cdee-48d2-abe7-f817670274be tempest-VolumesDeleteCascade-2146450032 None] Creating volume 1f2c1287-1b56-4b7d-9024-b22e833093b3 {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:24:51 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-c7406cad-cdee-48d2-abe7-f817670274be tempest-VolumesDeleteCascade-2146450032 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:24:51 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-c7406cad-cdee-48d2-abe7-f817670274be tempest-VolumesDeleteCascade-2146450032 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:24:51 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-c7406cad-cdee-48d2-abe7-f817670274be tempest-VolumesDeleteCascade-2146450032 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:24:51 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-c7406cad-cdee-48d2-abe7-f817670274be tempest-VolumesDeleteCascade-2146450032 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:24:51 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-c7406cad-cdee-48d2-abe7-f817670274be tempest-VolumesDeleteCascade-2146450032 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:24:51 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-c7406cad-cdee-48d2-abe7-f817670274be tempest-VolumesDeleteCascade-2146450032 None] Selected osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:24:51 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-c7406cad-cdee-48d2-abe7-f817670274be tempest-VolumesDeleteCascade-2146450032 None] casted to osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 Nov 04 10:24:51 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c7406cad-cdee-48d2-abe7-f817670274be tempest-VolumesDeleteCascade-2146450032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-1f2c1287-1b56-4b7d-9024-b22e833093b3 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:24:51 devstack sudo[99818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-1f2c1287-1b56-4b7d-9024-b22e833093b3 1073741824 Nov 04 10:24:51 devstack sudo[99818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:24:51 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-066607ef-13bc-49be-ac4a-952768fb733a tempest-CreateVolumesFromImageTest-778005494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d873331c-515d-44a9-b0d5-46aa22de5f04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-251b1ccf-1f0a-4a27-94e4-332e026494c4', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:24:51 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-066607ef-13bc-49be-ac4a-952768fb733a tempest-CreateVolumesFromImageTest-778005494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5006f977-0f86-438b-8f67-e2f8473976db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:24:51 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-066607ef-13bc-49be-ac4a-952768fb733a tempest-CreateVolumesFromImageTest-778005494 None] Volume volume-251b1ccf-1f0a-4a27-94e4-332e026494c4 (251b1ccf-1f0a-4a27-94e4-332e026494c4): created successfully Nov 04 10:24:51 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-066607ef-13bc-49be-ac4a-952768fb733a tempest-CreateVolumesFromImageTest-778005494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5006f977-0f86-438b-8f67-e2f8473976db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:24:51 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-066607ef-13bc-49be-ac4a-952768fb733a tempest-CreateVolumesFromImageTest-778005494 None] Flow 'volume_create_manager' (b1f3c465-b3f3-434c-a706-24b0e75e92f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:24:51 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-066607ef-13bc-49be-ac4a-952768fb733a tempest-CreateVolumesFromImageTest-778005494 None] Created volume successfully. Nov 04 10:24:52 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-ebae8a8f-d9b4-4da5-b219-3a91fe7e7c66 tempest-CreateVolumesFromImageTest-778005494 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:24:52 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-ebae8a8f-d9b4-4da5-b219-3a91fe7e7c66 tempest-CreateVolumesFromImageTest-778005494 None] Flow 'volume_create_manager' (5ffb09e3-40c4-4b0b-a729-fc0687c23eee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:24:52 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-ebae8a8f-d9b4-4da5-b219-3a91fe7e7c66 tempest-CreateVolumesFromImageTest-778005494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbcc6ec3-292e-41e0-aad8-74635ecdd1e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:24:52 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-ebae8a8f-d9b4-4da5-b219-3a91fe7e7c66 tempest-CreateVolumesFromImageTest-778005494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbcc6ec3-292e-41e0-aad8-74635ecdd1e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:24:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-27227861',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45b0584c-067a-485a-a051-359c21f3406e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75d3be08579343f799a00ca97efc27a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:24:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:24:52Z,use_quota=True,user_id='4929488fcbbe4dbdbead0a79f015b817',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:24:52 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-ebae8a8f-d9b4-4da5-b219-3a91fe7e7c66 tempest-CreateVolumesFromImageTest-778005494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02cdb42b-39cb-4610-8e70-962a1681eb84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:24:52 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-ebae8a8f-d9b4-4da5-b219-3a91fe7e7c66 tempest-CreateVolumesFromImageTest-778005494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02cdb42b-39cb-4610-8e70-962a1681eb84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:24:52 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-ebae8a8f-d9b4-4da5-b219-3a91fe7e7c66 tempest-CreateVolumesFromImageTest-778005494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9be734e-0cd7-4786-9100-8a82577dab35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:24:52 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-ebae8a8f-d9b4-4da5-b219-3a91fe7e7c66 tempest-CreateVolumesFromImageTest-778005494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9be734e-0cd7-4786-9100-8a82577dab35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45b0584c-067a-485a-a051-359c21f3406e', 'volume_name': 'volume-45b0584c-067a-485a-a051-359c21f3406e', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:24:52 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-ebae8a8f-d9b4-4da5-b219-3a91fe7e7c66 tempest-CreateVolumesFromImageTest-778005494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef2ad077-3a13-4b43-8662-e0248c3019c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:24:52 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-ebae8a8f-d9b4-4da5-b219-3a91fe7e7c66 tempest-CreateVolumesFromImageTest-778005494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef2ad077-3a13-4b43-8662-e0248c3019c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:24:52 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-ebae8a8f-d9b4-4da5-b219-3a91fe7e7c66 tempest-CreateVolumesFromImageTest-778005494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (658b87cd-92d7-4b58-8a04-a864dd90e048) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:24:52 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-ebae8a8f-d9b4-4da5-b219-3a91fe7e7c66 tempest-CreateVolumesFromImageTest-778005494 None] Volume 45b0584c-067a-485a-a051-359c21f3406e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45b0584c-067a-485a-a051-359c21f3406e', 'volume_size': 1} Nov 04 10:24:52 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-ebae8a8f-d9b4-4da5-b219-3a91fe7e7c66 tempest-CreateVolumesFromImageTest-778005494 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:24:52 devstack sudo[99818]: pam_unix(sudo:session): session closed for user root Nov 04 10:24:52 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c7406cad-cdee-48d2-abe7-f817670274be tempest-VolumesDeleteCascade-2146450032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-1f2c1287-1b56-4b7d-9024-b22e833093b3 1073741824" returned: 0 in 0.948s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:24:52 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c7406cad-cdee-48d2-abe7-f817670274be tempest-VolumesDeleteCascade-2146450032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-1f2c1287-1b56-4b7d-9024-b22e833093b3 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:24:52 devstack sudo[99830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-1f2c1287-1b56-4b7d-9024-b22e833093b3 Nov 04 10:24:52 devstack sudo[99830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:24:53 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed87a701-b281-497d-b906-564f8881c5be tempest-CreateVolumesFromImageTest-778005494 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:24:53 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-ed87a701-b281-497d-b906-564f8881c5be tempest-CreateVolumesFromImageTest-778005494 None] Flow 'volume_create_manager' (ef6c957f-7c14-49fe-a2f0-5c934388fdc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:24:53 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-ed87a701-b281-497d-b906-564f8881c5be tempest-CreateVolumesFromImageTest-778005494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f94cb3fd-4eda-4f6e-85b9-1875a9c3f666) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:24:53 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-ed87a701-b281-497d-b906-564f8881c5be tempest-CreateVolumesFromImageTest-778005494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f94cb3fd-4eda-4f6e-85b9-1875a9c3f666) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:24:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-913232561',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5622f731-220f-4044-9da6-e10cccb54ca6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75d3be08579343f799a00ca97efc27a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:24:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:24:53Z,use_quota=True,user_id='4929488fcbbe4dbdbead0a79f015b817',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:24:53 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-ed87a701-b281-497d-b906-564f8881c5be tempest-CreateVolumesFromImageTest-778005494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14a8c4b4-93dd-4735-8231-cdfc905ab22f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:24:53 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-ed87a701-b281-497d-b906-564f8881c5be tempest-CreateVolumesFromImageTest-778005494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14a8c4b4-93dd-4735-8231-cdfc905ab22f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:24:53 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-ed87a701-b281-497d-b906-564f8881c5be tempest-CreateVolumesFromImageTest-778005494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33ac1ac7-9e8d-4b2a-b105-183acb11c49a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:24:53 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-ed87a701-b281-497d-b906-564f8881c5be tempest-CreateVolumesFromImageTest-778005494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33ac1ac7-9e8d-4b2a-b105-183acb11c49a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5622f731-220f-4044-9da6-e10cccb54ca6', 'volume_name': 'volume-5622f731-220f-4044-9da6-e10cccb54ca6', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:24:53 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-ed87a701-b281-497d-b906-564f8881c5be tempest-CreateVolumesFromImageTest-778005494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7001d720-89aa-408a-aa83-6b7b2bb3ac07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:24:53 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-ed87a701-b281-497d-b906-564f8881c5be tempest-CreateVolumesFromImageTest-778005494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7001d720-89aa-408a-aa83-6b7b2bb3ac07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:24:53 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-ed87a701-b281-497d-b906-564f8881c5be tempest-CreateVolumesFromImageTest-778005494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49e63b50-f7c7-4ad4-8181-f53a62a73e3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:24:53 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-ed87a701-b281-497d-b906-564f8881c5be tempest-CreateVolumesFromImageTest-778005494 None] Volume 5622f731-220f-4044-9da6-e10cccb54ca6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5622f731-220f-4044-9da6-e10cccb54ca6', 'volume_size': 1} Nov 04 10:24:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-ed87a701-b281-497d-b906-564f8881c5be tempest-CreateVolumesFromImageTest-778005494 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:24:53 devstack sudo[99830]: pam_unix(sudo:session): session closed for user root Nov 04 10:24:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c7406cad-cdee-48d2-abe7-f817670274be tempest-VolumesDeleteCascade-2146450032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-1f2c1287-1b56-4b7d-9024-b22e833093b3" returned: 0 in 0.521s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:24:53 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-c7406cad-cdee-48d2-abe7-f817670274be tempest-VolumesDeleteCascade-2146450032 None] <== create_volume: return (1564ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 10:24:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-c7406cad-cdee-48d2-abe7-f817670274be tempest-VolumesDeleteCascade-2146450032 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.567s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:24:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-3bb3127f-4ec9-428f-b4bd-e5c7ef7cc8fb tempest-CreateVolumesFromImageTest-778005494 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.828s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:24:53 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-3bb3127f-4ec9-428f-b4bd-e5c7ef7cc8fb tempest-CreateVolumesFromImageTest-778005494 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:24:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1272624383',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78259178-f7f1-4156-93fa-d4f503e7e95c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75d3be08579343f799a00ca97efc27a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:24:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:24:50Z,use_quota=True,user_id='4929488fcbbe4dbdbead0a79f015b817',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 10:24:53 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-3bb3127f-4ec9-428f-b4bd-e5c7ef7cc8fb tempest-CreateVolumesFromImageTest-778005494 None] Creating volume 78259178-f7f1-4156-93fa-d4f503e7e95c {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:24:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-3bb3127f-4ec9-428f-b4bd-e5c7ef7cc8fb tempest-CreateVolumesFromImageTest-778005494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:24:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-3bb3127f-4ec9-428f-b4bd-e5c7ef7cc8fb tempest-CreateVolumesFromImageTest-778005494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:24:53 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-3bb3127f-4ec9-428f-b4bd-e5c7ef7cc8fb tempest-CreateVolumesFromImageTest-778005494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:24:53 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-3bb3127f-4ec9-428f-b4bd-e5c7ef7cc8fb tempest-CreateVolumesFromImageTest-778005494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:24:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-3bb3127f-4ec9-428f-b4bd-e5c7ef7cc8fb tempest-CreateVolumesFromImageTest-778005494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:24:53 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-3bb3127f-4ec9-428f-b4bd-e5c7ef7cc8fb tempest-CreateVolumesFromImageTest-778005494 None] Selected osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:24:53 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-3bb3127f-4ec9-428f-b4bd-e5c7ef7cc8fb tempest-CreateVolumesFromImageTest-778005494 None] casted to osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 Nov 04 10:24:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-3bb3127f-4ec9-428f-b4bd-e5c7ef7cc8fb tempest-CreateVolumesFromImageTest-778005494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-78259178-f7f1-4156-93fa-d4f503e7e95c 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:24:53 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c7406cad-cdee-48d2-abe7-f817670274be tempest-VolumesDeleteCascade-2146450032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffe1ce06-e084-4aaa-a527-7fcc2196f62f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f2c1287-1b56-4b7d-9024-b22e833093b3', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:24:53 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c7406cad-cdee-48d2-abe7-f817670274be tempest-VolumesDeleteCascade-2146450032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (451c8fa3-7cc0-4835-9843-5447cfeb6925) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:24:53 devstack sudo[99833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-78259178-f7f1-4156-93fa-d4f503e7e95c 1073741824 Nov 04 10:24:53 devstack sudo[99833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:24:53 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-c7406cad-cdee-48d2-abe7-f817670274be tempest-VolumesDeleteCascade-2146450032 None] Volume volume-1f2c1287-1b56-4b7d-9024-b22e833093b3 (1f2c1287-1b56-4b7d-9024-b22e833093b3): created successfully Nov 04 10:24:53 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c7406cad-cdee-48d2-abe7-f817670274be tempest-VolumesDeleteCascade-2146450032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (451c8fa3-7cc0-4835-9843-5447cfeb6925) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:24:53 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c7406cad-cdee-48d2-abe7-f817670274be tempest-VolumesDeleteCascade-2146450032 None] Flow 'volume_create_manager' (5c9ee025-2fca-4950-81f5-bf8173f68b34) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:24:53 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-c7406cad-cdee-48d2-abe7-f817670274be tempest-VolumesDeleteCascade-2146450032 None] Created volume successfully. Nov 04 10:24:53 devstack cinder-volume[87068]: DEBUG oslo_service.periodic_task [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87068) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 10:24:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:24:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:24:53 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:24:53 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:24:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:24:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:24:53 devstack sudo[99833]: pam_unix(sudo:session): session closed for user root Nov 04 10:24:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-3bb3127f-4ec9-428f-b4bd-e5c7ef7cc8fb tempest-CreateVolumesFromImageTest-778005494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-78259178-f7f1-4156-93fa-d4f503e7e95c 1073741824" returned: 0 in 0.607s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:24:53 devstack sudo[99839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:24:53 devstack sudo[99839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:24:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-3bb3127f-4ec9-428f-b4bd-e5c7ef7cc8fb tempest-CreateVolumesFromImageTest-778005494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-78259178-f7f1-4156-93fa-d4f503e7e95c {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:24:53 devstack sudo[99841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-78259178-f7f1-4156-93fa-d4f503e7e95c Nov 04 10:24:53 devstack sudo[99841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:24:54 devstack sudo[99839]: pam_unix(sudo:session): session closed for user root Nov 04 10:24:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.451s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:24:54 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:24:54 devstack cinder-volume[87068]: DEBUG oslo_service.periodic_task [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Running periodic task VolumeManager._thread_info {{(pid=87068) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 10:24:54 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] thread count: 28 {{(pid=87068) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 04 10:24:54 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] thread info: [<_MainThread(MainThread, started 126275656192128)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87068) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 04 10:24:54 devstack sudo[99841]: pam_unix(sudo:session): session closed for user root Nov 04 10:24:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-3bb3127f-4ec9-428f-b4bd-e5c7ef7cc8fb tempest-CreateVolumesFromImageTest-778005494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-78259178-f7f1-4156-93fa-d4f503e7e95c" returned: 0 in 0.537s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:24:54 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-3bb3127f-4ec9-428f-b4bd-e5c7ef7cc8fb tempest-CreateVolumesFromImageTest-778005494 None] <== create_volume: return (1213ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 10:24:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-3bb3127f-4ec9-428f-b4bd-e5c7ef7cc8fb tempest-CreateVolumesFromImageTest-778005494 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.216s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:24:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-8179918c-09b0-44cf-ba49-8608fea0be16 tempest-CreateVolumesFromImageTest-778005494 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.801s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:24:54 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-8179918c-09b0-44cf-ba49-8608fea0be16 tempest-CreateVolumesFromImageTest-778005494 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:24:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2061378629',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5901325b-1c80-4989-b43f-fc29f9e23257,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75d3be08579343f799a00ca97efc27a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:24:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:24:51Z,use_quota=True,user_id='4929488fcbbe4dbdbead0a79f015b817',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 10:24:54 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-8179918c-09b0-44cf-ba49-8608fea0be16 tempest-CreateVolumesFromImageTest-778005494 None] Creating volume 5901325b-1c80-4989-b43f-fc29f9e23257 {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:24:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-8179918c-09b0-44cf-ba49-8608fea0be16 tempest-CreateVolumesFromImageTest-778005494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:24:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-8179918c-09b0-44cf-ba49-8608fea0be16 tempest-CreateVolumesFromImageTest-778005494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:24:54 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-8179918c-09b0-44cf-ba49-8608fea0be16 tempest-CreateVolumesFromImageTest-778005494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:24:54 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-8179918c-09b0-44cf-ba49-8608fea0be16 tempest-CreateVolumesFromImageTest-778005494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:24:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-8179918c-09b0-44cf-ba49-8608fea0be16 tempest-CreateVolumesFromImageTest-778005494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:24:54 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-8179918c-09b0-44cf-ba49-8608fea0be16 tempest-CreateVolumesFromImageTest-778005494 None] Selected osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:24:54 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-8179918c-09b0-44cf-ba49-8608fea0be16 tempest-CreateVolumesFromImageTest-778005494 None] casted to osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 Nov 04 10:24:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-8179918c-09b0-44cf-ba49-8608fea0be16 tempest-CreateVolumesFromImageTest-778005494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-5901325b-1c80-4989-b43f-fc29f9e23257 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:24:54 devstack sudo[99845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-5901325b-1c80-4989-b43f-fc29f9e23257 1073741824 Nov 04 10:24:54 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-3bb3127f-4ec9-428f-b4bd-e5c7ef7cc8fb tempest-CreateVolumesFromImageTest-778005494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9a9ba26-3078-4b6f-a73a-37118796b03d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78259178-f7f1-4156-93fa-d4f503e7e95c', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:24:54 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-3bb3127f-4ec9-428f-b4bd-e5c7ef7cc8fb tempest-CreateVolumesFromImageTest-778005494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48ec9816-6dd7-42dc-a0e5-c42cc251461d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:24:54 devstack sudo[99845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:24:54 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-3bb3127f-4ec9-428f-b4bd-e5c7ef7cc8fb tempest-CreateVolumesFromImageTest-778005494 None] Volume volume-78259178-f7f1-4156-93fa-d4f503e7e95c (78259178-f7f1-4156-93fa-d4f503e7e95c): created successfully Nov 04 10:24:54 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-3bb3127f-4ec9-428f-b4bd-e5c7ef7cc8fb tempest-CreateVolumesFromImageTest-778005494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48ec9816-6dd7-42dc-a0e5-c42cc251461d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:24:54 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-3bb3127f-4ec9-428f-b4bd-e5c7ef7cc8fb tempest-CreateVolumesFromImageTest-778005494 None] Flow 'volume_create_manager' (41bb0d1e-2f2e-40e4-ba10-366dcc64bb35) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:24:54 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-3bb3127f-4ec9-428f-b4bd-e5c7ef7cc8fb tempest-CreateVolumesFromImageTest-778005494 None] Created volume successfully. Nov 04 10:24:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-cfa1001a-e703-409a-b3db-c394e75c06d5 tempest-VolumesDeleteCascade-2146450032 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:24:55 devstack sudo[99845]: pam_unix(sudo:session): session closed for user root Nov 04 10:24:55 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-8179918c-09b0-44cf-ba49-8608fea0be16 tempest-CreateVolumesFromImageTest-778005494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-5901325b-1c80-4989-b43f-fc29f9e23257 1073741824" returned: 0 in 0.753s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:24:55 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-8179918c-09b0-44cf-ba49-8608fea0be16 tempest-CreateVolumesFromImageTest-778005494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-5901325b-1c80-4989-b43f-fc29f9e23257 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:24:55 devstack sudo[99851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-5901325b-1c80-4989-b43f-fc29f9e23257 Nov 04 10:24:55 devstack sudo[99851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:24:55 devstack sudo[99851]: pam_unix(sudo:session): session closed for user root Nov 04 10:24:55 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-8179918c-09b0-44cf-ba49-8608fea0be16 tempest-CreateVolumesFromImageTest-778005494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-5901325b-1c80-4989-b43f-fc29f9e23257" returned: 0 in 0.361s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:24:55 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-8179918c-09b0-44cf-ba49-8608fea0be16 tempest-CreateVolumesFromImageTest-778005494 None] <== create_volume: return (1194ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 10:24:55 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-8179918c-09b0-44cf-ba49-8608fea0be16 tempest-CreateVolumesFromImageTest-778005494 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.199s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:24:55 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-ebae8a8f-d9b4-4da5-b219-3a91fe7e7c66 tempest-CreateVolumesFromImageTest-778005494 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.295s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:24:55 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-ebae8a8f-d9b4-4da5-b219-3a91fe7e7c66 tempest-CreateVolumesFromImageTest-778005494 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:24:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-27227861',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45b0584c-067a-485a-a051-359c21f3406e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75d3be08579343f799a00ca97efc27a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:24:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:24:52Z,use_quota=True,user_id='4929488fcbbe4dbdbead0a79f015b817',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 10:24:55 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-ebae8a8f-d9b4-4da5-b219-3a91fe7e7c66 tempest-CreateVolumesFromImageTest-778005494 None] Creating volume 45b0584c-067a-485a-a051-359c21f3406e {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:24:55 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-ebae8a8f-d9b4-4da5-b219-3a91fe7e7c66 tempest-CreateVolumesFromImageTest-778005494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:24:55 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-ebae8a8f-d9b4-4da5-b219-3a91fe7e7c66 tempest-CreateVolumesFromImageTest-778005494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:24:55 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-ebae8a8f-d9b4-4da5-b219-3a91fe7e7c66 tempest-CreateVolumesFromImageTest-778005494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:24:55 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-ebae8a8f-d9b4-4da5-b219-3a91fe7e7c66 tempest-CreateVolumesFromImageTest-778005494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:24:55 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-ebae8a8f-d9b4-4da5-b219-3a91fe7e7c66 tempest-CreateVolumesFromImageTest-778005494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:24:55 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-ebae8a8f-d9b4-4da5-b219-3a91fe7e7c66 tempest-CreateVolumesFromImageTest-778005494 None] Selected osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:24:55 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-ebae8a8f-d9b4-4da5-b219-3a91fe7e7c66 tempest-CreateVolumesFromImageTest-778005494 None] casted to osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 Nov 04 10:24:55 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ebae8a8f-d9b4-4da5-b219-3a91fe7e7c66 tempest-CreateVolumesFromImageTest-778005494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-45b0584c-067a-485a-a051-359c21f3406e 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:24:55 devstack sudo[99854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-45b0584c-067a-485a-a051-359c21f3406e 1073741824 Nov 04 10:24:55 devstack sudo[99854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:24:55 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-8179918c-09b0-44cf-ba49-8608fea0be16 tempest-CreateVolumesFromImageTest-778005494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (975b3783-2ac5-410e-822c-7adc88372296) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5901325b-1c80-4989-b43f-fc29f9e23257', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:24:55 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-8179918c-09b0-44cf-ba49-8608fea0be16 tempest-CreateVolumesFromImageTest-778005494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0c3bbe5-b4ce-4969-8faa-ecea3622f3bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:24:55 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-8179918c-09b0-44cf-ba49-8608fea0be16 tempest-CreateVolumesFromImageTest-778005494 None] Volume volume-5901325b-1c80-4989-b43f-fc29f9e23257 (5901325b-1c80-4989-b43f-fc29f9e23257): created successfully Nov 04 10:24:55 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-8179918c-09b0-44cf-ba49-8608fea0be16 tempest-CreateVolumesFromImageTest-778005494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0c3bbe5-b4ce-4969-8faa-ecea3622f3bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:24:55 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-8179918c-09b0-44cf-ba49-8608fea0be16 tempest-CreateVolumesFromImageTest-778005494 None] Flow 'volume_create_manager' (2a3dea06-bfa8-43fd-b8bb-1b7c93675168) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:24:55 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-8179918c-09b0-44cf-ba49-8608fea0be16 tempest-CreateVolumesFromImageTest-778005494 None] Created volume successfully. Nov 04 10:24:56 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c8bbf9c-83a0-4509-bce3-5778ca839413 tempest-TestMinimumBasicScenario-512484155 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:24:56 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7c8bbf9c-83a0-4509-bce3-5778ca839413 tempest-TestMinimumBasicScenario-512484155 None] Flow 'volume_create_manager' (b5dfae17-e081-40d6-b87a-99258a00ee8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:24:56 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7c8bbf9c-83a0-4509-bce3-5778ca839413 tempest-TestMinimumBasicScenario-512484155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7791ca4e-5f79-43ee-a0c8-a090f8297524) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:24:56 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7c8bbf9c-83a0-4509-bce3-5778ca839413 tempest-TestMinimumBasicScenario-512484155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7791ca4e-5f79-43ee-a0c8-a090f8297524) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:24:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1890480864',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=586e6856-2f98-4f89-b780-87737887804c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30508c79e7db4c39b7a288571a979a4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:24:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:24:56Z,use_quota=True,user_id='d81301c3b06f4355b4dd219e74f0682b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:24:56 devstack sudo[99854]: pam_unix(sudo:session): session closed for user root Nov 04 10:24:56 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7c8bbf9c-83a0-4509-bce3-5778ca839413 tempest-TestMinimumBasicScenario-512484155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (356cfc45-19d3-4eaa-acc7-4c086ba83c35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:24:56 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7c8bbf9c-83a0-4509-bce3-5778ca839413 tempest-TestMinimumBasicScenario-512484155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (356cfc45-19d3-4eaa-acc7-4c086ba83c35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:24:56 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7c8bbf9c-83a0-4509-bce3-5778ca839413 tempest-TestMinimumBasicScenario-512484155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1caba08-2cb8-4a4e-b8cf-930f754b99b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:24:56 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7c8bbf9c-83a0-4509-bce3-5778ca839413 tempest-TestMinimumBasicScenario-512484155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1caba08-2cb8-4a4e-b8cf-930f754b99b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '586e6856-2f98-4f89-b780-87737887804c', 'volume_name': 'volume-586e6856-2f98-4f89-b780-87737887804c', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:24:56 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7c8bbf9c-83a0-4509-bce3-5778ca839413 tempest-TestMinimumBasicScenario-512484155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a20da3e3-7323-4ab3-89ac-b0cd470f1b32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:24:56 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7c8bbf9c-83a0-4509-bce3-5778ca839413 tempest-TestMinimumBasicScenario-512484155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a20da3e3-7323-4ab3-89ac-b0cd470f1b32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:24:56 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7c8bbf9c-83a0-4509-bce3-5778ca839413 tempest-TestMinimumBasicScenario-512484155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9eb925ff-ba4f-4d62-95d3-c84ae5b087ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:24:56 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-7c8bbf9c-83a0-4509-bce3-5778ca839413 tempest-TestMinimumBasicScenario-512484155 None] Volume 586e6856-2f98-4f89-b780-87737887804c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-586e6856-2f98-4f89-b780-87737887804c', 'volume_size': 1} Nov 04 10:24:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-7c8bbf9c-83a0-4509-bce3-5778ca839413 tempest-TestMinimumBasicScenario-512484155 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:24:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ebae8a8f-d9b4-4da5-b219-3a91fe7e7c66 tempest-CreateVolumesFromImageTest-778005494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-45b0584c-067a-485a-a051-359c21f3406e 1073741824" returned: 0 in 0.607s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:24:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ebae8a8f-d9b4-4da5-b219-3a91fe7e7c66 tempest-CreateVolumesFromImageTest-778005494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-45b0584c-067a-485a-a051-359c21f3406e {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:24:56 devstack sudo[99860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-45b0584c-067a-485a-a051-359c21f3406e Nov 04 10:24:56 devstack sudo[99860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:24:56 devstack sudo[99860]: pam_unix(sudo:session): session closed for user root Nov 04 10:24:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ebae8a8f-d9b4-4da5-b219-3a91fe7e7c66 tempest-CreateVolumesFromImageTest-778005494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-45b0584c-067a-485a-a051-359c21f3406e" returned: 0 in 0.264s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:24:56 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-ebae8a8f-d9b4-4da5-b219-3a91fe7e7c66 tempest-CreateVolumesFromImageTest-778005494 None] <== create_volume: return (937ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 10:24:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-ebae8a8f-d9b4-4da5-b219-3a91fe7e7c66 tempest-CreateVolumesFromImageTest-778005494 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.946s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:24:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-ed87a701-b281-497d-b906-564f8881c5be tempest-CreateVolumesFromImageTest-778005494 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.464s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:24:56 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-ed87a701-b281-497d-b906-564f8881c5be tempest-CreateVolumesFromImageTest-778005494 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:24:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-913232561',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5622f731-220f-4044-9da6-e10cccb54ca6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75d3be08579343f799a00ca97efc27a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:24:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:24:53Z,use_quota=True,user_id='4929488fcbbe4dbdbead0a79f015b817',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 10:24:56 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-ed87a701-b281-497d-b906-564f8881c5be tempest-CreateVolumesFromImageTest-778005494 None] Creating volume 5622f731-220f-4044-9da6-e10cccb54ca6 {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:24:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-ed87a701-b281-497d-b906-564f8881c5be tempest-CreateVolumesFromImageTest-778005494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:24:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-ed87a701-b281-497d-b906-564f8881c5be tempest-CreateVolumesFromImageTest-778005494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:24:56 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-ed87a701-b281-497d-b906-564f8881c5be tempest-CreateVolumesFromImageTest-778005494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:24:56 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-ed87a701-b281-497d-b906-564f8881c5be tempest-CreateVolumesFromImageTest-778005494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:24:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-ed87a701-b281-497d-b906-564f8881c5be tempest-CreateVolumesFromImageTest-778005494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:24:56 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-ed87a701-b281-497d-b906-564f8881c5be tempest-CreateVolumesFromImageTest-778005494 None] Selected osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:24:56 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-ed87a701-b281-497d-b906-564f8881c5be tempest-CreateVolumesFromImageTest-778005494 None] casted to osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 Nov 04 10:24:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ed87a701-b281-497d-b906-564f8881c5be tempest-CreateVolumesFromImageTest-778005494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-5622f731-220f-4044-9da6-e10cccb54ca6 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:24:56 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-ebae8a8f-d9b4-4da5-b219-3a91fe7e7c66 tempest-CreateVolumesFromImageTest-778005494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (658b87cd-92d7-4b58-8a04-a864dd90e048) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45b0584c-067a-485a-a051-359c21f3406e', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:24:56 devstack sudo[99863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-5622f731-220f-4044-9da6-e10cccb54ca6 1073741824 Nov 04 10:24:56 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-ebae8a8f-d9b4-4da5-b219-3a91fe7e7c66 tempest-CreateVolumesFromImageTest-778005494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (641407f5-335b-4381-a27a-d7cf084f3d96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:24:56 devstack sudo[99863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:24:56 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-ebae8a8f-d9b4-4da5-b219-3a91fe7e7c66 tempest-CreateVolumesFromImageTest-778005494 None] Volume volume-45b0584c-067a-485a-a051-359c21f3406e (45b0584c-067a-485a-a051-359c21f3406e): created successfully Nov 04 10:24:56 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-ebae8a8f-d9b4-4da5-b219-3a91fe7e7c66 tempest-CreateVolumesFromImageTest-778005494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (641407f5-335b-4381-a27a-d7cf084f3d96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:24:56 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-ebae8a8f-d9b4-4da5-b219-3a91fe7e7c66 tempest-CreateVolumesFromImageTest-778005494 None] Flow 'volume_create_manager' (5ffb09e3-40c4-4b0b-a729-fc0687c23eee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:24:56 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-ebae8a8f-d9b4-4da5-b219-3a91fe7e7c66 tempest-CreateVolumesFromImageTest-778005494 None] Created volume successfully. Nov 04 10:24:57 devstack sudo[99863]: pam_unix(sudo:session): session closed for user root Nov 04 10:24:57 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ed87a701-b281-497d-b906-564f8881c5be tempest-CreateVolumesFromImageTest-778005494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-5622f731-220f-4044-9da6-e10cccb54ca6 1073741824" returned: 0 in 0.552s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:24:57 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ed87a701-b281-497d-b906-564f8881c5be tempest-CreateVolumesFromImageTest-778005494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-5622f731-220f-4044-9da6-e10cccb54ca6 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:24:57 devstack sudo[99868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-5622f731-220f-4044-9da6-e10cccb54ca6 Nov 04 10:24:57 devstack sudo[99868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:24:57 devstack sudo[99868]: pam_unix(sudo:session): session closed for user root Nov 04 10:24:57 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ed87a701-b281-497d-b906-564f8881c5be tempest-CreateVolumesFromImageTest-778005494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-5622f731-220f-4044-9da6-e10cccb54ca6" returned: 0 in 0.334s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:24:57 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-ed87a701-b281-497d-b906-564f8881c5be tempest-CreateVolumesFromImageTest-778005494 None] <== create_volume: return (960ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 10:24:57 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-ed87a701-b281-497d-b906-564f8881c5be tempest-CreateVolumesFromImageTest-778005494 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.964s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:24:57 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-cfa1001a-e703-409a-b3db-c394e75c06d5 tempest-VolumesDeleteCascade-2146450032 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.896s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:24:57 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-ed87a701-b281-497d-b906-564f8881c5be tempest-CreateVolumesFromImageTest-778005494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49e63b50-f7c7-4ad4-8181-f53a62a73e3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5622f731-220f-4044-9da6-e10cccb54ca6', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:24:57 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-ed87a701-b281-497d-b906-564f8881c5be tempest-CreateVolumesFromImageTest-778005494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (558a1e2d-ad36-4d7d-9501-c770d6a022eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:24:57 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-cfa1001a-e703-409a-b3db-c394e75c06d5 tempest-VolumesDeleteCascade-2146450032 None] Creating offline snapshot 67e553e4-377f-44a0-b424-b6dee84089f0 of volume 1f2c1287-1b56-4b7d-9024-b22e833093b3 {{(pid=87068) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 10:24:57 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-ed87a701-b281-497d-b906-564f8881c5be tempest-CreateVolumesFromImageTest-778005494 None] Volume volume-5622f731-220f-4044-9da6-e10cccb54ca6 (5622f731-220f-4044-9da6-e10cccb54ca6): created successfully Nov 04 10:24:57 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-ed87a701-b281-497d-b906-564f8881c5be tempest-CreateVolumesFromImageTest-778005494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (558a1e2d-ad36-4d7d-9501-c770d6a022eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:24:57 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-ed87a701-b281-497d-b906-564f8881c5be tempest-CreateVolumesFromImageTest-778005494 None] Flow 'volume_create_manager' (ef6c957f-7c14-49fe-a2f0-5c934388fdc9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:24:57 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1ed0e3c-395d-4ed9-848b-a12b5438d97c]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:24:57 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-cfa1001a-e703-409a-b3db-c394e75c06d5 tempest-VolumesDeleteCascade-2146450032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-1f2c1287-1b56-4b7d-9024-b22e833093b3 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:24:57 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-ed87a701-b281-497d-b906-564f8881c5be tempest-CreateVolumesFromImageTest-778005494 None] Created volume successfully. Nov 04 10:24:57 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-96aab0f2-878a-4829-ae07-148cfedea8ad tempest-CreateVolumesFromImageTest-778005494 None] Acquiring lock "cinder-5622f731-220f-4044-9da6-e10cccb54ca6-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:24:57 devstack sudo[99872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-1f2c1287-1b56-4b7d-9024-b22e833093b3 Nov 04 10:24:57 devstack sudo[99872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:24:57 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-96aab0f2-878a-4829-ae07-148cfedea8ad tempest-CreateVolumesFromImageTest-778005494 None] Lock "cinder-5622f731-220f-4044-9da6-e10cccb54ca6-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:24:57 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-96aab0f2-878a-4829-ae07-148cfedea8ad tempest-CreateVolumesFromImageTest-778005494 None] Acquiring lock "cinder-quobyte-5622f731-220f-4044-9da6-e10cccb54ca6" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:24:57 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-96aab0f2-878a-4829-ae07-148cfedea8ad tempest-CreateVolumesFromImageTest-778005494 None] Lock "cinder-quobyte-5622f731-220f-4044-9da6-e10cccb54ca6" acquired by "delete_volume" :: waited 0.023s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:24:57 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e3795fa-db0f-44a6-a56a-8a34677ac228]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:24:57 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-96aab0f2-878a-4829-ae07-148cfedea8ad tempest-CreateVolumesFromImageTest-778005494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-5622f731-220f-4044-9da6-e10cccb54ca6 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:24:58 devstack sudo[99872]: pam_unix(sudo:session): session closed for user root Nov 04 10:24:58 devstack sudo[99874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-5622f731-220f-4044-9da6-e10cccb54ca6 Nov 04 10:24:58 devstack sudo[99874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:24:58 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-cfa1001a-e703-409a-b3db-c394e75c06d5 tempest-VolumesDeleteCascade-2146450032 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-1f2c1287-1b56-4b7d-9024-b22e833093b3" returned: 0 in 0.635s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:24:58 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-cfa1001a-e703-409a-b3db-c394e75c06d5 tempest-VolumesDeleteCascade-2146450032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-1f2c1287-1b56-4b7d-9024-b22e833093b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-1f2c1287-1b56-4b7d-9024-b22e833093b3.67e553e4-377f-44a0-b424-b6dee84089f0 1G {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:24:58 devstack sudo[99880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-1f2c1287-1b56-4b7d-9024-b22e833093b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-1f2c1287-1b56-4b7d-9024-b22e833093b3.67e553e4-377f-44a0-b424-b6dee84089f0 1G Nov 04 10:24:58 devstack sudo[99880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:24:58 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-12706ba7-11ad-4f6c-a844-eb8676a14d3a tempest-ProjectReaderTests-1505730503 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:24:58 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-12706ba7-11ad-4f6c-a844-eb8676a14d3a tempest-ProjectReaderTests-1505730503 None] Flow 'volume_create_manager' (40c4d917-9a57-464f-bb6e-21089b983ed0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:24:58 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-12706ba7-11ad-4f6c-a844-eb8676a14d3a tempest-ProjectReaderTests-1505730503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (deba93e4-0fe3-4242-b3de-f98f904a267f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:24:58 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-12706ba7-11ad-4f6c-a844-eb8676a14d3a tempest-ProjectReaderTests-1505730503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (deba93e4-0fe3-4242-b3de-f98f904a267f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:24:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-340261224',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71ff4e6b-4548-4974-bd7d-5f06074ea0db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4e0b63f17594427a2929254e282322b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:24:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:24:58Z,use_quota=True,user_id='d92d849e895242e7b6d98621572cde14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:24:58 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-12706ba7-11ad-4f6c-a844-eb8676a14d3a tempest-ProjectReaderTests-1505730503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d324b615-a529-4d0c-98f9-1043d3e72813) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:24:58 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-12706ba7-11ad-4f6c-a844-eb8676a14d3a tempest-ProjectReaderTests-1505730503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d324b615-a529-4d0c-98f9-1043d3e72813) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:24:58 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-12706ba7-11ad-4f6c-a844-eb8676a14d3a tempest-ProjectReaderTests-1505730503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3da99709-f560-43f6-a625-1cd2965579da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:24:58 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-12706ba7-11ad-4f6c-a844-eb8676a14d3a tempest-ProjectReaderTests-1505730503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3da99709-f560-43f6-a625-1cd2965579da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '71ff4e6b-4548-4974-bd7d-5f06074ea0db', 'volume_name': 'volume-71ff4e6b-4548-4974-bd7d-5f06074ea0db', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:24:58 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-12706ba7-11ad-4f6c-a844-eb8676a14d3a tempest-ProjectReaderTests-1505730503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3955b2c-4522-4eb7-86ce-875d30d03ea0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:24:58 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-12706ba7-11ad-4f6c-a844-eb8676a14d3a tempest-ProjectReaderTests-1505730503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3955b2c-4522-4eb7-86ce-875d30d03ea0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:24:58 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-12706ba7-11ad-4f6c-a844-eb8676a14d3a tempest-ProjectReaderTests-1505730503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6f51d33-d641-452f-8755-d3f60b7719c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:24:58 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-12706ba7-11ad-4f6c-a844-eb8676a14d3a tempest-ProjectReaderTests-1505730503 None] Volume 71ff4e6b-4548-4974-bd7d-5f06074ea0db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-71ff4e6b-4548-4974-bd7d-5f06074ea0db', 'volume_size': 1} Nov 04 10:24:58 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-12706ba7-11ad-4f6c-a844-eb8676a14d3a tempest-ProjectReaderTests-1505730503 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:24:58 devstack sudo[99874]: pam_unix(sudo:session): session closed for user root Nov 04 10:24:58 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-96aab0f2-878a-4829-ae07-148cfedea8ad tempest-CreateVolumesFromImageTest-778005494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-5622f731-220f-4044-9da6-e10cccb54ca6" returned: 0 in 0.607s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:24:58 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-96aab0f2-878a-4829-ae07-148cfedea8ad tempest-CreateVolumesFromImageTest-778005494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-5622f731-220f-4044-9da6-e10cccb54ca6 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:24:58 devstack sudo[99888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-5622f731-220f-4044-9da6-e10cccb54ca6 Nov 04 10:24:58 devstack sudo[99888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:24:58 devstack sudo[99880]: pam_unix(sudo:session): session closed for user root Nov 04 10:24:58 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-cfa1001a-e703-409a-b3db-c394e75c06d5 tempest-VolumesDeleteCascade-2146450032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-1f2c1287-1b56-4b7d-9024-b22e833093b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-1f2c1287-1b56-4b7d-9024-b22e833093b3.67e553e4-377f-44a0-b424-b6dee84089f0 1G" returned: 0 in 0.455s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:24:58 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-cfa1001a-e703-409a-b3db-c394e75c06d5 tempest-VolumesDeleteCascade-2146450032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f2c1287-1b56-4b7d-9024-b22e833093b3 -F qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-1f2c1287-1b56-4b7d-9024-b22e833093b3.67e553e4-377f-44a0-b424-b6dee84089f0 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:24:58 devstack sudo[99890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f2c1287-1b56-4b7d-9024-b22e833093b3 -F qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-1f2c1287-1b56-4b7d-9024-b22e833093b3.67e553e4-377f-44a0-b424-b6dee84089f0 Nov 04 10:24:58 devstack sudo[99890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:24:58 devstack sudo[99888]: pam_unix(sudo:session): session closed for user root Nov 04 10:24:58 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-96aab0f2-878a-4829-ae07-148cfedea8ad tempest-CreateVolumesFromImageTest-778005494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-5622f731-220f-4044-9da6-e10cccb54ca6" returned: 0 in 0.309s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:24:58 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-96aab0f2-878a-4829-ae07-148cfedea8ad tempest-CreateVolumesFromImageTest-778005494 None] Lock "cinder-quobyte-5622f731-220f-4044-9da6-e10cccb54ca6" released by "delete_volume" :: held 0.978s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:24:59 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-96aab0f2-878a-4829-ae07-148cfedea8ad tempest-CreateVolumesFromImageTest-778005494 None] Created reservations ['2d0cbf42-b555-4ced-9baf-393835059335', '90a62cdf-35f7-4bd5-adbd-7d3ab34e07e2', '4c31a5b6-68e0-48af-a005-0db18885cf24', '2f91825e-3525-44b6-8092-eb8ed40c17d3'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:24:59 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-96aab0f2-878a-4829-ae07-148cfedea8ad tempest-CreateVolumesFromImageTest-778005494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:24:59 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-96aab0f2-878a-4829-ae07-148cfedea8ad tempest-CreateVolumesFromImageTest-778005494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:24:59 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-96aab0f2-878a-4829-ae07-148cfedea8ad tempest-CreateVolumesFromImageTest-778005494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:24:59 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-96aab0f2-878a-4829-ae07-148cfedea8ad tempest-CreateVolumesFromImageTest-778005494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:24:59 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-96aab0f2-878a-4829-ae07-148cfedea8ad tempest-CreateVolumesFromImageTest-778005494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:24:59 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-96aab0f2-878a-4829-ae07-148cfedea8ad tempest-CreateVolumesFromImageTest-778005494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:24:59 devstack sudo[99890]: pam_unix(sudo:session): session closed for user root Nov 04 10:24:59 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-cfa1001a-e703-409a-b3db-c394e75c06d5 tempest-VolumesDeleteCascade-2146450032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f2c1287-1b56-4b7d-9024-b22e833093b3 -F qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-1f2c1287-1b56-4b7d-9024-b22e833093b3.67e553e4-377f-44a0-b424-b6dee84089f0" returned: 0 in 0.386s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:24:59 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-cfa1001a-e703-409a-b3db-c394e75c06d5 tempest-VolumesDeleteCascade-2146450032 None] /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-1f2c1287-1b56-4b7d-9024-b22e833093b3.67e553e4-377f-44a0-b424-b6dee84089f0 is being set with open permissions: ugo+rw Nov 04 10:24:59 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-cfa1001a-e703-409a-b3db-c394e75c06d5 tempest-VolumesDeleteCascade-2146450032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-1f2c1287-1b56-4b7d-9024-b22e833093b3.67e553e4-377f-44a0-b424-b6dee84089f0 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:24:59 devstack sudo[99897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:24:59 devstack sudo[99897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:24:59 devstack sudo[99898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-1f2c1287-1b56-4b7d-9024-b22e833093b3.67e553e4-377f-44a0-b424-b6dee84089f0 Nov 04 10:24:59 devstack sudo[99898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:24:59 devstack sudo[99897]: pam_unix(sudo:session): session closed for user root Nov 04 10:24:59 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-96aab0f2-878a-4829-ae07-148cfedea8ad tempest-CreateVolumesFromImageTest-778005494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.298s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:24:59 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-96aab0f2-878a-4829-ae07-148cfedea8ad tempest-CreateVolumesFromImageTest-778005494 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:24:59 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-96aab0f2-878a-4829-ae07-148cfedea8ad tempest-CreateVolumesFromImageTest-778005494 None] Deleted volume successfully. Nov 04 10:24:59 devstack sudo[99898]: pam_unix(sudo:session): session closed for user root Nov 04 10:24:59 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-cfa1001a-e703-409a-b3db-c394e75c06d5 tempest-VolumesDeleteCascade-2146450032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-1f2c1287-1b56-4b7d-9024-b22e833093b3.67e553e4-377f-44a0-b424-b6dee84089f0" returned: 0 in 0.317s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:24:59 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-96aab0f2-878a-4829-ae07-148cfedea8ad tempest-CreateVolumesFromImageTest-778005494 None] Lock "cinder-5622f731-220f-4044-9da6-e10cccb54ca6-delete_volume" released by "delete_volume" :: held 1.596s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:24:59 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-cfa1001a-e703-409a-b3db-c394e75c06d5 tempest-VolumesDeleteCascade-2146450032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-1f2c1287-1b56-4b7d-9024-b22e833093b3.info {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:24:59 devstack sudo[99903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-1f2c1287-1b56-4b7d-9024-b22e833093b3.info Nov 04 10:24:59 devstack sudo[99903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:24:59 devstack sudo[99903]: pam_unix(sudo:session): session closed for user root Nov 04 10:24:59 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-cfa1001a-e703-409a-b3db-c394e75c06d5 tempest-VolumesDeleteCascade-2146450032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-1f2c1287-1b56-4b7d-9024-b22e833093b3.info" returned: 0 in 0.265s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:24:59 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-cfa1001a-e703-409a-b3db-c394e75c06d5 tempest-VolumesDeleteCascade-2146450032 None] /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-1f2c1287-1b56-4b7d-9024-b22e833093b3.info is being set with open permissions: ugo+rw Nov 04 10:24:59 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-cfa1001a-e703-409a-b3db-c394e75c06d5 tempest-VolumesDeleteCascade-2146450032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-1f2c1287-1b56-4b7d-9024-b22e833093b3.info {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:24:59 devstack sudo[99906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-1f2c1287-1b56-4b7d-9024-b22e833093b3.info Nov 04 10:24:59 devstack sudo[99906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:24:59 devstack sudo[99906]: pam_unix(sudo:session): session closed for user root Nov 04 10:25:00 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-cfa1001a-e703-409a-b3db-c394e75c06d5 tempest-VolumesDeleteCascade-2146450032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-1f2c1287-1b56-4b7d-9024-b22e833093b3.info" returned: 0 in 0.246s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:25:00 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-cfa1001a-e703-409a-b3db-c394e75c06d5 tempest-VolumesDeleteCascade-2146450032 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.470s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:25:00 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-7c8bbf9c-83a0-4509-bce3-5778ca839413 tempest-TestMinimumBasicScenario-512484155 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.767s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:25:00 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-7c8bbf9c-83a0-4509-bce3-5778ca839413 tempest-TestMinimumBasicScenario-512484155 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:24:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1890480864',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=586e6856-2f98-4f89-b780-87737887804c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30508c79e7db4c39b7a288571a979a4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:24:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:24:56Z,use_quota=True,user_id='d81301c3b06f4355b4dd219e74f0682b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 10:25:00 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-7c8bbf9c-83a0-4509-bce3-5778ca839413 tempest-TestMinimumBasicScenario-512484155 None] Creating volume 586e6856-2f98-4f89-b780-87737887804c {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:25:00 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-7c8bbf9c-83a0-4509-bce3-5778ca839413 tempest-TestMinimumBasicScenario-512484155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:25:00 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-7c8bbf9c-83a0-4509-bce3-5778ca839413 tempest-TestMinimumBasicScenario-512484155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:25:00 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-7c8bbf9c-83a0-4509-bce3-5778ca839413 tempest-TestMinimumBasicScenario-512484155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:25:00 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-7c8bbf9c-83a0-4509-bce3-5778ca839413 tempest-TestMinimumBasicScenario-512484155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:25:00 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-7c8bbf9c-83a0-4509-bce3-5778ca839413 tempest-TestMinimumBasicScenario-512484155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:25:00 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-7c8bbf9c-83a0-4509-bce3-5778ca839413 tempest-TestMinimumBasicScenario-512484155 None] Selected osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:25:00 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-7c8bbf9c-83a0-4509-bce3-5778ca839413 tempest-TestMinimumBasicScenario-512484155 None] casted to osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 Nov 04 10:25:00 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7c8bbf9c-83a0-4509-bce3-5778ca839413 tempest-TestMinimumBasicScenario-512484155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-586e6856-2f98-4f89-b780-87737887804c 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:25:00 devstack sudo[99909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-586e6856-2f98-4f89-b780-87737887804c 1073741824 Nov 04 10:25:00 devstack sudo[99909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:25:00 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-cfa1001a-e703-409a-b3db-c394e75c06d5 tempest-VolumesDeleteCascade-2146450032 None] Create snapshot completed successfully Nov 04 10:25:00 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-4ff4ef54-16bb-47db-b4c6-cec1142db517 tempest-CreateVolumesFromImageTest-778005494 None] Acquiring lock "cinder-45b0584c-067a-485a-a051-359c21f3406e-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:25:00 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-4ff4ef54-16bb-47db-b4c6-cec1142db517 tempest-CreateVolumesFromImageTest-778005494 None] Lock "cinder-45b0584c-067a-485a-a051-359c21f3406e-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:25:00 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-4ff4ef54-16bb-47db-b4c6-cec1142db517 tempest-CreateVolumesFromImageTest-778005494 None] Acquiring lock "cinder-quobyte-45b0584c-067a-485a-a051-359c21f3406e" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:25:00 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-4ff4ef54-16bb-47db-b4c6-cec1142db517 tempest-CreateVolumesFromImageTest-778005494 None] Lock "cinder-quobyte-45b0584c-067a-485a-a051-359c21f3406e" acquired by "delete_volume" :: waited 0.018s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:25:00 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[6396b79e-d430-49b2-9512-410961f7c46b]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:25:00 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-4ff4ef54-16bb-47db-b4c6-cec1142db517 tempest-CreateVolumesFromImageTest-778005494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-45b0584c-067a-485a-a051-359c21f3406e {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:25:00 devstack sudo[99912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-45b0584c-067a-485a-a051-359c21f3406e Nov 04 10:25:00 devstack sudo[99912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:25:00 devstack sudo[99909]: pam_unix(sudo:session): session closed for user root Nov 04 10:25:00 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7c8bbf9c-83a0-4509-bce3-5778ca839413 tempest-TestMinimumBasicScenario-512484155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-586e6856-2f98-4f89-b780-87737887804c 1073741824" returned: 0 in 0.562s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:25:00 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7c8bbf9c-83a0-4509-bce3-5778ca839413 tempest-TestMinimumBasicScenario-512484155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-586e6856-2f98-4f89-b780-87737887804c {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:25:00 devstack sudo[99917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-586e6856-2f98-4f89-b780-87737887804c Nov 04 10:25:00 devstack sudo[99917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:25:00 devstack sudo[99912]: pam_unix(sudo:session): session closed for user root Nov 04 10:25:00 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-4ff4ef54-16bb-47db-b4c6-cec1142db517 tempest-CreateVolumesFromImageTest-778005494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-45b0584c-067a-485a-a051-359c21f3406e" returned: 0 in 0.472s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:25:00 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-4ff4ef54-16bb-47db-b4c6-cec1142db517 tempest-CreateVolumesFromImageTest-778005494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-45b0584c-067a-485a-a051-359c21f3406e {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:25:00 devstack sudo[99922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-45b0584c-067a-485a-a051-359c21f3406e Nov 04 10:25:00 devstack sudo[99922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:25:00 devstack sudo[99917]: pam_unix(sudo:session): session closed for user root Nov 04 10:25:00 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7c8bbf9c-83a0-4509-bce3-5778ca839413 tempest-TestMinimumBasicScenario-512484155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-586e6856-2f98-4f89-b780-87737887804c" returned: 0 in 0.265s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:25:00 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-7c8bbf9c-83a0-4509-bce3-5778ca839413 tempest-TestMinimumBasicScenario-512484155 None] <== create_volume: return (881ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 10:25:00 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-7c8bbf9c-83a0-4509-bce3-5778ca839413 tempest-TestMinimumBasicScenario-512484155 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.886s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:25:00 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-12706ba7-11ad-4f6c-a844-eb8676a14d3a tempest-ProjectReaderTests-1505730503 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.366s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:25:00 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-12706ba7-11ad-4f6c-a844-eb8676a14d3a tempest-ProjectReaderTests-1505730503 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:24:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-340261224',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71ff4e6b-4548-4974-bd7d-5f06074ea0db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4e0b63f17594427a2929254e282322b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:24:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:24:58Z,use_quota=True,user_id='d92d849e895242e7b6d98621572cde14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 10:25:00 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-12706ba7-11ad-4f6c-a844-eb8676a14d3a tempest-ProjectReaderTests-1505730503 None] Creating volume 71ff4e6b-4548-4974-bd7d-5f06074ea0db {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:25:00 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-12706ba7-11ad-4f6c-a844-eb8676a14d3a tempest-ProjectReaderTests-1505730503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:25:00 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-12706ba7-11ad-4f6c-a844-eb8676a14d3a tempest-ProjectReaderTests-1505730503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:25:00 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-12706ba7-11ad-4f6c-a844-eb8676a14d3a tempest-ProjectReaderTests-1505730503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:25:00 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-12706ba7-11ad-4f6c-a844-eb8676a14d3a tempest-ProjectReaderTests-1505730503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:25:00 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-12706ba7-11ad-4f6c-a844-eb8676a14d3a tempest-ProjectReaderTests-1505730503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:25:00 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-12706ba7-11ad-4f6c-a844-eb8676a14d3a tempest-ProjectReaderTests-1505730503 None] Selected osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:25:00 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-12706ba7-11ad-4f6c-a844-eb8676a14d3a tempest-ProjectReaderTests-1505730503 None] casted to osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 Nov 04 10:25:00 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-12706ba7-11ad-4f6c-a844-eb8676a14d3a tempest-ProjectReaderTests-1505730503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-71ff4e6b-4548-4974-bd7d-5f06074ea0db 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:25:00 devstack sudo[99925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-71ff4e6b-4548-4974-bd7d-5f06074ea0db 1073741824 Nov 04 10:25:00 devstack sudo[99925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:25:00 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7c8bbf9c-83a0-4509-bce3-5778ca839413 tempest-TestMinimumBasicScenario-512484155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9eb925ff-ba4f-4d62-95d3-c84ae5b087ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-586e6856-2f98-4f89-b780-87737887804c', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:25:00 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7c8bbf9c-83a0-4509-bce3-5778ca839413 tempest-TestMinimumBasicScenario-512484155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c623f04-164c-4d7f-baed-fe61acdc55ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:25:01 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-7c8bbf9c-83a0-4509-bce3-5778ca839413 tempest-TestMinimumBasicScenario-512484155 None] Volume volume-586e6856-2f98-4f89-b780-87737887804c (586e6856-2f98-4f89-b780-87737887804c): created successfully Nov 04 10:25:01 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7c8bbf9c-83a0-4509-bce3-5778ca839413 tempest-TestMinimumBasicScenario-512484155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c623f04-164c-4d7f-baed-fe61acdc55ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:25:01 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7c8bbf9c-83a0-4509-bce3-5778ca839413 tempest-TestMinimumBasicScenario-512484155 None] Flow 'volume_create_manager' (b5dfae17-e081-40d6-b87a-99258a00ee8a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:25:01 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-7c8bbf9c-83a0-4509-bce3-5778ca839413 tempest-TestMinimumBasicScenario-512484155 None] Created volume successfully. Nov 04 10:25:01 devstack sudo[99922]: pam_unix(sudo:session): session closed for user root Nov 04 10:25:01 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-4ff4ef54-16bb-47db-b4c6-cec1142db517 tempest-CreateVolumesFromImageTest-778005494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-45b0584c-067a-485a-a051-359c21f3406e" returned: 0 in 0.336s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:25:01 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-4ff4ef54-16bb-47db-b4c6-cec1142db517 tempest-CreateVolumesFromImageTest-778005494 None] Lock "cinder-quobyte-45b0584c-067a-485a-a051-359c21f3406e" released by "delete_volume" :: held 0.882s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:25:01 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-4ff4ef54-16bb-47db-b4c6-cec1142db517 tempest-CreateVolumesFromImageTest-778005494 None] Created reservations ['6b973663-ab43-4423-a000-528432aaa965', '84727298-7e53-4673-94a5-0c4d97c6b5d8', 'ec0bdd2d-0aee-4f13-b820-0d13cf46ff3c', 'c1473209-93f7-4faa-80ba-a5c94baf74ce'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:25:01 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-4ff4ef54-16bb-47db-b4c6-cec1142db517 tempest-CreateVolumesFromImageTest-778005494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:25:01 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-4ff4ef54-16bb-47db-b4c6-cec1142db517 tempest-CreateVolumesFromImageTest-778005494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:25:01 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-4ff4ef54-16bb-47db-b4c6-cec1142db517 tempest-CreateVolumesFromImageTest-778005494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:25:01 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-4ff4ef54-16bb-47db-b4c6-cec1142db517 tempest-CreateVolumesFromImageTest-778005494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:25:01 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-4ff4ef54-16bb-47db-b4c6-cec1142db517 tempest-CreateVolumesFromImageTest-778005494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:25:01 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-4ff4ef54-16bb-47db-b4c6-cec1142db517 tempest-CreateVolumesFromImageTest-778005494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:25:01 devstack sudo[99933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:25:01 devstack sudo[99933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:25:01 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-c2b6303c-db4a-4dc8-b977-ac94525e0965 tempest-VolumesDeleteCascade-2146450032 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:25:01 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-1ccfc477-e055-4aad-89c1-ece1cc7a29f5 tempest-CreateVolumesFromImageTest-778005494 None] Acquiring lock "cinder-5901325b-1c80-4989-b43f-fc29f9e23257-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:25:01 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-1ccfc477-e055-4aad-89c1-ece1cc7a29f5 tempest-CreateVolumesFromImageTest-778005494 None] Lock "cinder-5901325b-1c80-4989-b43f-fc29f9e23257-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:25:01 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-1ccfc477-e055-4aad-89c1-ece1cc7a29f5 tempest-CreateVolumesFromImageTest-778005494 None] Acquiring lock "cinder-quobyte-5901325b-1c80-4989-b43f-fc29f9e23257" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:25:01 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-1ccfc477-e055-4aad-89c1-ece1cc7a29f5 tempest-CreateVolumesFromImageTest-778005494 None] Lock "cinder-quobyte-5901325b-1c80-4989-b43f-fc29f9e23257" acquired by "delete_volume" :: waited 0.036s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:25:01 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[6438d0e1-6c0f-433d-babf-cc5056f5cadd]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:25:01 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-1ccfc477-e055-4aad-89c1-ece1cc7a29f5 tempest-CreateVolumesFromImageTest-778005494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-5901325b-1c80-4989-b43f-fc29f9e23257 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:25:01 devstack sudo[99925]: pam_unix(sudo:session): session closed for user root Nov 04 10:25:01 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-12706ba7-11ad-4f6c-a844-eb8676a14d3a tempest-ProjectReaderTests-1505730503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-71ff4e6b-4548-4974-bd7d-5f06074ea0db 1073741824" returned: 0 in 0.814s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:25:01 devstack sudo[99933]: pam_unix(sudo:session): session closed for user root Nov 04 10:25:01 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-4ff4ef54-16bb-47db-b4c6-cec1142db517 tempest-CreateVolumesFromImageTest-778005494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.432s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:25:01 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-4ff4ef54-16bb-47db-b4c6-cec1142db517 tempest-CreateVolumesFromImageTest-778005494 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:25:01 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-4ff4ef54-16bb-47db-b4c6-cec1142db517 tempest-CreateVolumesFromImageTest-778005494 None] Deleted volume successfully. Nov 04 10:25:01 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-12706ba7-11ad-4f6c-a844-eb8676a14d3a tempest-ProjectReaderTests-1505730503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-71ff4e6b-4548-4974-bd7d-5f06074ea0db {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:25:01 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-4ff4ef54-16bb-47db-b4c6-cec1142db517 tempest-CreateVolumesFromImageTest-778005494 None] Lock "cinder-45b0584c-067a-485a-a051-359c21f3406e-delete_volume" released by "delete_volume" :: held 1.631s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:25:01 devstack sudo[99939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-71ff4e6b-4548-4974-bd7d-5f06074ea0db Nov 04 10:25:01 devstack sudo[99939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:25:01 devstack sudo[99938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-5901325b-1c80-4989-b43f-fc29f9e23257 Nov 04 10:25:01 devstack sudo[99938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:25:02 devstack sudo[99939]: pam_unix(sudo:session): session closed for user root Nov 04 10:25:02 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-12706ba7-11ad-4f6c-a844-eb8676a14d3a tempest-ProjectReaderTests-1505730503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-71ff4e6b-4548-4974-bd7d-5f06074ea0db" returned: 0 in 0.274s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:25:02 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-12706ba7-11ad-4f6c-a844-eb8676a14d3a tempest-ProjectReaderTests-1505730503 None] <== create_volume: return (1161ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 10:25:02 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-12706ba7-11ad-4f6c-a844-eb8676a14d3a tempest-ProjectReaderTests-1505730503 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.165s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:25:02 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-c2b6303c-db4a-4dc8-b977-ac94525e0965 tempest-VolumesDeleteCascade-2146450032 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.683s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:25:02 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-12706ba7-11ad-4f6c-a844-eb8676a14d3a tempest-ProjectReaderTests-1505730503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6f51d33-d641-452f-8755-d3f60b7719c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-71ff4e6b-4548-4974-bd7d-5f06074ea0db', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:25:02 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-12706ba7-11ad-4f6c-a844-eb8676a14d3a tempest-ProjectReaderTests-1505730503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0881d395-c603-4a74-8ab2-e1b0ce0d88db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:25:02 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-c2b6303c-db4a-4dc8-b977-ac94525e0965 tempest-VolumesDeleteCascade-2146450032 None] Creating offline snapshot 365a26dd-7955-4402-b47e-4ef7f2f555ad of volume 1f2c1287-1b56-4b7d-9024-b22e833093b3 {{(pid=87068) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 10:25:02 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-12706ba7-11ad-4f6c-a844-eb8676a14d3a tempest-ProjectReaderTests-1505730503 None] Volume volume-71ff4e6b-4548-4974-bd7d-5f06074ea0db (71ff4e6b-4548-4974-bd7d-5f06074ea0db): created successfully Nov 04 10:25:02 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-12706ba7-11ad-4f6c-a844-eb8676a14d3a tempest-ProjectReaderTests-1505730503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0881d395-c603-4a74-8ab2-e1b0ce0d88db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:25:02 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-12706ba7-11ad-4f6c-a844-eb8676a14d3a tempest-ProjectReaderTests-1505730503 None] Flow 'volume_create_manager' (40c4d917-9a57-464f-bb6e-21089b983ed0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:25:02 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cf28bc6-f4eb-4752-b3f3-95860385cbfb]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:25:02 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c2b6303c-db4a-4dc8-b977-ac94525e0965 tempest-VolumesDeleteCascade-2146450032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-1f2c1287-1b56-4b7d-9024-b22e833093b3.67e553e4-377f-44a0-b424-b6dee84089f0 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:25:02 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-12706ba7-11ad-4f6c-a844-eb8676a14d3a tempest-ProjectReaderTests-1505730503 None] Created volume successfully. Nov 04 10:25:02 devstack sudo[99938]: pam_unix(sudo:session): session closed for user root Nov 04 10:25:02 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-1ccfc477-e055-4aad-89c1-ece1cc7a29f5 tempest-CreateVolumesFromImageTest-778005494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-5901325b-1c80-4989-b43f-fc29f9e23257" returned: 0 in 0.565s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:25:02 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-1ccfc477-e055-4aad-89c1-ece1cc7a29f5 tempest-CreateVolumesFromImageTest-778005494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-5901325b-1c80-4989-b43f-fc29f9e23257 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:25:02 devstack sudo[99950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-5901325b-1c80-4989-b43f-fc29f9e23257 Nov 04 10:25:02 devstack sudo[99950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:25:02 devstack sudo[99949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-1f2c1287-1b56-4b7d-9024-b22e833093b3.67e553e4-377f-44a0-b424-b6dee84089f0 Nov 04 10:25:02 devstack sudo[99949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:25:02 devstack sudo[99950]: pam_unix(sudo:session): session closed for user root Nov 04 10:25:02 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-1ccfc477-e055-4aad-89c1-ece1cc7a29f5 tempest-CreateVolumesFromImageTest-778005494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-5901325b-1c80-4989-b43f-fc29f9e23257" returned: 0 in 0.504s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:25:02 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-1ccfc477-e055-4aad-89c1-ece1cc7a29f5 tempest-CreateVolumesFromImageTest-778005494 None] Lock "cinder-quobyte-5901325b-1c80-4989-b43f-fc29f9e23257" released by "delete_volume" :: held 1.142s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:25:02 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-1ccfc477-e055-4aad-89c1-ece1cc7a29f5 tempest-CreateVolumesFromImageTest-778005494 None] Created reservations ['4cd7f984-ace4-4c62-83d4-df392cff6c6e', '00fb8ce9-631f-4b48-8709-4a31a866bcc8', '96541abb-909b-4ef7-a05f-120231239fb7', '21144df4-2191-4c6d-ae70-9c50bde65e49'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:25:02 devstack sudo[99949]: pam_unix(sudo:session): session closed for user root Nov 04 10:25:02 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c2b6303c-db4a-4dc8-b977-ac94525e0965 tempest-VolumesDeleteCascade-2146450032 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-1f2c1287-1b56-4b7d-9024-b22e833093b3.67e553e4-377f-44a0-b424-b6dee84089f0" returned: 0 in 0.666s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:25:02 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-c2b6303c-db4a-4dc8-b977-ac94525e0965 tempest-VolumesDeleteCascade-2146450032 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1f2c1287-1b56-4b7d-9024-b22e833093b3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87068) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 10:25:02 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c2b6303c-db4a-4dc8-b977-ac94525e0965 tempest-VolumesDeleteCascade-2146450032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-1f2c1287-1b56-4b7d-9024-b22e833093b3.67e553e4-377f-44a0-b424-b6dee84089f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-1f2c1287-1b56-4b7d-9024-b22e833093b3.365a26dd-7955-4402-b47e-4ef7f2f555ad 1G {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:25:02 devstack sudo[99966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-1f2c1287-1b56-4b7d-9024-b22e833093b3.67e553e4-377f-44a0-b424-b6dee84089f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-1f2c1287-1b56-4b7d-9024-b22e833093b3.365a26dd-7955-4402-b47e-4ef7f2f555ad 1G Nov 04 10:25:02 devstack sudo[99966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:25:02 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-1ccfc477-e055-4aad-89c1-ece1cc7a29f5 tempest-CreateVolumesFromImageTest-778005494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:25:02 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-1ccfc477-e055-4aad-89c1-ece1cc7a29f5 tempest-CreateVolumesFromImageTest-778005494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:25:02 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-1ccfc477-e055-4aad-89c1-ece1cc7a29f5 tempest-CreateVolumesFromImageTest-778005494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:25:02 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-1ccfc477-e055-4aad-89c1-ece1cc7a29f5 tempest-CreateVolumesFromImageTest-778005494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:25:02 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-1ccfc477-e055-4aad-89c1-ece1cc7a29f5 tempest-CreateVolumesFromImageTest-778005494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:25:02 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-1ccfc477-e055-4aad-89c1-ece1cc7a29f5 tempest-CreateVolumesFromImageTest-778005494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:25:03 devstack sudo[99968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:25:03 devstack sudo[99968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:25:03 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [req-5461d88e-71f6-427d-b420-05029060541a req-ade9ede0-8fdc-4adb-af84-92255592ebe2 tempest-TestMinimumBasicScenario-512484155 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:25:03 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-6476a62c-914a-432f-8740-02cc757ddfd8 tempest-ProjectReaderTests-1505730503 None] Acquiring lock "cinder-71ff4e6b-4548-4974-bd7d-5f06074ea0db-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:25:03 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-6476a62c-914a-432f-8740-02cc757ddfd8 tempest-ProjectReaderTests-1505730503 None] Lock "cinder-71ff4e6b-4548-4974-bd7d-5f06074ea0db-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:25:03 devstack sudo[99968]: pam_unix(sudo:session): session closed for user root Nov 04 10:25:03 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-1ccfc477-e055-4aad-89c1-ece1cc7a29f5 tempest-CreateVolumesFromImageTest-778005494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.370s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:25:03 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-1ccfc477-e055-4aad-89c1-ece1cc7a29f5 tempest-CreateVolumesFromImageTest-778005494 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:25:03 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-1ccfc477-e055-4aad-89c1-ece1cc7a29f5 tempest-CreateVolumesFromImageTest-778005494 None] Deleted volume successfully. Nov 04 10:25:03 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-6476a62c-914a-432f-8740-02cc757ddfd8 tempest-ProjectReaderTests-1505730503 None] Acquiring lock "cinder-quobyte-71ff4e6b-4548-4974-bd7d-5f06074ea0db" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:25:03 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-1ccfc477-e055-4aad-89c1-ece1cc7a29f5 tempest-CreateVolumesFromImageTest-778005494 None] Lock "cinder-5901325b-1c80-4989-b43f-fc29f9e23257-delete_volume" released by "delete_volume" :: held 1.925s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:25:03 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-6476a62c-914a-432f-8740-02cc757ddfd8 tempest-ProjectReaderTests-1505730503 None] Lock "cinder-quobyte-71ff4e6b-4548-4974-bd7d-5f06074ea0db" acquired by "delete_volume" :: waited 0.030s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:25:03 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6cba223-0fb4-4bb2-855d-13044529e45c]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:25:03 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6476a62c-914a-432f-8740-02cc757ddfd8 tempest-ProjectReaderTests-1505730503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-71ff4e6b-4548-4974-bd7d-5f06074ea0db {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:25:03 devstack sudo[99966]: pam_unix(sudo:session): session closed for user root Nov 04 10:25:03 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c2b6303c-db4a-4dc8-b977-ac94525e0965 tempest-VolumesDeleteCascade-2146450032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-1f2c1287-1b56-4b7d-9024-b22e833093b3.67e553e4-377f-44a0-b424-b6dee84089f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-1f2c1287-1b56-4b7d-9024-b22e833093b3.365a26dd-7955-4402-b47e-4ef7f2f555ad 1G" returned: 0 in 0.662s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:25:03 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c2b6303c-db4a-4dc8-b977-ac94525e0965 tempest-VolumesDeleteCascade-2146450032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f2c1287-1b56-4b7d-9024-b22e833093b3.67e553e4-377f-44a0-b424-b6dee84089f0 -F qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-1f2c1287-1b56-4b7d-9024-b22e833093b3.365a26dd-7955-4402-b47e-4ef7f2f555ad {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:25:03 devstack sudo[99975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-71ff4e6b-4548-4974-bd7d-5f06074ea0db Nov 04 10:25:03 devstack sudo[99975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:25:03 devstack sudo[99976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f2c1287-1b56-4b7d-9024-b22e833093b3.67e553e4-377f-44a0-b424-b6dee84089f0 -F qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-1f2c1287-1b56-4b7d-9024-b22e833093b3.365a26dd-7955-4402-b47e-4ef7f2f555ad Nov 04 10:25:03 devstack sudo[99976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:25:03 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-f748e628-cf09-432c-ae71-2115e6ec8756 tempest-CreateVolumesFromImageTest-778005494 None] Acquiring lock "cinder-78259178-f7f1-4156-93fa-d4f503e7e95c-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:25:03 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-f748e628-cf09-432c-ae71-2115e6ec8756 tempest-CreateVolumesFromImageTest-778005494 None] Lock "cinder-78259178-f7f1-4156-93fa-d4f503e7e95c-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:25:03 devstack sudo[99975]: pam_unix(sudo:session): session closed for user root Nov 04 10:25:03 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6476a62c-914a-432f-8740-02cc757ddfd8 tempest-ProjectReaderTests-1505730503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-71ff4e6b-4548-4974-bd7d-5f06074ea0db" returned: 0 in 0.419s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:25:03 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6476a62c-914a-432f-8740-02cc757ddfd8 tempest-ProjectReaderTests-1505730503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-71ff4e6b-4548-4974-bd7d-5f06074ea0db {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:25:03 devstack sudo[99985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-71ff4e6b-4548-4974-bd7d-5f06074ea0db Nov 04 10:25:03 devstack sudo[99985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:25:03 devstack sudo[99976]: pam_unix(sudo:session): session closed for user root Nov 04 10:25:03 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-f748e628-cf09-432c-ae71-2115e6ec8756 tempest-CreateVolumesFromImageTest-778005494 None] Acquiring lock "cinder-quobyte-78259178-f7f1-4156-93fa-d4f503e7e95c" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:25:03 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c2b6303c-db4a-4dc8-b977-ac94525e0965 tempest-VolumesDeleteCascade-2146450032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f2c1287-1b56-4b7d-9024-b22e833093b3.67e553e4-377f-44a0-b424-b6dee84089f0 -F qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-1f2c1287-1b56-4b7d-9024-b22e833093b3.365a26dd-7955-4402-b47e-4ef7f2f555ad" returned: 0 in 0.391s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:25:03 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-c2b6303c-db4a-4dc8-b977-ac94525e0965 tempest-VolumesDeleteCascade-2146450032 None] /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-1f2c1287-1b56-4b7d-9024-b22e833093b3.365a26dd-7955-4402-b47e-4ef7f2f555ad is being set with open permissions: ugo+rw Nov 04 10:25:03 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c2b6303c-db4a-4dc8-b977-ac94525e0965 tempest-VolumesDeleteCascade-2146450032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-1f2c1287-1b56-4b7d-9024-b22e833093b3.365a26dd-7955-4402-b47e-4ef7f2f555ad {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:25:03 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-f748e628-cf09-432c-ae71-2115e6ec8756 tempest-CreateVolumesFromImageTest-778005494 None] Lock "cinder-quobyte-78259178-f7f1-4156-93fa-d4f503e7e95c" acquired by "delete_volume" :: waited 0.035s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:25:03 devstack sudo[99987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-1f2c1287-1b56-4b7d-9024-b22e833093b3.365a26dd-7955-4402-b47e-4ef7f2f555ad Nov 04 10:25:03 devstack sudo[99987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:25:04 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ef9092e-ef43-4b04-b814-cf19b492070f]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:25:04 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f748e628-cf09-432c-ae71-2115e6ec8756 tempest-CreateVolumesFromImageTest-778005494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-78259178-f7f1-4156-93fa-d4f503e7e95c {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:25:04 devstack sudo[99989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-78259178-f7f1-4156-93fa-d4f503e7e95c Nov 04 10:25:04 devstack sudo[99989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:25:04 devstack sudo[99985]: pam_unix(sudo:session): session closed for user root Nov 04 10:25:04 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6476a62c-914a-432f-8740-02cc757ddfd8 tempest-ProjectReaderTests-1505730503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-71ff4e6b-4548-4974-bd7d-5f06074ea0db" returned: 0 in 0.307s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:25:04 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-6476a62c-914a-432f-8740-02cc757ddfd8 tempest-ProjectReaderTests-1505730503 None] Lock "cinder-quobyte-71ff4e6b-4548-4974-bd7d-5f06074ea0db" released by "delete_volume" :: held 0.772s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:25:04 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-6476a62c-914a-432f-8740-02cc757ddfd8 tempest-ProjectReaderTests-1505730503 None] Created reservations ['6c1364b7-48e5-4d7f-a1e2-b3ce00654ee4', 'fb280edb-c0cf-4018-b6c9-ff42ba620497', 'e331505b-fa2a-4d14-b436-f46f0d5a802a', 'd562c0fc-ca95-40dc-a07b-2009d66849e1'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:25:04 devstack sudo[99987]: pam_unix(sudo:session): session closed for user root Nov 04 10:25:04 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c2b6303c-db4a-4dc8-b977-ac94525e0965 tempest-VolumesDeleteCascade-2146450032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-1f2c1287-1b56-4b7d-9024-b22e833093b3.365a26dd-7955-4402-b47e-4ef7f2f555ad" returned: 0 in 0.355s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:25:04 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-c2b6303c-db4a-4dc8-b977-ac94525e0965 tempest-VolumesDeleteCascade-2146450032 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.257s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:25:04 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [req-5461d88e-71f6-427d-b420-05029060541a req-ade9ede0-8fdc-4adb-af84-92255592ebe2 tempest-TestMinimumBasicScenario-512484155 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.276s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:25:04 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [req-5461d88e-71f6-427d-b420-05029060541a req-ade9ede0-8fdc-4adb-af84-92255592ebe2 tempest-TestMinimumBasicScenario-512484155 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:25:04 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-6476a62c-914a-432f-8740-02cc757ddfd8 tempest-ProjectReaderTests-1505730503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:25:04 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-6476a62c-914a-432f-8740-02cc757ddfd8 tempest-ProjectReaderTests-1505730503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:25:04 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-6476a62c-914a-432f-8740-02cc757ddfd8 tempest-ProjectReaderTests-1505730503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:25:04 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-6476a62c-914a-432f-8740-02cc757ddfd8 tempest-ProjectReaderTests-1505730503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:25:04 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-6476a62c-914a-432f-8740-02cc757ddfd8 tempest-ProjectReaderTests-1505730503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:25:04 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6476a62c-914a-432f-8740-02cc757ddfd8 tempest-ProjectReaderTests-1505730503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:25:04 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-c2b6303c-db4a-4dc8-b977-ac94525e0965 tempest-VolumesDeleteCascade-2146450032 None] Create snapshot completed successfully Nov 04 10:25:04 devstack sudo[99996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:25:04 devstack sudo[99996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:25:04 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [req-5461d88e-71f6-427d-b420-05029060541a req-ade9ede0-8fdc-4adb-af84-92255592ebe2 tempest-TestMinimumBasicScenario-512484155 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034', 'name': 'volume-586e6856-2f98-4f89-b780-87737887804c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'caaed32a-ffb4-45f3-a0b6-4337b31f9e55', 'enforce_multipath': True} {{(pid=87068) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 04 10:25:04 devstack sudo[99989]: pam_unix(sudo:session): session closed for user root Nov 04 10:25:04 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f748e628-cf09-432c-ae71-2115e6ec8756 tempest-CreateVolumesFromImageTest-778005494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-78259178-f7f1-4156-93fa-d4f503e7e95c" returned: 0 in 0.519s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:25:04 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f748e628-cf09-432c-ae71-2115e6ec8756 tempest-CreateVolumesFromImageTest-778005494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-78259178-f7f1-4156-93fa-d4f503e7e95c {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:25:04 devstack sudo[99998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-78259178-f7f1-4156-93fa-d4f503e7e95c Nov 04 10:25:04 devstack sudo[99998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:25:04 devstack cinder-volume[87068]: INFO cinder.volume.manager [req-5461d88e-71f6-427d-b420-05029060541a req-ade9ede0-8fdc-4adb-af84-92255592ebe2 tempest-TestMinimumBasicScenario-512484155 None] attachment_update completed successfully. Nov 04 10:25:04 devstack sudo[99996]: pam_unix(sudo:session): session closed for user root Nov 04 10:25:04 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6476a62c-914a-432f-8740-02cc757ddfd8 tempest-ProjectReaderTests-1505730503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.510s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:25:04 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-6476a62c-914a-432f-8740-02cc757ddfd8 tempest-ProjectReaderTests-1505730503 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:25:04 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-6476a62c-914a-432f-8740-02cc757ddfd8 tempest-ProjectReaderTests-1505730503 None] Deleted volume successfully. Nov 04 10:25:05 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-6476a62c-914a-432f-8740-02cc757ddfd8 tempest-ProjectReaderTests-1505730503 None] Lock "cinder-71ff4e6b-4548-4974-bd7d-5f06074ea0db-delete_volume" released by "delete_volume" :: held 1.731s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:25:05 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-4e6f93bd-493a-4413-9dbd-e547768be986 tempest-VolumesDeleteCascade-2146450032 None] Acquiring lock "cinder-1f2c1287-1b56-4b7d-9024-b22e833093b3-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:25:05 devstack sudo[99998]: pam_unix(sudo:session): session closed for user root Nov 04 10:25:05 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f748e628-cf09-432c-ae71-2115e6ec8756 tempest-CreateVolumesFromImageTest-778005494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-78259178-f7f1-4156-93fa-d4f503e7e95c" returned: 0 in 0.546s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:25:05 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-4e6f93bd-493a-4413-9dbd-e547768be986 tempest-VolumesDeleteCascade-2146450032 None] Lock "cinder-1f2c1287-1b56-4b7d-9024-b22e833093b3-delete_volume" acquired by "delete_volume" :: waited 0.104s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:25:05 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-f748e628-cf09-432c-ae71-2115e6ec8756 tempest-CreateVolumesFromImageTest-778005494 None] Lock "cinder-quobyte-78259178-f7f1-4156-93fa-d4f503e7e95c" released by "delete_volume" :: held 1.190s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:25:05 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-4e6f93bd-493a-4413-9dbd-e547768be986 tempest-VolumesDeleteCascade-2146450032 None] Performing cascade delete. {{(pid=87068) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Nov 04 10:25:05 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-4e6f93bd-493a-4413-9dbd-e547768be986 tempest-VolumesDeleteCascade-2146450032 None] Acquiring lock "cinder-365a26dd-7955-4402-b47e-4ef7f2f555ad-delete_snapshot" by "delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:25:05 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-f748e628-cf09-432c-ae71-2115e6ec8756 tempest-CreateVolumesFromImageTest-778005494 None] Created reservations ['8f2d8595-de4e-4ecc-8a4f-592d96dabd5d', '42a879e0-b07b-4b25-9b15-a90ba131f16d', '31e00508-04cc-4cf6-8460-7aa1863e31e0', '506127cb-1d18-49b5-a9da-1b6046ea355f'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:25:05 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-4e6f93bd-493a-4413-9dbd-e547768be986 tempest-VolumesDeleteCascade-2146450032 None] Lock "cinder-365a26dd-7955-4402-b47e-4ef7f2f555ad-delete_snapshot" acquired by "delete_snapshot" :: waited 0.058s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:25:05 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-4e6f93bd-493a-4413-9dbd-e547768be986 tempest-VolumesDeleteCascade-2146450032 None] Acquiring lock "cinder-quobyte-1f2c1287-1b56-4b7d-9024-b22e833093b3" by "delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:25:05 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-4e6f93bd-493a-4413-9dbd-e547768be986 tempest-VolumesDeleteCascade-2146450032 None] Lock "cinder-quobyte-1f2c1287-1b56-4b7d-9024-b22e833093b3" acquired by "delete_snapshot" :: waited 0.070s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:25:05 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-4e6f93bd-493a-4413-9dbd-e547768be986 tempest-VolumesDeleteCascade-2146450032 None] Acquiring lock "cinder-quobyte-365a26dd-7955-4402-b47e-4ef7f2f555ad" by "_delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:25:05 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-87f4bd02-a367-4293-ad23-93b3534b6129 tempest-ProjectReaderTests-1505730503 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:25:05 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-87f4bd02-a367-4293-ad23-93b3534b6129 tempest-ProjectReaderTests-1505730503 None] Flow 'volume_create_manager' (3dc312ce-4d10-4fe1-ae06-1d4855f339c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:25:05 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-87f4bd02-a367-4293-ad23-93b3534b6129 tempest-ProjectReaderTests-1505730503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b94cff1-dfa1-4933-8e79-62c2c30bb299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:25:05 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-4e6f93bd-493a-4413-9dbd-e547768be986 tempest-VolumesDeleteCascade-2146450032 None] Lock "cinder-quobyte-365a26dd-7955-4402-b47e-4ef7f2f555ad" acquired by "_delete_snapshot" :: waited 0.070s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:25:05 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-4e6f93bd-493a-4413-9dbd-e547768be986 tempest-VolumesDeleteCascade-2146450032 None] Deleting offline snapshot 365a26dd-7955-4402-b47e-4ef7f2f555ad of volume 1f2c1287-1b56-4b7d-9024-b22e833093b3 {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 10:25:05 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-4e6f93bd-493a-4413-9dbd-e547768be986 tempest-VolumesDeleteCascade-2146450032 None] snapshot_file for this snap is: volume-1f2c1287-1b56-4b7d-9024-b22e833093b3.365a26dd-7955-4402-b47e-4ef7f2f555ad {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 10:25:05 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-87f4bd02-a367-4293-ad23-93b3534b6129 tempest-ProjectReaderTests-1505730503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b94cff1-dfa1-4933-8e79-62c2c30bb299) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:25:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1319933150',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=295896d6-507f-4060-8e80-4372ac9b9708,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4e0b63f17594427a2929254e282322b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:25:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:25:05Z,use_quota=True,user_id='d92d849e895242e7b6d98621572cde14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:25:05 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-87f4bd02-a367-4293-ad23-93b3534b6129 tempest-ProjectReaderTests-1505730503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5f3e2ee-2cdf-472d-bd3b-3d1096b414e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:25:05 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-87f4bd02-a367-4293-ad23-93b3534b6129 tempest-ProjectReaderTests-1505730503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5f3e2ee-2cdf-472d-bd3b-3d1096b414e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:25:05 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-87f4bd02-a367-4293-ad23-93b3534b6129 tempest-ProjectReaderTests-1505730503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edac14a2-e6ff-4f01-959b-c7e3038e0612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:25:05 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-87f4bd02-a367-4293-ad23-93b3534b6129 tempest-ProjectReaderTests-1505730503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edac14a2-e6ff-4f01-959b-c7e3038e0612) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '295896d6-507f-4060-8e80-4372ac9b9708', 'volume_name': 'volume-295896d6-507f-4060-8e80-4372ac9b9708', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:25:05 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-87f4bd02-a367-4293-ad23-93b3534b6129 tempest-ProjectReaderTests-1505730503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7934429d-10e2-464f-a3cf-6cc983316a64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:25:05 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-87f4bd02-a367-4293-ad23-93b3534b6129 tempest-ProjectReaderTests-1505730503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7934429d-10e2-464f-a3cf-6cc983316a64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:25:05 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-87f4bd02-a367-4293-ad23-93b3534b6129 tempest-ProjectReaderTests-1505730503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8dac0b5-69f4-47d5-92fe-dad104f17b72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:25:05 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-87f4bd02-a367-4293-ad23-93b3534b6129 tempest-ProjectReaderTests-1505730503 None] Volume 295896d6-507f-4060-8e80-4372ac9b9708: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-295896d6-507f-4060-8e80-4372ac9b9708', 'volume_size': 1} Nov 04 10:25:05 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-87f4bd02-a367-4293-ad23-93b3534b6129 tempest-ProjectReaderTests-1505730503 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:25:05 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-87f4bd02-a367-4293-ad23-93b3534b6129 tempest-ProjectReaderTests-1505730503 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:25:05 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-87f4bd02-a367-4293-ad23-93b3534b6129 tempest-ProjectReaderTests-1505730503 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:25:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1319933150',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=295896d6-507f-4060-8e80-4372ac9b9708,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4e0b63f17594427a2929254e282322b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:25:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:25:05Z,use_quota=True,user_id='d92d849e895242e7b6d98621572cde14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 10:25:05 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-87f4bd02-a367-4293-ad23-93b3534b6129 tempest-ProjectReaderTests-1505730503 None] Creating volume 295896d6-507f-4060-8e80-4372ac9b9708 {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:25:05 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-87f4bd02-a367-4293-ad23-93b3534b6129 tempest-ProjectReaderTests-1505730503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:25:05 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-87f4bd02-a367-4293-ad23-93b3534b6129 tempest-ProjectReaderTests-1505730503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:25:05 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-87f4bd02-a367-4293-ad23-93b3534b6129 tempest-ProjectReaderTests-1505730503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:25:05 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-87f4bd02-a367-4293-ad23-93b3534b6129 tempest-ProjectReaderTests-1505730503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:25:05 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-87f4bd02-a367-4293-ad23-93b3534b6129 tempest-ProjectReaderTests-1505730503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:25:05 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-87f4bd02-a367-4293-ad23-93b3534b6129 tempest-ProjectReaderTests-1505730503 None] Selected osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:25:05 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-87f4bd02-a367-4293-ad23-93b3534b6129 tempest-ProjectReaderTests-1505730503 None] casted to osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 Nov 04 10:25:05 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-87f4bd02-a367-4293-ad23-93b3534b6129 tempest-ProjectReaderTests-1505730503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-295896d6-507f-4060-8e80-4372ac9b9708 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:25:05 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[3afdf737-2179-46cd-acca-e45466902018]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:25:05 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-4e6f93bd-493a-4413-9dbd-e547768be986 tempest-VolumesDeleteCascade-2146450032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-1f2c1287-1b56-4b7d-9024-b22e833093b3.365a26dd-7955-4402-b47e-4ef7f2f555ad {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:25:05 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-f748e628-cf09-432c-ae71-2115e6ec8756 tempest-CreateVolumesFromImageTest-778005494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:25:05 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-f748e628-cf09-432c-ae71-2115e6ec8756 tempest-CreateVolumesFromImageTest-778005494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:25:05 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-f748e628-cf09-432c-ae71-2115e6ec8756 tempest-CreateVolumesFromImageTest-778005494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:25:05 devstack sudo[100706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-295896d6-507f-4060-8e80-4372ac9b9708 1073741824 Nov 04 10:25:05 devstack sudo[100706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:25:05 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-f748e628-cf09-432c-ae71-2115e6ec8756 tempest-CreateVolumesFromImageTest-778005494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:25:05 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-f748e628-cf09-432c-ae71-2115e6ec8756 tempest-CreateVolumesFromImageTest-778005494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:25:05 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f748e628-cf09-432c-ae71-2115e6ec8756 tempest-CreateVolumesFromImageTest-778005494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:25:05 devstack sudo[100734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:25:05 devstack sudo[100734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:25:05 devstack sudo[100713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-1f2c1287-1b56-4b7d-9024-b22e833093b3.365a26dd-7955-4402-b47e-4ef7f2f555ad Nov 04 10:25:05 devstack sudo[100713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:25:06 devstack sudo[100734]: pam_unix(sudo:session): session closed for user root Nov 04 10:25:06 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f748e628-cf09-432c-ae71-2115e6ec8756 tempest-CreateVolumesFromImageTest-778005494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.328s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:25:06 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-f748e628-cf09-432c-ae71-2115e6ec8756 tempest-CreateVolumesFromImageTest-778005494 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:25:06 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-f748e628-cf09-432c-ae71-2115e6ec8756 tempest-CreateVolumesFromImageTest-778005494 None] Deleted volume successfully. Nov 04 10:25:06 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-f748e628-cf09-432c-ae71-2115e6ec8756 tempest-CreateVolumesFromImageTest-778005494 None] Lock "cinder-78259178-f7f1-4156-93fa-d4f503e7e95c-delete_volume" released by "delete_volume" :: held 2.258s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:25:06 devstack sudo[100713]: pam_unix(sudo:session): session closed for user root Nov 04 10:25:06 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-4e6f93bd-493a-4413-9dbd-e547768be986 tempest-VolumesDeleteCascade-2146450032 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-1f2c1287-1b56-4b7d-9024-b22e833093b3.365a26dd-7955-4402-b47e-4ef7f2f555ad" returned: 0 in 0.544s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:25:06 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-4e6f93bd-493a-4413-9dbd-e547768be986 tempest-VolumesDeleteCascade-2146450032 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1f2c1287-1b56-4b7d-9024-b22e833093b3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87068) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 10:25:06 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[b84cf9dc-0883-4356-848d-59ca302ba4f5]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:25:06 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-4e6f93bd-493a-4413-9dbd-e547768be986 tempest-VolumesDeleteCascade-2146450032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-1f2c1287-1b56-4b7d-9024-b22e833093b3.67e553e4-377f-44a0-b424-b6dee84089f0 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:25:06 devstack sudo[100706]: pam_unix(sudo:session): session closed for user root Nov 04 10:25:06 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-df3833af-f9a9-4d9a-be10-ec16245ca51d tempest-CreateVolumesFromImageTest-778005494 None] Acquiring lock "cinder-251b1ccf-1f0a-4a27-94e4-332e026494c4-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:25:06 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-87f4bd02-a367-4293-ad23-93b3534b6129 tempest-ProjectReaderTests-1505730503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-295896d6-507f-4060-8e80-4372ac9b9708 1073741824" returned: 0 in 0.693s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:25:06 devstack sudo[100802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-1f2c1287-1b56-4b7d-9024-b22e833093b3.67e553e4-377f-44a0-b424-b6dee84089f0 Nov 04 10:25:06 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-df3833af-f9a9-4d9a-be10-ec16245ca51d tempest-CreateVolumesFromImageTest-778005494 None] Lock "cinder-251b1ccf-1f0a-4a27-94e4-332e026494c4-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:25:06 devstack sudo[100802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:25:06 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-87f4bd02-a367-4293-ad23-93b3534b6129 tempest-ProjectReaderTests-1505730503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-295896d6-507f-4060-8e80-4372ac9b9708 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:25:06 devstack sudo[100804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-295896d6-507f-4060-8e80-4372ac9b9708 Nov 04 10:25:06 devstack sudo[100804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:25:06 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-df3833af-f9a9-4d9a-be10-ec16245ca51d tempest-CreateVolumesFromImageTest-778005494 None] Acquiring lock "cinder-quobyte-251b1ccf-1f0a-4a27-94e4-332e026494c4" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:25:06 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-df3833af-f9a9-4d9a-be10-ec16245ca51d tempest-CreateVolumesFromImageTest-778005494 None] Lock "cinder-quobyte-251b1ccf-1f0a-4a27-94e4-332e026494c4" acquired by "delete_volume" :: waited 0.018s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:25:06 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[45101cd4-86ef-4934-b0d8-04f95333e5db]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:25:06 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-df3833af-f9a9-4d9a-be10-ec16245ca51d tempest-CreateVolumesFromImageTest-778005494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-251b1ccf-1f0a-4a27-94e4-332e026494c4 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:25:06 devstack sudo[100806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-251b1ccf-1f0a-4a27-94e4-332e026494c4 Nov 04 10:25:06 devstack sudo[100806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:25:06 devstack sudo[100804]: pam_unix(sudo:session): session closed for user root Nov 04 10:25:06 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-87f4bd02-a367-4293-ad23-93b3534b6129 tempest-ProjectReaderTests-1505730503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-295896d6-507f-4060-8e80-4372ac9b9708" returned: 0 in 0.291s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:25:06 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-87f4bd02-a367-4293-ad23-93b3534b6129 tempest-ProjectReaderTests-1505730503 None] <== create_volume: return (1060ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 10:25:06 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-87f4bd02-a367-4293-ad23-93b3534b6129 tempest-ProjectReaderTests-1505730503 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.066s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:25:06 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-87f4bd02-a367-4293-ad23-93b3534b6129 tempest-ProjectReaderTests-1505730503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8dac0b5-69f4-47d5-92fe-dad104f17b72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-295896d6-507f-4060-8e80-4372ac9b9708', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:25:06 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-87f4bd02-a367-4293-ad23-93b3534b6129 tempest-ProjectReaderTests-1505730503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27d4fd69-95ab-4dbb-89a3-191d7008d13d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:25:06 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-87f4bd02-a367-4293-ad23-93b3534b6129 tempest-ProjectReaderTests-1505730503 None] Volume volume-295896d6-507f-4060-8e80-4372ac9b9708 (295896d6-507f-4060-8e80-4372ac9b9708): created successfully Nov 04 10:25:06 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-87f4bd02-a367-4293-ad23-93b3534b6129 tempest-ProjectReaderTests-1505730503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27d4fd69-95ab-4dbb-89a3-191d7008d13d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:25:06 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-87f4bd02-a367-4293-ad23-93b3534b6129 tempest-ProjectReaderTests-1505730503 None] Flow 'volume_create_manager' (3dc312ce-4d10-4fe1-ae06-1d4855f339c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:25:06 devstack sudo[100802]: pam_unix(sudo:session): session closed for user root Nov 04 10:25:06 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-87f4bd02-a367-4293-ad23-93b3534b6129 tempest-ProjectReaderTests-1505730503 None] Created volume successfully. Nov 04 10:25:06 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-4e6f93bd-493a-4413-9dbd-e547768be986 tempest-VolumesDeleteCascade-2146450032 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-1f2c1287-1b56-4b7d-9024-b22e833093b3.67e553e4-377f-44a0-b424-b6dee84089f0" returned: 0 in 0.537s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:25:06 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-4e6f93bd-493a-4413-9dbd-e547768be986 tempest-VolumesDeleteCascade-2146450032 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1f2c1287-1b56-4b7d-9024-b22e833093b3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87068) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 10:25:06 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-4e6f93bd-493a-4413-9dbd-e547768be986 tempest-VolumesDeleteCascade-2146450032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-1f2c1287-1b56-4b7d-9024-b22e833093b3.365a26dd-7955-4402-b47e-4ef7f2f555ad {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:25:06 devstack sudo[100813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-1f2c1287-1b56-4b7d-9024-b22e833093b3.365a26dd-7955-4402-b47e-4ef7f2f555ad Nov 04 10:25:06 devstack sudo[100813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:25:06 devstack sudo[100806]: pam_unix(sudo:session): session closed for user root Nov 04 10:25:07 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-df3833af-f9a9-4d9a-be10-ec16245ca51d tempest-CreateVolumesFromImageTest-778005494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-251b1ccf-1f0a-4a27-94e4-332e026494c4" returned: 0 in 0.406s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:25:07 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-df3833af-f9a9-4d9a-be10-ec16245ca51d tempest-CreateVolumesFromImageTest-778005494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-251b1ccf-1f0a-4a27-94e4-332e026494c4 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:25:07 devstack sudo[100818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-251b1ccf-1f0a-4a27-94e4-332e026494c4 Nov 04 10:25:07 devstack sudo[100818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:25:07 devstack sudo[100813]: pam_unix(sudo:session): session closed for user root Nov 04 10:25:07 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-4e6f93bd-493a-4413-9dbd-e547768be986 tempest-VolumesDeleteCascade-2146450032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-1f2c1287-1b56-4b7d-9024-b22e833093b3.365a26dd-7955-4402-b47e-4ef7f2f555ad" returned: 0 in 0.421s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:25:07 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-4e6f93bd-493a-4413-9dbd-e547768be986 tempest-VolumesDeleteCascade-2146450032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-1f2c1287-1b56-4b7d-9024-b22e833093b3.365a26dd-7955-4402-b47e-4ef7f2f555ad {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:25:07 devstack sudo[100818]: pam_unix(sudo:session): session closed for user root Nov 04 10:25:07 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-df3833af-f9a9-4d9a-be10-ec16245ca51d tempest-CreateVolumesFromImageTest-778005494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-251b1ccf-1f0a-4a27-94e4-332e026494c4" returned: 0 in 0.272s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:25:07 devstack sudo[100825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-1f2c1287-1b56-4b7d-9024-b22e833093b3.365a26dd-7955-4402-b47e-4ef7f2f555ad Nov 04 10:25:07 devstack sudo[100825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:25:07 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-df3833af-f9a9-4d9a-be10-ec16245ca51d tempest-CreateVolumesFromImageTest-778005494 None] Lock "cinder-quobyte-251b1ccf-1f0a-4a27-94e4-332e026494c4" released by "delete_volume" :: held 0.764s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:25:07 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-df3833af-f9a9-4d9a-be10-ec16245ca51d tempest-CreateVolumesFromImageTest-778005494 None] Created reservations ['b4f8c13c-42ab-4d12-ab8b-0c67bc72c87f', '3b586640-d666-4865-9cab-6b6b7c31209e', '1bbc011c-df12-41bd-83bb-e741aa7862f9', 'f8389ee7-beaf-4789-a6d1-bc7808ba0011'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:25:07 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-df3833af-f9a9-4d9a-be10-ec16245ca51d tempest-CreateVolumesFromImageTest-778005494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:25:07 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-df3833af-f9a9-4d9a-be10-ec16245ca51d tempest-CreateVolumesFromImageTest-778005494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:25:07 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-df3833af-f9a9-4d9a-be10-ec16245ca51d tempest-CreateVolumesFromImageTest-778005494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:25:07 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-df3833af-f9a9-4d9a-be10-ec16245ca51d tempest-CreateVolumesFromImageTest-778005494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:25:07 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-df3833af-f9a9-4d9a-be10-ec16245ca51d tempest-CreateVolumesFromImageTest-778005494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:25:07 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-df3833af-f9a9-4d9a-be10-ec16245ca51d tempest-CreateVolumesFromImageTest-778005494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:25:07 devstack sudo[100827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:25:07 devstack sudo[100827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:25:07 devstack sudo[100825]: pam_unix(sudo:session): session closed for user root Nov 04 10:25:07 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-4e6f93bd-493a-4413-9dbd-e547768be986 tempest-VolumesDeleteCascade-2146450032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-1f2c1287-1b56-4b7d-9024-b22e833093b3.365a26dd-7955-4402-b47e-4ef7f2f555ad" returned: 0 in 0.349s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:25:07 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-8fdc86e0-7c54-4eda-825f-87613a0988df tempest-ProjectReaderTests-1505730503 None] Acquiring lock "cinder-295896d6-507f-4060-8e80-4372ac9b9708-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:25:07 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-4e6f93bd-493a-4413-9dbd-e547768be986 tempest-VolumesDeleteCascade-2146450032 None] Lock "cinder-quobyte-365a26dd-7955-4402-b47e-4ef7f2f555ad" released by "_delete_snapshot" :: held 2.091s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:25:07 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-4e6f93bd-493a-4413-9dbd-e547768be986 tempest-VolumesDeleteCascade-2146450032 None] Lock "cinder-quobyte-1f2c1287-1b56-4b7d-9024-b22e833093b3" released by "delete_snapshot" :: held 2.182s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:25:07 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-8fdc86e0-7c54-4eda-825f-87613a0988df tempest-ProjectReaderTests-1505730503 None] Lock "cinder-295896d6-507f-4060-8e80-4372ac9b9708-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:25:07 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-8fdc86e0-7c54-4eda-825f-87613a0988df tempest-ProjectReaderTests-1505730503 None] Acquiring lock "cinder-quobyte-295896d6-507f-4060-8e80-4372ac9b9708" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:25:07 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-8fdc86e0-7c54-4eda-825f-87613a0988df tempest-ProjectReaderTests-1505730503 None] Lock "cinder-quobyte-295896d6-507f-4060-8e80-4372ac9b9708" acquired by "delete_volume" :: waited 0.026s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:25:07 devstack sudo[100827]: pam_unix(sudo:session): session closed for user root Nov 04 10:25:07 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-df3833af-f9a9-4d9a-be10-ec16245ca51d tempest-CreateVolumesFromImageTest-778005494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.387s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:25:07 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-df3833af-f9a9-4d9a-be10-ec16245ca51d tempest-CreateVolumesFromImageTest-778005494 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:25:07 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-df3833af-f9a9-4d9a-be10-ec16245ca51d tempest-CreateVolumesFromImageTest-778005494 None] Deleted volume successfully. Nov 04 10:25:07 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d60a0f4-6409-467a-a11e-0f661b65a004]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:25:07 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-8fdc86e0-7c54-4eda-825f-87613a0988df tempest-ProjectReaderTests-1505730503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-295896d6-507f-4060-8e80-4372ac9b9708 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:25:07 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-4e6f93bd-493a-4413-9dbd-e547768be986 tempest-VolumesDeleteCascade-2146450032 None] Created reservations ['e7311ef0-8430-4f20-af31-4f2998befa52', '96f4b6bc-0972-4ca7-997a-30c10dd52f13', '9db2c0b3-8350-4292-8e96-6b986d800845', '794b749d-e002-4bfb-aebe-df92bc3e0a4d'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:25:07 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-df3833af-f9a9-4d9a-be10-ec16245ca51d tempest-CreateVolumesFromImageTest-778005494 None] Lock "cinder-251b1ccf-1f0a-4a27-94e4-332e026494c4-delete_volume" released by "delete_volume" :: held 1.471s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:25:07 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-4e6f93bd-493a-4413-9dbd-e547768be986 tempest-VolumesDeleteCascade-2146450032 None] Delete snapshot completed successfully. Nov 04 10:25:07 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-4e6f93bd-493a-4413-9dbd-e547768be986 tempest-VolumesDeleteCascade-2146450032 None] Lock "cinder-365a26dd-7955-4402-b47e-4ef7f2f555ad-delete_snapshot" released by "delete_snapshot" :: held 2.573s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:25:07 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-4e6f93bd-493a-4413-9dbd-e547768be986 tempest-VolumesDeleteCascade-2146450032 None] Acquiring lock "cinder-67e553e4-377f-44a0-b424-b6dee84089f0-delete_snapshot" by "delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:25:07 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-4e6f93bd-493a-4413-9dbd-e547768be986 tempest-VolumesDeleteCascade-2146450032 None] Lock "cinder-67e553e4-377f-44a0-b424-b6dee84089f0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:25:07 devstack sudo[100831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-295896d6-507f-4060-8e80-4372ac9b9708 Nov 04 10:25:07 devstack sudo[100831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:25:08 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-4e6f93bd-493a-4413-9dbd-e547768be986 tempest-VolumesDeleteCascade-2146450032 None] Acquiring lock "cinder-quobyte-1f2c1287-1b56-4b7d-9024-b22e833093b3" by "delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:25:08 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-4e6f93bd-493a-4413-9dbd-e547768be986 tempest-VolumesDeleteCascade-2146450032 None] Lock "cinder-quobyte-1f2c1287-1b56-4b7d-9024-b22e833093b3" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:25:08 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-4e6f93bd-493a-4413-9dbd-e547768be986 tempest-VolumesDeleteCascade-2146450032 None] Acquiring lock "cinder-quobyte-67e553e4-377f-44a0-b424-b6dee84089f0" by "_delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:25:08 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-4e6f93bd-493a-4413-9dbd-e547768be986 tempest-VolumesDeleteCascade-2146450032 None] Lock "cinder-quobyte-67e553e4-377f-44a0-b424-b6dee84089f0" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:25:08 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-4e6f93bd-493a-4413-9dbd-e547768be986 tempest-VolumesDeleteCascade-2146450032 None] Deleting offline snapshot 67e553e4-377f-44a0-b424-b6dee84089f0 of volume 1f2c1287-1b56-4b7d-9024-b22e833093b3 {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 10:25:08 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-4e6f93bd-493a-4413-9dbd-e547768be986 tempest-VolumesDeleteCascade-2146450032 None] snapshot_file for this snap is: volume-1f2c1287-1b56-4b7d-9024-b22e833093b3.67e553e4-377f-44a0-b424-b6dee84089f0 {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 10:25:08 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[8face960-3614-459b-b04f-44744d20950e]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:25:08 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-4e6f93bd-493a-4413-9dbd-e547768be986 tempest-VolumesDeleteCascade-2146450032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-1f2c1287-1b56-4b7d-9024-b22e833093b3.67e553e4-377f-44a0-b424-b6dee84089f0 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:25:08 devstack sudo[100833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-1f2c1287-1b56-4b7d-9024-b22e833093b3.67e553e4-377f-44a0-b424-b6dee84089f0 Nov 04 10:25:08 devstack sudo[100833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:25:08 devstack sudo[100831]: pam_unix(sudo:session): session closed for user root Nov 04 10:25:08 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-8fdc86e0-7c54-4eda-825f-87613a0988df tempest-ProjectReaderTests-1505730503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-295896d6-507f-4060-8e80-4372ac9b9708" returned: 0 in 0.538s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:25:08 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-8fdc86e0-7c54-4eda-825f-87613a0988df tempest-ProjectReaderTests-1505730503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-295896d6-507f-4060-8e80-4372ac9b9708 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:25:08 devstack sudo[100839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-295896d6-507f-4060-8e80-4372ac9b9708 Nov 04 10:25:08 devstack sudo[100839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:25:08 devstack sudo[100833]: pam_unix(sudo:session): session closed for user root Nov 04 10:25:08 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-4e6f93bd-493a-4413-9dbd-e547768be986 tempest-VolumesDeleteCascade-2146450032 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-1f2c1287-1b56-4b7d-9024-b22e833093b3.67e553e4-377f-44a0-b424-b6dee84089f0" returned: 0 in 0.607s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:25:08 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-4e6f93bd-493a-4413-9dbd-e547768be986 tempest-VolumesDeleteCascade-2146450032 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1f2c1287-1b56-4b7d-9024-b22e833093b3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87068) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 10:25:08 devstack sudo[100839]: pam_unix(sudo:session): session closed for user root Nov 04 10:25:08 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-8fdc86e0-7c54-4eda-825f-87613a0988df tempest-ProjectReaderTests-1505730503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-295896d6-507f-4060-8e80-4372ac9b9708" returned: 0 in 0.352s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:25:08 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa82b276-4d3d-4542-aa52-b9578b5e9d7a]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:25:08 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-4e6f93bd-493a-4413-9dbd-e547768be986 tempest-VolumesDeleteCascade-2146450032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-1f2c1287-1b56-4b7d-9024-b22e833093b3 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:25:08 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-8fdc86e0-7c54-4eda-825f-87613a0988df tempest-ProjectReaderTests-1505730503 None] Lock "cinder-quobyte-295896d6-507f-4060-8e80-4372ac9b9708" released by "delete_volume" :: held 0.970s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:25:08 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-8fdc86e0-7c54-4eda-825f-87613a0988df tempest-ProjectReaderTests-1505730503 None] Created reservations ['44108ac6-f849-436c-b01e-7968ff5cbe8d', '8823d966-713f-46d3-aca7-3ab7fb486f22', '1baef2e4-c98c-4d58-9c60-34948499bd86', '405b2344-9a13-48fd-9f80-a68ecd65eb7a'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:25:08 devstack sudo[100845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-1f2c1287-1b56-4b7d-9024-b22e833093b3 Nov 04 10:25:08 devstack sudo[100845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:25:08 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-8fdc86e0-7c54-4eda-825f-87613a0988df tempest-ProjectReaderTests-1505730503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:25:08 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-8fdc86e0-7c54-4eda-825f-87613a0988df tempest-ProjectReaderTests-1505730503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:25:08 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-8fdc86e0-7c54-4eda-825f-87613a0988df tempest-ProjectReaderTests-1505730503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:25:08 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-8fdc86e0-7c54-4eda-825f-87613a0988df tempest-ProjectReaderTests-1505730503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:25:08 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-8fdc86e0-7c54-4eda-825f-87613a0988df tempest-ProjectReaderTests-1505730503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:25:08 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-8fdc86e0-7c54-4eda-825f-87613a0988df tempest-ProjectReaderTests-1505730503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:25:08 devstack sudo[100847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:25:08 devstack sudo[100847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:25:09 devstack sudo[100845]: pam_unix(sudo:session): session closed for user root Nov 04 10:25:09 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-4e6f93bd-493a-4413-9dbd-e547768be986 tempest-VolumesDeleteCascade-2146450032 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-1f2c1287-1b56-4b7d-9024-b22e833093b3" returned: 0 in 0.441s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:25:09 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-4e6f93bd-493a-4413-9dbd-e547768be986 tempest-VolumesDeleteCascade-2146450032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-1f2c1287-1b56-4b7d-9024-b22e833093b3.67e553e4-377f-44a0-b424-b6dee84089f0 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:25:09 devstack sudo[100852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-1f2c1287-1b56-4b7d-9024-b22e833093b3.67e553e4-377f-44a0-b424-b6dee84089f0 Nov 04 10:25:09 devstack sudo[100852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:25:09 devstack sudo[100847]: pam_unix(sudo:session): session closed for user root Nov 04 10:25:09 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-8fdc86e0-7c54-4eda-825f-87613a0988df tempest-ProjectReaderTests-1505730503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.393s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:25:09 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-8fdc86e0-7c54-4eda-825f-87613a0988df tempest-ProjectReaderTests-1505730503 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:25:09 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-8fdc86e0-7c54-4eda-825f-87613a0988df tempest-ProjectReaderTests-1505730503 None] Deleted volume successfully. Nov 04 10:25:09 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-8fdc86e0-7c54-4eda-825f-87613a0988df tempest-ProjectReaderTests-1505730503 None] Lock "cinder-295896d6-507f-4060-8e80-4372ac9b9708-delete_volume" released by "delete_volume" :: held 1.646s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:25:09 devstack sudo[100852]: pam_unix(sudo:session): session closed for user root Nov 04 10:25:09 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-4e6f93bd-493a-4413-9dbd-e547768be986 tempest-VolumesDeleteCascade-2146450032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-1f2c1287-1b56-4b7d-9024-b22e833093b3.67e553e4-377f-44a0-b424-b6dee84089f0" returned: 0 in 0.469s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:25:09 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-4e6f93bd-493a-4413-9dbd-e547768be986 tempest-VolumesDeleteCascade-2146450032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-1f2c1287-1b56-4b7d-9024-b22e833093b3.67e553e4-377f-44a0-b424-b6dee84089f0 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:25:09 devstack sudo[100861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-1f2c1287-1b56-4b7d-9024-b22e833093b3.67e553e4-377f-44a0-b424-b6dee84089f0 Nov 04 10:25:09 devstack sudo[100861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:25:09 devstack sudo[100861]: pam_unix(sudo:session): session closed for user root Nov 04 10:25:09 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-4e6f93bd-493a-4413-9dbd-e547768be986 tempest-VolumesDeleteCascade-2146450032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-1f2c1287-1b56-4b7d-9024-b22e833093b3.67e553e4-377f-44a0-b424-b6dee84089f0" returned: 0 in 0.316s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:25:10 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-4e6f93bd-493a-4413-9dbd-e547768be986 tempest-VolumesDeleteCascade-2146450032 None] Lock "cinder-quobyte-67e553e4-377f-44a0-b424-b6dee84089f0" released by "_delete_snapshot" :: held 1.979s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:25:10 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-4e6f93bd-493a-4413-9dbd-e547768be986 tempest-VolumesDeleteCascade-2146450032 None] Lock "cinder-quobyte-1f2c1287-1b56-4b7d-9024-b22e833093b3" released by "delete_snapshot" :: held 2.005s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:25:10 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-4e6f93bd-493a-4413-9dbd-e547768be986 tempest-VolumesDeleteCascade-2146450032 None] Created reservations ['8702b5ae-84ea-4b19-b1e5-d1261f86e005', 'afb8646b-1cc4-49cd-82ed-dc57718fc22b', '9ef29f7b-999b-4dc3-b2d5-8fa0a7c4e503', 'c29f4f3d-c18b-4a1e-bbfc-00f76aabb7e6'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:25:10 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-4e6f93bd-493a-4413-9dbd-e547768be986 tempest-VolumesDeleteCascade-2146450032 None] Delete snapshot completed successfully. Nov 04 10:25:10 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-4e6f93bd-493a-4413-9dbd-e547768be986 tempest-VolumesDeleteCascade-2146450032 None] Lock "cinder-67e553e4-377f-44a0-b424-b6dee84089f0-delete_snapshot" released by "delete_snapshot" :: held 2.229s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:25:10 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-4e6f93bd-493a-4413-9dbd-e547768be986 tempest-VolumesDeleteCascade-2146450032 None] Snapshots deleted, issuing volume delete {{(pid=87068) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Nov 04 10:25:10 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-4e6f93bd-493a-4413-9dbd-e547768be986 tempest-VolumesDeleteCascade-2146450032 None] Acquiring lock "cinder-quobyte-1f2c1287-1b56-4b7d-9024-b22e833093b3" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:25:10 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-4e6f93bd-493a-4413-9dbd-e547768be986 tempest-VolumesDeleteCascade-2146450032 None] Lock "cinder-quobyte-1f2c1287-1b56-4b7d-9024-b22e833093b3" acquired by "delete_volume" :: waited 0.022s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:25:10 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec436a20-16f7-4c2c-ba91-16949e7fcb19]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:25:10 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-4e6f93bd-493a-4413-9dbd-e547768be986 tempest-VolumesDeleteCascade-2146450032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-1f2c1287-1b56-4b7d-9024-b22e833093b3 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:25:10 devstack sudo[100865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-1f2c1287-1b56-4b7d-9024-b22e833093b3 Nov 04 10:25:10 devstack sudo[100865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:25:10 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-b63b1f22-09c2-453c-9df1-ae91f4c8300a tempest-ProjectReaderTests-1505730503 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:25:10 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-b63b1f22-09c2-453c-9df1-ae91f4c8300a tempest-ProjectReaderTests-1505730503 None] Flow 'volume_create_manager' (f3aeadcd-4bfd-41fd-a65d-329a55580c9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:25:10 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-b63b1f22-09c2-453c-9df1-ae91f4c8300a tempest-ProjectReaderTests-1505730503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f4f4247-911d-492b-a701-5dc26f9f0ede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:25:10 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-b63b1f22-09c2-453c-9df1-ae91f4c8300a tempest-ProjectReaderTests-1505730503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f4f4247-911d-492b-a701-5dc26f9f0ede) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:25:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1944070758',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2eaf634-2d79-4747-8809-8e3a7186e090,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4e0b63f17594427a2929254e282322b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:25:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:25:11Z,use_quota=True,user_id='d92d849e895242e7b6d98621572cde14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:25:10 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-b63b1f22-09c2-453c-9df1-ae91f4c8300a tempest-ProjectReaderTests-1505730503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (319c8c54-50ed-42c6-a6c1-26ce2ec9cb02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:25:10 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-b63b1f22-09c2-453c-9df1-ae91f4c8300a tempest-ProjectReaderTests-1505730503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (319c8c54-50ed-42c6-a6c1-26ce2ec9cb02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:25:10 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-b63b1f22-09c2-453c-9df1-ae91f4c8300a tempest-ProjectReaderTests-1505730503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61cbdc29-3899-4a68-ab9d-517c5eac38ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:25:10 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-b63b1f22-09c2-453c-9df1-ae91f4c8300a tempest-ProjectReaderTests-1505730503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61cbdc29-3899-4a68-ab9d-517c5eac38ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2eaf634-2d79-4747-8809-8e3a7186e090', 'volume_name': 'volume-a2eaf634-2d79-4747-8809-8e3a7186e090', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:25:10 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-b63b1f22-09c2-453c-9df1-ae91f4c8300a tempest-ProjectReaderTests-1505730503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a3609b7-0b92-4f79-bcb6-a917d7a8838a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:25:10 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-b63b1f22-09c2-453c-9df1-ae91f4c8300a tempest-ProjectReaderTests-1505730503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a3609b7-0b92-4f79-bcb6-a917d7a8838a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:25:10 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-b63b1f22-09c2-453c-9df1-ae91f4c8300a tempest-ProjectReaderTests-1505730503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf4eaccc-0369-4318-9177-847ddc7e211f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:25:10 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-b63b1f22-09c2-453c-9df1-ae91f4c8300a tempest-ProjectReaderTests-1505730503 None] Volume a2eaf634-2d79-4747-8809-8e3a7186e090: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2eaf634-2d79-4747-8809-8e3a7186e090', 'volume_size': 1} Nov 04 10:25:10 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-b63b1f22-09c2-453c-9df1-ae91f4c8300a tempest-ProjectReaderTests-1505730503 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:25:10 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-b63b1f22-09c2-453c-9df1-ae91f4c8300a tempest-ProjectReaderTests-1505730503 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:25:10 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-b63b1f22-09c2-453c-9df1-ae91f4c8300a tempest-ProjectReaderTests-1505730503 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:25:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1944070758',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2eaf634-2d79-4747-8809-8e3a7186e090,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4e0b63f17594427a2929254e282322b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:25:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:25:11Z,use_quota=True,user_id='d92d849e895242e7b6d98621572cde14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 10:25:10 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-b63b1f22-09c2-453c-9df1-ae91f4c8300a tempest-ProjectReaderTests-1505730503 None] Creating volume a2eaf634-2d79-4747-8809-8e3a7186e090 {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:25:10 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-b63b1f22-09c2-453c-9df1-ae91f4c8300a tempest-ProjectReaderTests-1505730503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:25:10 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-b63b1f22-09c2-453c-9df1-ae91f4c8300a tempest-ProjectReaderTests-1505730503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:25:10 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-b63b1f22-09c2-453c-9df1-ae91f4c8300a tempest-ProjectReaderTests-1505730503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:25:10 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-b63b1f22-09c2-453c-9df1-ae91f4c8300a tempest-ProjectReaderTests-1505730503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:25:10 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-b63b1f22-09c2-453c-9df1-ae91f4c8300a tempest-ProjectReaderTests-1505730503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:25:10 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-b63b1f22-09c2-453c-9df1-ae91f4c8300a tempest-ProjectReaderTests-1505730503 None] Selected osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:25:10 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-b63b1f22-09c2-453c-9df1-ae91f4c8300a tempest-ProjectReaderTests-1505730503 None] casted to osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 Nov 04 10:25:10 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-b63b1f22-09c2-453c-9df1-ae91f4c8300a tempest-ProjectReaderTests-1505730503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-a2eaf634-2d79-4747-8809-8e3a7186e090 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:25:10 devstack sudo[100867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-a2eaf634-2d79-4747-8809-8e3a7186e090 1073741824 Nov 04 10:25:10 devstack sudo[100867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:25:10 devstack sudo[100865]: pam_unix(sudo:session): session closed for user root Nov 04 10:25:10 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-4e6f93bd-493a-4413-9dbd-e547768be986 tempest-VolumesDeleteCascade-2146450032 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-1f2c1287-1b56-4b7d-9024-b22e833093b3" returned: 0 in 0.567s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:25:10 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-4e6f93bd-493a-4413-9dbd-e547768be986 tempest-VolumesDeleteCascade-2146450032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-1f2c1287-1b56-4b7d-9024-b22e833093b3 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:25:10 devstack sudo[100873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-1f2c1287-1b56-4b7d-9024-b22e833093b3 Nov 04 10:25:10 devstack sudo[100873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:25:11 devstack sudo[100873]: pam_unix(sudo:session): session closed for user root Nov 04 10:25:11 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-4e6f93bd-493a-4413-9dbd-e547768be986 tempest-VolumesDeleteCascade-2146450032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-1f2c1287-1b56-4b7d-9024-b22e833093b3" returned: 0 in 0.298s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:25:11 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-4e6f93bd-493a-4413-9dbd-e547768be986 tempest-VolumesDeleteCascade-2146450032 None] Lock "cinder-quobyte-1f2c1287-1b56-4b7d-9024-b22e833093b3" released by "delete_volume" :: held 0.965s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:25:11 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-4e6f93bd-493a-4413-9dbd-e547768be986 tempest-VolumesDeleteCascade-2146450032 None] Created reservations ['f69b657c-814f-4b6e-ad0e-6679a850077d', '272b428c-e4e1-4c16-a8b6-81b30f363d30', '4fb1cdbb-1297-4652-91a9-d267c8db62f6', '6a71555e-2063-4b13-9646-a573f5f4b8ff'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:25:11 devstack sudo[100867]: pam_unix(sudo:session): session closed for user root Nov 04 10:25:11 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-b63b1f22-09c2-453c-9df1-ae91f4c8300a tempest-ProjectReaderTests-1505730503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-a2eaf634-2d79-4747-8809-8e3a7186e090 1073741824" returned: 0 in 0.560s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:25:11 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-b63b1f22-09c2-453c-9df1-ae91f4c8300a tempest-ProjectReaderTests-1505730503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-a2eaf634-2d79-4747-8809-8e3a7186e090 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:25:11 devstack sudo[100880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-a2eaf634-2d79-4747-8809-8e3a7186e090 Nov 04 10:25:11 devstack sudo[100880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:25:11 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-4e6f93bd-493a-4413-9dbd-e547768be986 tempest-VolumesDeleteCascade-2146450032 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:25:11 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-4e6f93bd-493a-4413-9dbd-e547768be986 tempest-VolumesDeleteCascade-2146450032 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:25:11 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-4e6f93bd-493a-4413-9dbd-e547768be986 tempest-VolumesDeleteCascade-2146450032 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:25:11 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-4e6f93bd-493a-4413-9dbd-e547768be986 tempest-VolumesDeleteCascade-2146450032 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:25:11 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-4e6f93bd-493a-4413-9dbd-e547768be986 tempest-VolumesDeleteCascade-2146450032 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:25:11 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-4e6f93bd-493a-4413-9dbd-e547768be986 tempest-VolumesDeleteCascade-2146450032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:25:11 devstack sudo[100882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:25:11 devstack sudo[100882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:25:11 devstack sudo[100880]: pam_unix(sudo:session): session closed for user root Nov 04 10:25:11 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-b63b1f22-09c2-453c-9df1-ae91f4c8300a tempest-ProjectReaderTests-1505730503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-a2eaf634-2d79-4747-8809-8e3a7186e090" returned: 0 in 0.319s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:25:11 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-b63b1f22-09c2-453c-9df1-ae91f4c8300a tempest-ProjectReaderTests-1505730503 None] <== create_volume: return (940ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 10:25:11 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-b63b1f22-09c2-453c-9df1-ae91f4c8300a tempest-ProjectReaderTests-1505730503 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.943s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:25:11 devstack sudo[100882]: pam_unix(sudo:session): session closed for user root Nov 04 10:25:11 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-4e6f93bd-493a-4413-9dbd-e547768be986 tempest-VolumesDeleteCascade-2146450032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.270s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:25:11 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-4e6f93bd-493a-4413-9dbd-e547768be986 tempest-VolumesDeleteCascade-2146450032 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:25:11 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-4e6f93bd-493a-4413-9dbd-e547768be986 tempest-VolumesDeleteCascade-2146450032 None] Deleted volume successfully. Nov 04 10:25:11 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-b63b1f22-09c2-453c-9df1-ae91f4c8300a tempest-ProjectReaderTests-1505730503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf4eaccc-0369-4318-9177-847ddc7e211f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2eaf634-2d79-4747-8809-8e3a7186e090', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:25:11 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-b63b1f22-09c2-453c-9df1-ae91f4c8300a tempest-ProjectReaderTests-1505730503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9788d136-0a0a-455e-b40d-b261db464adf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:25:11 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-b63b1f22-09c2-453c-9df1-ae91f4c8300a tempest-ProjectReaderTests-1505730503 None] Volume volume-a2eaf634-2d79-4747-8809-8e3a7186e090 (a2eaf634-2d79-4747-8809-8e3a7186e090): created successfully Nov 04 10:25:11 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-b63b1f22-09c2-453c-9df1-ae91f4c8300a tempest-ProjectReaderTests-1505730503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9788d136-0a0a-455e-b40d-b261db464adf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:25:11 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-b63b1f22-09c2-453c-9df1-ae91f4c8300a tempest-ProjectReaderTests-1505730503 None] Flow 'volume_create_manager' (f3aeadcd-4bfd-41fd-a65d-329a55580c9e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:25:11 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-4e6f93bd-493a-4413-9dbd-e547768be986 tempest-VolumesDeleteCascade-2146450032 None] Lock "cinder-1f2c1287-1b56-4b7d-9024-b22e833093b3-delete_volume" released by "delete_volume" :: held 6.541s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:25:11 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-b63b1f22-09c2-453c-9df1-ae91f4c8300a tempest-ProjectReaderTests-1505730503 None] Created volume successfully. Nov 04 10:25:12 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-21453011-e400-4789-8be4-6b33fece0e48 tempest-ProjectReaderTests-1505730503 None] Acquiring lock "cinder-a2eaf634-2d79-4747-8809-8e3a7186e090-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:25:12 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-21453011-e400-4789-8be4-6b33fece0e48 tempest-ProjectReaderTests-1505730503 None] Lock "cinder-a2eaf634-2d79-4747-8809-8e3a7186e090-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:25:12 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-21453011-e400-4789-8be4-6b33fece0e48 tempest-ProjectReaderTests-1505730503 None] Acquiring lock "cinder-quobyte-a2eaf634-2d79-4747-8809-8e3a7186e090" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:25:12 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-21453011-e400-4789-8be4-6b33fece0e48 tempest-ProjectReaderTests-1505730503 None] Lock "cinder-quobyte-a2eaf634-2d79-4747-8809-8e3a7186e090" acquired by "delete_volume" :: waited 0.015s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:25:12 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[50802ca4-ac4e-40eb-bbd2-c41bd58777dd]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:25:12 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-21453011-e400-4789-8be4-6b33fece0e48 tempest-ProjectReaderTests-1505730503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-a2eaf634-2d79-4747-8809-8e3a7186e090 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:25:12 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-73532235-e48c-4d05-a354-8fa4fef2e32b tempest-VolumesDeleteCascade-2146450032 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:25:12 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-73532235-e48c-4d05-a354-8fa4fef2e32b tempest-VolumesDeleteCascade-2146450032 None] Flow 'volume_create_manager' (198557a8-2338-455f-bd6a-43391021dc89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:25:12 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-73532235-e48c-4d05-a354-8fa4fef2e32b tempest-VolumesDeleteCascade-2146450032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (589b32b2-613a-4cc5-a837-dd801bfddeb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:25:12 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-73532235-e48c-4d05-a354-8fa4fef2e32b tempest-VolumesDeleteCascade-2146450032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (589b32b2-613a-4cc5-a837-dd801bfddeb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:25:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1547224900',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ddd597bc-f6b7-411b-844a-509267d13a81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fdc968ee22341bdaa6192576bfcb30d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:25:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:25:13Z,use_quota=True,user_id='b760fe208cb04e798444643a284ba280',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:25:12 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-73532235-e48c-4d05-a354-8fa4fef2e32b tempest-VolumesDeleteCascade-2146450032 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec623ce4-fcba-409a-88fa-72faa4853642) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:25:12 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-73532235-e48c-4d05-a354-8fa4fef2e32b tempest-VolumesDeleteCascade-2146450032 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec623ce4-fcba-409a-88fa-72faa4853642) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:25:13 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-73532235-e48c-4d05-a354-8fa4fef2e32b tempest-VolumesDeleteCascade-2146450032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df1415c9-8de3-40d0-b430-2e6525e913f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:25:13 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-73532235-e48c-4d05-a354-8fa4fef2e32b tempest-VolumesDeleteCascade-2146450032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df1415c9-8de3-40d0-b430-2e6525e913f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ddd597bc-f6b7-411b-844a-509267d13a81', 'volume_name': 'volume-ddd597bc-f6b7-411b-844a-509267d13a81', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:25:13 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-73532235-e48c-4d05-a354-8fa4fef2e32b tempest-VolumesDeleteCascade-2146450032 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a88a9b3-ecca-4a43-9cd5-127064977562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:25:13 devstack sudo[100887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-a2eaf634-2d79-4747-8809-8e3a7186e090 Nov 04 10:25:13 devstack sudo[100887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:25:13 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-73532235-e48c-4d05-a354-8fa4fef2e32b tempest-VolumesDeleteCascade-2146450032 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a88a9b3-ecca-4a43-9cd5-127064977562) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:25:13 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-73532235-e48c-4d05-a354-8fa4fef2e32b tempest-VolumesDeleteCascade-2146450032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74a4c757-dc3d-460e-8874-7ddae5bed1ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:25:13 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-73532235-e48c-4d05-a354-8fa4fef2e32b tempest-VolumesDeleteCascade-2146450032 None] Volume ddd597bc-f6b7-411b-844a-509267d13a81: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ddd597bc-f6b7-411b-844a-509267d13a81', 'volume_size': 1} Nov 04 10:25:13 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-73532235-e48c-4d05-a354-8fa4fef2e32b tempest-VolumesDeleteCascade-2146450032 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:25:13 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-73532235-e48c-4d05-a354-8fa4fef2e32b tempest-VolumesDeleteCascade-2146450032 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:25:13 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-73532235-e48c-4d05-a354-8fa4fef2e32b tempest-VolumesDeleteCascade-2146450032 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:25:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1547224900',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ddd597bc-f6b7-411b-844a-509267d13a81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fdc968ee22341bdaa6192576bfcb30d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:25:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:25:13Z,use_quota=True,user_id='b760fe208cb04e798444643a284ba280',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 10:25:13 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-73532235-e48c-4d05-a354-8fa4fef2e32b tempest-VolumesDeleteCascade-2146450032 None] Creating volume ddd597bc-f6b7-411b-844a-509267d13a81 {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:25:13 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-73532235-e48c-4d05-a354-8fa4fef2e32b tempest-VolumesDeleteCascade-2146450032 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:25:13 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-73532235-e48c-4d05-a354-8fa4fef2e32b tempest-VolumesDeleteCascade-2146450032 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:25:13 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-73532235-e48c-4d05-a354-8fa4fef2e32b tempest-VolumesDeleteCascade-2146450032 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:25:13 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-73532235-e48c-4d05-a354-8fa4fef2e32b tempest-VolumesDeleteCascade-2146450032 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:25:13 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-73532235-e48c-4d05-a354-8fa4fef2e32b tempest-VolumesDeleteCascade-2146450032 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:25:13 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-73532235-e48c-4d05-a354-8fa4fef2e32b tempest-VolumesDeleteCascade-2146450032 None] Selected osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:25:13 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-73532235-e48c-4d05-a354-8fa4fef2e32b tempest-VolumesDeleteCascade-2146450032 None] casted to osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 Nov 04 10:25:13 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-73532235-e48c-4d05-a354-8fa4fef2e32b tempest-VolumesDeleteCascade-2146450032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-ddd597bc-f6b7-411b-844a-509267d13a81 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:25:13 devstack sudo[100889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-ddd597bc-f6b7-411b-844a-509267d13a81 1073741824 Nov 04 10:25:13 devstack sudo[100889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:25:13 devstack sudo[100887]: pam_unix(sudo:session): session closed for user root Nov 04 10:25:13 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-21453011-e400-4789-8be4-6b33fece0e48 tempest-ProjectReaderTests-1505730503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-a2eaf634-2d79-4747-8809-8e3a7186e090" returned: 0 in 0.452s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:25:13 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-21453011-e400-4789-8be4-6b33fece0e48 tempest-ProjectReaderTests-1505730503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-a2eaf634-2d79-4747-8809-8e3a7186e090 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:25:13 devstack sudo[100897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-a2eaf634-2d79-4747-8809-8e3a7186e090 Nov 04 10:25:13 devstack sudo[100897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:25:13 devstack sudo[100889]: pam_unix(sudo:session): session closed for user root Nov 04 10:25:13 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-73532235-e48c-4d05-a354-8fa4fef2e32b tempest-VolumesDeleteCascade-2146450032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-ddd597bc-f6b7-411b-844a-509267d13a81 1073741824" returned: 0 in 0.618s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:25:13 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-73532235-e48c-4d05-a354-8fa4fef2e32b tempest-VolumesDeleteCascade-2146450032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-ddd597bc-f6b7-411b-844a-509267d13a81 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:25:13 devstack sudo[100897]: pam_unix(sudo:session): session closed for user root Nov 04 10:25:13 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-21453011-e400-4789-8be4-6b33fece0e48 tempest-ProjectReaderTests-1505730503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-a2eaf634-2d79-4747-8809-8e3a7186e090" returned: 0 in 0.371s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:25:13 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-21453011-e400-4789-8be4-6b33fece0e48 tempest-ProjectReaderTests-1505730503 None] Lock "cinder-quobyte-a2eaf634-2d79-4747-8809-8e3a7186e090" released by "delete_volume" :: held 0.884s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:25:13 devstack sudo[100901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-ddd597bc-f6b7-411b-844a-509267d13a81 Nov 04 10:25:13 devstack sudo[100901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:25:13 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-21453011-e400-4789-8be4-6b33fece0e48 tempest-ProjectReaderTests-1505730503 None] Created reservations ['f7c6158c-0c19-4995-9f83-9816ffc7abf9', '166f5bf4-e5c5-439f-a499-2cfa3d122de6', 'a2c0a6e2-be43-4c2e-822d-682e81577c7e', 'a731b77e-e998-4f86-a26d-f4168c5fe3a0'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:25:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-21453011-e400-4789-8be4-6b33fece0e48 tempest-ProjectReaderTests-1505730503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:25:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-21453011-e400-4789-8be4-6b33fece0e48 tempest-ProjectReaderTests-1505730503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:25:14 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-21453011-e400-4789-8be4-6b33fece0e48 tempest-ProjectReaderTests-1505730503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:25:14 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-21453011-e400-4789-8be4-6b33fece0e48 tempest-ProjectReaderTests-1505730503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:25:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-21453011-e400-4789-8be4-6b33fece0e48 tempest-ProjectReaderTests-1505730503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:25:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-21453011-e400-4789-8be4-6b33fece0e48 tempest-ProjectReaderTests-1505730503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:25:14 devstack sudo[100908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:25:14 devstack sudo[100908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:25:14 devstack sudo[100901]: pam_unix(sudo:session): session closed for user root Nov 04 10:25:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-73532235-e48c-4d05-a354-8fa4fef2e32b tempest-VolumesDeleteCascade-2146450032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-ddd597bc-f6b7-411b-844a-509267d13a81" returned: 0 in 0.546s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:25:14 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-73532235-e48c-4d05-a354-8fa4fef2e32b tempest-VolumesDeleteCascade-2146450032 None] <== create_volume: return (1227ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 10:25:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-73532235-e48c-4d05-a354-8fa4fef2e32b tempest-VolumesDeleteCascade-2146450032 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.232s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:25:14 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-73532235-e48c-4d05-a354-8fa4fef2e32b tempest-VolumesDeleteCascade-2146450032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74a4c757-dc3d-460e-8874-7ddae5bed1ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ddd597bc-f6b7-411b-844a-509267d13a81', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:25:14 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-73532235-e48c-4d05-a354-8fa4fef2e32b tempest-VolumesDeleteCascade-2146450032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd31c620-efd1-4bfb-a023-13efa963633b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:25:14 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-73532235-e48c-4d05-a354-8fa4fef2e32b tempest-VolumesDeleteCascade-2146450032 None] Volume volume-ddd597bc-f6b7-411b-844a-509267d13a81 (ddd597bc-f6b7-411b-844a-509267d13a81): created successfully Nov 04 10:25:14 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-73532235-e48c-4d05-a354-8fa4fef2e32b tempest-VolumesDeleteCascade-2146450032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd31c620-efd1-4bfb-a023-13efa963633b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:25:14 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-73532235-e48c-4d05-a354-8fa4fef2e32b tempest-VolumesDeleteCascade-2146450032 None] Flow 'volume_create_manager' (198557a8-2338-455f-bd6a-43391021dc89) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:25:14 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-73532235-e48c-4d05-a354-8fa4fef2e32b tempest-VolumesDeleteCascade-2146450032 None] Created volume successfully. Nov 04 10:25:14 devstack sudo[100908]: pam_unix(sudo:session): session closed for user root Nov 04 10:25:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-21453011-e400-4789-8be4-6b33fece0e48 tempest-ProjectReaderTests-1505730503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.434s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:25:14 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-21453011-e400-4789-8be4-6b33fece0e48 tempest-ProjectReaderTests-1505730503 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:25:14 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-21453011-e400-4789-8be4-6b33fece0e48 tempest-ProjectReaderTests-1505730503 None] Deleted volume successfully. Nov 04 10:25:14 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-21453011-e400-4789-8be4-6b33fece0e48 tempest-ProjectReaderTests-1505730503 None] Lock "cinder-a2eaf634-2d79-4747-8809-8e3a7186e090-delete_volume" released by "delete_volume" :: held 1.722s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:25:15 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-d919db95-594b-49ab-a59d-d2b696c44f40 tempest-VolumesDeleteCascade-2146450032 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:25:15 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-d919db95-594b-49ab-a59d-d2b696c44f40 tempest-VolumesDeleteCascade-2146450032 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:25:15 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-d919db95-594b-49ab-a59d-d2b696c44f40 tempest-VolumesDeleteCascade-2146450032 None] Creating offline snapshot 4662b1d2-6296-4730-8c5e-87ae2c74d1b5 of volume ddd597bc-f6b7-411b-844a-509267d13a81 {{(pid=87068) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 10:25:15 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[01580f54-feb2-4f17-81ee-840d899bc8ac]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:25:15 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d919db95-594b-49ab-a59d-d2b696c44f40 tempest-VolumesDeleteCascade-2146450032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-ddd597bc-f6b7-411b-844a-509267d13a81 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:25:15 devstack sudo[100912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-ddd597bc-f6b7-411b-844a-509267d13a81 Nov 04 10:25:15 devstack sudo[100912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:25:15 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-49bb4c73-de63-4ab3-8a2e-2ad2737212a9 tempest-ProjectReaderTests-1505730503 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:25:15 devstack sudo[100912]: pam_unix(sudo:session): session closed for user root Nov 04 10:25:15 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-49bb4c73-de63-4ab3-8a2e-2ad2737212a9 tempest-ProjectReaderTests-1505730503 None] Flow 'volume_create_manager' (ba9f447d-abcb-46f7-aaba-8845f68b3524) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:25:15 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-49bb4c73-de63-4ab3-8a2e-2ad2737212a9 tempest-ProjectReaderTests-1505730503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c023cf5-365f-4bb3-9d4a-42d92ae5bcbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:25:15 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d919db95-594b-49ab-a59d-d2b696c44f40 tempest-VolumesDeleteCascade-2146450032 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-ddd597bc-f6b7-411b-844a-509267d13a81" returned: 0 in 0.495s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:25:15 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d919db95-594b-49ab-a59d-d2b696c44f40 tempest-VolumesDeleteCascade-2146450032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-ddd597bc-f6b7-411b-844a-509267d13a81,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-ddd597bc-f6b7-411b-844a-509267d13a81.4662b1d2-6296-4730-8c5e-87ae2c74d1b5 1G {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:25:15 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-49bb4c73-de63-4ab3-8a2e-2ad2737212a9 tempest-ProjectReaderTests-1505730503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c023cf5-365f-4bb3-9d4a-42d92ae5bcbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:25:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1645716860',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f78bd97-86be-41d5-a975-deb18293ecb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4e0b63f17594427a2929254e282322b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:25:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:25:16Z,use_quota=True,user_id='d92d849e895242e7b6d98621572cde14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:25:15 devstack sudo[100921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-ddd597bc-f6b7-411b-844a-509267d13a81,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-ddd597bc-f6b7-411b-844a-509267d13a81.4662b1d2-6296-4730-8c5e-87ae2c74d1b5 1G Nov 04 10:25:15 devstack sudo[100921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:25:15 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-49bb4c73-de63-4ab3-8a2e-2ad2737212a9 tempest-ProjectReaderTests-1505730503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2535e8b-7a80-4c12-af94-27b100c5ba18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:25:15 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-49bb4c73-de63-4ab3-8a2e-2ad2737212a9 tempest-ProjectReaderTests-1505730503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2535e8b-7a80-4c12-af94-27b100c5ba18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:25:15 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-49bb4c73-de63-4ab3-8a2e-2ad2737212a9 tempest-ProjectReaderTests-1505730503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31a98994-96a7-401a-a274-3f9069bb2b00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:25:15 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-49bb4c73-de63-4ab3-8a2e-2ad2737212a9 tempest-ProjectReaderTests-1505730503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31a98994-96a7-401a-a274-3f9069bb2b00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f78bd97-86be-41d5-a975-deb18293ecb2', 'volume_name': 'volume-2f78bd97-86be-41d5-a975-deb18293ecb2', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:25:15 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-49bb4c73-de63-4ab3-8a2e-2ad2737212a9 tempest-ProjectReaderTests-1505730503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9987255a-e813-40b5-a115-59194a1c4d52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:25:15 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-49bb4c73-de63-4ab3-8a2e-2ad2737212a9 tempest-ProjectReaderTests-1505730503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9987255a-e813-40b5-a115-59194a1c4d52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:25:15 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-49bb4c73-de63-4ab3-8a2e-2ad2737212a9 tempest-ProjectReaderTests-1505730503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bbae878-09c3-47f3-ad0b-332e9ea23ba3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:25:15 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-49bb4c73-de63-4ab3-8a2e-2ad2737212a9 tempest-ProjectReaderTests-1505730503 None] Volume 2f78bd97-86be-41d5-a975-deb18293ecb2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f78bd97-86be-41d5-a975-deb18293ecb2', 'volume_size': 1} Nov 04 10:25:15 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-49bb4c73-de63-4ab3-8a2e-2ad2737212a9 tempest-ProjectReaderTests-1505730503 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:25:16 devstack sudo[100921]: pam_unix(sudo:session): session closed for user root Nov 04 10:25:16 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d919db95-594b-49ab-a59d-d2b696c44f40 tempest-VolumesDeleteCascade-2146450032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-ddd597bc-f6b7-411b-844a-509267d13a81,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-ddd597bc-f6b7-411b-844a-509267d13a81.4662b1d2-6296-4730-8c5e-87ae2c74d1b5 1G" returned: 0 in 0.378s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:25:16 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d919db95-594b-49ab-a59d-d2b696c44f40 tempest-VolumesDeleteCascade-2146450032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ddd597bc-f6b7-411b-844a-509267d13a81 -F qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-ddd597bc-f6b7-411b-844a-509267d13a81.4662b1d2-6296-4730-8c5e-87ae2c74d1b5 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:25:16 devstack sudo[100926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ddd597bc-f6b7-411b-844a-509267d13a81 -F qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-ddd597bc-f6b7-411b-844a-509267d13a81.4662b1d2-6296-4730-8c5e-87ae2c74d1b5 Nov 04 10:25:16 devstack sudo[100926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:25:16 devstack sudo[100926]: pam_unix(sudo:session): session closed for user root Nov 04 10:25:16 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d919db95-594b-49ab-a59d-d2b696c44f40 tempest-VolumesDeleteCascade-2146450032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ddd597bc-f6b7-411b-844a-509267d13a81 -F qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-ddd597bc-f6b7-411b-844a-509267d13a81.4662b1d2-6296-4730-8c5e-87ae2c74d1b5" returned: 0 in 0.286s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:25:16 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-d919db95-594b-49ab-a59d-d2b696c44f40 tempest-VolumesDeleteCascade-2146450032 None] /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-ddd597bc-f6b7-411b-844a-509267d13a81.4662b1d2-6296-4730-8c5e-87ae2c74d1b5 is being set with open permissions: ugo+rw Nov 04 10:25:16 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d919db95-594b-49ab-a59d-d2b696c44f40 tempest-VolumesDeleteCascade-2146450032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-ddd597bc-f6b7-411b-844a-509267d13a81.4662b1d2-6296-4730-8c5e-87ae2c74d1b5 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:25:16 devstack sudo[100931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-ddd597bc-f6b7-411b-844a-509267d13a81.4662b1d2-6296-4730-8c5e-87ae2c74d1b5 Nov 04 10:25:16 devstack sudo[100931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:25:16 devstack sudo[100931]: pam_unix(sudo:session): session closed for user root Nov 04 10:25:16 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d919db95-594b-49ab-a59d-d2b696c44f40 tempest-VolumesDeleteCascade-2146450032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-ddd597bc-f6b7-411b-844a-509267d13a81.4662b1d2-6296-4730-8c5e-87ae2c74d1b5" returned: 0 in 0.258s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:25:16 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d919db95-594b-49ab-a59d-d2b696c44f40 tempest-VolumesDeleteCascade-2146450032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-ddd597bc-f6b7-411b-844a-509267d13a81.info {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:25:16 devstack sudo[100934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-ddd597bc-f6b7-411b-844a-509267d13a81.info Nov 04 10:25:16 devstack sudo[100934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:25:16 devstack sudo[100934]: pam_unix(sudo:session): session closed for user root Nov 04 10:25:16 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d919db95-594b-49ab-a59d-d2b696c44f40 tempest-VolumesDeleteCascade-2146450032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-ddd597bc-f6b7-411b-844a-509267d13a81.info" returned: 0 in 0.243s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:25:16 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-d919db95-594b-49ab-a59d-d2b696c44f40 tempest-VolumesDeleteCascade-2146450032 None] /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-ddd597bc-f6b7-411b-844a-509267d13a81.info is being set with open permissions: ugo+rw Nov 04 10:25:16 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d919db95-594b-49ab-a59d-d2b696c44f40 tempest-VolumesDeleteCascade-2146450032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-ddd597bc-f6b7-411b-844a-509267d13a81.info {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:25:16 devstack sudo[100939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-ddd597bc-f6b7-411b-844a-509267d13a81.info Nov 04 10:25:16 devstack sudo[100939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:25:17 devstack sudo[100939]: pam_unix(sudo:session): session closed for user root Nov 04 10:25:17 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d919db95-594b-49ab-a59d-d2b696c44f40 tempest-VolumesDeleteCascade-2146450032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-ddd597bc-f6b7-411b-844a-509267d13a81.info" returned: 0 in 0.264s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:25:17 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-d919db95-594b-49ab-a59d-d2b696c44f40 tempest-VolumesDeleteCascade-2146450032 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.053s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:25:17 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-49bb4c73-de63-4ab3-8a2e-2ad2737212a9 tempest-ProjectReaderTests-1505730503 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.454s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:25:17 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-49bb4c73-de63-4ab3-8a2e-2ad2737212a9 tempest-ProjectReaderTests-1505730503 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:25:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1645716860',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f78bd97-86be-41d5-a975-deb18293ecb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4e0b63f17594427a2929254e282322b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:25:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:25:16Z,use_quota=True,user_id='d92d849e895242e7b6d98621572cde14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 10:25:17 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-49bb4c73-de63-4ab3-8a2e-2ad2737212a9 tempest-ProjectReaderTests-1505730503 None] Creating volume 2f78bd97-86be-41d5-a975-deb18293ecb2 {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:25:17 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-49bb4c73-de63-4ab3-8a2e-2ad2737212a9 tempest-ProjectReaderTests-1505730503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:25:17 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-49bb4c73-de63-4ab3-8a2e-2ad2737212a9 tempest-ProjectReaderTests-1505730503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:25:17 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-49bb4c73-de63-4ab3-8a2e-2ad2737212a9 tempest-ProjectReaderTests-1505730503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:25:17 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-49bb4c73-de63-4ab3-8a2e-2ad2737212a9 tempest-ProjectReaderTests-1505730503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:25:17 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-49bb4c73-de63-4ab3-8a2e-2ad2737212a9 tempest-ProjectReaderTests-1505730503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:25:17 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-49bb4c73-de63-4ab3-8a2e-2ad2737212a9 tempest-ProjectReaderTests-1505730503 None] Selected osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:25:17 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-49bb4c73-de63-4ab3-8a2e-2ad2737212a9 tempest-ProjectReaderTests-1505730503 None] casted to osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 Nov 04 10:25:17 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-49bb4c73-de63-4ab3-8a2e-2ad2737212a9 tempest-ProjectReaderTests-1505730503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-2f78bd97-86be-41d5-a975-deb18293ecb2 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:25:17 devstack sudo[100942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-2f78bd97-86be-41d5-a975-deb18293ecb2 1073741824 Nov 04 10:25:17 devstack sudo[100942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:25:17 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-d919db95-594b-49ab-a59d-d2b696c44f40 tempest-VolumesDeleteCascade-2146450032 None] Create snapshot completed successfully Nov 04 10:25:17 devstack sudo[100942]: pam_unix(sudo:session): session closed for user root Nov 04 10:25:17 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-49bb4c73-de63-4ab3-8a2e-2ad2737212a9 tempest-ProjectReaderTests-1505730503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-2f78bd97-86be-41d5-a975-deb18293ecb2 1073741824" returned: 0 in 0.509s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:25:17 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-49bb4c73-de63-4ab3-8a2e-2ad2737212a9 tempest-ProjectReaderTests-1505730503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-2f78bd97-86be-41d5-a975-deb18293ecb2 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:25:17 devstack sudo[100948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-2f78bd97-86be-41d5-a975-deb18293ecb2 Nov 04 10:25:17 devstack sudo[100948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:25:18 devstack sudo[100948]: pam_unix(sudo:session): session closed for user root Nov 04 10:25:18 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-49bb4c73-de63-4ab3-8a2e-2ad2737212a9 tempest-ProjectReaderTests-1505730503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-2f78bd97-86be-41d5-a975-deb18293ecb2" returned: 0 in 0.238s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:25:18 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-49bb4c73-de63-4ab3-8a2e-2ad2737212a9 tempest-ProjectReaderTests-1505730503 None] <== create_volume: return (797ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 10:25:18 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-49bb4c73-de63-4ab3-8a2e-2ad2737212a9 tempest-ProjectReaderTests-1505730503 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.800s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:25:18 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-49bb4c73-de63-4ab3-8a2e-2ad2737212a9 tempest-ProjectReaderTests-1505730503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bbae878-09c3-47f3-ad0b-332e9ea23ba3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f78bd97-86be-41d5-a975-deb18293ecb2', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:25:18 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-49bb4c73-de63-4ab3-8a2e-2ad2737212a9 tempest-ProjectReaderTests-1505730503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70048036-4c46-47e6-b106-fe506a2bc79c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:25:18 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-49bb4c73-de63-4ab3-8a2e-2ad2737212a9 tempest-ProjectReaderTests-1505730503 None] Volume volume-2f78bd97-86be-41d5-a975-deb18293ecb2 (2f78bd97-86be-41d5-a975-deb18293ecb2): created successfully Nov 04 10:25:18 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-49bb4c73-de63-4ab3-8a2e-2ad2737212a9 tempest-ProjectReaderTests-1505730503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70048036-4c46-47e6-b106-fe506a2bc79c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:25:18 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-49bb4c73-de63-4ab3-8a2e-2ad2737212a9 tempest-ProjectReaderTests-1505730503 None] Flow 'volume_create_manager' (ba9f447d-abcb-46f7-aaba-8845f68b3524) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:25:18 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-49bb4c73-de63-4ab3-8a2e-2ad2737212a9 tempest-ProjectReaderTests-1505730503 None] Created volume successfully. Nov 04 10:25:18 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-50f6c5bd-9109-4cb0-b65c-18f77e608a62 tempest-ProjectReaderTests-1505730503 None] Acquiring lock "cinder-2f78bd97-86be-41d5-a975-deb18293ecb2-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:25:18 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-50f6c5bd-9109-4cb0-b65c-18f77e608a62 tempest-ProjectReaderTests-1505730503 None] Lock "cinder-2f78bd97-86be-41d5-a975-deb18293ecb2-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:25:18 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-50f6c5bd-9109-4cb0-b65c-18f77e608a62 tempest-ProjectReaderTests-1505730503 None] Acquiring lock "cinder-quobyte-2f78bd97-86be-41d5-a975-deb18293ecb2" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:25:18 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-50f6c5bd-9109-4cb0-b65c-18f77e608a62 tempest-ProjectReaderTests-1505730503 None] Lock "cinder-quobyte-2f78bd97-86be-41d5-a975-deb18293ecb2" acquired by "delete_volume" :: waited 0.023s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:25:18 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-be739ec9-ffd7-4dee-b7a0-1eb21551fea7 tempest-VolumesDeleteCascade-2146450032 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:25:18 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[69be8566-e335-4fd1-addb-26bf9b97afdb]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:25:18 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-50f6c5bd-9109-4cb0-b65c-18f77e608a62 tempest-ProjectReaderTests-1505730503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-2f78bd97-86be-41d5-a975-deb18293ecb2 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:25:18 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-be739ec9-ffd7-4dee-b7a0-1eb21551fea7 tempest-VolumesDeleteCascade-2146450032 None] Flow 'volume_create_manager' (f27e5f83-768a-4fec-bff2-8ab22c440cfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:25:18 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-be739ec9-ffd7-4dee-b7a0-1eb21551fea7 tempest-VolumesDeleteCascade-2146450032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ce6b837-6706-46ab-9312-4d9e9adfaa59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:25:18 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-be739ec9-ffd7-4dee-b7a0-1eb21551fea7 tempest-VolumesDeleteCascade-2146450032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ce6b837-6706-46ab-9312-4d9e9adfaa59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:25:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1782885823',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20d9d167-3f6f-4f6e-af85-0ebab34f0ce3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fdc968ee22341bdaa6192576bfcb30d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:25:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=4662b1d2-6296-4730-8c5e-87ae2c74d1b5,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:25:19Z,use_quota=True,user_id='b760fe208cb04e798444643a284ba280',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:25:18 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-be739ec9-ffd7-4dee-b7a0-1eb21551fea7 tempest-VolumesDeleteCascade-2146450032 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d433bbd-3ca3-4d4b-80b4-84d0d1e314dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:25:18 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-be739ec9-ffd7-4dee-b7a0-1eb21551fea7 tempest-VolumesDeleteCascade-2146450032 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d433bbd-3ca3-4d4b-80b4-84d0d1e314dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:25:18 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-be739ec9-ffd7-4dee-b7a0-1eb21551fea7 tempest-VolumesDeleteCascade-2146450032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (313fed84-7d87-462c-a7cf-b867bd4ff4a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:25:18 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-be739ec9-ffd7-4dee-b7a0-1eb21551fea7 tempest-VolumesDeleteCascade-2146450032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (313fed84-7d87-462c-a7cf-b867bd4ff4a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '20d9d167-3f6f-4f6e-af85-0ebab34f0ce3', 'volume_name': 'volume-20d9d167-3f6f-4f6e-af85-0ebab34f0ce3', 'volume_size': 1, 'snapshot_id': '4662b1d2-6296-4730-8c5e-87ae2c74d1b5'}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:25:18 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-be739ec9-ffd7-4dee-b7a0-1eb21551fea7 tempest-VolumesDeleteCascade-2146450032 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (045b1b95-a24f-4429-9bb7-56b0621cc208) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:25:18 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-be739ec9-ffd7-4dee-b7a0-1eb21551fea7 tempest-VolumesDeleteCascade-2146450032 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (045b1b95-a24f-4429-9bb7-56b0621cc208) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:25:19 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-be739ec9-ffd7-4dee-b7a0-1eb21551fea7 tempest-VolumesDeleteCascade-2146450032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48e89ba0-63d3-4b4e-80dc-afc2c019bb45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:25:19 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-be739ec9-ffd7-4dee-b7a0-1eb21551fea7 tempest-VolumesDeleteCascade-2146450032 None] Volume 20d9d167-3f6f-4f6e-af85-0ebab34f0ce3: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-20d9d167-3f6f-4f6e-af85-0ebab34f0ce3', 'volume_size': 1, 'snapshot_id': '4662b1d2-6296-4730-8c5e-87ae2c74d1b5'} Nov 04 10:25:19 devstack sudo[100951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-2f78bd97-86be-41d5-a975-deb18293ecb2 Nov 04 10:25:19 devstack sudo[100951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:25:19 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-be739ec9-ffd7-4dee-b7a0-1eb21551fea7 tempest-VolumesDeleteCascade-2146450032 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:25:19 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-be739ec9-ffd7-4dee-b7a0-1eb21551fea7 tempest-VolumesDeleteCascade-2146450032 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:25:19 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-be739ec9-ffd7-4dee-b7a0-1eb21551fea7 tempest-VolumesDeleteCascade-2146450032 None] Acquiring lock "cinder-quobyte-4662b1d2-6296-4730-8c5e-87ae2c74d1b5-20d9d167-3f6f-4f6e-af85-0ebab34f0ce3" by "_create_volume_from_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:25:19 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-be739ec9-ffd7-4dee-b7a0-1eb21551fea7 tempest-VolumesDeleteCascade-2146450032 None] Lock "cinder-quobyte-4662b1d2-6296-4730-8c5e-87ae2c74d1b5-20d9d167-3f6f-4f6e-af85-0ebab34f0ce3" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:25:19 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-be739ec9-ffd7-4dee-b7a0-1eb21551fea7 tempest-VolumesDeleteCascade-2146450032 None] Creating volume 20d9d167-3f6f-4f6e-af85-0ebab34f0ce3 from snapshot 4662b1d2-6296-4730-8c5e-87ae2c74d1b5 {{(pid=87068) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 04 10:25:19 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-be739ec9-ffd7-4dee-b7a0-1eb21551fea7 tempest-VolumesDeleteCascade-2146450032 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:25:19 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-be739ec9-ffd7-4dee-b7a0-1eb21551fea7 tempest-VolumesDeleteCascade-2146450032 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:25:19 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-be739ec9-ffd7-4dee-b7a0-1eb21551fea7 tempest-VolumesDeleteCascade-2146450032 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:25:19 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-be739ec9-ffd7-4dee-b7a0-1eb21551fea7 tempest-VolumesDeleteCascade-2146450032 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:25:19 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-be739ec9-ffd7-4dee-b7a0-1eb21551fea7 tempest-VolumesDeleteCascade-2146450032 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:25:19 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-be739ec9-ffd7-4dee-b7a0-1eb21551fea7 tempest-VolumesDeleteCascade-2146450032 None] Selected osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:25:19 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-be739ec9-ffd7-4dee-b7a0-1eb21551fea7 tempest-VolumesDeleteCascade-2146450032 None] Acquiring lock "cinder-quobyte-20d9d167-3f6f-4f6e-af85-0ebab34f0ce3" by "_copy_volume_from_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:25:19 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-be739ec9-ffd7-4dee-b7a0-1eb21551fea7 tempest-VolumesDeleteCascade-2146450032 None] Lock "cinder-quobyte-20d9d167-3f6f-4f6e-af85-0ebab34f0ce3" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:25:19 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-be739ec9-ffd7-4dee-b7a0-1eb21551fea7 tempest-VolumesDeleteCascade-2146450032 None] snapshot: 4662b1d2-6296-4730-8c5e-87ae2c74d1b5, volume: 20d9d167-3f6f-4f6e-af85-0ebab34f0ce3, {{(pid=87068) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 04 10:25:19 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-be739ec9-ffd7-4dee-b7a0-1eb21551fea7 tempest-VolumesDeleteCascade-2146450032 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:25:19 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-be739ec9-ffd7-4dee-b7a0-1eb21551fea7 tempest-VolumesDeleteCascade-2146450032 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:25:19 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-be739ec9-ffd7-4dee-b7a0-1eb21551fea7 tempest-VolumesDeleteCascade-2146450032 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:25:19 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-be739ec9-ffd7-4dee-b7a0-1eb21551fea7 tempest-VolumesDeleteCascade-2146450032 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:25:19 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-be739ec9-ffd7-4dee-b7a0-1eb21551fea7 tempest-VolumesDeleteCascade-2146450032 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:25:19 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[06eb0fce-31f5-4f16-b4b3-388d0c32e5c6]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:25:19 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-be739ec9-ffd7-4dee-b7a0-1eb21551fea7 tempest-VolumesDeleteCascade-2146450032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-ddd597bc-f6b7-411b-844a-509267d13a81.4662b1d2-6296-4730-8c5e-87ae2c74d1b5 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:25:19 devstack sudo[100953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-ddd597bc-f6b7-411b-844a-509267d13a81.4662b1d2-6296-4730-8c5e-87ae2c74d1b5 Nov 04 10:25:19 devstack sudo[100953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:25:19 devstack sudo[100951]: pam_unix(sudo:session): session closed for user root Nov 04 10:25:19 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-50f6c5bd-9109-4cb0-b65c-18f77e608a62 tempest-ProjectReaderTests-1505730503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-2f78bd97-86be-41d5-a975-deb18293ecb2" returned: 0 in 0.362s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:25:19 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-50f6c5bd-9109-4cb0-b65c-18f77e608a62 tempest-ProjectReaderTests-1505730503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-2f78bd97-86be-41d5-a975-deb18293ecb2 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:25:19 devstack sudo[100958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-2f78bd97-86be-41d5-a975-deb18293ecb2 Nov 04 10:25:19 devstack sudo[100958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:25:19 devstack sudo[100953]: pam_unix(sudo:session): session closed for user root Nov 04 10:25:19 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-be739ec9-ffd7-4dee-b7a0-1eb21551fea7 tempest-VolumesDeleteCascade-2146450032 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-ddd597bc-f6b7-411b-844a-509267d13a81.4662b1d2-6296-4730-8c5e-87ae2c74d1b5" returned: 0 in 0.373s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:25:19 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-be739ec9-ffd7-4dee-b7a0-1eb21551fea7 tempest-VolumesDeleteCascade-2146450032 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ddd597bc-f6b7-411b-844a-509267d13a81(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87068) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 10:25:19 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eca6cf6-49ef-4082-b461-3677d3e6dc2e]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:25:19 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-be739ec9-ffd7-4dee-b7a0-1eb21551fea7 tempest-VolumesDeleteCascade-2146450032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-ddd597bc-f6b7-411b-844a-509267d13a81 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:25:19 devstack sudo[100958]: pam_unix(sudo:session): session closed for user root Nov 04 10:25:19 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-50f6c5bd-9109-4cb0-b65c-18f77e608a62 tempest-ProjectReaderTests-1505730503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-2f78bd97-86be-41d5-a975-deb18293ecb2" returned: 0 in 0.261s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:25:19 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-50f6c5bd-9109-4cb0-b65c-18f77e608a62 tempest-ProjectReaderTests-1505730503 None] Lock "cinder-quobyte-2f78bd97-86be-41d5-a975-deb18293ecb2" released by "delete_volume" :: held 0.681s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:25:19 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-50f6c5bd-9109-4cb0-b65c-18f77e608a62 tempest-ProjectReaderTests-1505730503 None] Created reservations ['acef9186-d8f1-4b30-af75-db4fced0529e', 'c40dc0d8-152e-446f-94fc-62ab664b71c4', '4c3527a3-051d-45b7-9d42-188104e8ad12', '3e9184d4-11f9-48a1-88f8-662fcfdef929'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:25:19 devstack sudo[100964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-ddd597bc-f6b7-411b-844a-509267d13a81 Nov 04 10:25:19 devstack sudo[100964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:25:19 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-50f6c5bd-9109-4cb0-b65c-18f77e608a62 tempest-ProjectReaderTests-1505730503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:25:19 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-50f6c5bd-9109-4cb0-b65c-18f77e608a62 tempest-ProjectReaderTests-1505730503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:25:19 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-50f6c5bd-9109-4cb0-b65c-18f77e608a62 tempest-ProjectReaderTests-1505730503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:25:19 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-50f6c5bd-9109-4cb0-b65c-18f77e608a62 tempest-ProjectReaderTests-1505730503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:25:19 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-50f6c5bd-9109-4cb0-b65c-18f77e608a62 tempest-ProjectReaderTests-1505730503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:25:19 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-50f6c5bd-9109-4cb0-b65c-18f77e608a62 tempest-ProjectReaderTests-1505730503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:25:19 devstack sudo[100966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:25:19 devstack sudo[100966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:25:19 devstack sudo[100964]: pam_unix(sudo:session): session closed for user root Nov 04 10:25:19 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-be739ec9-ffd7-4dee-b7a0-1eb21551fea7 tempest-VolumesDeleteCascade-2146450032 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-ddd597bc-f6b7-411b-844a-509267d13a81" returned: 0 in 0.420s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:25:19 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-be739ec9-ffd7-4dee-b7a0-1eb21551fea7 tempest-VolumesDeleteCascade-2146450032 None] will copy from snapshot at /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-ddd597bc-f6b7-411b-844a-509267d13a81 {{(pid=87068) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 04 10:25:19 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-be739ec9-ffd7-4dee-b7a0-1eb21551fea7 tempest-VolumesDeleteCascade-2146450032 None] Creating direct copy from snapshot {{(pid=87068) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 04 10:25:19 devstack cinder-volume[87068]: DEBUG cinder.utils [None req-be739ec9-ffd7-4dee-b7a0-1eb21551fea7 tempest-VolumesDeleteCascade-2146450032 None] Path /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-20d9d167-3f6f-4f6e-af85-0ebab34f0ce3 not found in is_blk_device check {{(pid=87068) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 04 10:25:19 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-be739ec9-ffd7-4dee-b7a0-1eb21551fea7 tempest-VolumesDeleteCascade-2146450032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-ddd597bc-f6b7-411b-844a-509267d13a81 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-20d9d167-3f6f-4f6e-af85-0ebab34f0ce3 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:25:19 devstack sudo[100966]: pam_unix(sudo:session): session closed for user root Nov 04 10:25:19 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-50f6c5bd-9109-4cb0-b65c-18f77e608a62 tempest-ProjectReaderTests-1505730503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.281s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:25:19 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-50f6c5bd-9109-4cb0-b65c-18f77e608a62 tempest-ProjectReaderTests-1505730503 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:25:19 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-50f6c5bd-9109-4cb0-b65c-18f77e608a62 tempest-ProjectReaderTests-1505730503 None] Deleted volume successfully. Nov 04 10:25:19 devstack sudo[100972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-ddd597bc-f6b7-411b-844a-509267d13a81 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-20d9d167-3f6f-4f6e-af85-0ebab34f0ce3 Nov 04 10:25:19 devstack sudo[100972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:25:19 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-50f6c5bd-9109-4cb0-b65c-18f77e608a62 tempest-ProjectReaderTests-1505730503 None] Lock "cinder-2f78bd97-86be-41d5-a975-deb18293ecb2-delete_volume" released by "delete_volume" :: held 1.180s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:25:27 devstack sudo[100972]: pam_unix(sudo:session): session closed for user root Nov 04 10:25:27 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-be739ec9-ffd7-4dee-b7a0-1eb21551fea7 tempest-VolumesDeleteCascade-2146450032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-ddd597bc-f6b7-411b-844a-509267d13a81 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-20d9d167-3f6f-4f6e-af85-0ebab34f0ce3" returned: 0 in 8.046s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:25:27 devstack cinder-volume[87068]: DEBUG cinder.image.image_utils [None req-be739ec9-ffd7-4dee-b7a0-1eb21551fea7 tempest-VolumesDeleteCascade-2146450032 None] Image conversion details: src /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-ddd597bc-f6b7-411b-844a-509267d13a81, size 1024.00 MB, duration 8.05 sec, destination /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-20d9d167-3f6f-4f6e-af85-0ebab34f0ce3 {{(pid=87068) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 04 10:25:27 devstack cinder-volume[87068]: INFO cinder.image.image_utils [None req-be739ec9-ffd7-4dee-b7a0-1eb21551fea7 tempest-VolumesDeleteCascade-2146450032 None] Converted 1024.00 MB image at 127.25 MB/s Nov 04 10:25:27 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-be739ec9-ffd7-4dee-b7a0-1eb21551fea7 tempest-VolumesDeleteCascade-2146450032 None] /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-20d9d167-3f6f-4f6e-af85-0ebab34f0ce3 is being set with open permissions: ugo+rw Nov 04 10:25:27 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-be739ec9-ffd7-4dee-b7a0-1eb21551fea7 tempest-VolumesDeleteCascade-2146450032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-20d9d167-3f6f-4f6e-af85-0ebab34f0ce3 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:25:27 devstack sudo[101129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-20d9d167-3f6f-4f6e-af85-0ebab34f0ce3 Nov 04 10:25:27 devstack sudo[101129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:25:28 devstack sudo[101129]: pam_unix(sudo:session): session closed for user root Nov 04 10:25:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-be739ec9-ffd7-4dee-b7a0-1eb21551fea7 tempest-VolumesDeleteCascade-2146450032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-20d9d167-3f6f-4f6e-af85-0ebab34f0ce3" returned: 0 in 0.244s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:25:28 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-be739ec9-ffd7-4dee-b7a0-1eb21551fea7 tempest-VolumesDeleteCascade-2146450032 None] Lock "cinder-quobyte-20d9d167-3f6f-4f6e-af85-0ebab34f0ce3" released by "_copy_volume_from_snapshot" :: held 9.173s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:25:28 devstack cinder-volume[87068]: DEBUG dbcounter [-] [87068] Writing DB stats cinder:SELECT=148,cinder:UPDATE=177,cinder:INSERT=50,cinder:DELETE=9 {{(pid=87068) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 10:25:28 devstack cinder-volume[87068]: DEBUG dbcounter [-] [87068] Writing DB stats cinder:SELECT=134,cinder:UPDATE=182,cinder:INSERT=47,cinder:DELETE=23 {{(pid=87068) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 10:25:28 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-be739ec9-ffd7-4dee-b7a0-1eb21551fea7 tempest-VolumesDeleteCascade-2146450032 None] Lock "cinder-quobyte-4662b1d2-6296-4730-8c5e-87ae2c74d1b5-20d9d167-3f6f-4f6e-af85-0ebab34f0ce3" released by "_create_volume_from_snapshot" :: held 9.255s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:25:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-be739ec9-ffd7-4dee-b7a0-1eb21551fea7 tempest-VolumesDeleteCascade-2146450032 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.274s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:25:28 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-be739ec9-ffd7-4dee-b7a0-1eb21551fea7 tempest-VolumesDeleteCascade-2146450032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48e89ba0-63d3-4b4e-80dc-afc2c019bb45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20d9d167-3f6f-4f6e-af85-0ebab34f0ce3', 'volume_size': 1, 'snapshot_id': '4662b1d2-6296-4730-8c5e-87ae2c74d1b5'}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:25:28 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-be739ec9-ffd7-4dee-b7a0-1eb21551fea7 tempest-VolumesDeleteCascade-2146450032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f05b61e7-694c-4430-8186-4455e04752b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:25:28 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-be739ec9-ffd7-4dee-b7a0-1eb21551fea7 tempest-VolumesDeleteCascade-2146450032 None] Volume volume-20d9d167-3f6f-4f6e-af85-0ebab34f0ce3 (20d9d167-3f6f-4f6e-af85-0ebab34f0ce3): created successfully Nov 04 10:25:28 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-be739ec9-ffd7-4dee-b7a0-1eb21551fea7 tempest-VolumesDeleteCascade-2146450032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f05b61e7-694c-4430-8186-4455e04752b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:25:28 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-be739ec9-ffd7-4dee-b7a0-1eb21551fea7 tempest-VolumesDeleteCascade-2146450032 None] Flow 'volume_create_manager' (f27e5f83-768a-4fec-bff2-8ab22c440cfc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:25:28 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-be739ec9-ffd7-4dee-b7a0-1eb21551fea7 tempest-VolumesDeleteCascade-2146450032 None] Created volume successfully. Nov 04 10:25:28 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-07c4d01b-291e-4414-bf22-ce8d2b8ab0dc tempest-VolumesDeleteCascade-2146450032 None] Acquiring lock "cinder-ddd597bc-f6b7-411b-844a-509267d13a81-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:25:29 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-07c4d01b-291e-4414-bf22-ce8d2b8ab0dc tempest-VolumesDeleteCascade-2146450032 None] Lock "cinder-ddd597bc-f6b7-411b-844a-509267d13a81-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:25:29 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-07c4d01b-291e-4414-bf22-ce8d2b8ab0dc tempest-VolumesDeleteCascade-2146450032 None] Performing cascade delete. {{(pid=87068) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Nov 04 10:25:29 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-07c4d01b-291e-4414-bf22-ce8d2b8ab0dc tempest-VolumesDeleteCascade-2146450032 None] Acquiring lock "cinder-4662b1d2-6296-4730-8c5e-87ae2c74d1b5-delete_snapshot" by "delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:25:29 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-07c4d01b-291e-4414-bf22-ce8d2b8ab0dc tempest-VolumesDeleteCascade-2146450032 None] Lock "cinder-4662b1d2-6296-4730-8c5e-87ae2c74d1b5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:25:29 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-07c4d01b-291e-4414-bf22-ce8d2b8ab0dc tempest-VolumesDeleteCascade-2146450032 None] Acquiring lock "cinder-quobyte-ddd597bc-f6b7-411b-844a-509267d13a81" by "delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:25:29 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-07c4d01b-291e-4414-bf22-ce8d2b8ab0dc tempest-VolumesDeleteCascade-2146450032 None] Lock "cinder-quobyte-ddd597bc-f6b7-411b-844a-509267d13a81" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:25:29 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-07c4d01b-291e-4414-bf22-ce8d2b8ab0dc tempest-VolumesDeleteCascade-2146450032 None] Acquiring lock "cinder-quobyte-4662b1d2-6296-4730-8c5e-87ae2c74d1b5" by "_delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:25:29 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-07c4d01b-291e-4414-bf22-ce8d2b8ab0dc tempest-VolumesDeleteCascade-2146450032 None] Lock "cinder-quobyte-4662b1d2-6296-4730-8c5e-87ae2c74d1b5" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:25:29 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-07c4d01b-291e-4414-bf22-ce8d2b8ab0dc tempest-VolumesDeleteCascade-2146450032 None] Deleting offline snapshot 4662b1d2-6296-4730-8c5e-87ae2c74d1b5 of volume ddd597bc-f6b7-411b-844a-509267d13a81 {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 10:25:29 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-07c4d01b-291e-4414-bf22-ce8d2b8ab0dc tempest-VolumesDeleteCascade-2146450032 None] snapshot_file for this snap is: volume-ddd597bc-f6b7-411b-844a-509267d13a81.4662b1d2-6296-4730-8c5e-87ae2c74d1b5 {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 10:25:29 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc3e4b9e-8db4-4189-a494-c2a3b0b07dbc]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:25:29 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-07c4d01b-291e-4414-bf22-ce8d2b8ab0dc tempest-VolumesDeleteCascade-2146450032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-ddd597bc-f6b7-411b-844a-509267d13a81.4662b1d2-6296-4730-8c5e-87ae2c74d1b5 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:25:29 devstack sudo[101134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-ddd597bc-f6b7-411b-844a-509267d13a81.4662b1d2-6296-4730-8c5e-87ae2c74d1b5 Nov 04 10:25:29 devstack sudo[101134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:25:29 devstack sudo[101134]: pam_unix(sudo:session): session closed for user root Nov 04 10:25:29 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-07c4d01b-291e-4414-bf22-ce8d2b8ab0dc tempest-VolumesDeleteCascade-2146450032 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-ddd597bc-f6b7-411b-844a-509267d13a81.4662b1d2-6296-4730-8c5e-87ae2c74d1b5" returned: 0 in 0.363s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:25:29 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-07c4d01b-291e-4414-bf22-ce8d2b8ab0dc tempest-VolumesDeleteCascade-2146450032 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ddd597bc-f6b7-411b-844a-509267d13a81(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87068) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 10:25:29 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[02926603-5720-4a27-a0fe-5ad3775b01d7]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:25:29 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-07c4d01b-291e-4414-bf22-ce8d2b8ab0dc tempest-VolumesDeleteCascade-2146450032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-ddd597bc-f6b7-411b-844a-509267d13a81 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:25:29 devstack sudo[101139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-ddd597bc-f6b7-411b-844a-509267d13a81 Nov 04 10:25:29 devstack sudo[101139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:25:30 devstack sudo[101139]: pam_unix(sudo:session): session closed for user root Nov 04 10:25:30 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-07c4d01b-291e-4414-bf22-ce8d2b8ab0dc tempest-VolumesDeleteCascade-2146450032 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-ddd597bc-f6b7-411b-844a-509267d13a81" returned: 0 in 0.580s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:25:30 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-07c4d01b-291e-4414-bf22-ce8d2b8ab0dc tempest-VolumesDeleteCascade-2146450032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-ddd597bc-f6b7-411b-844a-509267d13a81.4662b1d2-6296-4730-8c5e-87ae2c74d1b5 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:25:30 devstack sudo[101144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-ddd597bc-f6b7-411b-844a-509267d13a81.4662b1d2-6296-4730-8c5e-87ae2c74d1b5 Nov 04 10:25:30 devstack sudo[101144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:25:30 devstack sudo[101144]: pam_unix(sudo:session): session closed for user root Nov 04 10:25:30 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-07c4d01b-291e-4414-bf22-ce8d2b8ab0dc tempest-VolumesDeleteCascade-2146450032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-ddd597bc-f6b7-411b-844a-509267d13a81.4662b1d2-6296-4730-8c5e-87ae2c74d1b5" returned: 0 in 0.360s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:25:30 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-07c4d01b-291e-4414-bf22-ce8d2b8ab0dc tempest-VolumesDeleteCascade-2146450032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-ddd597bc-f6b7-411b-844a-509267d13a81.4662b1d2-6296-4730-8c5e-87ae2c74d1b5 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:25:30 devstack sudo[101150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-ddd597bc-f6b7-411b-844a-509267d13a81.4662b1d2-6296-4730-8c5e-87ae2c74d1b5 Nov 04 10:25:30 devstack sudo[101150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:25:30 devstack sudo[101150]: pam_unix(sudo:session): session closed for user root Nov 04 10:25:30 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-07c4d01b-291e-4414-bf22-ce8d2b8ab0dc tempest-VolumesDeleteCascade-2146450032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-ddd597bc-f6b7-411b-844a-509267d13a81.4662b1d2-6296-4730-8c5e-87ae2c74d1b5" returned: 0 in 0.279s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:25:30 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-07c4d01b-291e-4414-bf22-ce8d2b8ab0dc tempest-VolumesDeleteCascade-2146450032 None] Lock "cinder-quobyte-4662b1d2-6296-4730-8c5e-87ae2c74d1b5" released by "_delete_snapshot" :: held 1.681s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:25:30 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-07c4d01b-291e-4414-bf22-ce8d2b8ab0dc tempest-VolumesDeleteCascade-2146450032 None] Lock "cinder-quobyte-ddd597bc-f6b7-411b-844a-509267d13a81" released by "delete_snapshot" :: held 1.705s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:25:30 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-07c4d01b-291e-4414-bf22-ce8d2b8ab0dc tempest-VolumesDeleteCascade-2146450032 None] Created reservations ['78cea9e5-e541-4a22-a438-405d970cb098', '654dd30b-0b0d-43fb-a8d4-09b06856662f', '60b20292-233d-46ce-a9b8-98ae78e8b9d7', 'dd0514d2-6165-4895-9596-0383329b1f50'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:25:30 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-07c4d01b-291e-4414-bf22-ce8d2b8ab0dc tempest-VolumesDeleteCascade-2146450032 None] Delete snapshot completed successfully. Nov 04 10:25:30 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-07c4d01b-291e-4414-bf22-ce8d2b8ab0dc tempest-VolumesDeleteCascade-2146450032 None] Lock "cinder-4662b1d2-6296-4730-8c5e-87ae2c74d1b5-delete_snapshot" released by "delete_snapshot" :: held 1.866s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:25:30 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-07c4d01b-291e-4414-bf22-ce8d2b8ab0dc tempest-VolumesDeleteCascade-2146450032 None] Snapshots deleted, issuing volume delete {{(pid=87068) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Nov 04 10:25:30 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-07c4d01b-291e-4414-bf22-ce8d2b8ab0dc tempest-VolumesDeleteCascade-2146450032 None] Acquiring lock "cinder-quobyte-ddd597bc-f6b7-411b-844a-509267d13a81" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:25:30 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-07c4d01b-291e-4414-bf22-ce8d2b8ab0dc tempest-VolumesDeleteCascade-2146450032 None] Lock "cinder-quobyte-ddd597bc-f6b7-411b-844a-509267d13a81" acquired by "delete_volume" :: waited 0.018s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:25:31 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[06f15e6b-a49f-48d8-a9c3-83baa385f3a4]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:25:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-07c4d01b-291e-4414-bf22-ce8d2b8ab0dc tempest-VolumesDeleteCascade-2146450032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-ddd597bc-f6b7-411b-844a-509267d13a81 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:25:31 devstack sudo[101153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-ddd597bc-f6b7-411b-844a-509267d13a81 Nov 04 10:25:31 devstack sudo[101153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:25:31 devstack sudo[101153]: pam_unix(sudo:session): session closed for user root Nov 04 10:25:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-07c4d01b-291e-4414-bf22-ce8d2b8ab0dc tempest-VolumesDeleteCascade-2146450032 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-ddd597bc-f6b7-411b-844a-509267d13a81" returned: 0 in 0.425s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:25:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-07c4d01b-291e-4414-bf22-ce8d2b8ab0dc tempest-VolumesDeleteCascade-2146450032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-ddd597bc-f6b7-411b-844a-509267d13a81 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:25:31 devstack sudo[101158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-ddd597bc-f6b7-411b-844a-509267d13a81 Nov 04 10:25:31 devstack sudo[101158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:25:31 devstack sudo[101158]: pam_unix(sudo:session): session closed for user root Nov 04 10:25:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-07c4d01b-291e-4414-bf22-ce8d2b8ab0dc tempest-VolumesDeleteCascade-2146450032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-ddd597bc-f6b7-411b-844a-509267d13a81" returned: 0 in 0.261s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:25:31 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-07c4d01b-291e-4414-bf22-ce8d2b8ab0dc tempest-VolumesDeleteCascade-2146450032 None] Lock "cinder-quobyte-ddd597bc-f6b7-411b-844a-509267d13a81" released by "delete_volume" :: held 0.756s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:25:31 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-07c4d01b-291e-4414-bf22-ce8d2b8ab0dc tempest-VolumesDeleteCascade-2146450032 None] Created reservations ['9fce13c5-c32d-43b6-b378-22f7f5b56c3c', 'c1ff2e2c-0ff0-4a4a-a8be-11164f1feacf', 'd939deb5-6235-4f9d-bb29-c1f8d726b7d9', '415d32e2-a34c-46f1-8bc6-bca72794a1f5'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:25:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-07c4d01b-291e-4414-bf22-ce8d2b8ab0dc tempest-VolumesDeleteCascade-2146450032 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:25:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-07c4d01b-291e-4414-bf22-ce8d2b8ab0dc tempest-VolumesDeleteCascade-2146450032 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:25:31 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-07c4d01b-291e-4414-bf22-ce8d2b8ab0dc tempest-VolumesDeleteCascade-2146450032 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:25:31 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-07c4d01b-291e-4414-bf22-ce8d2b8ab0dc tempest-VolumesDeleteCascade-2146450032 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:25:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-07c4d01b-291e-4414-bf22-ce8d2b8ab0dc tempest-VolumesDeleteCascade-2146450032 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:25:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-07c4d01b-291e-4414-bf22-ce8d2b8ab0dc tempest-VolumesDeleteCascade-2146450032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:25:31 devstack sudo[101161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:25:31 devstack sudo[101161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:25:32 devstack sudo[101161]: pam_unix(sudo:session): session closed for user root Nov 04 10:25:32 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-07c4d01b-291e-4414-bf22-ce8d2b8ab0dc tempest-VolumesDeleteCascade-2146450032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.269s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:25:32 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-07c4d01b-291e-4414-bf22-ce8d2b8ab0dc tempest-VolumesDeleteCascade-2146450032 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:25:32 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-07c4d01b-291e-4414-bf22-ce8d2b8ab0dc tempest-VolumesDeleteCascade-2146450032 None] Deleted volume successfully. Nov 04 10:25:32 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-07c4d01b-291e-4414-bf22-ce8d2b8ab0dc tempest-VolumesDeleteCascade-2146450032 None] Lock "cinder-ddd597bc-f6b7-411b-844a-509267d13a81-delete_volume" released by "delete_volume" :: held 3.153s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:25:32 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-03be7d24-ac90-4a34-98ab-789e6d7a93df tempest-VolumesDeleteCascade-2146450032 None] Acquiring lock "cinder-20d9d167-3f6f-4f6e-af85-0ebab34f0ce3-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:25:32 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-03be7d24-ac90-4a34-98ab-789e6d7a93df tempest-VolumesDeleteCascade-2146450032 None] Lock "cinder-20d9d167-3f6f-4f6e-af85-0ebab34f0ce3-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:25:32 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-03be7d24-ac90-4a34-98ab-789e6d7a93df tempest-VolumesDeleteCascade-2146450032 None] Acquiring lock "cinder-quobyte-20d9d167-3f6f-4f6e-af85-0ebab34f0ce3" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:25:32 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-03be7d24-ac90-4a34-98ab-789e6d7a93df tempest-VolumesDeleteCascade-2146450032 None] Lock "cinder-quobyte-20d9d167-3f6f-4f6e-af85-0ebab34f0ce3" acquired by "delete_volume" :: waited 0.015s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:25:32 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[69a06f26-f235-43d1-945d-d3f43bb307e2]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:25:32 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-03be7d24-ac90-4a34-98ab-789e6d7a93df tempest-VolumesDeleteCascade-2146450032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-20d9d167-3f6f-4f6e-af85-0ebab34f0ce3 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:25:32 devstack sudo[101165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-20d9d167-3f6f-4f6e-af85-0ebab34f0ce3 Nov 04 10:25:32 devstack sudo[101165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:25:33 devstack sudo[101165]: pam_unix(sudo:session): session closed for user root Nov 04 10:25:33 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-03be7d24-ac90-4a34-98ab-789e6d7a93df tempest-VolumesDeleteCascade-2146450032 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-20d9d167-3f6f-4f6e-af85-0ebab34f0ce3" returned: 0 in 0.384s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:25:33 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-03be7d24-ac90-4a34-98ab-789e6d7a93df tempest-VolumesDeleteCascade-2146450032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-20d9d167-3f6f-4f6e-af85-0ebab34f0ce3 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:25:33 devstack sudo[101170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-20d9d167-3f6f-4f6e-af85-0ebab34f0ce3 Nov 04 10:25:33 devstack sudo[101170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:25:33 devstack sudo[101170]: pam_unix(sudo:session): session closed for user root Nov 04 10:25:33 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-03be7d24-ac90-4a34-98ab-789e6d7a93df tempest-VolumesDeleteCascade-2146450032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-20d9d167-3f6f-4f6e-af85-0ebab34f0ce3" returned: 0 in 0.253s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:25:33 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-03be7d24-ac90-4a34-98ab-789e6d7a93df tempest-VolumesDeleteCascade-2146450032 None] Lock "cinder-quobyte-20d9d167-3f6f-4f6e-af85-0ebab34f0ce3" released by "delete_volume" :: held 0.685s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:25:33 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-03be7d24-ac90-4a34-98ab-789e6d7a93df tempest-VolumesDeleteCascade-2146450032 None] Created reservations ['e5a5d3cd-8473-4900-b94b-0af28e5e0eae', '0122af08-e5a5-410c-8096-3e05e57de961', '1d6732d3-0c87-4aa5-bcaf-332b7c3e46e2', '87dd457b-9d66-4954-a958-bb129993e892'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:25:33 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-03be7d24-ac90-4a34-98ab-789e6d7a93df tempest-VolumesDeleteCascade-2146450032 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:25:33 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-03be7d24-ac90-4a34-98ab-789e6d7a93df tempest-VolumesDeleteCascade-2146450032 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:25:33 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-03be7d24-ac90-4a34-98ab-789e6d7a93df tempest-VolumesDeleteCascade-2146450032 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:25:33 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-03be7d24-ac90-4a34-98ab-789e6d7a93df tempest-VolumesDeleteCascade-2146450032 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:25:33 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-03be7d24-ac90-4a34-98ab-789e6d7a93df tempest-VolumesDeleteCascade-2146450032 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:25:33 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-03be7d24-ac90-4a34-98ab-789e6d7a93df tempest-VolumesDeleteCascade-2146450032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:25:33 devstack sudo[101173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:25:33 devstack sudo[101173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:25:33 devstack sudo[101173]: pam_unix(sudo:session): session closed for user root Nov 04 10:25:33 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-03be7d24-ac90-4a34-98ab-789e6d7a93df tempest-VolumesDeleteCascade-2146450032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.273s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:25:33 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-03be7d24-ac90-4a34-98ab-789e6d7a93df tempest-VolumesDeleteCascade-2146450032 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:25:33 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-03be7d24-ac90-4a34-98ab-789e6d7a93df tempest-VolumesDeleteCascade-2146450032 None] Deleted volume successfully. Nov 04 10:25:33 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-03be7d24-ac90-4a34-98ab-789e6d7a93df tempest-VolumesDeleteCascade-2146450032 None] Lock "cinder-20d9d167-3f6f-4f6e-af85-0ebab34f0ce3-delete_volume" released by "delete_volume" :: held 1.221s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:25:38 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-e46d9cef-5ed8-4fda-83e9-9241fbfd67ed tempest-VolumesTransfersV357Test-1044077295 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:25:38 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-e46d9cef-5ed8-4fda-83e9-9241fbfd67ed tempest-VolumesTransfersV357Test-1044077295 None] Flow 'volume_create_manager' (ecb38329-91d8-405d-805b-773ec7885292) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:25:38 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-e46d9cef-5ed8-4fda-83e9-9241fbfd67ed tempest-VolumesTransfersV357Test-1044077295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45349bcf-844a-49ac-89dc-7d54b769a499) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:25:38 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-e46d9cef-5ed8-4fda-83e9-9241fbfd67ed tempest-VolumesTransfersV357Test-1044077295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45349bcf-844a-49ac-89dc-7d54b769a499) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:25:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1715234563',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcd2fbce-ea5f-46c4-9f3f-071e9148ed69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f45082eb33641f6a68c3012b8a3c851',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:25:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:25:39Z,use_quota=True,user_id='c932c80fdbaa4bcd9668ef7dd88f2dba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:25:38 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-e46d9cef-5ed8-4fda-83e9-9241fbfd67ed tempest-VolumesTransfersV357Test-1044077295 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8c3fece-81cb-47ad-a866-94194a8f0de2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:25:38 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-e46d9cef-5ed8-4fda-83e9-9241fbfd67ed tempest-VolumesTransfersV357Test-1044077295 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8c3fece-81cb-47ad-a866-94194a8f0de2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:25:38 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-e46d9cef-5ed8-4fda-83e9-9241fbfd67ed tempest-VolumesTransfersV357Test-1044077295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa6c4cc0-d574-498c-b546-c5f9f77e0bca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:25:38 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-e46d9cef-5ed8-4fda-83e9-9241fbfd67ed tempest-VolumesTransfersV357Test-1044077295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa6c4cc0-d574-498c-b546-c5f9f77e0bca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bcd2fbce-ea5f-46c4-9f3f-071e9148ed69', 'volume_name': 'volume-bcd2fbce-ea5f-46c4-9f3f-071e9148ed69', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:25:38 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-e46d9cef-5ed8-4fda-83e9-9241fbfd67ed tempest-VolumesTransfersV357Test-1044077295 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcaf5dda-86b6-4680-86ba-9624ece34e70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:25:38 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-e46d9cef-5ed8-4fda-83e9-9241fbfd67ed tempest-VolumesTransfersV357Test-1044077295 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcaf5dda-86b6-4680-86ba-9624ece34e70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:25:38 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-e46d9cef-5ed8-4fda-83e9-9241fbfd67ed tempest-VolumesTransfersV357Test-1044077295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de31dd5f-8fdf-431a-b56b-1205862090fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:25:38 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-e46d9cef-5ed8-4fda-83e9-9241fbfd67ed tempest-VolumesTransfersV357Test-1044077295 None] Volume bcd2fbce-ea5f-46c4-9f3f-071e9148ed69: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bcd2fbce-ea5f-46c4-9f3f-071e9148ed69', 'volume_size': 1} Nov 04 10:25:38 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-e46d9cef-5ed8-4fda-83e9-9241fbfd67ed tempest-VolumesTransfersV357Test-1044077295 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:25:38 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-e46d9cef-5ed8-4fda-83e9-9241fbfd67ed tempest-VolumesTransfersV357Test-1044077295 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:25:38 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-e46d9cef-5ed8-4fda-83e9-9241fbfd67ed tempest-VolumesTransfersV357Test-1044077295 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:25:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1715234563',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcd2fbce-ea5f-46c4-9f3f-071e9148ed69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f45082eb33641f6a68c3012b8a3c851',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:25:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:25:39Z,use_quota=True,user_id='c932c80fdbaa4bcd9668ef7dd88f2dba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 10:25:38 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-e46d9cef-5ed8-4fda-83e9-9241fbfd67ed tempest-VolumesTransfersV357Test-1044077295 None] Creating volume bcd2fbce-ea5f-46c4-9f3f-071e9148ed69 {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:25:38 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-e46d9cef-5ed8-4fda-83e9-9241fbfd67ed tempest-VolumesTransfersV357Test-1044077295 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:25:38 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-e46d9cef-5ed8-4fda-83e9-9241fbfd67ed tempest-VolumesTransfersV357Test-1044077295 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:25:38 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-e46d9cef-5ed8-4fda-83e9-9241fbfd67ed tempest-VolumesTransfersV357Test-1044077295 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:25:38 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-e46d9cef-5ed8-4fda-83e9-9241fbfd67ed tempest-VolumesTransfersV357Test-1044077295 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:25:38 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-e46d9cef-5ed8-4fda-83e9-9241fbfd67ed tempest-VolumesTransfersV357Test-1044077295 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:25:38 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-e46d9cef-5ed8-4fda-83e9-9241fbfd67ed tempest-VolumesTransfersV357Test-1044077295 None] Selected osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:25:38 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-e46d9cef-5ed8-4fda-83e9-9241fbfd67ed tempest-VolumesTransfersV357Test-1044077295 None] casted to osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 Nov 04 10:25:38 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-e46d9cef-5ed8-4fda-83e9-9241fbfd67ed tempest-VolumesTransfersV357Test-1044077295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-bcd2fbce-ea5f-46c4-9f3f-071e9148ed69 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:25:39 devstack sudo[101178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-bcd2fbce-ea5f-46c4-9f3f-071e9148ed69 1073741824 Nov 04 10:25:39 devstack sudo[101178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:25:39 devstack sudo[101178]: pam_unix(sudo:session): session closed for user root Nov 04 10:25:39 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-e46d9cef-5ed8-4fda-83e9-9241fbfd67ed tempest-VolumesTransfersV357Test-1044077295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-bcd2fbce-ea5f-46c4-9f3f-071e9148ed69 1073741824" returned: 0 in 0.420s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:25:39 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-e46d9cef-5ed8-4fda-83e9-9241fbfd67ed tempest-VolumesTransfersV357Test-1044077295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-bcd2fbce-ea5f-46c4-9f3f-071e9148ed69 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:25:39 devstack sudo[101184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-bcd2fbce-ea5f-46c4-9f3f-071e9148ed69 Nov 04 10:25:39 devstack sudo[101184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:25:39 devstack sudo[101184]: pam_unix(sudo:session): session closed for user root Nov 04 10:25:39 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-e46d9cef-5ed8-4fda-83e9-9241fbfd67ed tempest-VolumesTransfersV357Test-1044077295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-bcd2fbce-ea5f-46c4-9f3f-071e9148ed69" returned: 0 in 0.290s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:25:39 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-e46d9cef-5ed8-4fda-83e9-9241fbfd67ed tempest-VolumesTransfersV357Test-1044077295 None] <== create_volume: return (750ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 10:25:39 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-e46d9cef-5ed8-4fda-83e9-9241fbfd67ed tempest-VolumesTransfersV357Test-1044077295 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.752s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:25:39 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-e46d9cef-5ed8-4fda-83e9-9241fbfd67ed tempest-VolumesTransfersV357Test-1044077295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de31dd5f-8fdf-431a-b56b-1205862090fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bcd2fbce-ea5f-46c4-9f3f-071e9148ed69', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:25:39 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-e46d9cef-5ed8-4fda-83e9-9241fbfd67ed tempest-VolumesTransfersV357Test-1044077295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2aa70888-870a-4800-ad3b-35dc24aba298) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:25:39 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-e46d9cef-5ed8-4fda-83e9-9241fbfd67ed tempest-VolumesTransfersV357Test-1044077295 None] Volume volume-bcd2fbce-ea5f-46c4-9f3f-071e9148ed69 (bcd2fbce-ea5f-46c4-9f3f-071e9148ed69): created successfully Nov 04 10:25:39 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-e46d9cef-5ed8-4fda-83e9-9241fbfd67ed tempest-VolumesTransfersV357Test-1044077295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2aa70888-870a-4800-ad3b-35dc24aba298) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:25:39 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-e46d9cef-5ed8-4fda-83e9-9241fbfd67ed tempest-VolumesTransfersV357Test-1044077295 None] Flow 'volume_create_manager' (ecb38329-91d8-405d-805b-773ec7885292) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:25:39 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-e46d9cef-5ed8-4fda-83e9-9241fbfd67ed tempest-VolumesTransfersV357Test-1044077295 None] Created volume successfully. Nov 04 10:25:40 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-a860a7bf-7d93-4fb8-82b8-1f815f0e3fb4 tempest-VolumesTransfersV357Test-943266727 None] Transfer volume completed successfully. Nov 04 10:25:40 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-e312ba66-d2e2-489e-8e47-09998cf606b0 tempest-VolumesTransfersV357Test-1921557390 None] Acquiring lock "cinder-bcd2fbce-ea5f-46c4-9f3f-071e9148ed69-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:25:40 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-e312ba66-d2e2-489e-8e47-09998cf606b0 tempest-VolumesTransfersV357Test-1921557390 None] Lock "cinder-bcd2fbce-ea5f-46c4-9f3f-071e9148ed69-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:25:40 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-e312ba66-d2e2-489e-8e47-09998cf606b0 tempest-VolumesTransfersV357Test-1921557390 None] Acquiring lock "cinder-quobyte-bcd2fbce-ea5f-46c4-9f3f-071e9148ed69" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:25:40 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-e312ba66-d2e2-489e-8e47-09998cf606b0 tempest-VolumesTransfersV357Test-1921557390 None] Lock "cinder-quobyte-bcd2fbce-ea5f-46c4-9f3f-071e9148ed69" acquired by "delete_volume" :: waited 0.014s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:25:41 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[664f01b6-1e80-42fe-80b2-6ac388b2bf42]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:25:41 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-e312ba66-d2e2-489e-8e47-09998cf606b0 tempest-VolumesTransfersV357Test-1921557390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-bcd2fbce-ea5f-46c4-9f3f-071e9148ed69 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:25:41 devstack sudo[101187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-bcd2fbce-ea5f-46c4-9f3f-071e9148ed69 Nov 04 10:25:41 devstack sudo[101187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:25:41 devstack sudo[101187]: pam_unix(sudo:session): session closed for user root Nov 04 10:25:41 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-e312ba66-d2e2-489e-8e47-09998cf606b0 tempest-VolumesTransfersV357Test-1921557390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-bcd2fbce-ea5f-46c4-9f3f-071e9148ed69" returned: 0 in 0.342s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:25:41 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-e312ba66-d2e2-489e-8e47-09998cf606b0 tempest-VolumesTransfersV357Test-1921557390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-bcd2fbce-ea5f-46c4-9f3f-071e9148ed69 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:25:41 devstack sudo[101192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-bcd2fbce-ea5f-46c4-9f3f-071e9148ed69 Nov 04 10:25:41 devstack sudo[101192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:25:41 devstack sudo[101192]: pam_unix(sudo:session): session closed for user root Nov 04 10:25:41 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-e312ba66-d2e2-489e-8e47-09998cf606b0 tempest-VolumesTransfersV357Test-1921557390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-bcd2fbce-ea5f-46c4-9f3f-071e9148ed69" returned: 0 in 0.235s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:25:41 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-e312ba66-d2e2-489e-8e47-09998cf606b0 tempest-VolumesTransfersV357Test-1921557390 None] Lock "cinder-quobyte-bcd2fbce-ea5f-46c4-9f3f-071e9148ed69" released by "delete_volume" :: held 0.615s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:25:41 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-e312ba66-d2e2-489e-8e47-09998cf606b0 tempest-VolumesTransfersV357Test-1921557390 None] Created reservations ['146ac58d-e299-499e-b4e3-4cb7d0e4bc1d', 'bac6f277-ddf5-4251-8924-10fe20cb787a', '462cc509-acc5-417d-9fa4-816a76ef033d', '4cb411ef-7a10-4fb7-9a7a-b9e03e6d267e'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:25:41 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-e312ba66-d2e2-489e-8e47-09998cf606b0 tempest-VolumesTransfersV357Test-1921557390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:25:41 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-e312ba66-d2e2-489e-8e47-09998cf606b0 tempest-VolumesTransfersV357Test-1921557390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:25:41 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-e312ba66-d2e2-489e-8e47-09998cf606b0 tempest-VolumesTransfersV357Test-1921557390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:25:41 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-e312ba66-d2e2-489e-8e47-09998cf606b0 tempest-VolumesTransfersV357Test-1921557390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:25:41 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-e312ba66-d2e2-489e-8e47-09998cf606b0 tempest-VolumesTransfersV357Test-1921557390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:25:41 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-e312ba66-d2e2-489e-8e47-09998cf606b0 tempest-VolumesTransfersV357Test-1921557390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:25:41 devstack sudo[101195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:25:41 devstack sudo[101195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:25:41 devstack sudo[101195]: pam_unix(sudo:session): session closed for user root Nov 04 10:25:41 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-e312ba66-d2e2-489e-8e47-09998cf606b0 tempest-VolumesTransfersV357Test-1921557390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.242s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:25:41 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-e312ba66-d2e2-489e-8e47-09998cf606b0 tempest-VolumesTransfersV357Test-1921557390 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:25:41 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-e312ba66-d2e2-489e-8e47-09998cf606b0 tempest-VolumesTransfersV357Test-1921557390 None] Deleted volume successfully. Nov 04 10:25:41 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-e312ba66-d2e2-489e-8e47-09998cf606b0 tempest-VolumesTransfersV357Test-1921557390 None] Lock "cinder-bcd2fbce-ea5f-46c4-9f3f-071e9148ed69-delete_volume" released by "delete_volume" :: held 1.035s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:25:42 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1ec0a80-d2c4-40ef-8535-8b9f9309918f tempest-VolumesTransfersV357Test-1044077295 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:25:42 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c1ec0a80-d2c4-40ef-8535-8b9f9309918f tempest-VolumesTransfersV357Test-1044077295 None] Flow 'volume_create_manager' (884c8556-e93c-4769-9d71-a44089b6ff23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:25:42 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c1ec0a80-d2c4-40ef-8535-8b9f9309918f tempest-VolumesTransfersV357Test-1044077295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (505f686d-c4cd-405c-a0a2-3667ae3c63e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:25:42 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c1ec0a80-d2c4-40ef-8535-8b9f9309918f tempest-VolumesTransfersV357Test-1044077295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (505f686d-c4cd-405c-a0a2-3667ae3c63e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:25:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1819470437',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b279a64c-7673-43d6-b122-584a91e4f647,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f45082eb33641f6a68c3012b8a3c851',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:25:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:25:43Z,use_quota=True,user_id='c932c80fdbaa4bcd9668ef7dd88f2dba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:25:42 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c1ec0a80-d2c4-40ef-8535-8b9f9309918f tempest-VolumesTransfersV357Test-1044077295 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fadb8269-529a-4f84-8023-20d93dbd7351) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:25:42 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c1ec0a80-d2c4-40ef-8535-8b9f9309918f tempest-VolumesTransfersV357Test-1044077295 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fadb8269-529a-4f84-8023-20d93dbd7351) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:25:42 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c1ec0a80-d2c4-40ef-8535-8b9f9309918f tempest-VolumesTransfersV357Test-1044077295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36c2ce92-de6c-432d-9ea1-c033745bd30e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:25:42 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c1ec0a80-d2c4-40ef-8535-8b9f9309918f tempest-VolumesTransfersV357Test-1044077295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36c2ce92-de6c-432d-9ea1-c033745bd30e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b279a64c-7673-43d6-b122-584a91e4f647', 'volume_name': 'volume-b279a64c-7673-43d6-b122-584a91e4f647', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:25:42 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c1ec0a80-d2c4-40ef-8535-8b9f9309918f tempest-VolumesTransfersV357Test-1044077295 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b2a16e1-b36c-4f13-9759-9e9c2c1c7d9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:25:42 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c1ec0a80-d2c4-40ef-8535-8b9f9309918f tempest-VolumesTransfersV357Test-1044077295 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b2a16e1-b36c-4f13-9759-9e9c2c1c7d9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:25:42 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c1ec0a80-d2c4-40ef-8535-8b9f9309918f tempest-VolumesTransfersV357Test-1044077295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e6cf04b-ce2d-4895-8171-7505091fef6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:25:42 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-c1ec0a80-d2c4-40ef-8535-8b9f9309918f tempest-VolumesTransfersV357Test-1044077295 None] Volume b279a64c-7673-43d6-b122-584a91e4f647: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b279a64c-7673-43d6-b122-584a91e4f647', 'volume_size': 1} Nov 04 10:25:42 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-c1ec0a80-d2c4-40ef-8535-8b9f9309918f tempest-VolumesTransfersV357Test-1044077295 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:25:42 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-c1ec0a80-d2c4-40ef-8535-8b9f9309918f tempest-VolumesTransfersV357Test-1044077295 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:25:42 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-c1ec0a80-d2c4-40ef-8535-8b9f9309918f tempest-VolumesTransfersV357Test-1044077295 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:25:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1819470437',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b279a64c-7673-43d6-b122-584a91e4f647,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f45082eb33641f6a68c3012b8a3c851',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:25:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:25:43Z,use_quota=True,user_id='c932c80fdbaa4bcd9668ef7dd88f2dba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 10:25:42 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-c1ec0a80-d2c4-40ef-8535-8b9f9309918f tempest-VolumesTransfersV357Test-1044077295 None] Creating volume b279a64c-7673-43d6-b122-584a91e4f647 {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:25:42 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-c1ec0a80-d2c4-40ef-8535-8b9f9309918f tempest-VolumesTransfersV357Test-1044077295 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:25:42 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-c1ec0a80-d2c4-40ef-8535-8b9f9309918f tempest-VolumesTransfersV357Test-1044077295 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:25:42 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-c1ec0a80-d2c4-40ef-8535-8b9f9309918f tempest-VolumesTransfersV357Test-1044077295 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:25:42 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-c1ec0a80-d2c4-40ef-8535-8b9f9309918f tempest-VolumesTransfersV357Test-1044077295 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:25:42 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-c1ec0a80-d2c4-40ef-8535-8b9f9309918f tempest-VolumesTransfersV357Test-1044077295 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:25:42 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-c1ec0a80-d2c4-40ef-8535-8b9f9309918f tempest-VolumesTransfersV357Test-1044077295 None] Selected osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:25:42 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-c1ec0a80-d2c4-40ef-8535-8b9f9309918f tempest-VolumesTransfersV357Test-1044077295 None] casted to osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 Nov 04 10:25:42 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c1ec0a80-d2c4-40ef-8535-8b9f9309918f tempest-VolumesTransfersV357Test-1044077295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b279a64c-7673-43d6-b122-584a91e4f647 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:25:42 devstack sudo[101199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b279a64c-7673-43d6-b122-584a91e4f647 1073741824 Nov 04 10:25:42 devstack sudo[101199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:25:43 devstack sudo[101199]: pam_unix(sudo:session): session closed for user root Nov 04 10:25:43 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c1ec0a80-d2c4-40ef-8535-8b9f9309918f tempest-VolumesTransfersV357Test-1044077295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b279a64c-7673-43d6-b122-584a91e4f647 1073741824" returned: 0 in 0.417s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:25:43 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c1ec0a80-d2c4-40ef-8535-8b9f9309918f tempest-VolumesTransfersV357Test-1044077295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b279a64c-7673-43d6-b122-584a91e4f647 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:25:43 devstack sudo[101204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b279a64c-7673-43d6-b122-584a91e4f647 Nov 04 10:25:43 devstack sudo[101204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:25:43 devstack sudo[101204]: pam_unix(sudo:session): session closed for user root Nov 04 10:25:43 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c1ec0a80-d2c4-40ef-8535-8b9f9309918f tempest-VolumesTransfersV357Test-1044077295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b279a64c-7673-43d6-b122-584a91e4f647" returned: 0 in 0.248s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:25:43 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-c1ec0a80-d2c4-40ef-8535-8b9f9309918f tempest-VolumesTransfersV357Test-1044077295 None] <== create_volume: return (706ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 10:25:43 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-c1ec0a80-d2c4-40ef-8535-8b9f9309918f tempest-VolumesTransfersV357Test-1044077295 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.709s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:25:43 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c1ec0a80-d2c4-40ef-8535-8b9f9309918f tempest-VolumesTransfersV357Test-1044077295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e6cf04b-ce2d-4895-8171-7505091fef6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b279a64c-7673-43d6-b122-584a91e4f647', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:25:43 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c1ec0a80-d2c4-40ef-8535-8b9f9309918f tempest-VolumesTransfersV357Test-1044077295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (933563e6-9039-445c-95d5-9d2eed3db093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:25:43 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-c1ec0a80-d2c4-40ef-8535-8b9f9309918f tempest-VolumesTransfersV357Test-1044077295 None] Volume volume-b279a64c-7673-43d6-b122-584a91e4f647 (b279a64c-7673-43d6-b122-584a91e4f647): created successfully Nov 04 10:25:43 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c1ec0a80-d2c4-40ef-8535-8b9f9309918f tempest-VolumesTransfersV357Test-1044077295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (933563e6-9039-445c-95d5-9d2eed3db093) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:25:43 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c1ec0a80-d2c4-40ef-8535-8b9f9309918f tempest-VolumesTransfersV357Test-1044077295 None] Flow 'volume_create_manager' (884c8556-e93c-4769-9d71-a44089b6ff23) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:25:43 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-c1ec0a80-d2c4-40ef-8535-8b9f9309918f tempest-VolumesTransfersV357Test-1044077295 None] Created volume successfully. Nov 04 10:25:43 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-d888bf9a-d00b-4f6f-9093-d6c737e4f36c tempest-VolumesTransfersV357Test-1921557390 None] Acquiring lock "cinder-b279a64c-7673-43d6-b122-584a91e4f647-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:25:43 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-d888bf9a-d00b-4f6f-9093-d6c737e4f36c tempest-VolumesTransfersV357Test-1921557390 None] Lock "cinder-b279a64c-7673-43d6-b122-584a91e4f647-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:25:43 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-d888bf9a-d00b-4f6f-9093-d6c737e4f36c tempest-VolumesTransfersV357Test-1921557390 None] Acquiring lock "cinder-quobyte-b279a64c-7673-43d6-b122-584a91e4f647" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:25:43 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-d888bf9a-d00b-4f6f-9093-d6c737e4f36c tempest-VolumesTransfersV357Test-1921557390 None] Lock "cinder-quobyte-b279a64c-7673-43d6-b122-584a91e4f647" acquired by "delete_volume" :: waited 0.013s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:25:43 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[8de760e1-aa13-4673-890e-4fcd7528d87d]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:25:43 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d888bf9a-d00b-4f6f-9093-d6c737e4f36c tempest-VolumesTransfersV357Test-1921557390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b279a64c-7673-43d6-b122-584a91e4f647 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:25:44 devstack sudo[101207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b279a64c-7673-43d6-b122-584a91e4f647 Nov 04 10:25:44 devstack sudo[101207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:25:44 devstack sudo[101207]: pam_unix(sudo:session): session closed for user root Nov 04 10:25:44 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d888bf9a-d00b-4f6f-9093-d6c737e4f36c tempest-VolumesTransfersV357Test-1921557390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b279a64c-7673-43d6-b122-584a91e4f647" returned: 0 in 0.367s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:25:44 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d888bf9a-d00b-4f6f-9093-d6c737e4f36c tempest-VolumesTransfersV357Test-1921557390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b279a64c-7673-43d6-b122-584a91e4f647 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:25:44 devstack sudo[101212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b279a64c-7673-43d6-b122-584a91e4f647 Nov 04 10:25:44 devstack sudo[101212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:25:44 devstack sudo[101212]: pam_unix(sudo:session): session closed for user root Nov 04 10:25:44 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d888bf9a-d00b-4f6f-9093-d6c737e4f36c tempest-VolumesTransfersV357Test-1921557390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b279a64c-7673-43d6-b122-584a91e4f647" returned: 0 in 0.235s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:25:44 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-d888bf9a-d00b-4f6f-9093-d6c737e4f36c tempest-VolumesTransfersV357Test-1921557390 None] Lock "cinder-quobyte-b279a64c-7673-43d6-b122-584a91e4f647" released by "delete_volume" :: held 0.640s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:25:44 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-d888bf9a-d00b-4f6f-9093-d6c737e4f36c tempest-VolumesTransfersV357Test-1921557390 None] Created reservations ['2c5871dc-1133-4f40-a457-72a5acaba374', 'cbf73d70-43e7-40f8-a891-366582c72f46', '95233fd4-bdc7-499c-94f8-a5584a0034a6', 'a42260f9-d8c9-43fd-a9f4-7e728567c2bc'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:25:44 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-d888bf9a-d00b-4f6f-9093-d6c737e4f36c tempest-VolumesTransfersV357Test-1921557390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:25:44 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-d888bf9a-d00b-4f6f-9093-d6c737e4f36c tempest-VolumesTransfersV357Test-1921557390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:25:44 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-d888bf9a-d00b-4f6f-9093-d6c737e4f36c tempest-VolumesTransfersV357Test-1921557390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:25:44 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-d888bf9a-d00b-4f6f-9093-d6c737e4f36c tempest-VolumesTransfersV357Test-1921557390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:25:44 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-d888bf9a-d00b-4f6f-9093-d6c737e4f36c tempest-VolumesTransfersV357Test-1921557390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:25:44 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d888bf9a-d00b-4f6f-9093-d6c737e4f36c tempest-VolumesTransfersV357Test-1921557390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:25:44 devstack sudo[101215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:25:44 devstack sudo[101215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:25:44 devstack sudo[101215]: pam_unix(sudo:session): session closed for user root Nov 04 10:25:44 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d888bf9a-d00b-4f6f-9093-d6c737e4f36c tempest-VolumesTransfersV357Test-1921557390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.231s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:25:44 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-d888bf9a-d00b-4f6f-9093-d6c737e4f36c tempest-VolumesTransfersV357Test-1921557390 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:25:44 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-d888bf9a-d00b-4f6f-9093-d6c737e4f36c tempest-VolumesTransfersV357Test-1921557390 None] Deleted volume successfully. Nov 04 10:25:44 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-d888bf9a-d00b-4f6f-9093-d6c737e4f36c tempest-VolumesTransfersV357Test-1921557390 None] Lock "cinder-b279a64c-7673-43d6-b122-584a91e4f647-delete_volume" released by "delete_volume" :: held 1.054s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:25:48 devstack cinder-volume[87068]: INFO cinder.volume.manager [req-1c49d714-254e-468a-bf27-0259aec16ef8 req-af06c593-470a-4bc3-9ff2-e9436a6acc86 tempest-TestMinimumBasicScenario-512484155 None] Terminate volume connection completed successfully. Nov 04 10:25:48 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [req-1c49d714-254e-468a-bf27-0259aec16ef8 req-af06c593-470a-4bc3-9ff2-e9436a6acc86 tempest-TestMinimumBasicScenario-512484155 None] Deleting attachment caaed32a-ffb4-45f3-a0b6-4337b31f9e55. {{(pid=87068) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 04 10:25:48 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-1bab9e4d-4909-41ac-9634-f15fd4a9088e tempest-TestMinimumBasicScenario-512484155 None] Acquiring lock "cinder-586e6856-2f98-4f89-b780-87737887804c-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:25:49 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-1bab9e4d-4909-41ac-9634-f15fd4a9088e tempest-TestMinimumBasicScenario-512484155 None] Lock "cinder-586e6856-2f98-4f89-b780-87737887804c-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:25:49 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-1bab9e4d-4909-41ac-9634-f15fd4a9088e tempest-TestMinimumBasicScenario-512484155 None] Acquiring lock "cinder-quobyte-586e6856-2f98-4f89-b780-87737887804c" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:25:49 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-1bab9e4d-4909-41ac-9634-f15fd4a9088e tempest-TestMinimumBasicScenario-512484155 None] Lock "cinder-quobyte-586e6856-2f98-4f89-b780-87737887804c" acquired by "delete_volume" :: waited 0.019s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:25:49 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[73fa31fa-ff2b-444f-a744-6693bc5d2104]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:25:49 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-1bab9e4d-4909-41ac-9634-f15fd4a9088e tempest-TestMinimumBasicScenario-512484155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-586e6856-2f98-4f89-b780-87737887804c {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:25:49 devstack sudo[101280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-586e6856-2f98-4f89-b780-87737887804c Nov 04 10:25:49 devstack sudo[101280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:25:49 devstack sudo[101280]: pam_unix(sudo:session): session closed for user root Nov 04 10:25:49 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-1bab9e4d-4909-41ac-9634-f15fd4a9088e tempest-TestMinimumBasicScenario-512484155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-586e6856-2f98-4f89-b780-87737887804c" returned: 0 in 0.361s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:25:49 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-1bab9e4d-4909-41ac-9634-f15fd4a9088e tempest-TestMinimumBasicScenario-512484155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-586e6856-2f98-4f89-b780-87737887804c {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:25:49 devstack sudo[101285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-586e6856-2f98-4f89-b780-87737887804c Nov 04 10:25:49 devstack sudo[101285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:25:49 devstack sudo[101285]: pam_unix(sudo:session): session closed for user root Nov 04 10:25:49 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-1bab9e4d-4909-41ac-9634-f15fd4a9088e tempest-TestMinimumBasicScenario-512484155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-586e6856-2f98-4f89-b780-87737887804c" returned: 0 in 0.277s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:25:49 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-1bab9e4d-4909-41ac-9634-f15fd4a9088e tempest-TestMinimumBasicScenario-512484155 None] Lock "cinder-quobyte-586e6856-2f98-4f89-b780-87737887804c" released by "delete_volume" :: held 0.692s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:25:49 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-1bab9e4d-4909-41ac-9634-f15fd4a9088e tempest-TestMinimumBasicScenario-512484155 None] Created reservations ['550c6bb7-4a7b-45a3-9802-882a55ff51a6', '20edea5a-a0d8-492d-b981-5ba988aa9fc1', '17d7fd84-e09f-47b8-bc02-1fd9e10bb173', 'ccc386ac-ca2b-47a6-8549-1031a4cac9e6'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:25:49 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-1bab9e4d-4909-41ac-9634-f15fd4a9088e tempest-TestMinimumBasicScenario-512484155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:25:49 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-1bab9e4d-4909-41ac-9634-f15fd4a9088e tempest-TestMinimumBasicScenario-512484155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:25:49 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-1bab9e4d-4909-41ac-9634-f15fd4a9088e tempest-TestMinimumBasicScenario-512484155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:25:49 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-1bab9e4d-4909-41ac-9634-f15fd4a9088e tempest-TestMinimumBasicScenario-512484155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:25:49 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-1bab9e4d-4909-41ac-9634-f15fd4a9088e tempest-TestMinimumBasicScenario-512484155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:25:49 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-1bab9e4d-4909-41ac-9634-f15fd4a9088e tempest-TestMinimumBasicScenario-512484155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:25:49 devstack sudo[101288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:25:49 devstack sudo[101288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:25:50 devstack sudo[101288]: pam_unix(sudo:session): session closed for user root Nov 04 10:25:50 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-1bab9e4d-4909-41ac-9634-f15fd4a9088e tempest-TestMinimumBasicScenario-512484155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.247s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:25:50 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-1bab9e4d-4909-41ac-9634-f15fd4a9088e tempest-TestMinimumBasicScenario-512484155 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:25:50 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-1bab9e4d-4909-41ac-9634-f15fd4a9088e tempest-TestMinimumBasicScenario-512484155 None] Deleted volume successfully. Nov 04 10:25:50 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-1bab9e4d-4909-41ac-9634-f15fd4a9088e tempest-TestMinimumBasicScenario-512484155 None] Lock "cinder-586e6856-2f98-4f89-b780-87737887804c-delete_volume" released by "delete_volume" :: held 1.163s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:25:52 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-413c3b05-e7cd-4a24-b58b-64903d0b4a48 tempest-VolumesSnapshotNegativeTestJSON-1705295323 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:25:52 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-413c3b05-e7cd-4a24-b58b-64903d0b4a48 tempest-VolumesSnapshotNegativeTestJSON-1705295323 None] Flow 'volume_create_manager' (49c62f34-f30f-414a-a3c2-d0d8ff7eadd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:25:52 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-413c3b05-e7cd-4a24-b58b-64903d0b4a48 tempest-VolumesSnapshotNegativeTestJSON-1705295323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa91c3af-b7a7-4e41-8b27-50358eefa096) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:25:52 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-413c3b05-e7cd-4a24-b58b-64903d0b4a48 tempest-VolumesSnapshotNegativeTestJSON-1705295323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa91c3af-b7a7-4e41-8b27-50358eefa096) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:25:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1931217438',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b6846e6-2f60-41d7-9ae9-09e3867492b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86679d0450f440868ae658970808da86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:25:52Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:25:52Z,use_quota=True,user_id='74b48f8af47c443faa5af2240bcdf20f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:25:52 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-413c3b05-e7cd-4a24-b58b-64903d0b4a48 tempest-VolumesSnapshotNegativeTestJSON-1705295323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fe63bc2-a003-456b-9ca4-2b9fe1f93046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:25:52 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-413c3b05-e7cd-4a24-b58b-64903d0b4a48 tempest-VolumesSnapshotNegativeTestJSON-1705295323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fe63bc2-a003-456b-9ca4-2b9fe1f93046) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:25:52 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-413c3b05-e7cd-4a24-b58b-64903d0b4a48 tempest-VolumesSnapshotNegativeTestJSON-1705295323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a94662b-9785-47b2-8567-ef25ad4403ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:25:52 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-413c3b05-e7cd-4a24-b58b-64903d0b4a48 tempest-VolumesSnapshotNegativeTestJSON-1705295323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a94662b-9785-47b2-8567-ef25ad4403ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b6846e6-2f60-41d7-9ae9-09e3867492b8', 'volume_name': 'volume-0b6846e6-2f60-41d7-9ae9-09e3867492b8', 'volume_size': 2}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:25:52 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-413c3b05-e7cd-4a24-b58b-64903d0b4a48 tempest-VolumesSnapshotNegativeTestJSON-1705295323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (205dd676-be39-43a7-960b-4d1379754296) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:25:52 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-413c3b05-e7cd-4a24-b58b-64903d0b4a48 tempest-VolumesSnapshotNegativeTestJSON-1705295323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (205dd676-be39-43a7-960b-4d1379754296) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:25:52 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-413c3b05-e7cd-4a24-b58b-64903d0b4a48 tempest-VolumesSnapshotNegativeTestJSON-1705295323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (863f5ee0-3536-41ec-a1e2-8b5ef2efa2e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:25:52 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-413c3b05-e7cd-4a24-b58b-64903d0b4a48 tempest-VolumesSnapshotNegativeTestJSON-1705295323 None] Volume 0b6846e6-2f60-41d7-9ae9-09e3867492b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b6846e6-2f60-41d7-9ae9-09e3867492b8', 'volume_size': 2} Nov 04 10:25:52 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-413c3b05-e7cd-4a24-b58b-64903d0b4a48 tempest-VolumesSnapshotNegativeTestJSON-1705295323 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:25:52 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-413c3b05-e7cd-4a24-b58b-64903d0b4a48 tempest-VolumesSnapshotNegativeTestJSON-1705295323 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:25:52 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-413c3b05-e7cd-4a24-b58b-64903d0b4a48 tempest-VolumesSnapshotNegativeTestJSON-1705295323 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:25:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1931217438',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b6846e6-2f60-41d7-9ae9-09e3867492b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86679d0450f440868ae658970808da86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:25:52Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:25:52Z,use_quota=True,user_id='74b48f8af47c443faa5af2240bcdf20f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 10:25:52 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-413c3b05-e7cd-4a24-b58b-64903d0b4a48 tempest-VolumesSnapshotNegativeTestJSON-1705295323 None] Creating volume 0b6846e6-2f60-41d7-9ae9-09e3867492b8 {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:25:52 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-413c3b05-e7cd-4a24-b58b-64903d0b4a48 tempest-VolumesSnapshotNegativeTestJSON-1705295323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:25:52 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-413c3b05-e7cd-4a24-b58b-64903d0b4a48 tempest-VolumesSnapshotNegativeTestJSON-1705295323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:25:52 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-413c3b05-e7cd-4a24-b58b-64903d0b4a48 tempest-VolumesSnapshotNegativeTestJSON-1705295323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:25:52 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-413c3b05-e7cd-4a24-b58b-64903d0b4a48 tempest-VolumesSnapshotNegativeTestJSON-1705295323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:25:52 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-413c3b05-e7cd-4a24-b58b-64903d0b4a48 tempest-VolumesSnapshotNegativeTestJSON-1705295323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:25:52 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-413c3b05-e7cd-4a24-b58b-64903d0b4a48 tempest-VolumesSnapshotNegativeTestJSON-1705295323 None] Selected osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:25:52 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-413c3b05-e7cd-4a24-b58b-64903d0b4a48 tempest-VolumesSnapshotNegativeTestJSON-1705295323 None] casted to osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 Nov 04 10:25:52 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-413c3b05-e7cd-4a24-b58b-64903d0b4a48 tempest-VolumesSnapshotNegativeTestJSON-1705295323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-0b6846e6-2f60-41d7-9ae9-09e3867492b8 2147483648 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:25:52 devstack sudo[101313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-0b6846e6-2f60-41d7-9ae9-09e3867492b8 2147483648 Nov 04 10:25:52 devstack sudo[101313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:25:52 devstack sudo[101313]: pam_unix(sudo:session): session closed for user root Nov 04 10:25:52 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-413c3b05-e7cd-4a24-b58b-64903d0b4a48 tempest-VolumesSnapshotNegativeTestJSON-1705295323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-0b6846e6-2f60-41d7-9ae9-09e3867492b8 2147483648" returned: 0 in 0.460s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:25:52 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-413c3b05-e7cd-4a24-b58b-64903d0b4a48 tempest-VolumesSnapshotNegativeTestJSON-1705295323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-0b6846e6-2f60-41d7-9ae9-09e3867492b8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:25:53 devstack sudo[101320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-0b6846e6-2f60-41d7-9ae9-09e3867492b8 Nov 04 10:25:53 devstack sudo[101320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:25:53 devstack sudo[101320]: pam_unix(sudo:session): session closed for user root Nov 04 10:25:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-413c3b05-e7cd-4a24-b58b-64903d0b4a48 tempest-VolumesSnapshotNegativeTestJSON-1705295323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-0b6846e6-2f60-41d7-9ae9-09e3867492b8" returned: 0 in 0.265s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:25:53 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-413c3b05-e7cd-4a24-b58b-64903d0b4a48 tempest-VolumesSnapshotNegativeTestJSON-1705295323 None] <== create_volume: return (769ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 10:25:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-413c3b05-e7cd-4a24-b58b-64903d0b4a48 tempest-VolumesSnapshotNegativeTestJSON-1705295323 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.772s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:25:53 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-413c3b05-e7cd-4a24-b58b-64903d0b4a48 tempest-VolumesSnapshotNegativeTestJSON-1705295323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (863f5ee0-3536-41ec-a1e2-8b5ef2efa2e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b6846e6-2f60-41d7-9ae9-09e3867492b8', 'volume_size': 2}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:25:53 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-413c3b05-e7cd-4a24-b58b-64903d0b4a48 tempest-VolumesSnapshotNegativeTestJSON-1705295323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65682554-4edd-4cdf-9868-45e41ce84496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:25:53 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-413c3b05-e7cd-4a24-b58b-64903d0b4a48 tempest-VolumesSnapshotNegativeTestJSON-1705295323 None] Volume volume-0b6846e6-2f60-41d7-9ae9-09e3867492b8 (0b6846e6-2f60-41d7-9ae9-09e3867492b8): created successfully Nov 04 10:25:53 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-413c3b05-e7cd-4a24-b58b-64903d0b4a48 tempest-VolumesSnapshotNegativeTestJSON-1705295323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65682554-4edd-4cdf-9868-45e41ce84496) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:25:53 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-413c3b05-e7cd-4a24-b58b-64903d0b4a48 tempest-VolumesSnapshotNegativeTestJSON-1705295323 None] Flow 'volume_create_manager' (49c62f34-f30f-414a-a3c2-d0d8ff7eadd6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:25:53 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-413c3b05-e7cd-4a24-b58b-64903d0b4a48 tempest-VolumesSnapshotNegativeTestJSON-1705295323 None] Created volume successfully. Nov 04 10:25:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-ddb2bbe4-da7a-4e13-ac23-0322eaddb9d8 tempest-VolumesSnapshotNegativeTestJSON-1705295323 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:25:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-ddb2bbe4-da7a-4e13-ac23-0322eaddb9d8 tempest-VolumesSnapshotNegativeTestJSON-1705295323 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:25:53 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-ddb2bbe4-da7a-4e13-ac23-0322eaddb9d8 tempest-VolumesSnapshotNegativeTestJSON-1705295323 None] Creating offline snapshot 7a5a7ccd-21ef-4bc8-b91e-3c27949c6dcb of volume 0b6846e6-2f60-41d7-9ae9-09e3867492b8 {{(pid=87068) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 10:25:53 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac1abfc7-3d07-4f23-9c7e-064330945552]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:25:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ddb2bbe4-da7a-4e13-ac23-0322eaddb9d8 tempest-VolumesSnapshotNegativeTestJSON-1705295323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-0b6846e6-2f60-41d7-9ae9-09e3867492b8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:25:53 devstack sudo[101323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-0b6846e6-2f60-41d7-9ae9-09e3867492b8 Nov 04 10:25:53 devstack sudo[101323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:25:53 devstack cinder-volume[87068]: DEBUG oslo_service.periodic_task [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87068) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 10:25:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:25:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:25:53 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:25:53 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:25:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:25:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:25:53 devstack sudo[101325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:25:53 devstack sudo[101325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:25:54 devstack sudo[101323]: pam_unix(sudo:session): session closed for user root Nov 04 10:25:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ddb2bbe4-da7a-4e13-ac23-0322eaddb9d8 tempest-VolumesSnapshotNegativeTestJSON-1705295323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-0b6846e6-2f60-41d7-9ae9-09e3867492b8" returned: 0 in 0.373s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:25:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ddb2bbe4-da7a-4e13-ac23-0322eaddb9d8 tempest-VolumesSnapshotNegativeTestJSON-1705295323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-0b6846e6-2f60-41d7-9ae9-09e3867492b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-0b6846e6-2f60-41d7-9ae9-09e3867492b8.7a5a7ccd-21ef-4bc8-b91e-3c27949c6dcb 2G {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:25:54 devstack sudo[101325]: pam_unix(sudo:session): session closed for user root Nov 04 10:25:54 devstack sudo[101331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-0b6846e6-2f60-41d7-9ae9-09e3867492b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-0b6846e6-2f60-41d7-9ae9-09e3867492b8.7a5a7ccd-21ef-4bc8-b91e-3c27949c6dcb 2G Nov 04 10:25:54 devstack sudo[101331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:25:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.252s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:25:54 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:25:54 devstack cinder-volume[87068]: DEBUG oslo_service.periodic_task [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Running periodic task VolumeManager._thread_info {{(pid=87068) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 10:25:54 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] thread count: 28 {{(pid=87068) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 04 10:25:54 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] thread info: [<_MainThread(MainThread, started 126275656192128)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87068) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 04 10:25:54 devstack sudo[101331]: pam_unix(sudo:session): session closed for user root Nov 04 10:25:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ddb2bbe4-da7a-4e13-ac23-0322eaddb9d8 tempest-VolumesSnapshotNegativeTestJSON-1705295323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-0b6846e6-2f60-41d7-9ae9-09e3867492b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-0b6846e6-2f60-41d7-9ae9-09e3867492b8.7a5a7ccd-21ef-4bc8-b91e-3c27949c6dcb 2G" returned: 0 in 0.438s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:25:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ddb2bbe4-da7a-4e13-ac23-0322eaddb9d8 tempest-VolumesSnapshotNegativeTestJSON-1705295323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b6846e6-2f60-41d7-9ae9-09e3867492b8 -F qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-0b6846e6-2f60-41d7-9ae9-09e3867492b8.7a5a7ccd-21ef-4bc8-b91e-3c27949c6dcb {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:25:54 devstack sudo[101338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b6846e6-2f60-41d7-9ae9-09e3867492b8 -F qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-0b6846e6-2f60-41d7-9ae9-09e3867492b8.7a5a7ccd-21ef-4bc8-b91e-3c27949c6dcb Nov 04 10:25:54 devstack sudo[101338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:25:54 devstack sudo[101338]: pam_unix(sudo:session): session closed for user root Nov 04 10:25:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ddb2bbe4-da7a-4e13-ac23-0322eaddb9d8 tempest-VolumesSnapshotNegativeTestJSON-1705295323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b6846e6-2f60-41d7-9ae9-09e3867492b8 -F qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-0b6846e6-2f60-41d7-9ae9-09e3867492b8.7a5a7ccd-21ef-4bc8-b91e-3c27949c6dcb" returned: 0 in 0.302s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:25:54 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-ddb2bbe4-da7a-4e13-ac23-0322eaddb9d8 tempest-VolumesSnapshotNegativeTestJSON-1705295323 None] /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-0b6846e6-2f60-41d7-9ae9-09e3867492b8.7a5a7ccd-21ef-4bc8-b91e-3c27949c6dcb is being set with open permissions: ugo+rw Nov 04 10:25:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ddb2bbe4-da7a-4e13-ac23-0322eaddb9d8 tempest-VolumesSnapshotNegativeTestJSON-1705295323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-0b6846e6-2f60-41d7-9ae9-09e3867492b8.7a5a7ccd-21ef-4bc8-b91e-3c27949c6dcb {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:25:54 devstack sudo[101344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-0b6846e6-2f60-41d7-9ae9-09e3867492b8.7a5a7ccd-21ef-4bc8-b91e-3c27949c6dcb Nov 04 10:25:54 devstack sudo[101344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:25:55 devstack sudo[101344]: pam_unix(sudo:session): session closed for user root Nov 04 10:25:55 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ddb2bbe4-da7a-4e13-ac23-0322eaddb9d8 tempest-VolumesSnapshotNegativeTestJSON-1705295323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-0b6846e6-2f60-41d7-9ae9-09e3867492b8.7a5a7ccd-21ef-4bc8-b91e-3c27949c6dcb" returned: 0 in 0.258s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:25:55 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ddb2bbe4-da7a-4e13-ac23-0322eaddb9d8 tempest-VolumesSnapshotNegativeTestJSON-1705295323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-0b6846e6-2f60-41d7-9ae9-09e3867492b8.info {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:25:55 devstack sudo[101347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-0b6846e6-2f60-41d7-9ae9-09e3867492b8.info Nov 04 10:25:55 devstack sudo[101347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:25:55 devstack sudo[101347]: pam_unix(sudo:session): session closed for user root Nov 04 10:25:55 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ddb2bbe4-da7a-4e13-ac23-0322eaddb9d8 tempest-VolumesSnapshotNegativeTestJSON-1705295323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-0b6846e6-2f60-41d7-9ae9-09e3867492b8.info" returned: 0 in 0.258s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:25:55 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-ddb2bbe4-da7a-4e13-ac23-0322eaddb9d8 tempest-VolumesSnapshotNegativeTestJSON-1705295323 None] /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-0b6846e6-2f60-41d7-9ae9-09e3867492b8.info is being set with open permissions: ugo+rw Nov 04 10:25:55 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ddb2bbe4-da7a-4e13-ac23-0322eaddb9d8 tempest-VolumesSnapshotNegativeTestJSON-1705295323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-0b6846e6-2f60-41d7-9ae9-09e3867492b8.info {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:25:55 devstack sudo[101351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-0b6846e6-2f60-41d7-9ae9-09e3867492b8.info Nov 04 10:25:55 devstack sudo[101351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:25:55 devstack sudo[101351]: pam_unix(sudo:session): session closed for user root Nov 04 10:25:55 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ddb2bbe4-da7a-4e13-ac23-0322eaddb9d8 tempest-VolumesSnapshotNegativeTestJSON-1705295323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-0b6846e6-2f60-41d7-9ae9-09e3867492b8.info" returned: 0 in 0.251s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:25:55 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-ddb2bbe4-da7a-4e13-ac23-0322eaddb9d8 tempest-VolumesSnapshotNegativeTestJSON-1705295323 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.971s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:25:55 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-ddb2bbe4-da7a-4e13-ac23-0322eaddb9d8 tempest-VolumesSnapshotNegativeTestJSON-1705295323 None] Create snapshot completed successfully Nov 04 10:25:55 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-6fe4af48-69fc-42f8-a436-93b38cd0bc8d tempest-VolumesSnapshotNegativeTestJSON-1705295323 None] Acquiring lock "cinder-7a5a7ccd-21ef-4bc8-b91e-3c27949c6dcb-delete_snapshot" by "delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:25:55 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-6fe4af48-69fc-42f8-a436-93b38cd0bc8d tempest-VolumesSnapshotNegativeTestJSON-1705295323 None] Lock "cinder-7a5a7ccd-21ef-4bc8-b91e-3c27949c6dcb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:25:55 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-6fe4af48-69fc-42f8-a436-93b38cd0bc8d tempest-VolumesSnapshotNegativeTestJSON-1705295323 None] Acquiring lock "cinder-quobyte-0b6846e6-2f60-41d7-9ae9-09e3867492b8" by "delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:25:55 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-6fe4af48-69fc-42f8-a436-93b38cd0bc8d tempest-VolumesSnapshotNegativeTestJSON-1705295323 None] Lock "cinder-quobyte-0b6846e6-2f60-41d7-9ae9-09e3867492b8" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:25:55 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-6fe4af48-69fc-42f8-a436-93b38cd0bc8d tempest-VolumesSnapshotNegativeTestJSON-1705295323 None] Acquiring lock "cinder-quobyte-7a5a7ccd-21ef-4bc8-b91e-3c27949c6dcb" by "_delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:25:55 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-6fe4af48-69fc-42f8-a436-93b38cd0bc8d tempest-VolumesSnapshotNegativeTestJSON-1705295323 None] Lock "cinder-quobyte-7a5a7ccd-21ef-4bc8-b91e-3c27949c6dcb" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:25:55 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-6fe4af48-69fc-42f8-a436-93b38cd0bc8d tempest-VolumesSnapshotNegativeTestJSON-1705295323 None] Deleting offline snapshot 7a5a7ccd-21ef-4bc8-b91e-3c27949c6dcb of volume 0b6846e6-2f60-41d7-9ae9-09e3867492b8 {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 10:25:55 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-6fe4af48-69fc-42f8-a436-93b38cd0bc8d tempest-VolumesSnapshotNegativeTestJSON-1705295323 None] snapshot_file for this snap is: volume-0b6846e6-2f60-41d7-9ae9-09e3867492b8.7a5a7ccd-21ef-4bc8-b91e-3c27949c6dcb {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 10:25:55 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[179afa8a-4b79-4c7a-99d7-67c879da6977]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:25:55 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6fe4af48-69fc-42f8-a436-93b38cd0bc8d tempest-VolumesSnapshotNegativeTestJSON-1705295323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-0b6846e6-2f60-41d7-9ae9-09e3867492b8.7a5a7ccd-21ef-4bc8-b91e-3c27949c6dcb {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:25:55 devstack sudo[101354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-0b6846e6-2f60-41d7-9ae9-09e3867492b8.7a5a7ccd-21ef-4bc8-b91e-3c27949c6dcb Nov 04 10:25:55 devstack sudo[101354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:25:56 devstack sudo[101354]: pam_unix(sudo:session): session closed for user root Nov 04 10:25:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6fe4af48-69fc-42f8-a436-93b38cd0bc8d tempest-VolumesSnapshotNegativeTestJSON-1705295323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-0b6846e6-2f60-41d7-9ae9-09e3867492b8.7a5a7ccd-21ef-4bc8-b91e-3c27949c6dcb" returned: 0 in 0.375s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:25:56 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-6fe4af48-69fc-42f8-a436-93b38cd0bc8d tempest-VolumesSnapshotNegativeTestJSON-1705295323 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0b6846e6-2f60-41d7-9ae9-09e3867492b8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87068) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 10:25:56 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[0577b037-4db6-4934-8034-6e54adab080f]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:25:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6fe4af48-69fc-42f8-a436-93b38cd0bc8d tempest-VolumesSnapshotNegativeTestJSON-1705295323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-0b6846e6-2f60-41d7-9ae9-09e3867492b8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:25:56 devstack sudo[101359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-0b6846e6-2f60-41d7-9ae9-09e3867492b8 Nov 04 10:25:56 devstack sudo[101359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:25:56 devstack sudo[101359]: pam_unix(sudo:session): session closed for user root Nov 04 10:25:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6fe4af48-69fc-42f8-a436-93b38cd0bc8d tempest-VolumesSnapshotNegativeTestJSON-1705295323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-0b6846e6-2f60-41d7-9ae9-09e3867492b8" returned: 0 in 0.434s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:25:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6fe4af48-69fc-42f8-a436-93b38cd0bc8d tempest-VolumesSnapshotNegativeTestJSON-1705295323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-0b6846e6-2f60-41d7-9ae9-09e3867492b8.7a5a7ccd-21ef-4bc8-b91e-3c27949c6dcb {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:25:56 devstack sudo[101364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-0b6846e6-2f60-41d7-9ae9-09e3867492b8.7a5a7ccd-21ef-4bc8-b91e-3c27949c6dcb Nov 04 10:25:56 devstack sudo[101364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:25:57 devstack sudo[101364]: pam_unix(sudo:session): session closed for user root Nov 04 10:25:57 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6fe4af48-69fc-42f8-a436-93b38cd0bc8d tempest-VolumesSnapshotNegativeTestJSON-1705295323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-0b6846e6-2f60-41d7-9ae9-09e3867492b8.7a5a7ccd-21ef-4bc8-b91e-3c27949c6dcb" returned: 0 in 0.335s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:25:57 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6fe4af48-69fc-42f8-a436-93b38cd0bc8d tempest-VolumesSnapshotNegativeTestJSON-1705295323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-0b6846e6-2f60-41d7-9ae9-09e3867492b8.7a5a7ccd-21ef-4bc8-b91e-3c27949c6dcb {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:25:57 devstack sudo[101369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-0b6846e6-2f60-41d7-9ae9-09e3867492b8.7a5a7ccd-21ef-4bc8-b91e-3c27949c6dcb Nov 04 10:25:57 devstack sudo[101369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:25:57 devstack sudo[101369]: pam_unix(sudo:session): session closed for user root Nov 04 10:25:57 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6fe4af48-69fc-42f8-a436-93b38cd0bc8d tempest-VolumesSnapshotNegativeTestJSON-1705295323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-0b6846e6-2f60-41d7-9ae9-09e3867492b8.7a5a7ccd-21ef-4bc8-b91e-3c27949c6dcb" returned: 0 in 0.299s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:25:57 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-6fe4af48-69fc-42f8-a436-93b38cd0bc8d tempest-VolumesSnapshotNegativeTestJSON-1705295323 None] Lock "cinder-quobyte-7a5a7ccd-21ef-4bc8-b91e-3c27949c6dcb" released by "_delete_snapshot" :: held 1.561s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:25:57 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-6fe4af48-69fc-42f8-a436-93b38cd0bc8d tempest-VolumesSnapshotNegativeTestJSON-1705295323 None] Lock "cinder-quobyte-0b6846e6-2f60-41d7-9ae9-09e3867492b8" released by "delete_snapshot" :: held 1.580s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:25:57 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-6fe4af48-69fc-42f8-a436-93b38cd0bc8d tempest-VolumesSnapshotNegativeTestJSON-1705295323 None] Created reservations ['eb48b45f-9a05-41f6-89f3-61e5c6ab0876', 'a473873f-1baa-4c56-8bf0-e66ac2e40cf9', '68b730d2-11c9-429b-886a-84b67ab4a2ab', 'd0f7e66b-8345-4820-921a-44585618c728'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:25:57 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-6fe4af48-69fc-42f8-a436-93b38cd0bc8d tempest-VolumesSnapshotNegativeTestJSON-1705295323 None] Delete snapshot completed successfully. Nov 04 10:25:57 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-6fe4af48-69fc-42f8-a436-93b38cd0bc8d tempest-VolumesSnapshotNegativeTestJSON-1705295323 None] Lock "cinder-7a5a7ccd-21ef-4bc8-b91e-3c27949c6dcb-delete_snapshot" released by "delete_snapshot" :: held 1.716s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:25:57 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-1915d0b7-8de0-4843-abdd-d21e20015bfe tempest-VolumesSnapshotNegativeTestJSON-1705295323 None] Acquiring lock "cinder-0b6846e6-2f60-41d7-9ae9-09e3867492b8-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:25:58 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-1915d0b7-8de0-4843-abdd-d21e20015bfe tempest-VolumesSnapshotNegativeTestJSON-1705295323 None] Lock "cinder-0b6846e6-2f60-41d7-9ae9-09e3867492b8-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:25:58 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-1915d0b7-8de0-4843-abdd-d21e20015bfe tempest-VolumesSnapshotNegativeTestJSON-1705295323 None] Acquiring lock "cinder-quobyte-0b6846e6-2f60-41d7-9ae9-09e3867492b8" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:25:58 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-1915d0b7-8de0-4843-abdd-d21e20015bfe tempest-VolumesSnapshotNegativeTestJSON-1705295323 None] Lock "cinder-quobyte-0b6846e6-2f60-41d7-9ae9-09e3867492b8" acquired by "delete_volume" :: waited 0.020s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:25:58 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[199cdbdd-1fc2-46da-8da3-f620cce92588]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:25:58 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-1915d0b7-8de0-4843-abdd-d21e20015bfe tempest-VolumesSnapshotNegativeTestJSON-1705295323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-0b6846e6-2f60-41d7-9ae9-09e3867492b8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:25:58 devstack sudo[101374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-0b6846e6-2f60-41d7-9ae9-09e3867492b8 Nov 04 10:25:58 devstack sudo[101374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:25:58 devstack sudo[101374]: pam_unix(sudo:session): session closed for user root Nov 04 10:25:58 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-1915d0b7-8de0-4843-abdd-d21e20015bfe tempest-VolumesSnapshotNegativeTestJSON-1705295323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-0b6846e6-2f60-41d7-9ae9-09e3867492b8" returned: 0 in 0.381s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:25:58 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-1915d0b7-8de0-4843-abdd-d21e20015bfe tempest-VolumesSnapshotNegativeTestJSON-1705295323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-0b6846e6-2f60-41d7-9ae9-09e3867492b8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:25:58 devstack sudo[101379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-0b6846e6-2f60-41d7-9ae9-09e3867492b8 Nov 04 10:25:58 devstack sudo[101379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:25:58 devstack sudo[101379]: pam_unix(sudo:session): session closed for user root Nov 04 10:25:58 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-1915d0b7-8de0-4843-abdd-d21e20015bfe tempest-VolumesSnapshotNegativeTestJSON-1705295323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-0b6846e6-2f60-41d7-9ae9-09e3867492b8" returned: 0 in 0.254s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:25:58 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-1915d0b7-8de0-4843-abdd-d21e20015bfe tempest-VolumesSnapshotNegativeTestJSON-1705295323 None] Lock "cinder-quobyte-0b6846e6-2f60-41d7-9ae9-09e3867492b8" released by "delete_volume" :: held 0.718s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:25:58 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-1915d0b7-8de0-4843-abdd-d21e20015bfe tempest-VolumesSnapshotNegativeTestJSON-1705295323 None] Created reservations ['fe95f249-e8fa-4f69-9e82-e5941e9184ea', 'cb2009cb-8696-4fa9-b23e-d8eabe287033', '9cd4440f-607e-47f3-beaf-b8f0a7fffc58', 'cae0561b-4270-446e-9d47-51a503d53877'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:25:58 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-1915d0b7-8de0-4843-abdd-d21e20015bfe tempest-VolumesSnapshotNegativeTestJSON-1705295323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:25:58 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-1915d0b7-8de0-4843-abdd-d21e20015bfe tempest-VolumesSnapshotNegativeTestJSON-1705295323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:25:58 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-1915d0b7-8de0-4843-abdd-d21e20015bfe tempest-VolumesSnapshotNegativeTestJSON-1705295323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:25:58 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-1915d0b7-8de0-4843-abdd-d21e20015bfe tempest-VolumesSnapshotNegativeTestJSON-1705295323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:25:58 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-1915d0b7-8de0-4843-abdd-d21e20015bfe tempest-VolumesSnapshotNegativeTestJSON-1705295323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:25:58 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-1915d0b7-8de0-4843-abdd-d21e20015bfe tempest-VolumesSnapshotNegativeTestJSON-1705295323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:25:58 devstack sudo[101383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:25:58 devstack sudo[101383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:25:59 devstack sudo[101383]: pam_unix(sudo:session): session closed for user root Nov 04 10:25:59 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-1915d0b7-8de0-4843-abdd-d21e20015bfe tempest-VolumesSnapshotNegativeTestJSON-1705295323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.270s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:25:59 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-1915d0b7-8de0-4843-abdd-d21e20015bfe tempest-VolumesSnapshotNegativeTestJSON-1705295323 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:25:59 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-1915d0b7-8de0-4843-abdd-d21e20015bfe tempest-VolumesSnapshotNegativeTestJSON-1705295323 None] Deleted volume successfully. Nov 04 10:25:59 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-1915d0b7-8de0-4843-abdd-d21e20015bfe tempest-VolumesSnapshotNegativeTestJSON-1705295323 None] Lock "cinder-0b6846e6-2f60-41d7-9ae9-09e3867492b8-delete_volume" released by "delete_volume" :: held 1.229s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:26:08 devstack cinder-volume[87068]: DEBUG dbcounter [-] [87068] Writing DB stats cinder:UPDATE=69,cinder:SELECT=54,cinder:INSERT=19,cinder:DELETE=4 {{(pid=87068) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 10:26:09 devstack cinder-volume[87068]: DEBUG dbcounter [-] [87068] Writing DB stats cinder:SELECT=53,cinder:INSERT=18,cinder:UPDATE=75,cinder:DELETE=7 {{(pid=87068) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 10:26:30 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-1524eda2-8dc0-444a-ad85-0b6924fbbc3f tempest-TestShelveInstance-1504001969 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:26:30 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1524eda2-8dc0-444a-ad85-0b6924fbbc3f tempest-TestShelveInstance-1504001969 None] Flow 'volume_create_manager' (ce6a7c2b-2803-44c9-9c70-928bf700feb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:26:30 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1524eda2-8dc0-444a-ad85-0b6924fbbc3f tempest-TestShelveInstance-1504001969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f92ac37e-53b0-4044-879e-cf5c6166080f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:26:30 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1524eda2-8dc0-444a-ad85-0b6924fbbc3f tempest-TestShelveInstance-1504001969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f92ac37e-53b0-4044-879e-cf5c6166080f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:26:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-179918079',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0c51602-6286-46aa-9b20-2580e9a68364,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e03cc9d734cc48cd910723f763c7c446',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:26:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:26:30Z,use_quota=True,user_id='a296315bbbda40efb59df87a693ba0a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:26:30 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1524eda2-8dc0-444a-ad85-0b6924fbbc3f tempest-TestShelveInstance-1504001969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ede4829c-3812-413f-a56f-0c87fa95d3fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:26:30 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1524eda2-8dc0-444a-ad85-0b6924fbbc3f tempest-TestShelveInstance-1504001969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ede4829c-3812-413f-a56f-0c87fa95d3fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:26:30 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1524eda2-8dc0-444a-ad85-0b6924fbbc3f tempest-TestShelveInstance-1504001969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02e32b07-21ac-4232-aaf4-b4e2d0a70960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:26:30 devstack cinder-volume[87068]: DEBUG cinder.image.glance [None req-1524eda2-8dc0-444a-ad85-0b6924fbbc3f tempest-TestShelveInstance-1504001969 None] Creating Keystone auth plugin from conf {{(pid=87068) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 04 10:26:30 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1524eda2-8dc0-444a-ad85-0b6924fbbc3f tempest-TestShelveInstance-1504001969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02e32b07-21ac-4232-aaf4-b4e2d0a70960) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e0c51602-6286-46aa-9b20-2580e9a68364', 'volume_name': 'volume-e0c51602-6286-46aa-9b20-2580e9a68364', 'volume_size': 1, 'image_id': 'c589a328-f3ed-418a-8877-e90bfc4cf133', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c589a328-f3ed-418a-8877-e90bfc4cf133', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '046e78417f874f20873c25a0eb7adc65', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c589a328-f3ed-418a-8877-e90bfc4cf133', 'created_at': datetime.datetime(2026, 11, 4, 9, 4, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 9, 5, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c589a328-f3ed-418a-8877-e90bfc4cf133/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:26:30 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1524eda2-8dc0-444a-ad85-0b6924fbbc3f tempest-TestShelveInstance-1504001969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b5654ce-2956-4506-a4b0-6d941db87161) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:26:30 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1524eda2-8dc0-444a-ad85-0b6924fbbc3f tempest-TestShelveInstance-1504001969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b5654ce-2956-4506-a4b0-6d941db87161) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:26:30 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1524eda2-8dc0-444a-ad85-0b6924fbbc3f tempest-TestShelveInstance-1504001969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1820d9f3-6b1e-4489-aabf-1f0023a3d41c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:26:30 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-1524eda2-8dc0-444a-ad85-0b6924fbbc3f tempest-TestShelveInstance-1504001969 None] Volume e0c51602-6286-46aa-9b20-2580e9a68364: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e0c51602-6286-46aa-9b20-2580e9a68364', 'volume_size': 1, 'image_id': 'c589a328-f3ed-418a-8877-e90bfc4cf133', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c589a328-f3ed-418a-8877-e90bfc4cf133', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '046e78417f874f20873c25a0eb7adc65', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c589a328-f3ed-418a-8877-e90bfc4cf133', 'created_at': datetime.datetime(2026, 11, 4, 9, 4, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 9, 5, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c589a328-f3ed-418a-8877-e90bfc4cf133/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 04 10:26:30 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-1524eda2-8dc0-444a-ad85-0b6924fbbc3f tempest-TestShelveInstance-1504001969 None] Trying to clone e0c51602-6286-46aa-9b20-2580e9a68364 from image c589a328-f3ed-418a-8877-e90bfc4cf133 at location (None, [{'url': 'file:///opt/stack/data/glance/images/c589a328-f3ed-418a-8877-e90bfc4cf133', 'metadata': {}}]). {{(pid=87068) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 04 10:26:31 devstack cinder-volume[87068]: DEBUG cinder.image.image_utils [None req-1524eda2-8dc0-444a-ad85-0b6924fbbc3f tempest-TestShelveInstance-1504001969 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c589a328-f3ed-418a-8877-e90bfc4cf133_k5deqxa8devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87068) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 04 10:26:31 devstack cinder-volume[87068]: INFO cinder.image.image_utils [None req-1524eda2-8dc0-444a-ad85-0b6924fbbc3f tempest-TestShelveInstance-1504001969 None] Image download 20.69 MB at 20.69 MB/s Nov 04 10:26:31 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[11c1f073-1169-4cb7-90ff-f06f350d7fad]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:26:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-1524eda2-8dc0-444a-ad85-0b6924fbbc3f tempest-TestShelveInstance-1504001969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c589a328-f3ed-418a-8877-e90bfc4cf133_k5deqxa8devstack@QuobyteHD {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:26:31 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-1002c965-b6b7-412c-9ab7-e4ac872843cb tempest-TestStampPattern-1045022407 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:26:31 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1002c965-b6b7-412c-9ab7-e4ac872843cb tempest-TestStampPattern-1045022407 None] Flow 'volume_create_manager' (79b4eebc-dc62-4a04-80f3-7a80924f2af0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:26:31 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1002c965-b6b7-412c-9ab7-e4ac872843cb tempest-TestStampPattern-1045022407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c94b8a1b-cd76-455a-a316-6a97177331bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:26:31 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1002c965-b6b7-412c-9ab7-e4ac872843cb tempest-TestStampPattern-1045022407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c94b8a1b-cd76-455a-a316-6a97177331bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:26:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1616529416',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3b9cd28-ed6f-4edd-8e42-8a673fbc5e8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e12b84c88cc34906a0630d145a7cf902',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:26:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:26:31Z,use_quota=True,user_id='9f3f9db90d664979bb321a198fdcf3b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:26:31 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1002c965-b6b7-412c-9ab7-e4ac872843cb tempest-TestStampPattern-1045022407 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72b8f05a-1b6f-4bd4-819b-fb4b97d48465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:26:31 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1002c965-b6b7-412c-9ab7-e4ac872843cb tempest-TestStampPattern-1045022407 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72b8f05a-1b6f-4bd4-819b-fb4b97d48465) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:26:31 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1002c965-b6b7-412c-9ab7-e4ac872843cb tempest-TestStampPattern-1045022407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3254254-fb9e-40c6-a93c-3978b4e4d135) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:26:31 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1002c965-b6b7-412c-9ab7-e4ac872843cb tempest-TestStampPattern-1045022407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3254254-fb9e-40c6-a93c-3978b4e4d135) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3b9cd28-ed6f-4edd-8e42-8a673fbc5e8b', 'volume_name': 'volume-d3b9cd28-ed6f-4edd-8e42-8a673fbc5e8b', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:26:31 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1002c965-b6b7-412c-9ab7-e4ac872843cb tempest-TestStampPattern-1045022407 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63b2d0d3-5d6c-41e8-b666-3eb65061b457) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:26:31 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1002c965-b6b7-412c-9ab7-e4ac872843cb tempest-TestStampPattern-1045022407 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63b2d0d3-5d6c-41e8-b666-3eb65061b457) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:26:31 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1002c965-b6b7-412c-9ab7-e4ac872843cb tempest-TestStampPattern-1045022407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1712d08-160b-4ae2-ba0d-133326f2665c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:26:31 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-1002c965-b6b7-412c-9ab7-e4ac872843cb tempest-TestStampPattern-1045022407 None] Volume d3b9cd28-ed6f-4edd-8e42-8a673fbc5e8b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3b9cd28-ed6f-4edd-8e42-8a673fbc5e8b', 'volume_size': 1} Nov 04 10:26:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-1002c965-b6b7-412c-9ab7-e4ac872843cb tempest-TestStampPattern-1045022407 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:26:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-1002c965-b6b7-412c-9ab7-e4ac872843cb tempest-TestStampPattern-1045022407 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:26:31 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-1002c965-b6b7-412c-9ab7-e4ac872843cb tempest-TestStampPattern-1045022407 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:26:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1616529416',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3b9cd28-ed6f-4edd-8e42-8a673fbc5e8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e12b84c88cc34906a0630d145a7cf902',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:26:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:26:31Z,use_quota=True,user_id='9f3f9db90d664979bb321a198fdcf3b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 10:26:31 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-1002c965-b6b7-412c-9ab7-e4ac872843cb tempest-TestStampPattern-1045022407 None] Creating volume d3b9cd28-ed6f-4edd-8e42-8a673fbc5e8b {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:26:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-1002c965-b6b7-412c-9ab7-e4ac872843cb tempest-TestStampPattern-1045022407 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:26:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-1002c965-b6b7-412c-9ab7-e4ac872843cb tempest-TestStampPattern-1045022407 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:26:31 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-1002c965-b6b7-412c-9ab7-e4ac872843cb tempest-TestStampPattern-1045022407 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:26:31 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-1002c965-b6b7-412c-9ab7-e4ac872843cb tempest-TestStampPattern-1045022407 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:26:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-1002c965-b6b7-412c-9ab7-e4ac872843cb tempest-TestStampPattern-1045022407 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:26:31 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-1002c965-b6b7-412c-9ab7-e4ac872843cb tempest-TestStampPattern-1045022407 None] Selected osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:26:31 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-1002c965-b6b7-412c-9ab7-e4ac872843cb tempest-TestStampPattern-1045022407 None] casted to osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 Nov 04 10:26:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-1002c965-b6b7-412c-9ab7-e4ac872843cb tempest-TestStampPattern-1045022407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-d3b9cd28-ed6f-4edd-8e42-8a673fbc5e8b 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:26:31 devstack sudo[101395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c589a328-f3ed-418a-8877-e90bfc4cf133_k5deqxa8devstack@QuobyteHD Nov 04 10:26:31 devstack sudo[101395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:26:31 devstack sudo[101397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-d3b9cd28-ed6f-4edd-8e42-8a673fbc5e8b 1073741824 Nov 04 10:26:31 devstack sudo[101397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:26:31 devstack sudo[101395]: pam_unix(sudo:session): session closed for user root Nov 04 10:26:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-1524eda2-8dc0-444a-ad85-0b6924fbbc3f tempest-TestShelveInstance-1504001969 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c589a328-f3ed-418a-8877-e90bfc4cf133_k5deqxa8devstack@QuobyteHD" returned: 0 in 0.336s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:26:31 devstack cinder-volume[87068]: DEBUG cinder.image.image_utils [None req-1524eda2-8dc0-444a-ad85-0b6924fbbc3f tempest-TestShelveInstance-1504001969 None] Temporary image c589a328-f3ed-418a-8877-e90bfc4cf133 is fetched for user a296315bbbda40efb59df87a693ba0a7. {{(pid=87068) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 04 10:26:31 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5ded565-995c-40f5-9c4c-523894cac768]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:26:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-1524eda2-8dc0-444a-ad85-0b6924fbbc3f tempest-TestShelveInstance-1504001969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c589a328-f3ed-418a-8877-e90bfc4cf133_k5deqxa8devstack@QuobyteHD {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:26:31 devstack sudo[101405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c589a328-f3ed-418a-8877-e90bfc4cf133_k5deqxa8devstack@QuobyteHD Nov 04 10:26:31 devstack sudo[101405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:26:32 devstack sudo[101397]: pam_unix(sudo:session): session closed for user root Nov 04 10:26:32 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-1002c965-b6b7-412c-9ab7-e4ac872843cb tempest-TestStampPattern-1045022407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-d3b9cd28-ed6f-4edd-8e42-8a673fbc5e8b 1073741824" returned: 0 in 0.504s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:26:32 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-1002c965-b6b7-412c-9ab7-e4ac872843cb tempest-TestStampPattern-1045022407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-d3b9cd28-ed6f-4edd-8e42-8a673fbc5e8b {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:26:32 devstack sudo[101409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-d3b9cd28-ed6f-4edd-8e42-8a673fbc5e8b Nov 04 10:26:32 devstack sudo[101409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:26:32 devstack sudo[101405]: pam_unix(sudo:session): session closed for user root Nov 04 10:26:32 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-1524eda2-8dc0-444a-ad85-0b6924fbbc3f tempest-TestShelveInstance-1504001969 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c589a328-f3ed-418a-8877-e90bfc4cf133_k5deqxa8devstack@QuobyteHD" returned: 0 in 0.414s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:26:32 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-1524eda2-8dc0-444a-ad85-0b6924fbbc3f tempest-TestShelveInstance-1504001969 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:26:32 devstack sudo[101409]: pam_unix(sudo:session): session closed for user root Nov 04 10:26:32 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-1002c965-b6b7-412c-9ab7-e4ac872843cb tempest-TestStampPattern-1045022407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-d3b9cd28-ed6f-4edd-8e42-8a673fbc5e8b" returned: 0 in 0.293s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:26:32 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-1002c965-b6b7-412c-9ab7-e4ac872843cb tempest-TestStampPattern-1045022407 None] <== create_volume: return (846ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 10:26:32 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-1002c965-b6b7-412c-9ab7-e4ac872843cb tempest-TestStampPattern-1045022407 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.849s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:26:32 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-1524eda2-8dc0-444a-ad85-0b6924fbbc3f tempest-TestShelveInstance-1504001969 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.123s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:26:32 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-1524eda2-8dc0-444a-ad85-0b6924fbbc3f tempest-TestShelveInstance-1504001969 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:26:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-179918079',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0c51602-6286-46aa-9b20-2580e9a68364,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e03cc9d734cc48cd910723f763c7c446',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:26:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:26:30Z,use_quota=True,user_id='a296315bbbda40efb59df87a693ba0a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 10:26:32 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-1524eda2-8dc0-444a-ad85-0b6924fbbc3f tempest-TestShelveInstance-1504001969 None] Creating volume e0c51602-6286-46aa-9b20-2580e9a68364 {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:26:32 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-1524eda2-8dc0-444a-ad85-0b6924fbbc3f tempest-TestShelveInstance-1504001969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:26:32 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-1524eda2-8dc0-444a-ad85-0b6924fbbc3f tempest-TestShelveInstance-1504001969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:26:32 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-1524eda2-8dc0-444a-ad85-0b6924fbbc3f tempest-TestShelveInstance-1504001969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:26:32 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-1524eda2-8dc0-444a-ad85-0b6924fbbc3f tempest-TestShelveInstance-1504001969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:26:32 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-1524eda2-8dc0-444a-ad85-0b6924fbbc3f tempest-TestShelveInstance-1504001969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:26:32 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-1524eda2-8dc0-444a-ad85-0b6924fbbc3f tempest-TestShelveInstance-1504001969 None] Selected osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:26:32 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-1524eda2-8dc0-444a-ad85-0b6924fbbc3f tempest-TestShelveInstance-1504001969 None] casted to osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 Nov 04 10:26:32 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-1524eda2-8dc0-444a-ad85-0b6924fbbc3f tempest-TestShelveInstance-1504001969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-e0c51602-6286-46aa-9b20-2580e9a68364 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:26:32 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1002c965-b6b7-412c-9ab7-e4ac872843cb tempest-TestStampPattern-1045022407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1712d08-160b-4ae2-ba0d-133326f2665c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3b9cd28-ed6f-4edd-8e42-8a673fbc5e8b', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:26:32 devstack sudo[101417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-e0c51602-6286-46aa-9b20-2580e9a68364 1073741824 Nov 04 10:26:32 devstack sudo[101417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:26:32 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1002c965-b6b7-412c-9ab7-e4ac872843cb tempest-TestStampPattern-1045022407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d940820-6d5c-41c0-b20e-a4b808eb88a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:26:32 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-1002c965-b6b7-412c-9ab7-e4ac872843cb tempest-TestStampPattern-1045022407 None] Volume volume-d3b9cd28-ed6f-4edd-8e42-8a673fbc5e8b (d3b9cd28-ed6f-4edd-8e42-8a673fbc5e8b): created successfully Nov 04 10:26:32 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1002c965-b6b7-412c-9ab7-e4ac872843cb tempest-TestStampPattern-1045022407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d940820-6d5c-41c0-b20e-a4b808eb88a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:26:32 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1002c965-b6b7-412c-9ab7-e4ac872843cb tempest-TestStampPattern-1045022407 None] Flow 'volume_create_manager' (79b4eebc-dc62-4a04-80f3-7a80924f2af0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:26:32 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-1002c965-b6b7-412c-9ab7-e4ac872843cb tempest-TestStampPattern-1045022407 None] Created volume successfully. Nov 04 10:26:32 devstack sudo[101417]: pam_unix(sudo:session): session closed for user root Nov 04 10:26:32 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-1524eda2-8dc0-444a-ad85-0b6924fbbc3f tempest-TestShelveInstance-1504001969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-e0c51602-6286-46aa-9b20-2580e9a68364 1073741824" returned: 0 in 0.466s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:26:32 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-1524eda2-8dc0-444a-ad85-0b6924fbbc3f tempest-TestShelveInstance-1504001969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-e0c51602-6286-46aa-9b20-2580e9a68364 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:26:32 devstack sudo[101424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-e0c51602-6286-46aa-9b20-2580e9a68364 Nov 04 10:26:32 devstack sudo[101424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:26:33 devstack sudo[101424]: pam_unix(sudo:session): session closed for user root Nov 04 10:26:33 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-1524eda2-8dc0-444a-ad85-0b6924fbbc3f tempest-TestShelveInstance-1504001969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-e0c51602-6286-46aa-9b20-2580e9a68364" returned: 0 in 0.270s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:26:33 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-1524eda2-8dc0-444a-ad85-0b6924fbbc3f tempest-TestShelveInstance-1504001969 None] <== create_volume: return (777ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 10:26:33 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-1524eda2-8dc0-444a-ad85-0b6924fbbc3f tempest-TestShelveInstance-1504001969 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.781s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:26:33 devstack cinder-volume[87068]: DEBUG cinder.volume.volume_utils [None req-1524eda2-8dc0-444a-ad85-0b6924fbbc3f tempest-TestShelveInstance-1504001969 None] Attempting download of c589a328-f3ed-418a-8877-e90bfc4cf133 ((None, [{'url': 'file:///opt/stack/data/glance/images/c589a328-f3ed-418a-8877-e90bfc4cf133', 'metadata': {}}])) to volume e0c51602-6286-46aa-9b20-2580e9a68364. {{(pid=87068) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 04 10:26:33 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[da032eb2-11b3-4e24-a4fb-6de8a9cc918c]: (4, 'raw') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:26:33 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-1524eda2-8dc0-444a-ad85-0b6924fbbc3f tempest-TestShelveInstance-1504001969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c589a328-f3ed-418a-8877-e90bfc4cf133_bqsit81v {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:26:33 devstack sudo[101427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c589a328-f3ed-418a-8877-e90bfc4cf133_bqsit81v Nov 04 10:26:33 devstack sudo[101427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:26:33 devstack sudo[101427]: pam_unix(sudo:session): session closed for user root Nov 04 10:26:33 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-1524eda2-8dc0-444a-ad85-0b6924fbbc3f tempest-TestShelveInstance-1504001969 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c589a328-f3ed-418a-8877-e90bfc4cf133_bqsit81v" returned: 0 in 0.347s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:26:33 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-1524eda2-8dc0-444a-ad85-0b6924fbbc3f tempest-TestShelveInstance-1504001969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c589a328-f3ed-418a-8877-e90bfc4cf133_bqsit81v {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:26:33 devstack sudo[101431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c589a328-f3ed-418a-8877-e90bfc4cf133_bqsit81v Nov 04 10:26:33 devstack sudo[101431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:26:33 devstack sudo[101431]: pam_unix(sudo:session): session closed for user root Nov 04 10:26:33 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-1524eda2-8dc0-444a-ad85-0b6924fbbc3f tempest-TestShelveInstance-1504001969 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c589a328-f3ed-418a-8877-e90bfc4cf133_bqsit81v" returned: 1 in 0.339s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:26:33 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-1524eda2-8dc0-444a-ad85-0b6924fbbc3f tempest-TestShelveInstance-1504001969 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c589a328-f3ed-418a-8877-e90bfc4cf133_bqsit81v' failed. Not Retrying. {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 04 10:26:33 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[61e99d44-de20-45b0-8a81-edf1a8868097]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:26:33 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-1524eda2-8dc0-444a-ad85-0b6924fbbc3f tempest-TestShelveInstance-1504001969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c589a328-f3ed-418a-8877-e90bfc4cf133_k5deqxa8devstack@QuobyteHD {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:26:34 devstack sudo[101439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c589a328-f3ed-418a-8877-e90bfc4cf133_k5deqxa8devstack@QuobyteHD Nov 04 10:26:34 devstack sudo[101439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:26:34 devstack sudo[101439]: pam_unix(sudo:session): session closed for user root Nov 04 10:26:34 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-1524eda2-8dc0-444a-ad85-0b6924fbbc3f tempest-TestShelveInstance-1504001969 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c589a328-f3ed-418a-8877-e90bfc4cf133_k5deqxa8devstack@QuobyteHD" returned: 0 in 0.336s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:26:34 devstack cinder-volume[87068]: DEBUG cinder.image.image_utils [None req-1524eda2-8dc0-444a-ad85-0b6924fbbc3f tempest-TestShelveInstance-1504001969 None] c589a328-f3ed-418a-8877-e90bfc4cf133 was qcow2, converting to qcow2 {{(pid=87068) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 04 10:26:34 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-1524eda2-8dc0-444a-ad85-0b6924fbbc3f tempest-TestShelveInstance-1504001969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c589a328-f3ed-418a-8877-e90bfc4cf133_k5deqxa8devstack@QuobyteHD /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-e0c51602-6286-46aa-9b20-2580e9a68364 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:26:34 devstack sudo[101453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c589a328-f3ed-418a-8877-e90bfc4cf133_k5deqxa8devstack@QuobyteHD /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-e0c51602-6286-46aa-9b20-2580e9a68364 Nov 04 10:26:34 devstack sudo[101453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:26:36 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-1524eda2-8dc0-444a-ad85-0b6924fbbc3f tempest-TestShelveInstance-1504001969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c589a328-f3ed-418a-8877-e90bfc4cf133_k5deqxa8devstack@QuobyteHD /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-e0c51602-6286-46aa-9b20-2580e9a68364" returned: 0 in 2.158s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:26:36 devstack cinder-volume[87068]: DEBUG cinder.image.image_utils [None req-1524eda2-8dc0-444a-ad85-0b6924fbbc3f tempest-TestShelveInstance-1504001969 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c589a328-f3ed-418a-8877-e90bfc4cf133_k5deqxa8devstack@QuobyteHD, size 112.00 MB, duration 2.16 sec, destination /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-e0c51602-6286-46aa-9b20-2580e9a68364 {{(pid=87068) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 04 10:26:36 devstack cinder-volume[87068]: INFO cinder.image.image_utils [None req-1524eda2-8dc0-444a-ad85-0b6924fbbc3f tempest-TestShelveInstance-1504001969 None] Converted 112.00 MB image at 51.84 MB/s Nov 04 10:26:36 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-1524eda2-8dc0-444a-ad85-0b6924fbbc3f tempest-TestShelveInstance-1504001969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-e0c51602-6286-46aa-9b20-2580e9a68364 1G {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:26:36 devstack sudo[101453]: pam_unix(sudo:session): session closed for user root Nov 04 10:26:36 devstack sudo[101467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-e0c51602-6286-46aa-9b20-2580e9a68364 1G Nov 04 10:26:36 devstack sudo[101467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:26:37 devstack sudo[101467]: pam_unix(sudo:session): session closed for user root Nov 04 10:26:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-1524eda2-8dc0-444a-ad85-0b6924fbbc3f tempest-TestShelveInstance-1504001969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-e0c51602-6286-46aa-9b20-2580e9a68364 1G" returned: 0 in 0.601s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:26:37 devstack cinder-volume[87068]: DEBUG cinder.volume.volume_utils [None req-1524eda2-8dc0-444a-ad85-0b6924fbbc3f tempest-TestShelveInstance-1504001969 None] Downloaded image c589a328-f3ed-418a-8877-e90bfc4cf133 ((None, [{'url': 'file:///opt/stack/data/glance/images/c589a328-f3ed-418a-8877-e90bfc4cf133', 'metadata': {}}])) to volume e0c51602-6286-46aa-9b20-2580e9a68364 successfully. {{(pid=87068) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 04 10:26:37 devstack cinder-volume[87068]: DEBUG cinder.image.image_utils [None req-1524eda2-8dc0-444a-ad85-0b6924fbbc3f tempest-TestShelveInstance-1504001969 None] Temporary image c589a328-f3ed-418a-8877-e90bfc4cf133 for user a296315bbbda40efb59df87a693ba0a7 is deleted. {{(pid=87068) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 04 10:26:37 devstack cinder-volume[87068]: DEBUG cinder.volume.volume_utils [None req-1524eda2-8dc0-444a-ad85-0b6924fbbc3f tempest-TestShelveInstance-1504001969 None] Marking volume e0c51602-6286-46aa-9b20-2580e9a68364 as bootable. {{(pid=87068) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 04 10:26:37 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-1524eda2-8dc0-444a-ad85-0b6924fbbc3f tempest-TestShelveInstance-1504001969 None] Copying metadata from image c589a328-f3ed-418a-8877-e90bfc4cf133 to e0c51602-6286-46aa-9b20-2580e9a68364. {{(pid=87068) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 04 10:26:37 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-1524eda2-8dc0-444a-ad85-0b6924fbbc3f tempest-TestShelveInstance-1504001969 None] Creating volume glance metadata for volume e0c51602-6286-46aa-9b20-2580e9a68364 backed by image c589a328-f3ed-418a-8877-e90bfc4cf133 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'c589a328-f3ed-418a-8877-e90bfc4cf133', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87068) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 04 10:26:37 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1524eda2-8dc0-444a-ad85-0b6924fbbc3f tempest-TestShelveInstance-1504001969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1820d9f3-6b1e-4489-aabf-1f0023a3d41c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0c51602-6286-46aa-9b20-2580e9a68364', 'volume_size': 1, 'image_id': 'c589a328-f3ed-418a-8877-e90bfc4cf133', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c589a328-f3ed-418a-8877-e90bfc4cf133', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '046e78417f874f20873c25a0eb7adc65', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c589a328-f3ed-418a-8877-e90bfc4cf133', 'created_at': datetime.datetime(2026, 11, 4, 9, 4, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 9, 5, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c589a328-f3ed-418a-8877-e90bfc4cf133/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:26:37 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1524eda2-8dc0-444a-ad85-0b6924fbbc3f tempest-TestShelveInstance-1504001969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bdc2003-f526-4359-8378-9351246f11fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:26:37 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-1524eda2-8dc0-444a-ad85-0b6924fbbc3f tempest-TestShelveInstance-1504001969 None] Volume volume-e0c51602-6286-46aa-9b20-2580e9a68364 (e0c51602-6286-46aa-9b20-2580e9a68364): created successfully Nov 04 10:26:37 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1524eda2-8dc0-444a-ad85-0b6924fbbc3f tempest-TestShelveInstance-1504001969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bdc2003-f526-4359-8378-9351246f11fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:26:37 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1524eda2-8dc0-444a-ad85-0b6924fbbc3f tempest-TestShelveInstance-1504001969 None] Flow 'volume_create_manager' (ce6a7c2b-2803-44c9-9c70-928bf700feb7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:26:37 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-1524eda2-8dc0-444a-ad85-0b6924fbbc3f tempest-TestShelveInstance-1504001969 None] Created volume successfully. Nov 04 10:26:40 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [req-38e19b98-be5f-4832-bf0e-e581237b0ff4 req-733e77a3-1329-4f4d-af5a-891d1a3f007c tempest-TestShelveInstance-1504001969 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:26:40 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [req-38e19b98-be5f-4832-bf0e-e581237b0ff4 req-733e77a3-1329-4f4d-af5a-891d1a3f007c tempest-TestShelveInstance-1504001969 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:26:40 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [req-38e19b98-be5f-4832-bf0e-e581237b0ff4 req-733e77a3-1329-4f4d-af5a-891d1a3f007c tempest-TestShelveInstance-1504001969 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:26:41 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [req-38e19b98-be5f-4832-bf0e-e581237b0ff4 req-733e77a3-1329-4f4d-af5a-891d1a3f007c tempest-TestShelveInstance-1504001969 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034', 'name': 'volume-e0c51602-6286-46aa-9b20-2580e9a68364', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6009a0ff-83ac-4f79-90e1-6865536f6e1c', 'enforce_multipath': True} {{(pid=87068) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 04 10:26:41 devstack cinder-volume[87068]: INFO cinder.volume.manager [req-38e19b98-be5f-4832-bf0e-e581237b0ff4 req-733e77a3-1329-4f4d-af5a-891d1a3f007c tempest-TestShelveInstance-1504001969 None] attachment_update completed successfully. Nov 04 10:26:51 devstack cinder-volume[87068]: DEBUG dbcounter [-] [87068] Writing DB stats cinder:UPDATE=9,cinder:SELECT=17,cinder:INSERT=6,cinder:DELETE=1 {{(pid=87068) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 10:26:51 devstack cinder-volume[87068]: DEBUG dbcounter [-] [87068] Writing DB stats cinder:SELECT=19,cinder:UPDATE=9,cinder:INSERT=9,cinder:DELETE=1 {{(pid=87068) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 10:26:53 devstack cinder-volume[87068]: DEBUG oslo_service.periodic_task [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87068) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 10:26:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:26:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:26:53 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:26:53 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:26:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:26:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:26:53 devstack sudo[102104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:26:53 devstack sudo[102104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:26:54 devstack sudo[102104]: pam_unix(sudo:session): session closed for user root Nov 04 10:26:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.240s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:26:54 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:26:54 devstack cinder-volume[87068]: DEBUG oslo_service.periodic_task [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Running periodic task VolumeManager._thread_info {{(pid=87068) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 10:26:54 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] thread count: 28 {{(pid=87068) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 04 10:26:54 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] thread info: [<_MainThread(MainThread, started 126275656192128)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87068) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 04 10:27:02 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [req-3c5c74fc-6941-43a5-92f1-e7a0240c3dea req-301e0350-1aa0-49aa-8645-3a324ea8bd7f tempest-TestStampPattern-1045022407 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:27:02 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [req-3c5c74fc-6941-43a5-92f1-e7a0240c3dea req-301e0350-1aa0-49aa-8645-3a324ea8bd7f tempest-TestStampPattern-1045022407 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:27:02 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [req-3c5c74fc-6941-43a5-92f1-e7a0240c3dea req-301e0350-1aa0-49aa-8645-3a324ea8bd7f tempest-TestStampPattern-1045022407 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:27:02 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [req-3c5c74fc-6941-43a5-92f1-e7a0240c3dea req-301e0350-1aa0-49aa-8645-3a324ea8bd7f tempest-TestStampPattern-1045022407 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034', 'name': 'volume-d3b9cd28-ed6f-4edd-8e42-8a673fbc5e8b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c8481f9f-14cc-4728-87fc-7fddbb338707', 'enforce_multipath': True} {{(pid=87068) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 04 10:27:02 devstack cinder-volume[87068]: INFO cinder.volume.manager [req-3c5c74fc-6941-43a5-92f1-e7a0240c3dea req-301e0350-1aa0-49aa-8645-3a324ea8bd7f tempest-TestStampPattern-1045022407 None] attachment_update completed successfully. Nov 04 10:27:06 devstack cinder-volume[87068]: INFO cinder.volume.manager [req-6a7b90b0-4624-4fab-8683-3353c20f139b req-3a155d07-d7aa-4026-b66c-19d9924dec12 tempest-TestStampPattern-1045022407 None] Terminate volume connection completed successfully. Nov 04 10:27:06 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [req-6a7b90b0-4624-4fab-8683-3353c20f139b req-3a155d07-d7aa-4026-b66c-19d9924dec12 tempest-TestStampPattern-1045022407 None] Deleting attachment c8481f9f-14cc-4728-87fc-7fddbb338707. {{(pid=87068) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 04 10:27:07 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-e4149da7-d282-4cdc-ae4b-a0a346f3a9a5 tempest-TestStampPattern-1045022407 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:27:07 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-e4149da7-d282-4cdc-ae4b-a0a346f3a9a5 tempest-TestStampPattern-1045022407 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:27:07 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-e4149da7-d282-4cdc-ae4b-a0a346f3a9a5 tempest-TestStampPattern-1045022407 None] Creating offline snapshot c41d70b7-b095-45f9-9e23-8e4b98d6b025 of volume d3b9cd28-ed6f-4edd-8e42-8a673fbc5e8b {{(pid=87068) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 10:27:07 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[202ac10e-8fd4-4a04-82ff-e28aed8d02b7]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:27:07 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-e4149da7-d282-4cdc-ae4b-a0a346f3a9a5 tempest-TestStampPattern-1045022407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-d3b9cd28-ed6f-4edd-8e42-8a673fbc5e8b {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:27:07 devstack sudo[102190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-d3b9cd28-ed6f-4edd-8e42-8a673fbc5e8b Nov 04 10:27:07 devstack sudo[102190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:27:07 devstack sudo[102190]: pam_unix(sudo:session): session closed for user root Nov 04 10:27:07 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-e4149da7-d282-4cdc-ae4b-a0a346f3a9a5 tempest-TestStampPattern-1045022407 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-d3b9cd28-ed6f-4edd-8e42-8a673fbc5e8b" returned: 0 in 0.367s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:27:07 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-e4149da7-d282-4cdc-ae4b-a0a346f3a9a5 tempest-TestStampPattern-1045022407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-d3b9cd28-ed6f-4edd-8e42-8a673fbc5e8b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-d3b9cd28-ed6f-4edd-8e42-8a673fbc5e8b.c41d70b7-b095-45f9-9e23-8e4b98d6b025 1G {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:27:07 devstack sudo[102195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-d3b9cd28-ed6f-4edd-8e42-8a673fbc5e8b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-d3b9cd28-ed6f-4edd-8e42-8a673fbc5e8b.c41d70b7-b095-45f9-9e23-8e4b98d6b025 1G Nov 04 10:27:07 devstack sudo[102195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:27:08 devstack sudo[102195]: pam_unix(sudo:session): session closed for user root Nov 04 10:27:08 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-e4149da7-d282-4cdc-ae4b-a0a346f3a9a5 tempest-TestStampPattern-1045022407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-d3b9cd28-ed6f-4edd-8e42-8a673fbc5e8b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-d3b9cd28-ed6f-4edd-8e42-8a673fbc5e8b.c41d70b7-b095-45f9-9e23-8e4b98d6b025 1G" returned: 0 in 0.427s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:27:08 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-e4149da7-d282-4cdc-ae4b-a0a346f3a9a5 tempest-TestStampPattern-1045022407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d3b9cd28-ed6f-4edd-8e42-8a673fbc5e8b -F qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-d3b9cd28-ed6f-4edd-8e42-8a673fbc5e8b.c41d70b7-b095-45f9-9e23-8e4b98d6b025 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:27:08 devstack sudo[102200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d3b9cd28-ed6f-4edd-8e42-8a673fbc5e8b -F qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-d3b9cd28-ed6f-4edd-8e42-8a673fbc5e8b.c41d70b7-b095-45f9-9e23-8e4b98d6b025 Nov 04 10:27:08 devstack sudo[102200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:27:08 devstack sudo[102200]: pam_unix(sudo:session): session closed for user root Nov 04 10:27:08 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-e4149da7-d282-4cdc-ae4b-a0a346f3a9a5 tempest-TestStampPattern-1045022407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d3b9cd28-ed6f-4edd-8e42-8a673fbc5e8b -F qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-d3b9cd28-ed6f-4edd-8e42-8a673fbc5e8b.c41d70b7-b095-45f9-9e23-8e4b98d6b025" returned: 0 in 0.323s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:27:08 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-e4149da7-d282-4cdc-ae4b-a0a346f3a9a5 tempest-TestStampPattern-1045022407 None] /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-d3b9cd28-ed6f-4edd-8e42-8a673fbc5e8b.c41d70b7-b095-45f9-9e23-8e4b98d6b025 is being set with open permissions: ugo+rw Nov 04 10:27:08 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-e4149da7-d282-4cdc-ae4b-a0a346f3a9a5 tempest-TestStampPattern-1045022407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-d3b9cd28-ed6f-4edd-8e42-8a673fbc5e8b.c41d70b7-b095-45f9-9e23-8e4b98d6b025 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:27:08 devstack sudo[102205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-d3b9cd28-ed6f-4edd-8e42-8a673fbc5e8b.c41d70b7-b095-45f9-9e23-8e4b98d6b025 Nov 04 10:27:08 devstack sudo[102205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:27:08 devstack sudo[102205]: pam_unix(sudo:session): session closed for user root Nov 04 10:27:08 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-e4149da7-d282-4cdc-ae4b-a0a346f3a9a5 tempest-TestStampPattern-1045022407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-d3b9cd28-ed6f-4edd-8e42-8a673fbc5e8b.c41d70b7-b095-45f9-9e23-8e4b98d6b025" returned: 0 in 0.257s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:27:08 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-e4149da7-d282-4cdc-ae4b-a0a346f3a9a5 tempest-TestStampPattern-1045022407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-d3b9cd28-ed6f-4edd-8e42-8a673fbc5e8b.info {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:27:08 devstack sudo[102208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-d3b9cd28-ed6f-4edd-8e42-8a673fbc5e8b.info Nov 04 10:27:08 devstack sudo[102208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:27:09 devstack sudo[102208]: pam_unix(sudo:session): session closed for user root Nov 04 10:27:09 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-e4149da7-d282-4cdc-ae4b-a0a346f3a9a5 tempest-TestStampPattern-1045022407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-d3b9cd28-ed6f-4edd-8e42-8a673fbc5e8b.info" returned: 0 in 0.246s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:27:09 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-e4149da7-d282-4cdc-ae4b-a0a346f3a9a5 tempest-TestStampPattern-1045022407 None] /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-d3b9cd28-ed6f-4edd-8e42-8a673fbc5e8b.info is being set with open permissions: ugo+rw Nov 04 10:27:09 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-e4149da7-d282-4cdc-ae4b-a0a346f3a9a5 tempest-TestStampPattern-1045022407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-d3b9cd28-ed6f-4edd-8e42-8a673fbc5e8b.info {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:27:09 devstack sudo[102211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-d3b9cd28-ed6f-4edd-8e42-8a673fbc5e8b.info Nov 04 10:27:09 devstack sudo[102211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:27:09 devstack sudo[102211]: pam_unix(sudo:session): session closed for user root Nov 04 10:27:09 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-e4149da7-d282-4cdc-ae4b-a0a346f3a9a5 tempest-TestStampPattern-1045022407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-d3b9cd28-ed6f-4edd-8e42-8a673fbc5e8b.info" returned: 0 in 0.247s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:27:09 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-e4149da7-d282-4cdc-ae4b-a0a346f3a9a5 tempest-TestStampPattern-1045022407 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.974s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:27:09 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-e4149da7-d282-4cdc-ae4b-a0a346f3a9a5 tempest-TestStampPattern-1045022407 None] Create snapshot completed successfully Nov 04 10:27:15 devstack cinder-volume[87068]: INFO cinder.volume.manager [req-a5a69f0b-b396-470c-a139-9a3761ce647f req-730879e1-c1c3-4938-8967-95e293cb5638 tempest-TestShelveInstance-1504001969 None] Terminate volume connection completed successfully. Nov 04 10:27:15 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [req-a5a69f0b-b396-470c-a139-9a3761ce647f req-730879e1-c1c3-4938-8967-95e293cb5638 tempest-TestShelveInstance-1504001969 None] Deleting attachment 6009a0ff-83ac-4f79-90e1-6865536f6e1c. {{(pid=87068) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 04 10:27:16 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-aead8486-5405-4b04-8d11-11b3c0876d0d tempest-TestStampPattern-1045022407 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:27:16 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-aead8486-5405-4b04-8d11-11b3c0876d0d tempest-TestStampPattern-1045022407 None] Flow 'volume_create_manager' (d925e419-8304-44ae-87e5-3526dcffa8e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:27:16 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-aead8486-5405-4b04-8d11-11b3c0876d0d tempest-TestStampPattern-1045022407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f9552bf-fb89-4cf0-864a-44b1b4d2645f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:27:16 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-aead8486-5405-4b04-8d11-11b3c0876d0d tempest-TestStampPattern-1045022407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f9552bf-fb89-4cf0-864a-44b1b4d2645f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:27:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1489334732',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=476bb45e-1a48-4d71-a1d4-fbb6a0750cd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e12b84c88cc34906a0630d145a7cf902',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:27:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=c41d70b7-b095-45f9-9e23-8e4b98d6b025,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:27:16Z,use_quota=True,user_id='9f3f9db90d664979bb321a198fdcf3b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:27:16 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-aead8486-5405-4b04-8d11-11b3c0876d0d tempest-TestStampPattern-1045022407 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f3e4833-fb45-44cb-abe7-3fe561c6d375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:27:16 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-aead8486-5405-4b04-8d11-11b3c0876d0d tempest-TestStampPattern-1045022407 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f3e4833-fb45-44cb-abe7-3fe561c6d375) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:27:16 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-aead8486-5405-4b04-8d11-11b3c0876d0d tempest-TestStampPattern-1045022407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (284d0b07-c6ff-418a-b4da-459e20df9969) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:27:16 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-aead8486-5405-4b04-8d11-11b3c0876d0d tempest-TestStampPattern-1045022407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (284d0b07-c6ff-418a-b4da-459e20df9969) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '476bb45e-1a48-4d71-a1d4-fbb6a0750cd8', 'volume_name': 'volume-476bb45e-1a48-4d71-a1d4-fbb6a0750cd8', 'volume_size': 1, 'snapshot_id': 'c41d70b7-b095-45f9-9e23-8e4b98d6b025'}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:27:16 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-aead8486-5405-4b04-8d11-11b3c0876d0d tempest-TestStampPattern-1045022407 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92c1f201-8ae7-4a13-a7ce-c977bf9aba12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:27:16 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-aead8486-5405-4b04-8d11-11b3c0876d0d tempest-TestStampPattern-1045022407 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92c1f201-8ae7-4a13-a7ce-c977bf9aba12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:27:16 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-aead8486-5405-4b04-8d11-11b3c0876d0d tempest-TestStampPattern-1045022407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (707a8a43-66a4-4677-920f-c75e6fdd0b26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:27:16 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-aead8486-5405-4b04-8d11-11b3c0876d0d tempest-TestStampPattern-1045022407 None] Volume 476bb45e-1a48-4d71-a1d4-fbb6a0750cd8: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-476bb45e-1a48-4d71-a1d4-fbb6a0750cd8', 'volume_size': 1, 'snapshot_id': 'c41d70b7-b095-45f9-9e23-8e4b98d6b025'} Nov 04 10:27:16 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-aead8486-5405-4b04-8d11-11b3c0876d0d tempest-TestStampPattern-1045022407 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:27:16 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-aead8486-5405-4b04-8d11-11b3c0876d0d tempest-TestStampPattern-1045022407 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:27:16 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-aead8486-5405-4b04-8d11-11b3c0876d0d tempest-TestStampPattern-1045022407 None] Acquiring lock "cinder-quobyte-c41d70b7-b095-45f9-9e23-8e4b98d6b025-476bb45e-1a48-4d71-a1d4-fbb6a0750cd8" by "_create_volume_from_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:27:16 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-aead8486-5405-4b04-8d11-11b3c0876d0d tempest-TestStampPattern-1045022407 None] Lock "cinder-quobyte-c41d70b7-b095-45f9-9e23-8e4b98d6b025-476bb45e-1a48-4d71-a1d4-fbb6a0750cd8" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:27:16 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-aead8486-5405-4b04-8d11-11b3c0876d0d tempest-TestStampPattern-1045022407 None] Creating volume 476bb45e-1a48-4d71-a1d4-fbb6a0750cd8 from snapshot c41d70b7-b095-45f9-9e23-8e4b98d6b025 {{(pid=87068) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 04 10:27:16 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-aead8486-5405-4b04-8d11-11b3c0876d0d tempest-TestStampPattern-1045022407 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:27:16 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-aead8486-5405-4b04-8d11-11b3c0876d0d tempest-TestStampPattern-1045022407 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:27:16 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-aead8486-5405-4b04-8d11-11b3c0876d0d tempest-TestStampPattern-1045022407 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:27:16 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-aead8486-5405-4b04-8d11-11b3c0876d0d tempest-TestStampPattern-1045022407 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:27:16 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-aead8486-5405-4b04-8d11-11b3c0876d0d tempest-TestStampPattern-1045022407 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:27:16 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-aead8486-5405-4b04-8d11-11b3c0876d0d tempest-TestStampPattern-1045022407 None] Selected osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:27:16 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-aead8486-5405-4b04-8d11-11b3c0876d0d tempest-TestStampPattern-1045022407 None] Acquiring lock "cinder-quobyte-476bb45e-1a48-4d71-a1d4-fbb6a0750cd8" by "_copy_volume_from_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:27:16 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-aead8486-5405-4b04-8d11-11b3c0876d0d tempest-TestStampPattern-1045022407 None] Lock "cinder-quobyte-476bb45e-1a48-4d71-a1d4-fbb6a0750cd8" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:27:16 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-aead8486-5405-4b04-8d11-11b3c0876d0d tempest-TestStampPattern-1045022407 None] snapshot: c41d70b7-b095-45f9-9e23-8e4b98d6b025, volume: 476bb45e-1a48-4d71-a1d4-fbb6a0750cd8, {{(pid=87068) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 04 10:27:16 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-aead8486-5405-4b04-8d11-11b3c0876d0d tempest-TestStampPattern-1045022407 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:27:16 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-aead8486-5405-4b04-8d11-11b3c0876d0d tempest-TestStampPattern-1045022407 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:27:16 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-aead8486-5405-4b04-8d11-11b3c0876d0d tempest-TestStampPattern-1045022407 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:27:16 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-aead8486-5405-4b04-8d11-11b3c0876d0d tempest-TestStampPattern-1045022407 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:27:16 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-aead8486-5405-4b04-8d11-11b3c0876d0d tempest-TestStampPattern-1045022407 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:27:16 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae1d17b8-f09d-486f-96e2-0d949fceafd3]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:27:16 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-aead8486-5405-4b04-8d11-11b3c0876d0d tempest-TestStampPattern-1045022407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-d3b9cd28-ed6f-4edd-8e42-8a673fbc5e8b.c41d70b7-b095-45f9-9e23-8e4b98d6b025 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:27:16 devstack sudo[102275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-d3b9cd28-ed6f-4edd-8e42-8a673fbc5e8b.c41d70b7-b095-45f9-9e23-8e4b98d6b025 Nov 04 10:27:16 devstack sudo[102275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:27:17 devstack sudo[102275]: pam_unix(sudo:session): session closed for user root Nov 04 10:27:17 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-aead8486-5405-4b04-8d11-11b3c0876d0d tempest-TestStampPattern-1045022407 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-d3b9cd28-ed6f-4edd-8e42-8a673fbc5e8b.c41d70b7-b095-45f9-9e23-8e4b98d6b025" returned: 0 in 0.469s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:27:17 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-aead8486-5405-4b04-8d11-11b3c0876d0d tempest-TestStampPattern-1045022407 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d3b9cd28-ed6f-4edd-8e42-8a673fbc5e8b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87068) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 10:27:17 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa0aeca2-a233-4a64-b2dd-171c6dd4cbe0]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:27:17 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-aead8486-5405-4b04-8d11-11b3c0876d0d tempest-TestStampPattern-1045022407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-d3b9cd28-ed6f-4edd-8e42-8a673fbc5e8b {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:27:17 devstack sudo[102281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-d3b9cd28-ed6f-4edd-8e42-8a673fbc5e8b Nov 04 10:27:17 devstack sudo[102281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:27:17 devstack sudo[102281]: pam_unix(sudo:session): session closed for user root Nov 04 10:27:17 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-aead8486-5405-4b04-8d11-11b3c0876d0d tempest-TestStampPattern-1045022407 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-d3b9cd28-ed6f-4edd-8e42-8a673fbc5e8b" returned: 0 in 0.473s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:27:17 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-aead8486-5405-4b04-8d11-11b3c0876d0d tempest-TestStampPattern-1045022407 None] will copy from snapshot at /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-d3b9cd28-ed6f-4edd-8e42-8a673fbc5e8b {{(pid=87068) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 04 10:27:17 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-aead8486-5405-4b04-8d11-11b3c0876d0d tempest-TestStampPattern-1045022407 None] Creating direct copy from snapshot {{(pid=87068) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 04 10:27:17 devstack cinder-volume[87068]: DEBUG cinder.utils [None req-aead8486-5405-4b04-8d11-11b3c0876d0d tempest-TestStampPattern-1045022407 None] Path /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-476bb45e-1a48-4d71-a1d4-fbb6a0750cd8 not found in is_blk_device check {{(pid=87068) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 04 10:27:17 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-aead8486-5405-4b04-8d11-11b3c0876d0d tempest-TestStampPattern-1045022407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-d3b9cd28-ed6f-4edd-8e42-8a673fbc5e8b /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-476bb45e-1a48-4d71-a1d4-fbb6a0750cd8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:27:17 devstack sudo[102291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-d3b9cd28-ed6f-4edd-8e42-8a673fbc5e8b /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-476bb45e-1a48-4d71-a1d4-fbb6a0750cd8 Nov 04 10:27:17 devstack sudo[102291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:27:18 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [req-f5e692e3-3928-4f90-804a-249264825da0 req-39119a03-1064-4190-a0a5-b37f4a1b4992 tempest-TestShelveInstance-1504001969 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:27:26 devstack sudo[102291]: pam_unix(sudo:session): session closed for user root Nov 04 10:27:26 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-aead8486-5405-4b04-8d11-11b3c0876d0d tempest-TestStampPattern-1045022407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-d3b9cd28-ed6f-4edd-8e42-8a673fbc5e8b /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-476bb45e-1a48-4d71-a1d4-fbb6a0750cd8" returned: 0 in 8.796s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:27:26 devstack cinder-volume[87068]: DEBUG cinder.image.image_utils [None req-aead8486-5405-4b04-8d11-11b3c0876d0d tempest-TestStampPattern-1045022407 None] Image conversion details: src /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-d3b9cd28-ed6f-4edd-8e42-8a673fbc5e8b, size 1024.00 MB, duration 8.80 sec, destination /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-476bb45e-1a48-4d71-a1d4-fbb6a0750cd8 {{(pid=87068) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 04 10:27:26 devstack cinder-volume[87068]: INFO cinder.image.image_utils [None req-aead8486-5405-4b04-8d11-11b3c0876d0d tempest-TestStampPattern-1045022407 None] Converted 1024.00 MB image at 116.40 MB/s Nov 04 10:27:26 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-aead8486-5405-4b04-8d11-11b3c0876d0d tempest-TestStampPattern-1045022407 None] /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-476bb45e-1a48-4d71-a1d4-fbb6a0750cd8 is being set with open permissions: ugo+rw Nov 04 10:27:26 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-aead8486-5405-4b04-8d11-11b3c0876d0d tempest-TestStampPattern-1045022407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-476bb45e-1a48-4d71-a1d4-fbb6a0750cd8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:27:26 devstack sudo[102383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-476bb45e-1a48-4d71-a1d4-fbb6a0750cd8 Nov 04 10:27:26 devstack sudo[102383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:27:26 devstack sudo[102383]: pam_unix(sudo:session): session closed for user root Nov 04 10:27:26 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-aead8486-5405-4b04-8d11-11b3c0876d0d tempest-TestStampPattern-1045022407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-476bb45e-1a48-4d71-a1d4-fbb6a0750cd8" returned: 0 in 0.260s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:27:26 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-aead8486-5405-4b04-8d11-11b3c0876d0d tempest-TestStampPattern-1045022407 None] Lock "cinder-quobyte-476bb45e-1a48-4d71-a1d4-fbb6a0750cd8" released by "_copy_volume_from_snapshot" :: held 10.101s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:27:26 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-aead8486-5405-4b04-8d11-11b3c0876d0d tempest-TestStampPattern-1045022407 None] Lock "cinder-quobyte-c41d70b7-b095-45f9-9e23-8e4b98d6b025-476bb45e-1a48-4d71-a1d4-fbb6a0750cd8" released by "_create_volume_from_snapshot" :: held 10.177s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:27:26 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-aead8486-5405-4b04-8d11-11b3c0876d0d tempest-TestStampPattern-1045022407 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.197s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:27:26 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [req-f5e692e3-3928-4f90-804a-249264825da0 req-39119a03-1064-4190-a0a5-b37f4a1b4992 tempest-TestShelveInstance-1504001969 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 8.327s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:27:26 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [req-f5e692e3-3928-4f90-804a-249264825da0 req-39119a03-1064-4190-a0a5-b37f4a1b4992 tempest-TestShelveInstance-1504001969 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:27:26 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-aead8486-5405-4b04-8d11-11b3c0876d0d tempest-TestStampPattern-1045022407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (707a8a43-66a4-4677-920f-c75e6fdd0b26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-476bb45e-1a48-4d71-a1d4-fbb6a0750cd8', 'volume_size': 1, 'snapshot_id': 'c41d70b7-b095-45f9-9e23-8e4b98d6b025'}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:27:26 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-aead8486-5405-4b04-8d11-11b3c0876d0d tempest-TestStampPattern-1045022407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7460f423-f363-4984-baa1-0fa08509974d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:27:26 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-aead8486-5405-4b04-8d11-11b3c0876d0d tempest-TestStampPattern-1045022407 None] Volume volume-476bb45e-1a48-4d71-a1d4-fbb6a0750cd8 (476bb45e-1a48-4d71-a1d4-fbb6a0750cd8): created successfully Nov 04 10:27:26 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-aead8486-5405-4b04-8d11-11b3c0876d0d tempest-TestStampPattern-1045022407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7460f423-f363-4984-baa1-0fa08509974d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:27:26 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-aead8486-5405-4b04-8d11-11b3c0876d0d tempest-TestStampPattern-1045022407 None] Flow 'volume_create_manager' (d925e419-8304-44ae-87e5-3526dcffa8e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:27:26 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [req-f5e692e3-3928-4f90-804a-249264825da0 req-39119a03-1064-4190-a0a5-b37f4a1b4992 tempest-TestShelveInstance-1504001969 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034', 'name': 'volume-e0c51602-6286-46aa-9b20-2580e9a68364', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5f0326c2-2e64-4fb0-8747-ef513ba23020', 'enforce_multipath': True} {{(pid=87068) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 04 10:27:26 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-aead8486-5405-4b04-8d11-11b3c0876d0d tempest-TestStampPattern-1045022407 None] Created volume successfully. Nov 04 10:27:26 devstack cinder-volume[87068]: INFO cinder.volume.manager [req-f5e692e3-3928-4f90-804a-249264825da0 req-39119a03-1064-4190-a0a5-b37f4a1b4992 tempest-TestShelveInstance-1504001969 None] attachment_update completed successfully. Nov 04 10:27:36 devstack cinder-volume[87068]: DEBUG dbcounter [-] [87068] Writing DB stats cinder:SELECT=22,cinder:UPDATE=6,cinder:INSERT=2,cinder:DELETE=2 {{(pid=87068) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 10:27:45 devstack cinder-volume[87068]: DEBUG dbcounter [-] [87068] Writing DB stats cinder:SELECT=23,cinder:UPDATE=10 {{(pid=87068) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 10:27:53 devstack cinder-volume[87068]: DEBUG oslo_service.periodic_task [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87068) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 10:27:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:27:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:27:53 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:27:53 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:27:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:27:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:27:53 devstack sudo[102985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:27:53 devstack sudo[102985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:27:54 devstack sudo[102985]: pam_unix(sudo:session): session closed for user root Nov 04 10:27:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.334s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:27:54 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:27:54 devstack cinder-volume[87068]: DEBUG oslo_service.periodic_task [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Running periodic task VolumeManager._thread_info {{(pid=87068) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 10:27:54 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] thread count: 28 {{(pid=87068) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 04 10:27:54 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] thread info: [<_MainThread(MainThread, started 126275656192128)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87068) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 04 10:27:55 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [req-b66986b2-9bc7-4d7d-8d77-3caa49a5de9b req-0094162d-03b3-4838-a23a-0bb6a6da4ad4 tempest-TestStampPattern-1045022407 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:27:55 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [req-b66986b2-9bc7-4d7d-8d77-3caa49a5de9b req-0094162d-03b3-4838-a23a-0bb6a6da4ad4 tempest-TestStampPattern-1045022407 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:27:55 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [req-b66986b2-9bc7-4d7d-8d77-3caa49a5de9b req-0094162d-03b3-4838-a23a-0bb6a6da4ad4 tempest-TestStampPattern-1045022407 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.027s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:27:55 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [req-b66986b2-9bc7-4d7d-8d77-3caa49a5de9b req-0094162d-03b3-4838-a23a-0bb6a6da4ad4 tempest-TestStampPattern-1045022407 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034', 'name': 'volume-476bb45e-1a48-4d71-a1d4-fbb6a0750cd8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e67d473f-9a16-4aee-81c5-2e5841771d3e', 'enforce_multipath': True} {{(pid=87068) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 04 10:27:55 devstack cinder-volume[87068]: INFO cinder.volume.manager [req-b66986b2-9bc7-4d7d-8d77-3caa49a5de9b req-0094162d-03b3-4838-a23a-0bb6a6da4ad4 tempest-TestStampPattern-1045022407 None] attachment_update completed successfully. Nov 04 10:27:55 devstack cinder-volume[87068]: INFO cinder.volume.manager [req-c4bcb452-967e-4d26-b88e-bbc643ad68ef req-d1f5e01a-9eee-4667-9234-eccaae96086e tempest-TestShelveInstance-1504001969 None] Terminate volume connection completed successfully. Nov 04 10:27:55 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [req-c4bcb452-967e-4d26-b88e-bbc643ad68ef req-d1f5e01a-9eee-4667-9234-eccaae96086e tempest-TestShelveInstance-1504001969 None] Deleting attachment 5f0326c2-2e64-4fb0-8747-ef513ba23020. {{(pid=87068) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 04 10:27:55 devstack cinder-volume[87068]: DEBUG cinder.coordination [req-c4bcb452-967e-4d26-b88e-bbc643ad68ef req-9e8b4ba3-ea9b-41fa-9f11-a866fdb50c18 tempest-TestShelveInstance-1504001969 None] Acquiring lock "cinder-e0c51602-6286-46aa-9b20-2580e9a68364-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:27:55 devstack cinder-volume[87068]: DEBUG cinder.coordination [req-c4bcb452-967e-4d26-b88e-bbc643ad68ef req-9e8b4ba3-ea9b-41fa-9f11-a866fdb50c18 tempest-TestShelveInstance-1504001969 None] Lock "cinder-e0c51602-6286-46aa-9b20-2580e9a68364-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:27:55 devstack cinder-volume[87068]: DEBUG cinder.coordination [req-c4bcb452-967e-4d26-b88e-bbc643ad68ef req-9e8b4ba3-ea9b-41fa-9f11-a866fdb50c18 tempest-TestShelveInstance-1504001969 None] Acquiring lock "cinder-quobyte-e0c51602-6286-46aa-9b20-2580e9a68364" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:27:55 devstack cinder-volume[87068]: DEBUG cinder.coordination [req-c4bcb452-967e-4d26-b88e-bbc643ad68ef req-9e8b4ba3-ea9b-41fa-9f11-a866fdb50c18 tempest-TestShelveInstance-1504001969 None] Lock "cinder-quobyte-e0c51602-6286-46aa-9b20-2580e9a68364" acquired by "delete_volume" :: waited 0.024s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:27:55 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8ba6af0-a797-4cee-9c1d-fc23b96c53f8]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:27:55 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [req-c4bcb452-967e-4d26-b88e-bbc643ad68ef req-9e8b4ba3-ea9b-41fa-9f11-a866fdb50c18 tempest-TestShelveInstance-1504001969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-e0c51602-6286-46aa-9b20-2580e9a68364 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:27:56 devstack sudo[103360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-e0c51602-6286-46aa-9b20-2580e9a68364 Nov 04 10:27:56 devstack sudo[103360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:27:56 devstack sudo[103360]: pam_unix(sudo:session): session closed for user root Nov 04 10:27:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [req-c4bcb452-967e-4d26-b88e-bbc643ad68ef req-9e8b4ba3-ea9b-41fa-9f11-a866fdb50c18 tempest-TestShelveInstance-1504001969 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-e0c51602-6286-46aa-9b20-2580e9a68364" returned: 0 in 0.454s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:27:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [req-c4bcb452-967e-4d26-b88e-bbc643ad68ef req-9e8b4ba3-ea9b-41fa-9f11-a866fdb50c18 tempest-TestShelveInstance-1504001969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-e0c51602-6286-46aa-9b20-2580e9a68364 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:27:56 devstack sudo[103445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-e0c51602-6286-46aa-9b20-2580e9a68364 Nov 04 10:27:56 devstack sudo[103445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:27:56 devstack sudo[103445]: pam_unix(sudo:session): session closed for user root Nov 04 10:27:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [req-c4bcb452-967e-4d26-b88e-bbc643ad68ef req-9e8b4ba3-ea9b-41fa-9f11-a866fdb50c18 tempest-TestShelveInstance-1504001969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-e0c51602-6286-46aa-9b20-2580e9a68364" returned: 0 in 0.272s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:27:56 devstack cinder-volume[87068]: DEBUG cinder.coordination [req-c4bcb452-967e-4d26-b88e-bbc643ad68ef req-9e8b4ba3-ea9b-41fa-9f11-a866fdb50c18 tempest-TestShelveInstance-1504001969 None] Lock "cinder-quobyte-e0c51602-6286-46aa-9b20-2580e9a68364" released by "delete_volume" :: held 0.786s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:27:56 devstack cinder-volume[87068]: DEBUG cinder.quota [req-c4bcb452-967e-4d26-b88e-bbc643ad68ef req-9e8b4ba3-ea9b-41fa-9f11-a866fdb50c18 tempest-TestShelveInstance-1504001969 None] Created reservations ['2270054a-3547-4860-b583-12f9526deda5', 'f0da08d7-7e55-43af-a52d-dc91961b0389', 'c10dfe58-1aa2-43da-8b21-d9cd75870b45', 'a9f6d693-09b6-47fc-89a6-b2e3148dc4ab'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:27:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [req-c4bcb452-967e-4d26-b88e-bbc643ad68ef req-9e8b4ba3-ea9b-41fa-9f11-a866fdb50c18 tempest-TestShelveInstance-1504001969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:27:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [req-c4bcb452-967e-4d26-b88e-bbc643ad68ef req-9e8b4ba3-ea9b-41fa-9f11-a866fdb50c18 tempest-TestShelveInstance-1504001969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:27:56 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [req-c4bcb452-967e-4d26-b88e-bbc643ad68ef req-9e8b4ba3-ea9b-41fa-9f11-a866fdb50c18 tempest-TestShelveInstance-1504001969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:27:56 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [req-c4bcb452-967e-4d26-b88e-bbc643ad68ef req-9e8b4ba3-ea9b-41fa-9f11-a866fdb50c18 tempest-TestShelveInstance-1504001969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:27:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [req-c4bcb452-967e-4d26-b88e-bbc643ad68ef req-9e8b4ba3-ea9b-41fa-9f11-a866fdb50c18 tempest-TestShelveInstance-1504001969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:27:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [req-c4bcb452-967e-4d26-b88e-bbc643ad68ef req-9e8b4ba3-ea9b-41fa-9f11-a866fdb50c18 tempest-TestShelveInstance-1504001969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:27:56 devstack sudo[103448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:27:56 devstack sudo[103448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:27:57 devstack sudo[103448]: pam_unix(sudo:session): session closed for user root Nov 04 10:27:57 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [req-c4bcb452-967e-4d26-b88e-bbc643ad68ef req-9e8b4ba3-ea9b-41fa-9f11-a866fdb50c18 tempest-TestShelveInstance-1504001969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.284s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:27:57 devstack cinder-volume[87068]: DEBUG cinder.manager [req-c4bcb452-967e-4d26-b88e-bbc643ad68ef req-9e8b4ba3-ea9b-41fa-9f11-a866fdb50c18 tempest-TestShelveInstance-1504001969 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:27:57 devstack cinder-volume[87068]: INFO cinder.volume.manager [req-c4bcb452-967e-4d26-b88e-bbc643ad68ef req-9e8b4ba3-ea9b-41fa-9f11-a866fdb50c18 tempest-TestShelveInstance-1504001969 None] Deleted volume successfully. Nov 04 10:27:57 devstack cinder-volume[87068]: DEBUG cinder.coordination [req-c4bcb452-967e-4d26-b88e-bbc643ad68ef req-9e8b4ba3-ea9b-41fa-9f11-a866fdb50c18 tempest-TestShelveInstance-1504001969 None] Lock "cinder-e0c51602-6286-46aa-9b20-2580e9a68364-delete_volume" released by "delete_volume" :: held 1.314s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:27:58 devstack cinder-volume[87068]: INFO cinder.volume.manager [req-87caf7ea-f68b-4f6d-8de1-9a70e80ce7e4 req-a4e6faac-4eb5-422c-baba-25219dd63cd8 tempest-TestStampPattern-1045022407 None] Terminate volume connection completed successfully. Nov 04 10:27:58 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [req-87caf7ea-f68b-4f6d-8de1-9a70e80ce7e4 req-a4e6faac-4eb5-422c-baba-25219dd63cd8 tempest-TestStampPattern-1045022407 None] Deleting attachment e67d473f-9a16-4aee-81c5-2e5841771d3e. {{(pid=87068) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 04 10:28:03 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-ac27562a-93fd-4e5d-b89a-1e245809f461 tempest-TestStampPattern-1045022407 None] Acquiring lock "cinder-476bb45e-1a48-4d71-a1d4-fbb6a0750cd8-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:28:03 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-ac27562a-93fd-4e5d-b89a-1e245809f461 tempest-TestStampPattern-1045022407 None] Lock "cinder-476bb45e-1a48-4d71-a1d4-fbb6a0750cd8-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:28:03 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-ac27562a-93fd-4e5d-b89a-1e245809f461 tempest-TestStampPattern-1045022407 None] Acquiring lock "cinder-quobyte-476bb45e-1a48-4d71-a1d4-fbb6a0750cd8" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:28:03 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-ac27562a-93fd-4e5d-b89a-1e245809f461 tempest-TestStampPattern-1045022407 None] Lock "cinder-quobyte-476bb45e-1a48-4d71-a1d4-fbb6a0750cd8" acquired by "delete_volume" :: waited 0.015s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:28:03 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[8625b4fb-2193-459c-ae65-5658b510f4d3]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:28:03 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ac27562a-93fd-4e5d-b89a-1e245809f461 tempest-TestStampPattern-1045022407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-476bb45e-1a48-4d71-a1d4-fbb6a0750cd8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:28:03 devstack sudo[103523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-476bb45e-1a48-4d71-a1d4-fbb6a0750cd8 Nov 04 10:28:03 devstack sudo[103523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:28:03 devstack sudo[103523]: pam_unix(sudo:session): session closed for user root Nov 04 10:28:03 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ac27562a-93fd-4e5d-b89a-1e245809f461 tempest-TestStampPattern-1045022407 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-476bb45e-1a48-4d71-a1d4-fbb6a0750cd8" returned: 0 in 0.402s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:28:03 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ac27562a-93fd-4e5d-b89a-1e245809f461 tempest-TestStampPattern-1045022407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-476bb45e-1a48-4d71-a1d4-fbb6a0750cd8 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:28:04 devstack sudo[103529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-476bb45e-1a48-4d71-a1d4-fbb6a0750cd8 Nov 04 10:28:04 devstack sudo[103529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:28:04 devstack sudo[103529]: pam_unix(sudo:session): session closed for user root Nov 04 10:28:04 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ac27562a-93fd-4e5d-b89a-1e245809f461 tempest-TestStampPattern-1045022407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-476bb45e-1a48-4d71-a1d4-fbb6a0750cd8" returned: 0 in 0.279s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:28:04 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-ac27562a-93fd-4e5d-b89a-1e245809f461 tempest-TestStampPattern-1045022407 None] Lock "cinder-quobyte-476bb45e-1a48-4d71-a1d4-fbb6a0750cd8" released by "delete_volume" :: held 0.745s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:28:04 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-ac27562a-93fd-4e5d-b89a-1e245809f461 tempest-TestStampPattern-1045022407 None] Created reservations ['ae54739a-0f7d-4243-9a63-07d1129b57f9', 'f6acce74-d23d-4719-aab9-3eb06278c823', '8315d743-5820-41d5-a2c4-2fdbe2fd397e', '255634b8-9a69-4f57-bfdf-15d69292a021'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:28:04 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-ac27562a-93fd-4e5d-b89a-1e245809f461 tempest-TestStampPattern-1045022407 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:28:04 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-ac27562a-93fd-4e5d-b89a-1e245809f461 tempest-TestStampPattern-1045022407 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:28:04 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-ac27562a-93fd-4e5d-b89a-1e245809f461 tempest-TestStampPattern-1045022407 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:28:04 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-ac27562a-93fd-4e5d-b89a-1e245809f461 tempest-TestStampPattern-1045022407 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:28:04 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-ac27562a-93fd-4e5d-b89a-1e245809f461 tempest-TestStampPattern-1045022407 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:28:04 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ac27562a-93fd-4e5d-b89a-1e245809f461 tempest-TestStampPattern-1045022407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:28:04 devstack sudo[103532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:28:04 devstack sudo[103532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:28:04 devstack sudo[103532]: pam_unix(sudo:session): session closed for user root Nov 04 10:28:04 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ac27562a-93fd-4e5d-b89a-1e245809f461 tempest-TestStampPattern-1045022407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.327s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:28:04 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-ac27562a-93fd-4e5d-b89a-1e245809f461 tempest-TestStampPattern-1045022407 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:28:04 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-ac27562a-93fd-4e5d-b89a-1e245809f461 tempest-TestStampPattern-1045022407 None] Deleted volume successfully. Nov 04 10:28:04 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-ac27562a-93fd-4e5d-b89a-1e245809f461 tempest-TestStampPattern-1045022407 None] Lock "cinder-476bb45e-1a48-4d71-a1d4-fbb6a0750cd8-delete_volume" released by "delete_volume" :: held 1.364s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:28:05 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-79918936-2653-4752-a103-ea36ea3e99a6 tempest-TestStampPattern-1045022407 None] Acquiring lock "cinder-c41d70b7-b095-45f9-9e23-8e4b98d6b025-delete_snapshot" by "delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:28:05 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-79918936-2653-4752-a103-ea36ea3e99a6 tempest-TestStampPattern-1045022407 None] Lock "cinder-c41d70b7-b095-45f9-9e23-8e4b98d6b025-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:28:05 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-79918936-2653-4752-a103-ea36ea3e99a6 tempest-TestStampPattern-1045022407 None] Acquiring lock "cinder-quobyte-d3b9cd28-ed6f-4edd-8e42-8a673fbc5e8b" by "delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:28:05 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-79918936-2653-4752-a103-ea36ea3e99a6 tempest-TestStampPattern-1045022407 None] Lock "cinder-quobyte-d3b9cd28-ed6f-4edd-8e42-8a673fbc5e8b" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:28:05 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-79918936-2653-4752-a103-ea36ea3e99a6 tempest-TestStampPattern-1045022407 None] Acquiring lock "cinder-quobyte-c41d70b7-b095-45f9-9e23-8e4b98d6b025" by "_delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:28:05 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-79918936-2653-4752-a103-ea36ea3e99a6 tempest-TestStampPattern-1045022407 None] Lock "cinder-quobyte-c41d70b7-b095-45f9-9e23-8e4b98d6b025" acquired by "_delete_snapshot" :: waited 0.040s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:28:05 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-79918936-2653-4752-a103-ea36ea3e99a6 tempest-TestStampPattern-1045022407 None] Deleting offline snapshot c41d70b7-b095-45f9-9e23-8e4b98d6b025 of volume d3b9cd28-ed6f-4edd-8e42-8a673fbc5e8b {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 10:28:05 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-79918936-2653-4752-a103-ea36ea3e99a6 tempest-TestStampPattern-1045022407 None] snapshot_file for this snap is: volume-d3b9cd28-ed6f-4edd-8e42-8a673fbc5e8b.c41d70b7-b095-45f9-9e23-8e4b98d6b025 {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 10:28:05 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[f08dadde-27b7-4191-b4a4-73c009375bcc]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:28:05 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-79918936-2653-4752-a103-ea36ea3e99a6 tempest-TestStampPattern-1045022407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-d3b9cd28-ed6f-4edd-8e42-8a673fbc5e8b.c41d70b7-b095-45f9-9e23-8e4b98d6b025 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:28:05 devstack sudo[103535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-d3b9cd28-ed6f-4edd-8e42-8a673fbc5e8b.c41d70b7-b095-45f9-9e23-8e4b98d6b025 Nov 04 10:28:05 devstack sudo[103535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:28:05 devstack sudo[103535]: pam_unix(sudo:session): session closed for user root Nov 04 10:28:05 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-79918936-2653-4752-a103-ea36ea3e99a6 tempest-TestStampPattern-1045022407 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-d3b9cd28-ed6f-4edd-8e42-8a673fbc5e8b.c41d70b7-b095-45f9-9e23-8e4b98d6b025" returned: 0 in 0.390s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:28:05 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-79918936-2653-4752-a103-ea36ea3e99a6 tempest-TestStampPattern-1045022407 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d3b9cd28-ed6f-4edd-8e42-8a673fbc5e8b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87068) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 10:28:05 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c6e7126-4eb2-4056-9cb9-38a931810eda]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:28:05 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-79918936-2653-4752-a103-ea36ea3e99a6 tempest-TestStampPattern-1045022407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-d3b9cd28-ed6f-4edd-8e42-8a673fbc5e8b {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:28:05 devstack sudo[103540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-d3b9cd28-ed6f-4edd-8e42-8a673fbc5e8b Nov 04 10:28:05 devstack sudo[103540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:28:06 devstack sudo[103540]: pam_unix(sudo:session): session closed for user root Nov 04 10:28:06 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-79918936-2653-4752-a103-ea36ea3e99a6 tempest-TestStampPattern-1045022407 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-d3b9cd28-ed6f-4edd-8e42-8a673fbc5e8b" returned: 0 in 0.632s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:28:06 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-79918936-2653-4752-a103-ea36ea3e99a6 tempest-TestStampPattern-1045022407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-d3b9cd28-ed6f-4edd-8e42-8a673fbc5e8b.c41d70b7-b095-45f9-9e23-8e4b98d6b025 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:28:06 devstack sudo[103545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-d3b9cd28-ed6f-4edd-8e42-8a673fbc5e8b.c41d70b7-b095-45f9-9e23-8e4b98d6b025 Nov 04 10:28:06 devstack sudo[103545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:28:06 devstack sudo[103545]: pam_unix(sudo:session): session closed for user root Nov 04 10:28:06 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-79918936-2653-4752-a103-ea36ea3e99a6 tempest-TestStampPattern-1045022407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-d3b9cd28-ed6f-4edd-8e42-8a673fbc5e8b.c41d70b7-b095-45f9-9e23-8e4b98d6b025" returned: 0 in 0.377s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:28:06 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-79918936-2653-4752-a103-ea36ea3e99a6 tempest-TestStampPattern-1045022407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-d3b9cd28-ed6f-4edd-8e42-8a673fbc5e8b.c41d70b7-b095-45f9-9e23-8e4b98d6b025 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:28:06 devstack sudo[103550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-d3b9cd28-ed6f-4edd-8e42-8a673fbc5e8b.c41d70b7-b095-45f9-9e23-8e4b98d6b025 Nov 04 10:28:06 devstack sudo[103550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:28:06 devstack sudo[103550]: pam_unix(sudo:session): session closed for user root Nov 04 10:28:06 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-79918936-2653-4752-a103-ea36ea3e99a6 tempest-TestStampPattern-1045022407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-d3b9cd28-ed6f-4edd-8e42-8a673fbc5e8b.c41d70b7-b095-45f9-9e23-8e4b98d6b025" returned: 0 in 0.255s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:28:06 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-79918936-2653-4752-a103-ea36ea3e99a6 tempest-TestStampPattern-1045022407 None] Lock "cinder-quobyte-c41d70b7-b095-45f9-9e23-8e4b98d6b025" released by "_delete_snapshot" :: held 1.782s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:28:07 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-79918936-2653-4752-a103-ea36ea3e99a6 tempest-TestStampPattern-1045022407 None] Lock "cinder-quobyte-d3b9cd28-ed6f-4edd-8e42-8a673fbc5e8b" released by "delete_snapshot" :: held 1.843s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:28:07 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-79918936-2653-4752-a103-ea36ea3e99a6 tempest-TestStampPattern-1045022407 None] Created reservations ['4a76183b-685a-482b-b4e3-48cb0b0ca795', 'a8a18673-952a-414a-ae08-d73e725303cd', '8529bd55-1e9a-4910-87b4-065d1c39c1f8', '0d57b79b-8244-4a1e-a0f3-b361f2f5f3b6'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:28:07 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-79918936-2653-4752-a103-ea36ea3e99a6 tempest-TestStampPattern-1045022407 None] Delete snapshot completed successfully. Nov 04 10:28:07 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-79918936-2653-4752-a103-ea36ea3e99a6 tempest-TestStampPattern-1045022407 None] Lock "cinder-c41d70b7-b095-45f9-9e23-8e4b98d6b025-delete_snapshot" released by "delete_snapshot" :: held 2.033s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:28:11 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-cc77e66f-c5ea-42bf-b304-6d538fa44fc9 tempest-TestStampPattern-1045022407 None] Acquiring lock "cinder-d3b9cd28-ed6f-4edd-8e42-8a673fbc5e8b-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:28:11 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-cc77e66f-c5ea-42bf-b304-6d538fa44fc9 tempest-TestStampPattern-1045022407 None] Lock "cinder-d3b9cd28-ed6f-4edd-8e42-8a673fbc5e8b-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:28:11 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-cc77e66f-c5ea-42bf-b304-6d538fa44fc9 tempest-TestStampPattern-1045022407 None] Acquiring lock "cinder-quobyte-d3b9cd28-ed6f-4edd-8e42-8a673fbc5e8b" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:28:11 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-cc77e66f-c5ea-42bf-b304-6d538fa44fc9 tempest-TestStampPattern-1045022407 None] Lock "cinder-quobyte-d3b9cd28-ed6f-4edd-8e42-8a673fbc5e8b" acquired by "delete_volume" :: waited 0.019s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:28:11 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bd9d07a-5530-4245-8da5-0604e0eab024]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:28:11 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-cc77e66f-c5ea-42bf-b304-6d538fa44fc9 tempest-TestStampPattern-1045022407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-d3b9cd28-ed6f-4edd-8e42-8a673fbc5e8b {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:28:11 devstack sudo[103580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-d3b9cd28-ed6f-4edd-8e42-8a673fbc5e8b Nov 04 10:28:11 devstack sudo[103580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:28:11 devstack sudo[103580]: pam_unix(sudo:session): session closed for user root Nov 04 10:28:11 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-34890093-858f-4367-bf9d-f894914a7cc0 tempest-CreateVolumesFromSnapshotTest-696580006 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:28:11 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-34890093-858f-4367-bf9d-f894914a7cc0 tempest-CreateVolumesFromSnapshotTest-696580006 None] Flow 'volume_create_manager' (76d19462-3369-42a6-a68b-05c9e8f5861d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:28:11 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-34890093-858f-4367-bf9d-f894914a7cc0 tempest-CreateVolumesFromSnapshotTest-696580006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (715f6b48-1070-4a35-b143-b6c0b29ff620) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:28:11 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-cc77e66f-c5ea-42bf-b304-6d538fa44fc9 tempest-TestStampPattern-1045022407 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-d3b9cd28-ed6f-4edd-8e42-8a673fbc5e8b" returned: 0 in 0.439s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:28:11 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-cc77e66f-c5ea-42bf-b304-6d538fa44fc9 tempest-TestStampPattern-1045022407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-d3b9cd28-ed6f-4edd-8e42-8a673fbc5e8b {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:28:11 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-34890093-858f-4367-bf9d-f894914a7cc0 tempest-CreateVolumesFromSnapshotTest-696580006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (715f6b48-1070-4a35-b143-b6c0b29ff620) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:28:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-362574322',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9eec778b-8b1d-4fbb-bd3d-20069629b2a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c31957b207044b3db1d354b2dcc6dae6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:28:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:28:12Z,use_quota=True,user_id='5e67d4a7cd9e46a6a96f475ecc18b01b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:28:11 devstack sudo[103585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-d3b9cd28-ed6f-4edd-8e42-8a673fbc5e8b Nov 04 10:28:11 devstack sudo[103585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:28:11 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-34890093-858f-4367-bf9d-f894914a7cc0 tempest-CreateVolumesFromSnapshotTest-696580006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fae4d20d-ea53-46ef-8805-4f6d91645883) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:28:11 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-34890093-858f-4367-bf9d-f894914a7cc0 tempest-CreateVolumesFromSnapshotTest-696580006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fae4d20d-ea53-46ef-8805-4f6d91645883) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:28:11 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-34890093-858f-4367-bf9d-f894914a7cc0 tempest-CreateVolumesFromSnapshotTest-696580006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (149d8c2b-76cf-4eaf-9c4e-4cf95c63c3d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:28:11 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-34890093-858f-4367-bf9d-f894914a7cc0 tempest-CreateVolumesFromSnapshotTest-696580006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (149d8c2b-76cf-4eaf-9c4e-4cf95c63c3d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9eec778b-8b1d-4fbb-bd3d-20069629b2a9', 'volume_name': 'volume-9eec778b-8b1d-4fbb-bd3d-20069629b2a9', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:28:11 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-34890093-858f-4367-bf9d-f894914a7cc0 tempest-CreateVolumesFromSnapshotTest-696580006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a2319dc-9bf8-4a90-b539-d2305e55a160) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:28:11 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-34890093-858f-4367-bf9d-f894914a7cc0 tempest-CreateVolumesFromSnapshotTest-696580006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a2319dc-9bf8-4a90-b539-d2305e55a160) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:28:11 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-34890093-858f-4367-bf9d-f894914a7cc0 tempest-CreateVolumesFromSnapshotTest-696580006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (279a390b-b870-4c12-963d-6ef67dc46871) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:28:11 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-34890093-858f-4367-bf9d-f894914a7cc0 tempest-CreateVolumesFromSnapshotTest-696580006 None] Volume 9eec778b-8b1d-4fbb-bd3d-20069629b2a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9eec778b-8b1d-4fbb-bd3d-20069629b2a9', 'volume_size': 1} Nov 04 10:28:11 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-34890093-858f-4367-bf9d-f894914a7cc0 tempest-CreateVolumesFromSnapshotTest-696580006 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:28:11 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-34890093-858f-4367-bf9d-f894914a7cc0 tempest-CreateVolumesFromSnapshotTest-696580006 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:28:11 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-34890093-858f-4367-bf9d-f894914a7cc0 tempest-CreateVolumesFromSnapshotTest-696580006 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:28:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-362574322',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9eec778b-8b1d-4fbb-bd3d-20069629b2a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c31957b207044b3db1d354b2dcc6dae6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:28:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:28:12Z,use_quota=True,user_id='5e67d4a7cd9e46a6a96f475ecc18b01b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 10:28:11 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-34890093-858f-4367-bf9d-f894914a7cc0 tempest-CreateVolumesFromSnapshotTest-696580006 None] Creating volume 9eec778b-8b1d-4fbb-bd3d-20069629b2a9 {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:28:11 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-34890093-858f-4367-bf9d-f894914a7cc0 tempest-CreateVolumesFromSnapshotTest-696580006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:28:11 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-34890093-858f-4367-bf9d-f894914a7cc0 tempest-CreateVolumesFromSnapshotTest-696580006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:28:11 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-34890093-858f-4367-bf9d-f894914a7cc0 tempest-CreateVolumesFromSnapshotTest-696580006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:28:11 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-34890093-858f-4367-bf9d-f894914a7cc0 tempest-CreateVolumesFromSnapshotTest-696580006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:28:11 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-34890093-858f-4367-bf9d-f894914a7cc0 tempest-CreateVolumesFromSnapshotTest-696580006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:28:11 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-34890093-858f-4367-bf9d-f894914a7cc0 tempest-CreateVolumesFromSnapshotTest-696580006 None] Selected osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:28:11 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-34890093-858f-4367-bf9d-f894914a7cc0 tempest-CreateVolumesFromSnapshotTest-696580006 None] casted to osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 Nov 04 10:28:11 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-34890093-858f-4367-bf9d-f894914a7cc0 tempest-CreateVolumesFromSnapshotTest-696580006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-9eec778b-8b1d-4fbb-bd3d-20069629b2a9 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:28:11 devstack sudo[103587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-9eec778b-8b1d-4fbb-bd3d-20069629b2a9 1073741824 Nov 04 10:28:11 devstack sudo[103587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:28:11 devstack sudo[103585]: pam_unix(sudo:session): session closed for user root Nov 04 10:28:11 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-cc77e66f-c5ea-42bf-b304-6d538fa44fc9 tempest-TestStampPattern-1045022407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-d3b9cd28-ed6f-4edd-8e42-8a673fbc5e8b" returned: 0 in 0.253s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:28:11 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-cc77e66f-c5ea-42bf-b304-6d538fa44fc9 tempest-TestStampPattern-1045022407 None] Lock "cinder-quobyte-d3b9cd28-ed6f-4edd-8e42-8a673fbc5e8b" released by "delete_volume" :: held 0.782s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:28:11 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-cc77e66f-c5ea-42bf-b304-6d538fa44fc9 tempest-TestStampPattern-1045022407 None] Created reservations ['817a8257-2aab-4285-8dde-871e9c090d87', '6427ebcc-584e-4838-8415-bcf5c2519965', '68aa78c0-de25-4c1a-a85b-aa11e96b2cf5', '871568cf-ab95-4bf4-a307-f55708ba2002'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:28:12 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-cc77e66f-c5ea-42bf-b304-6d538fa44fc9 tempest-TestStampPattern-1045022407 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:28:12 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-cc77e66f-c5ea-42bf-b304-6d538fa44fc9 tempest-TestStampPattern-1045022407 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:28:12 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-cc77e66f-c5ea-42bf-b304-6d538fa44fc9 tempest-TestStampPattern-1045022407 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:28:12 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-cc77e66f-c5ea-42bf-b304-6d538fa44fc9 tempest-TestStampPattern-1045022407 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:28:12 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-cc77e66f-c5ea-42bf-b304-6d538fa44fc9 tempest-TestStampPattern-1045022407 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:28:12 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-cc77e66f-c5ea-42bf-b304-6d538fa44fc9 tempest-TestStampPattern-1045022407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:28:12 devstack sudo[103593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:28:12 devstack sudo[103593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:28:12 devstack sudo[103587]: pam_unix(sudo:session): session closed for user root Nov 04 10:28:12 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-34890093-858f-4367-bf9d-f894914a7cc0 tempest-CreateVolumesFromSnapshotTest-696580006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-9eec778b-8b1d-4fbb-bd3d-20069629b2a9 1073741824" returned: 0 in 0.437s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:28:12 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-34890093-858f-4367-bf9d-f894914a7cc0 tempest-CreateVolumesFromSnapshotTest-696580006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-9eec778b-8b1d-4fbb-bd3d-20069629b2a9 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:28:12 devstack sudo[103595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-9eec778b-8b1d-4fbb-bd3d-20069629b2a9 Nov 04 10:28:12 devstack sudo[103595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:28:12 devstack sudo[103593]: pam_unix(sudo:session): session closed for user root Nov 04 10:28:12 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-cc77e66f-c5ea-42bf-b304-6d538fa44fc9 tempest-TestStampPattern-1045022407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.287s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:28:12 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-cc77e66f-c5ea-42bf-b304-6d538fa44fc9 tempest-TestStampPattern-1045022407 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:28:12 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-cc77e66f-c5ea-42bf-b304-6d538fa44fc9 tempest-TestStampPattern-1045022407 None] Deleted volume successfully. Nov 04 10:28:12 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-cc77e66f-c5ea-42bf-b304-6d538fa44fc9 tempest-TestStampPattern-1045022407 None] Lock "cinder-d3b9cd28-ed6f-4edd-8e42-8a673fbc5e8b-delete_volume" released by "delete_volume" :: held 1.282s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:28:12 devstack sudo[103595]: pam_unix(sudo:session): session closed for user root Nov 04 10:28:12 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-34890093-858f-4367-bf9d-f894914a7cc0 tempest-CreateVolumesFromSnapshotTest-696580006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-9eec778b-8b1d-4fbb-bd3d-20069629b2a9" returned: 0 in 0.279s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:28:12 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-34890093-858f-4367-bf9d-f894914a7cc0 tempest-CreateVolumesFromSnapshotTest-696580006 None] <== create_volume: return (762ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 10:28:12 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-34890093-858f-4367-bf9d-f894914a7cc0 tempest-CreateVolumesFromSnapshotTest-696580006 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.766s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:28:12 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-34890093-858f-4367-bf9d-f894914a7cc0 tempest-CreateVolumesFromSnapshotTest-696580006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (279a390b-b870-4c12-963d-6ef67dc46871) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9eec778b-8b1d-4fbb-bd3d-20069629b2a9', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:28:12 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-34890093-858f-4367-bf9d-f894914a7cc0 tempest-CreateVolumesFromSnapshotTest-696580006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4aa2af5f-559c-4d2a-9d63-a7a1a179acb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:28:12 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-34890093-858f-4367-bf9d-f894914a7cc0 tempest-CreateVolumesFromSnapshotTest-696580006 None] Volume volume-9eec778b-8b1d-4fbb-bd3d-20069629b2a9 (9eec778b-8b1d-4fbb-bd3d-20069629b2a9): created successfully Nov 04 10:28:12 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-34890093-858f-4367-bf9d-f894914a7cc0 tempest-CreateVolumesFromSnapshotTest-696580006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4aa2af5f-559c-4d2a-9d63-a7a1a179acb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:28:12 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-34890093-858f-4367-bf9d-f894914a7cc0 tempest-CreateVolumesFromSnapshotTest-696580006 None] Flow 'volume_create_manager' (76d19462-3369-42a6-a68b-05c9e8f5861d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:28:12 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-34890093-858f-4367-bf9d-f894914a7cc0 tempest-CreateVolumesFromSnapshotTest-696580006 None] Created volume successfully. Nov 04 10:28:12 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-970f3e8f-6357-405e-96a7-dc4f04efdce6 tempest-CreateVolumesFromSnapshotTest-696580006 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:28:12 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-970f3e8f-6357-405e-96a7-dc4f04efdce6 tempest-CreateVolumesFromSnapshotTest-696580006 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:28:12 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-970f3e8f-6357-405e-96a7-dc4f04efdce6 tempest-CreateVolumesFromSnapshotTest-696580006 None] Creating offline snapshot 4674d956-c06f-4ac9-a697-c237281f9b46 of volume 9eec778b-8b1d-4fbb-bd3d-20069629b2a9 {{(pid=87068) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 10:28:12 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[16ff6ac5-8b12-45f5-97f2-9f1eac7a3dc9]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:28:12 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-970f3e8f-6357-405e-96a7-dc4f04efdce6 tempest-CreateVolumesFromSnapshotTest-696580006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-9eec778b-8b1d-4fbb-bd3d-20069629b2a9 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:28:13 devstack sudo[103600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-9eec778b-8b1d-4fbb-bd3d-20069629b2a9 Nov 04 10:28:13 devstack sudo[103600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:28:13 devstack sudo[103600]: pam_unix(sudo:session): session closed for user root Nov 04 10:28:13 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-970f3e8f-6357-405e-96a7-dc4f04efdce6 tempest-CreateVolumesFromSnapshotTest-696580006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-9eec778b-8b1d-4fbb-bd3d-20069629b2a9" returned: 0 in 0.369s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:28:13 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-970f3e8f-6357-405e-96a7-dc4f04efdce6 tempest-CreateVolumesFromSnapshotTest-696580006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-9eec778b-8b1d-4fbb-bd3d-20069629b2a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-9eec778b-8b1d-4fbb-bd3d-20069629b2a9.4674d956-c06f-4ac9-a697-c237281f9b46 1G {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:28:13 devstack sudo[103605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-9eec778b-8b1d-4fbb-bd3d-20069629b2a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-9eec778b-8b1d-4fbb-bd3d-20069629b2a9.4674d956-c06f-4ac9-a697-c237281f9b46 1G Nov 04 10:28:13 devstack sudo[103605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:28:13 devstack sudo[103605]: pam_unix(sudo:session): session closed for user root Nov 04 10:28:13 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-970f3e8f-6357-405e-96a7-dc4f04efdce6 tempest-CreateVolumesFromSnapshotTest-696580006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-9eec778b-8b1d-4fbb-bd3d-20069629b2a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-9eec778b-8b1d-4fbb-bd3d-20069629b2a9.4674d956-c06f-4ac9-a697-c237281f9b46 1G" returned: 0 in 0.447s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:28:13 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-970f3e8f-6357-405e-96a7-dc4f04efdce6 tempest-CreateVolumesFromSnapshotTest-696580006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9eec778b-8b1d-4fbb-bd3d-20069629b2a9 -F qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-9eec778b-8b1d-4fbb-bd3d-20069629b2a9.4674d956-c06f-4ac9-a697-c237281f9b46 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:28:13 devstack sudo[103610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9eec778b-8b1d-4fbb-bd3d-20069629b2a9 -F qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-9eec778b-8b1d-4fbb-bd3d-20069629b2a9.4674d956-c06f-4ac9-a697-c237281f9b46 Nov 04 10:28:13 devstack sudo[103610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:28:14 devstack sudo[103610]: pam_unix(sudo:session): session closed for user root Nov 04 10:28:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-970f3e8f-6357-405e-96a7-dc4f04efdce6 tempest-CreateVolumesFromSnapshotTest-696580006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9eec778b-8b1d-4fbb-bd3d-20069629b2a9 -F qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-9eec778b-8b1d-4fbb-bd3d-20069629b2a9.4674d956-c06f-4ac9-a697-c237281f9b46" returned: 0 in 0.287s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:28:14 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-970f3e8f-6357-405e-96a7-dc4f04efdce6 tempest-CreateVolumesFromSnapshotTest-696580006 None] /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-9eec778b-8b1d-4fbb-bd3d-20069629b2a9.4674d956-c06f-4ac9-a697-c237281f9b46 is being set with open permissions: ugo+rw Nov 04 10:28:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-970f3e8f-6357-405e-96a7-dc4f04efdce6 tempest-CreateVolumesFromSnapshotTest-696580006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-9eec778b-8b1d-4fbb-bd3d-20069629b2a9.4674d956-c06f-4ac9-a697-c237281f9b46 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:28:14 devstack sudo[103615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-9eec778b-8b1d-4fbb-bd3d-20069629b2a9.4674d956-c06f-4ac9-a697-c237281f9b46 Nov 04 10:28:14 devstack sudo[103615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:28:14 devstack sudo[103615]: pam_unix(sudo:session): session closed for user root Nov 04 10:28:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-970f3e8f-6357-405e-96a7-dc4f04efdce6 tempest-CreateVolumesFromSnapshotTest-696580006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-9eec778b-8b1d-4fbb-bd3d-20069629b2a9.4674d956-c06f-4ac9-a697-c237281f9b46" returned: 0 in 0.277s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:28:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-970f3e8f-6357-405e-96a7-dc4f04efdce6 tempest-CreateVolumesFromSnapshotTest-696580006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-9eec778b-8b1d-4fbb-bd3d-20069629b2a9.info {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:28:14 devstack sudo[103619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-9eec778b-8b1d-4fbb-bd3d-20069629b2a9.info Nov 04 10:28:14 devstack sudo[103619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:28:14 devstack sudo[103619]: pam_unix(sudo:session): session closed for user root Nov 04 10:28:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-970f3e8f-6357-405e-96a7-dc4f04efdce6 tempest-CreateVolumesFromSnapshotTest-696580006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-9eec778b-8b1d-4fbb-bd3d-20069629b2a9.info" returned: 0 in 0.251s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:28:14 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-970f3e8f-6357-405e-96a7-dc4f04efdce6 tempest-CreateVolumesFromSnapshotTest-696580006 None] /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-9eec778b-8b1d-4fbb-bd3d-20069629b2a9.info is being set with open permissions: ugo+rw Nov 04 10:28:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-970f3e8f-6357-405e-96a7-dc4f04efdce6 tempest-CreateVolumesFromSnapshotTest-696580006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-9eec778b-8b1d-4fbb-bd3d-20069629b2a9.info {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:28:14 devstack sudo[103622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-9eec778b-8b1d-4fbb-bd3d-20069629b2a9.info Nov 04 10:28:14 devstack sudo[103622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:28:14 devstack sudo[103622]: pam_unix(sudo:session): session closed for user root Nov 04 10:28:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-970f3e8f-6357-405e-96a7-dc4f04efdce6 tempest-CreateVolumesFromSnapshotTest-696580006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-9eec778b-8b1d-4fbb-bd3d-20069629b2a9.info" returned: 0 in 0.259s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:28:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-970f3e8f-6357-405e-96a7-dc4f04efdce6 tempest-CreateVolumesFromSnapshotTest-696580006 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.986s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:28:14 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-970f3e8f-6357-405e-96a7-dc4f04efdce6 tempest-CreateVolumesFromSnapshotTest-696580006 None] Create snapshot completed successfully Nov 04 10:28:15 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-a48c03a9-df57-4108-b4bb-1eb144e3d8be tempest-CreateVolumesFromSnapshotTest-696580006 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:28:15 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-a48c03a9-df57-4108-b4bb-1eb144e3d8be tempest-CreateVolumesFromSnapshotTest-696580006 None] Flow 'volume_create_manager' (f78a96f0-948c-4edc-af6c-0c2c768786de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:28:15 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-a48c03a9-df57-4108-b4bb-1eb144e3d8be tempest-CreateVolumesFromSnapshotTest-696580006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c5d014c-0116-4721-b0df-5951bdf68fb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:28:15 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-a48c03a9-df57-4108-b4bb-1eb144e3d8be tempest-CreateVolumesFromSnapshotTest-696580006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c5d014c-0116-4721-b0df-5951bdf68fb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:28:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-58734903',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecd490e3-5a14-41a8-ac3a-c2a0dd1283db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c31957b207044b3db1d354b2dcc6dae6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:28:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:28:15Z,use_quota=True,user_id='5e67d4a7cd9e46a6a96f475ecc18b01b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:28:15 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-a48c03a9-df57-4108-b4bb-1eb144e3d8be tempest-CreateVolumesFromSnapshotTest-696580006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f4588dd-2f1a-4501-9264-b66275ec95c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:28:15 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-a48c03a9-df57-4108-b4bb-1eb144e3d8be tempest-CreateVolumesFromSnapshotTest-696580006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f4588dd-2f1a-4501-9264-b66275ec95c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:28:15 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-a48c03a9-df57-4108-b4bb-1eb144e3d8be tempest-CreateVolumesFromSnapshotTest-696580006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (074585ac-9c97-4a39-a715-f6b7d97373d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:28:15 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-a48c03a9-df57-4108-b4bb-1eb144e3d8be tempest-CreateVolumesFromSnapshotTest-696580006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (074585ac-9c97-4a39-a715-f6b7d97373d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ecd490e3-5a14-41a8-ac3a-c2a0dd1283db', 'volume_name': 'volume-ecd490e3-5a14-41a8-ac3a-c2a0dd1283db', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:28:15 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-a48c03a9-df57-4108-b4bb-1eb144e3d8be tempest-CreateVolumesFromSnapshotTest-696580006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1eafa94-b502-4983-83fa-ecb36aa750ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:28:15 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-a48c03a9-df57-4108-b4bb-1eb144e3d8be tempest-CreateVolumesFromSnapshotTest-696580006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1eafa94-b502-4983-83fa-ecb36aa750ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:28:15 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-a48c03a9-df57-4108-b4bb-1eb144e3d8be tempest-CreateVolumesFromSnapshotTest-696580006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abb781fc-5a73-42ed-81cc-9efa857c2ff0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:28:15 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-a48c03a9-df57-4108-b4bb-1eb144e3d8be tempest-CreateVolumesFromSnapshotTest-696580006 None] Volume ecd490e3-5a14-41a8-ac3a-c2a0dd1283db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ecd490e3-5a14-41a8-ac3a-c2a0dd1283db', 'volume_size': 1} Nov 04 10:28:15 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-a48c03a9-df57-4108-b4bb-1eb144e3d8be tempest-CreateVolumesFromSnapshotTest-696580006 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:28:15 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-a48c03a9-df57-4108-b4bb-1eb144e3d8be tempest-CreateVolumesFromSnapshotTest-696580006 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:28:15 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-a48c03a9-df57-4108-b4bb-1eb144e3d8be tempest-CreateVolumesFromSnapshotTest-696580006 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:28:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-58734903',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecd490e3-5a14-41a8-ac3a-c2a0dd1283db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c31957b207044b3db1d354b2dcc6dae6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:28:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:28:15Z,use_quota=True,user_id='5e67d4a7cd9e46a6a96f475ecc18b01b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 10:28:15 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-a48c03a9-df57-4108-b4bb-1eb144e3d8be tempest-CreateVolumesFromSnapshotTest-696580006 None] Creating volume ecd490e3-5a14-41a8-ac3a-c2a0dd1283db {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:28:15 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-a48c03a9-df57-4108-b4bb-1eb144e3d8be tempest-CreateVolumesFromSnapshotTest-696580006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:28:15 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-a48c03a9-df57-4108-b4bb-1eb144e3d8be tempest-CreateVolumesFromSnapshotTest-696580006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:28:15 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-a48c03a9-df57-4108-b4bb-1eb144e3d8be tempest-CreateVolumesFromSnapshotTest-696580006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:28:15 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-a48c03a9-df57-4108-b4bb-1eb144e3d8be tempest-CreateVolumesFromSnapshotTest-696580006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:28:15 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-a48c03a9-df57-4108-b4bb-1eb144e3d8be tempest-CreateVolumesFromSnapshotTest-696580006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:28:15 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-a48c03a9-df57-4108-b4bb-1eb144e3d8be tempest-CreateVolumesFromSnapshotTest-696580006 None] Selected osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:28:15 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-a48c03a9-df57-4108-b4bb-1eb144e3d8be tempest-CreateVolumesFromSnapshotTest-696580006 None] casted to osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 Nov 04 10:28:15 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-a48c03a9-df57-4108-b4bb-1eb144e3d8be tempest-CreateVolumesFromSnapshotTest-696580006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-ecd490e3-5a14-41a8-ac3a-c2a0dd1283db 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:28:15 devstack sudo[103625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-ecd490e3-5a14-41a8-ac3a-c2a0dd1283db 1073741824 Nov 04 10:28:15 devstack sudo[103625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:28:15 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-76297774-7081-4f4f-bac5-9378a0a7ebe3 tempest-CreateVolumesFromSnapshotTest-696580006 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:28:15 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-76297774-7081-4f4f-bac5-9378a0a7ebe3 tempest-CreateVolumesFromSnapshotTest-696580006 None] Flow 'volume_create_manager' (e2ca6b00-326c-4510-95a5-120df45d8fb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:28:15 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-76297774-7081-4f4f-bac5-9378a0a7ebe3 tempest-CreateVolumesFromSnapshotTest-696580006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cab81416-c4ad-407f-851f-0b050520378d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:28:15 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-76297774-7081-4f4f-bac5-9378a0a7ebe3 tempest-CreateVolumesFromSnapshotTest-696580006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cab81416-c4ad-407f-851f-0b050520378d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:28:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-915259970',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ada9c88c-6b20-4c84-9499-6924da6f9784,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c31957b207044b3db1d354b2dcc6dae6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:28:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:28:16Z,use_quota=True,user_id='5e67d4a7cd9e46a6a96f475ecc18b01b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:28:15 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-76297774-7081-4f4f-bac5-9378a0a7ebe3 tempest-CreateVolumesFromSnapshotTest-696580006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb5a8542-460f-438a-a988-5c6af5c9f8d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:28:15 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-76297774-7081-4f4f-bac5-9378a0a7ebe3 tempest-CreateVolumesFromSnapshotTest-696580006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb5a8542-460f-438a-a988-5c6af5c9f8d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:28:15 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-76297774-7081-4f4f-bac5-9378a0a7ebe3 tempest-CreateVolumesFromSnapshotTest-696580006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fbeb814-40bb-444d-b499-44611837bf2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:28:15 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-76297774-7081-4f4f-bac5-9378a0a7ebe3 tempest-CreateVolumesFromSnapshotTest-696580006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fbeb814-40bb-444d-b499-44611837bf2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ada9c88c-6b20-4c84-9499-6924da6f9784', 'volume_name': 'volume-ada9c88c-6b20-4c84-9499-6924da6f9784', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:28:15 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-76297774-7081-4f4f-bac5-9378a0a7ebe3 tempest-CreateVolumesFromSnapshotTest-696580006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (880723cd-7473-4ace-aa93-78ab6f120837) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:28:15 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-76297774-7081-4f4f-bac5-9378a0a7ebe3 tempest-CreateVolumesFromSnapshotTest-696580006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (880723cd-7473-4ace-aa93-78ab6f120837) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:28:15 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-76297774-7081-4f4f-bac5-9378a0a7ebe3 tempest-CreateVolumesFromSnapshotTest-696580006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0addcb96-1c90-44c5-8189-1c2992ac986c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:28:15 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-76297774-7081-4f4f-bac5-9378a0a7ebe3 tempest-CreateVolumesFromSnapshotTest-696580006 None] Volume ada9c88c-6b20-4c84-9499-6924da6f9784: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ada9c88c-6b20-4c84-9499-6924da6f9784', 'volume_size': 1} Nov 04 10:28:15 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-76297774-7081-4f4f-bac5-9378a0a7ebe3 tempest-CreateVolumesFromSnapshotTest-696580006 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:28:16 devstack sudo[103625]: pam_unix(sudo:session): session closed for user root Nov 04 10:28:16 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-a48c03a9-df57-4108-b4bb-1eb144e3d8be tempest-CreateVolumesFromSnapshotTest-696580006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-ecd490e3-5a14-41a8-ac3a-c2a0dd1283db 1073741824" returned: 0 in 0.540s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:28:16 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-a48c03a9-df57-4108-b4bb-1eb144e3d8be tempest-CreateVolumesFromSnapshotTest-696580006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-ecd490e3-5a14-41a8-ac3a-c2a0dd1283db {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:28:16 devstack sudo[103631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-ecd490e3-5a14-41a8-ac3a-c2a0dd1283db Nov 04 10:28:16 devstack sudo[103631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:28:16 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-aecf6e12-018c-4a39-83d2-1f8ebcb2d2d2 tempest-CreateVolumesFromSnapshotTest-696580006 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:28:16 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-aecf6e12-018c-4a39-83d2-1f8ebcb2d2d2 tempest-CreateVolumesFromSnapshotTest-696580006 None] Flow 'volume_create_manager' (edfe7fe2-bc8d-40f6-8c23-855b7a8a9d54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:28:16 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-aecf6e12-018c-4a39-83d2-1f8ebcb2d2d2 tempest-CreateVolumesFromSnapshotTest-696580006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77f8f3b2-2bcc-40e4-b87a-57896f122a9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:28:16 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-aecf6e12-018c-4a39-83d2-1f8ebcb2d2d2 tempest-CreateVolumesFromSnapshotTest-696580006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77f8f3b2-2bcc-40e4-b87a-57896f122a9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:28:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-531349849',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc013ec5-088b-47e5-85b4-e41c02e4b38c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c31957b207044b3db1d354b2dcc6dae6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:28:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:28:16Z,use_quota=True,user_id='5e67d4a7cd9e46a6a96f475ecc18b01b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:28:16 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-aecf6e12-018c-4a39-83d2-1f8ebcb2d2d2 tempest-CreateVolumesFromSnapshotTest-696580006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d1a9017-274e-4322-b74e-9aaf7d6e53ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:28:16 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-aecf6e12-018c-4a39-83d2-1f8ebcb2d2d2 tempest-CreateVolumesFromSnapshotTest-696580006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d1a9017-274e-4322-b74e-9aaf7d6e53ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:28:16 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-aecf6e12-018c-4a39-83d2-1f8ebcb2d2d2 tempest-CreateVolumesFromSnapshotTest-696580006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13331aa7-fc33-450f-8b89-ae4c23a2f372) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:28:16 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-aecf6e12-018c-4a39-83d2-1f8ebcb2d2d2 tempest-CreateVolumesFromSnapshotTest-696580006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13331aa7-fc33-450f-8b89-ae4c23a2f372) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc013ec5-088b-47e5-85b4-e41c02e4b38c', 'volume_name': 'volume-bc013ec5-088b-47e5-85b4-e41c02e4b38c', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:28:16 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-aecf6e12-018c-4a39-83d2-1f8ebcb2d2d2 tempest-CreateVolumesFromSnapshotTest-696580006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6b0b17c-0286-41a1-885f-b7470c80e015) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:28:16 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-aecf6e12-018c-4a39-83d2-1f8ebcb2d2d2 tempest-CreateVolumesFromSnapshotTest-696580006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6b0b17c-0286-41a1-885f-b7470c80e015) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:28:16 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-aecf6e12-018c-4a39-83d2-1f8ebcb2d2d2 tempest-CreateVolumesFromSnapshotTest-696580006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7d361da-fd4e-4645-a2c2-eeddeef32f78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:28:16 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-aecf6e12-018c-4a39-83d2-1f8ebcb2d2d2 tempest-CreateVolumesFromSnapshotTest-696580006 None] Volume bc013ec5-088b-47e5-85b4-e41c02e4b38c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc013ec5-088b-47e5-85b4-e41c02e4b38c', 'volume_size': 1} Nov 04 10:28:16 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-aecf6e12-018c-4a39-83d2-1f8ebcb2d2d2 tempest-CreateVolumesFromSnapshotTest-696580006 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:28:16 devstack sudo[103631]: pam_unix(sudo:session): session closed for user root Nov 04 10:28:16 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-a48c03a9-df57-4108-b4bb-1eb144e3d8be tempest-CreateVolumesFromSnapshotTest-696580006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-ecd490e3-5a14-41a8-ac3a-c2a0dd1283db" returned: 0 in 0.388s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:28:16 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-a48c03a9-df57-4108-b4bb-1eb144e3d8be tempest-CreateVolumesFromSnapshotTest-696580006 None] <== create_volume: return (1008ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 10:28:16 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-a48c03a9-df57-4108-b4bb-1eb144e3d8be tempest-CreateVolumesFromSnapshotTest-696580006 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.010s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:28:16 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-76297774-7081-4f4f-bac5-9378a0a7ebe3 tempest-CreateVolumesFromSnapshotTest-696580006 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.617s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:28:16 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-76297774-7081-4f4f-bac5-9378a0a7ebe3 tempest-CreateVolumesFromSnapshotTest-696580006 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:28:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-915259970',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ada9c88c-6b20-4c84-9499-6924da6f9784,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c31957b207044b3db1d354b2dcc6dae6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:28:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:28:16Z,use_quota=True,user_id='5e67d4a7cd9e46a6a96f475ecc18b01b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 10:28:16 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-76297774-7081-4f4f-bac5-9378a0a7ebe3 tempest-CreateVolumesFromSnapshotTest-696580006 None] Creating volume ada9c88c-6b20-4c84-9499-6924da6f9784 {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:28:16 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-76297774-7081-4f4f-bac5-9378a0a7ebe3 tempest-CreateVolumesFromSnapshotTest-696580006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:28:16 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-76297774-7081-4f4f-bac5-9378a0a7ebe3 tempest-CreateVolumesFromSnapshotTest-696580006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:28:16 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-76297774-7081-4f4f-bac5-9378a0a7ebe3 tempest-CreateVolumesFromSnapshotTest-696580006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:28:16 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-76297774-7081-4f4f-bac5-9378a0a7ebe3 tempest-CreateVolumesFromSnapshotTest-696580006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:28:16 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-76297774-7081-4f4f-bac5-9378a0a7ebe3 tempest-CreateVolumesFromSnapshotTest-696580006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:28:16 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-76297774-7081-4f4f-bac5-9378a0a7ebe3 tempest-CreateVolumesFromSnapshotTest-696580006 None] Selected osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:28:16 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-76297774-7081-4f4f-bac5-9378a0a7ebe3 tempest-CreateVolumesFromSnapshotTest-696580006 None] casted to osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 Nov 04 10:28:16 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-76297774-7081-4f4f-bac5-9378a0a7ebe3 tempest-CreateVolumesFromSnapshotTest-696580006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-ada9c88c-6b20-4c84-9499-6924da6f9784 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:28:16 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-a48c03a9-df57-4108-b4bb-1eb144e3d8be tempest-CreateVolumesFromSnapshotTest-696580006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abb781fc-5a73-42ed-81cc-9efa857c2ff0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ecd490e3-5a14-41a8-ac3a-c2a0dd1283db', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:28:16 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-a48c03a9-df57-4108-b4bb-1eb144e3d8be tempest-CreateVolumesFromSnapshotTest-696580006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d93c8816-056d-43a8-8353-e5b26212c739) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:28:16 devstack sudo[103634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-ada9c88c-6b20-4c84-9499-6924da6f9784 1073741824 Nov 04 10:28:16 devstack sudo[103634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:28:16 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-a48c03a9-df57-4108-b4bb-1eb144e3d8be tempest-CreateVolumesFromSnapshotTest-696580006 None] Volume volume-ecd490e3-5a14-41a8-ac3a-c2a0dd1283db (ecd490e3-5a14-41a8-ac3a-c2a0dd1283db): created successfully Nov 04 10:28:16 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-a48c03a9-df57-4108-b4bb-1eb144e3d8be tempest-CreateVolumesFromSnapshotTest-696580006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d93c8816-056d-43a8-8353-e5b26212c739) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:28:16 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-a48c03a9-df57-4108-b4bb-1eb144e3d8be tempest-CreateVolumesFromSnapshotTest-696580006 None] Flow 'volume_create_manager' (f78a96f0-948c-4edc-af6c-0c2c768786de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:28:16 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-a48c03a9-df57-4108-b4bb-1eb144e3d8be tempest-CreateVolumesFromSnapshotTest-696580006 None] Created volume successfully. Nov 04 10:28:16 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-7533f991-9547-4ad7-bad9-5fb9bb356f75 tempest-CreateVolumesFromSnapshotTest-696580006 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:28:16 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7533f991-9547-4ad7-bad9-5fb9bb356f75 tempest-CreateVolumesFromSnapshotTest-696580006 None] Flow 'volume_create_manager' (54acd3f2-9333-4293-aa89-26a19a8e3762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:28:16 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7533f991-9547-4ad7-bad9-5fb9bb356f75 tempest-CreateVolumesFromSnapshotTest-696580006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb351b14-53da-41ca-a78c-901714752510) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:28:16 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7533f991-9547-4ad7-bad9-5fb9bb356f75 tempest-CreateVolumesFromSnapshotTest-696580006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb351b14-53da-41ca-a78c-901714752510) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:28:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-394600271',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c309cf8f-b169-462e-a8bb-cdf42cc4ea03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c31957b207044b3db1d354b2dcc6dae6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:28:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:28:17Z,use_quota=True,user_id='5e67d4a7cd9e46a6a96f475ecc18b01b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:28:16 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7533f991-9547-4ad7-bad9-5fb9bb356f75 tempest-CreateVolumesFromSnapshotTest-696580006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (213b9160-f9cf-4963-b7b1-8217c0896b2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:28:17 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7533f991-9547-4ad7-bad9-5fb9bb356f75 tempest-CreateVolumesFromSnapshotTest-696580006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (213b9160-f9cf-4963-b7b1-8217c0896b2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:28:17 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7533f991-9547-4ad7-bad9-5fb9bb356f75 tempest-CreateVolumesFromSnapshotTest-696580006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79920f9a-ee2d-452c-89fc-528a615733d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:28:17 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7533f991-9547-4ad7-bad9-5fb9bb356f75 tempest-CreateVolumesFromSnapshotTest-696580006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79920f9a-ee2d-452c-89fc-528a615733d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c309cf8f-b169-462e-a8bb-cdf42cc4ea03', 'volume_name': 'volume-c309cf8f-b169-462e-a8bb-cdf42cc4ea03', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:28:17 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7533f991-9547-4ad7-bad9-5fb9bb356f75 tempest-CreateVolumesFromSnapshotTest-696580006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8485225e-91bb-4099-8d9b-b041477ba19a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:28:17 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7533f991-9547-4ad7-bad9-5fb9bb356f75 tempest-CreateVolumesFromSnapshotTest-696580006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8485225e-91bb-4099-8d9b-b041477ba19a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:28:17 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7533f991-9547-4ad7-bad9-5fb9bb356f75 tempest-CreateVolumesFromSnapshotTest-696580006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65efebeb-8fa7-494e-a518-e4cf6c80e0e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:28:17 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-7533f991-9547-4ad7-bad9-5fb9bb356f75 tempest-CreateVolumesFromSnapshotTest-696580006 None] Volume c309cf8f-b169-462e-a8bb-cdf42cc4ea03: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c309cf8f-b169-462e-a8bb-cdf42cc4ea03', 'volume_size': 1} Nov 04 10:28:17 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-7533f991-9547-4ad7-bad9-5fb9bb356f75 tempest-CreateVolumesFromSnapshotTest-696580006 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:28:17 devstack sudo[103634]: pam_unix(sudo:session): session closed for user root Nov 04 10:28:17 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-76297774-7081-4f4f-bac5-9378a0a7ebe3 tempest-CreateVolumesFromSnapshotTest-696580006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-ada9c88c-6b20-4c84-9499-6924da6f9784 1073741824" returned: 0 in 0.608s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:28:17 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-76297774-7081-4f4f-bac5-9378a0a7ebe3 tempest-CreateVolumesFromSnapshotTest-696580006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-ada9c88c-6b20-4c84-9499-6924da6f9784 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:28:17 devstack sudo[103642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-ada9c88c-6b20-4c84-9499-6924da6f9784 Nov 04 10:28:17 devstack sudo[103642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:28:17 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c274d72-4fb4-4fd2-bc7a-cf233ec6498c tempest-CreateVolumesFromSnapshotTest-696580006 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:28:17 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1c274d72-4fb4-4fd2-bc7a-cf233ec6498c tempest-CreateVolumesFromSnapshotTest-696580006 None] Flow 'volume_create_manager' (670877d2-5e19-4549-8501-e43004b8194c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:28:17 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1c274d72-4fb4-4fd2-bc7a-cf233ec6498c tempest-CreateVolumesFromSnapshotTest-696580006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f853c0a0-fd0e-4333-b47e-5db5212a5fd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:28:17 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1c274d72-4fb4-4fd2-bc7a-cf233ec6498c tempest-CreateVolumesFromSnapshotTest-696580006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f853c0a0-fd0e-4333-b47e-5db5212a5fd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:28:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-809454386',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90525a8b-945e-4677-9a43-1ce183d7a94c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c31957b207044b3db1d354b2dcc6dae6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:28:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:28:17Z,use_quota=True,user_id='5e67d4a7cd9e46a6a96f475ecc18b01b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:28:17 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1c274d72-4fb4-4fd2-bc7a-cf233ec6498c tempest-CreateVolumesFromSnapshotTest-696580006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5dd86c27-876a-46af-95ff-9256e1d6586b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:28:17 devstack sudo[103642]: pam_unix(sudo:session): session closed for user root Nov 04 10:28:17 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1c274d72-4fb4-4fd2-bc7a-cf233ec6498c tempest-CreateVolumesFromSnapshotTest-696580006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5dd86c27-876a-46af-95ff-9256e1d6586b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:28:17 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1c274d72-4fb4-4fd2-bc7a-cf233ec6498c tempest-CreateVolumesFromSnapshotTest-696580006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1cbf473-cff7-47a4-a6b9-c2e1461747e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:28:17 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1c274d72-4fb4-4fd2-bc7a-cf233ec6498c tempest-CreateVolumesFromSnapshotTest-696580006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1cbf473-cff7-47a4-a6b9-c2e1461747e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '90525a8b-945e-4677-9a43-1ce183d7a94c', 'volume_name': 'volume-90525a8b-945e-4677-9a43-1ce183d7a94c', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:28:17 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1c274d72-4fb4-4fd2-bc7a-cf233ec6498c tempest-CreateVolumesFromSnapshotTest-696580006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92838099-dad7-4a55-b6bd-a093f18a9e3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:28:17 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1c274d72-4fb4-4fd2-bc7a-cf233ec6498c tempest-CreateVolumesFromSnapshotTest-696580006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92838099-dad7-4a55-b6bd-a093f18a9e3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:28:17 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1c274d72-4fb4-4fd2-bc7a-cf233ec6498c tempest-CreateVolumesFromSnapshotTest-696580006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fe0b2c1-6f30-4e24-b29a-3b66a051b909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:28:17 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-1c274d72-4fb4-4fd2-bc7a-cf233ec6498c tempest-CreateVolumesFromSnapshotTest-696580006 None] Volume 90525a8b-945e-4677-9a43-1ce183d7a94c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-90525a8b-945e-4677-9a43-1ce183d7a94c', 'volume_size': 1} Nov 04 10:28:17 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-1c274d72-4fb4-4fd2-bc7a-cf233ec6498c tempest-CreateVolumesFromSnapshotTest-696580006 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:28:17 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-76297774-7081-4f4f-bac5-9378a0a7ebe3 tempest-CreateVolumesFromSnapshotTest-696580006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-ada9c88c-6b20-4c84-9499-6924da6f9784" returned: 0 in 0.397s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:28:17 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-76297774-7081-4f4f-bac5-9378a0a7ebe3 tempest-CreateVolumesFromSnapshotTest-696580006 None] <== create_volume: return (1076ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 10:28:17 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-76297774-7081-4f4f-bac5-9378a0a7ebe3 tempest-CreateVolumesFromSnapshotTest-696580006 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.079s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:28:17 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-aecf6e12-018c-4a39-83d2-1f8ebcb2d2d2 tempest-CreateVolumesFromSnapshotTest-696580006 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.188s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:28:17 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-aecf6e12-018c-4a39-83d2-1f8ebcb2d2d2 tempest-CreateVolumesFromSnapshotTest-696580006 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:28:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-531349849',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc013ec5-088b-47e5-85b4-e41c02e4b38c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c31957b207044b3db1d354b2dcc6dae6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:28:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:28:16Z,use_quota=True,user_id='5e67d4a7cd9e46a6a96f475ecc18b01b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 10:28:17 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-aecf6e12-018c-4a39-83d2-1f8ebcb2d2d2 tempest-CreateVolumesFromSnapshotTest-696580006 None] Creating volume bc013ec5-088b-47e5-85b4-e41c02e4b38c {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:28:17 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-aecf6e12-018c-4a39-83d2-1f8ebcb2d2d2 tempest-CreateVolumesFromSnapshotTest-696580006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:28:17 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-aecf6e12-018c-4a39-83d2-1f8ebcb2d2d2 tempest-CreateVolumesFromSnapshotTest-696580006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:28:17 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-aecf6e12-018c-4a39-83d2-1f8ebcb2d2d2 tempest-CreateVolumesFromSnapshotTest-696580006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:28:17 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-aecf6e12-018c-4a39-83d2-1f8ebcb2d2d2 tempest-CreateVolumesFromSnapshotTest-696580006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:28:17 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-aecf6e12-018c-4a39-83d2-1f8ebcb2d2d2 tempest-CreateVolumesFromSnapshotTest-696580006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:28:17 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-aecf6e12-018c-4a39-83d2-1f8ebcb2d2d2 tempest-CreateVolumesFromSnapshotTest-696580006 None] Selected osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:28:17 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-aecf6e12-018c-4a39-83d2-1f8ebcb2d2d2 tempest-CreateVolumesFromSnapshotTest-696580006 None] casted to osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 Nov 04 10:28:17 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-aecf6e12-018c-4a39-83d2-1f8ebcb2d2d2 tempest-CreateVolumesFromSnapshotTest-696580006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-bc013ec5-088b-47e5-85b4-e41c02e4b38c 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:28:17 devstack sudo[103645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-bc013ec5-088b-47e5-85b4-e41c02e4b38c 1073741824 Nov 04 10:28:17 devstack sudo[103645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:28:17 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-76297774-7081-4f4f-bac5-9378a0a7ebe3 tempest-CreateVolumesFromSnapshotTest-696580006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0addcb96-1c90-44c5-8189-1c2992ac986c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ada9c88c-6b20-4c84-9499-6924da6f9784', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:28:17 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-76297774-7081-4f4f-bac5-9378a0a7ebe3 tempest-CreateVolumesFromSnapshotTest-696580006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f15dad57-69d9-47e4-8b2e-9739ae9b8780) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:28:17 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-76297774-7081-4f4f-bac5-9378a0a7ebe3 tempest-CreateVolumesFromSnapshotTest-696580006 None] Volume volume-ada9c88c-6b20-4c84-9499-6924da6f9784 (ada9c88c-6b20-4c84-9499-6924da6f9784): created successfully Nov 04 10:28:17 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-76297774-7081-4f4f-bac5-9378a0a7ebe3 tempest-CreateVolumesFromSnapshotTest-696580006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f15dad57-69d9-47e4-8b2e-9739ae9b8780) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:28:17 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-76297774-7081-4f4f-bac5-9378a0a7ebe3 tempest-CreateVolumesFromSnapshotTest-696580006 None] Flow 'volume_create_manager' (e2ca6b00-326c-4510-95a5-120df45d8fb7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:28:17 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-76297774-7081-4f4f-bac5-9378a0a7ebe3 tempest-CreateVolumesFromSnapshotTest-696580006 None] Created volume successfully. Nov 04 10:28:18 devstack sudo[103645]: pam_unix(sudo:session): session closed for user root Nov 04 10:28:18 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-aecf6e12-018c-4a39-83d2-1f8ebcb2d2d2 tempest-CreateVolumesFromSnapshotTest-696580006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-bc013ec5-088b-47e5-85b4-e41c02e4b38c 1073741824" returned: 0 in 0.445s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:28:18 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-aecf6e12-018c-4a39-83d2-1f8ebcb2d2d2 tempest-CreateVolumesFromSnapshotTest-696580006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-bc013ec5-088b-47e5-85b4-e41c02e4b38c {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:28:18 devstack sudo[103651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-bc013ec5-088b-47e5-85b4-e41c02e4b38c Nov 04 10:28:18 devstack sudo[103651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:28:18 devstack sudo[103651]: pam_unix(sudo:session): session closed for user root Nov 04 10:28:18 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-aecf6e12-018c-4a39-83d2-1f8ebcb2d2d2 tempest-CreateVolumesFromSnapshotTest-696580006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-bc013ec5-088b-47e5-85b4-e41c02e4b38c" returned: 0 in 0.246s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:28:18 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-aecf6e12-018c-4a39-83d2-1f8ebcb2d2d2 tempest-CreateVolumesFromSnapshotTest-696580006 None] <== create_volume: return (749ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 10:28:18 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-aecf6e12-018c-4a39-83d2-1f8ebcb2d2d2 tempest-CreateVolumesFromSnapshotTest-696580006 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.752s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:28:18 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-7533f991-9547-4ad7-bad9-5fb9bb356f75 tempest-CreateVolumesFromSnapshotTest-696580006 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.332s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:28:18 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-7533f991-9547-4ad7-bad9-5fb9bb356f75 tempest-CreateVolumesFromSnapshotTest-696580006 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:28:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-394600271',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c309cf8f-b169-462e-a8bb-cdf42cc4ea03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c31957b207044b3db1d354b2dcc6dae6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:28:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:28:17Z,use_quota=True,user_id='5e67d4a7cd9e46a6a96f475ecc18b01b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 10:28:18 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-7533f991-9547-4ad7-bad9-5fb9bb356f75 tempest-CreateVolumesFromSnapshotTest-696580006 None] Creating volume c309cf8f-b169-462e-a8bb-cdf42cc4ea03 {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:28:18 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-7533f991-9547-4ad7-bad9-5fb9bb356f75 tempest-CreateVolumesFromSnapshotTest-696580006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:28:18 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-7533f991-9547-4ad7-bad9-5fb9bb356f75 tempest-CreateVolumesFromSnapshotTest-696580006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:28:18 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-7533f991-9547-4ad7-bad9-5fb9bb356f75 tempest-CreateVolumesFromSnapshotTest-696580006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:28:18 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-7533f991-9547-4ad7-bad9-5fb9bb356f75 tempest-CreateVolumesFromSnapshotTest-696580006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:28:18 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-7533f991-9547-4ad7-bad9-5fb9bb356f75 tempest-CreateVolumesFromSnapshotTest-696580006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:28:18 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-7533f991-9547-4ad7-bad9-5fb9bb356f75 tempest-CreateVolumesFromSnapshotTest-696580006 None] Selected osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:28:18 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-7533f991-9547-4ad7-bad9-5fb9bb356f75 tempest-CreateVolumesFromSnapshotTest-696580006 None] casted to osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 Nov 04 10:28:18 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7533f991-9547-4ad7-bad9-5fb9bb356f75 tempest-CreateVolumesFromSnapshotTest-696580006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-c309cf8f-b169-462e-a8bb-cdf42cc4ea03 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:28:18 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-aecf6e12-018c-4a39-83d2-1f8ebcb2d2d2 tempest-CreateVolumesFromSnapshotTest-696580006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7d361da-fd4e-4645-a2c2-eeddeef32f78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc013ec5-088b-47e5-85b4-e41c02e4b38c', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:28:18 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-aecf6e12-018c-4a39-83d2-1f8ebcb2d2d2 tempest-CreateVolumesFromSnapshotTest-696580006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96a0b1f7-2754-4bb5-b7fd-53394354c378) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:28:18 devstack sudo[103654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-c309cf8f-b169-462e-a8bb-cdf42cc4ea03 1073741824 Nov 04 10:28:18 devstack sudo[103654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:28:18 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-aecf6e12-018c-4a39-83d2-1f8ebcb2d2d2 tempest-CreateVolumesFromSnapshotTest-696580006 None] Volume volume-bc013ec5-088b-47e5-85b4-e41c02e4b38c (bc013ec5-088b-47e5-85b4-e41c02e4b38c): created successfully Nov 04 10:28:18 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-aecf6e12-018c-4a39-83d2-1f8ebcb2d2d2 tempest-CreateVolumesFromSnapshotTest-696580006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96a0b1f7-2754-4bb5-b7fd-53394354c378) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:28:18 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-aecf6e12-018c-4a39-83d2-1f8ebcb2d2d2 tempest-CreateVolumesFromSnapshotTest-696580006 None] Flow 'volume_create_manager' (edfe7fe2-bc8d-40f6-8c23-855b7a8a9d54) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:28:18 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-aecf6e12-018c-4a39-83d2-1f8ebcb2d2d2 tempest-CreateVolumesFromSnapshotTest-696580006 None] Created volume successfully. Nov 04 10:28:18 devstack sudo[103654]: pam_unix(sudo:session): session closed for user root Nov 04 10:28:18 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7533f991-9547-4ad7-bad9-5fb9bb356f75 tempest-CreateVolumesFromSnapshotTest-696580006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-c309cf8f-b169-462e-a8bb-cdf42cc4ea03 1073741824" returned: 0 in 0.514s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:28:18 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7533f991-9547-4ad7-bad9-5fb9bb356f75 tempest-CreateVolumesFromSnapshotTest-696580006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-c309cf8f-b169-462e-a8bb-cdf42cc4ea03 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:28:18 devstack sudo[103661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-c309cf8f-b169-462e-a8bb-cdf42cc4ea03 Nov 04 10:28:18 devstack sudo[103661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:28:19 devstack sudo[103661]: pam_unix(sudo:session): session closed for user root Nov 04 10:28:19 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7533f991-9547-4ad7-bad9-5fb9bb356f75 tempest-CreateVolumesFromSnapshotTest-696580006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-c309cf8f-b169-462e-a8bb-cdf42cc4ea03" returned: 0 in 0.237s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:28:19 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-7533f991-9547-4ad7-bad9-5fb9bb356f75 tempest-CreateVolumesFromSnapshotTest-696580006 None] <== create_volume: return (790ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 10:28:19 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-7533f991-9547-4ad7-bad9-5fb9bb356f75 tempest-CreateVolumesFromSnapshotTest-696580006 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.793s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:28:19 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-1c274d72-4fb4-4fd2-bc7a-cf233ec6498c tempest-CreateVolumesFromSnapshotTest-696580006 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.557s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:28:19 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-1c274d72-4fb4-4fd2-bc7a-cf233ec6498c tempest-CreateVolumesFromSnapshotTest-696580006 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:28:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-809454386',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90525a8b-945e-4677-9a43-1ce183d7a94c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c31957b207044b3db1d354b2dcc6dae6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:28:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:28:17Z,use_quota=True,user_id='5e67d4a7cd9e46a6a96f475ecc18b01b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 10:28:19 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-1c274d72-4fb4-4fd2-bc7a-cf233ec6498c tempest-CreateVolumesFromSnapshotTest-696580006 None] Creating volume 90525a8b-945e-4677-9a43-1ce183d7a94c {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:28:19 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-1c274d72-4fb4-4fd2-bc7a-cf233ec6498c tempest-CreateVolumesFromSnapshotTest-696580006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:28:19 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-1c274d72-4fb4-4fd2-bc7a-cf233ec6498c tempest-CreateVolumesFromSnapshotTest-696580006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:28:19 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-1c274d72-4fb4-4fd2-bc7a-cf233ec6498c tempest-CreateVolumesFromSnapshotTest-696580006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:28:19 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-1c274d72-4fb4-4fd2-bc7a-cf233ec6498c tempest-CreateVolumesFromSnapshotTest-696580006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:28:19 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-1c274d72-4fb4-4fd2-bc7a-cf233ec6498c tempest-CreateVolumesFromSnapshotTest-696580006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:28:19 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-1c274d72-4fb4-4fd2-bc7a-cf233ec6498c tempest-CreateVolumesFromSnapshotTest-696580006 None] Selected osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:28:19 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-1c274d72-4fb4-4fd2-bc7a-cf233ec6498c tempest-CreateVolumesFromSnapshotTest-696580006 None] casted to osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 Nov 04 10:28:19 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-1c274d72-4fb4-4fd2-bc7a-cf233ec6498c tempest-CreateVolumesFromSnapshotTest-696580006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-90525a8b-945e-4677-9a43-1ce183d7a94c 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:28:19 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7533f991-9547-4ad7-bad9-5fb9bb356f75 tempest-CreateVolumesFromSnapshotTest-696580006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65efebeb-8fa7-494e-a518-e4cf6c80e0e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c309cf8f-b169-462e-a8bb-cdf42cc4ea03', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:28:19 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7533f991-9547-4ad7-bad9-5fb9bb356f75 tempest-CreateVolumesFromSnapshotTest-696580006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8900239a-f5ff-4bc1-a564-509d9566815a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:28:19 devstack sudo[103664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-90525a8b-945e-4677-9a43-1ce183d7a94c 1073741824 Nov 04 10:28:19 devstack sudo[103664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:28:19 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-7533f991-9547-4ad7-bad9-5fb9bb356f75 tempest-CreateVolumesFromSnapshotTest-696580006 None] Volume volume-c309cf8f-b169-462e-a8bb-cdf42cc4ea03 (c309cf8f-b169-462e-a8bb-cdf42cc4ea03): created successfully Nov 04 10:28:19 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7533f991-9547-4ad7-bad9-5fb9bb356f75 tempest-CreateVolumesFromSnapshotTest-696580006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8900239a-f5ff-4bc1-a564-509d9566815a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:28:19 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7533f991-9547-4ad7-bad9-5fb9bb356f75 tempest-CreateVolumesFromSnapshotTest-696580006 None] Flow 'volume_create_manager' (54acd3f2-9333-4293-aa89-26a19a8e3762) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:28:19 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-7533f991-9547-4ad7-bad9-5fb9bb356f75 tempest-CreateVolumesFromSnapshotTest-696580006 None] Created volume successfully. Nov 04 10:28:19 devstack sudo[103664]: pam_unix(sudo:session): session closed for user root Nov 04 10:28:19 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-1c274d72-4fb4-4fd2-bc7a-cf233ec6498c tempest-CreateVolumesFromSnapshotTest-696580006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-90525a8b-945e-4677-9a43-1ce183d7a94c 1073741824" returned: 0 in 0.458s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:28:19 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-1c274d72-4fb4-4fd2-bc7a-cf233ec6498c tempest-CreateVolumesFromSnapshotTest-696580006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-90525a8b-945e-4677-9a43-1ce183d7a94c {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:28:19 devstack sudo[103670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-90525a8b-945e-4677-9a43-1ce183d7a94c Nov 04 10:28:19 devstack sudo[103670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:28:19 devstack sudo[103670]: pam_unix(sudo:session): session closed for user root Nov 04 10:28:19 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-1c274d72-4fb4-4fd2-bc7a-cf233ec6498c tempest-CreateVolumesFromSnapshotTest-696580006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-90525a8b-945e-4677-9a43-1ce183d7a94c" returned: 0 in 0.286s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:28:19 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-1c274d72-4fb4-4fd2-bc7a-cf233ec6498c tempest-CreateVolumesFromSnapshotTest-696580006 None] <== create_volume: return (799ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 10:28:19 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-1c274d72-4fb4-4fd2-bc7a-cf233ec6498c tempest-CreateVolumesFromSnapshotTest-696580006 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.801s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:28:19 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1c274d72-4fb4-4fd2-bc7a-cf233ec6498c tempest-CreateVolumesFromSnapshotTest-696580006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fe0b2c1-6f30-4e24-b29a-3b66a051b909) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90525a8b-945e-4677-9a43-1ce183d7a94c', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:28:19 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1c274d72-4fb4-4fd2-bc7a-cf233ec6498c tempest-CreateVolumesFromSnapshotTest-696580006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5ff076d-48e0-4053-9543-868599cbe36b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:28:19 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-1c274d72-4fb4-4fd2-bc7a-cf233ec6498c tempest-CreateVolumesFromSnapshotTest-696580006 None] Volume volume-90525a8b-945e-4677-9a43-1ce183d7a94c (90525a8b-945e-4677-9a43-1ce183d7a94c): created successfully Nov 04 10:28:20 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1c274d72-4fb4-4fd2-bc7a-cf233ec6498c tempest-CreateVolumesFromSnapshotTest-696580006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5ff076d-48e0-4053-9543-868599cbe36b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:28:20 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1c274d72-4fb4-4fd2-bc7a-cf233ec6498c tempest-CreateVolumesFromSnapshotTest-696580006 None] Flow 'volume_create_manager' (670877d2-5e19-4549-8501-e43004b8194c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:28:20 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-1c274d72-4fb4-4fd2-bc7a-cf233ec6498c tempest-CreateVolumesFromSnapshotTest-696580006 None] Created volume successfully. Nov 04 10:28:20 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-a8a48b9a-ab64-4ea5-9f65-b4bb300d49d3 tempest-CreateVolumesFromSnapshotTest-696580006 None] Acquiring lock "cinder-90525a8b-945e-4677-9a43-1ce183d7a94c-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:28:20 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-a8a48b9a-ab64-4ea5-9f65-b4bb300d49d3 tempest-CreateVolumesFromSnapshotTest-696580006 None] Lock "cinder-90525a8b-945e-4677-9a43-1ce183d7a94c-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:28:20 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-a8a48b9a-ab64-4ea5-9f65-b4bb300d49d3 tempest-CreateVolumesFromSnapshotTest-696580006 None] Acquiring lock "cinder-quobyte-90525a8b-945e-4677-9a43-1ce183d7a94c" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:28:20 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-a8a48b9a-ab64-4ea5-9f65-b4bb300d49d3 tempest-CreateVolumesFromSnapshotTest-696580006 None] Lock "cinder-quobyte-90525a8b-945e-4677-9a43-1ce183d7a94c" acquired by "delete_volume" :: waited 0.019s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:28:20 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7bfdd3f-83db-4373-b13d-e66de8139ec1]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:28:20 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-a8a48b9a-ab64-4ea5-9f65-b4bb300d49d3 tempest-CreateVolumesFromSnapshotTest-696580006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-90525a8b-945e-4677-9a43-1ce183d7a94c {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:28:21 devstack sudo[103673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-90525a8b-945e-4677-9a43-1ce183d7a94c Nov 04 10:28:21 devstack sudo[103673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:28:21 devstack sudo[103673]: pam_unix(sudo:session): session closed for user root Nov 04 10:28:21 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-a8a48b9a-ab64-4ea5-9f65-b4bb300d49d3 tempest-CreateVolumesFromSnapshotTest-696580006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-90525a8b-945e-4677-9a43-1ce183d7a94c" returned: 0 in 0.374s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:28:21 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-a8a48b9a-ab64-4ea5-9f65-b4bb300d49d3 tempest-CreateVolumesFromSnapshotTest-696580006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-90525a8b-945e-4677-9a43-1ce183d7a94c {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:28:21 devstack sudo[103678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-90525a8b-945e-4677-9a43-1ce183d7a94c Nov 04 10:28:21 devstack sudo[103678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:28:21 devstack sudo[103678]: pam_unix(sudo:session): session closed for user root Nov 04 10:28:21 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-a8a48b9a-ab64-4ea5-9f65-b4bb300d49d3 tempest-CreateVolumesFromSnapshotTest-696580006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-90525a8b-945e-4677-9a43-1ce183d7a94c" returned: 0 in 0.266s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:28:21 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-a8a48b9a-ab64-4ea5-9f65-b4bb300d49d3 tempest-CreateVolumesFromSnapshotTest-696580006 None] Lock "cinder-quobyte-90525a8b-945e-4677-9a43-1ce183d7a94c" released by "delete_volume" :: held 0.682s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:28:21 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-a8a48b9a-ab64-4ea5-9f65-b4bb300d49d3 tempest-CreateVolumesFromSnapshotTest-696580006 None] Created reservations ['a53ae837-323b-4977-a460-5a0bd4e5442d', 'f2ba157a-c091-4a07-a3e0-6ca9a866124c', 'c800fe8e-7701-4629-ac7c-24c17d3dec0c', '3187dda5-38a7-4d9d-a06f-2772eea70d58'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:28:21 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-a8a48b9a-ab64-4ea5-9f65-b4bb300d49d3 tempest-CreateVolumesFromSnapshotTest-696580006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:28:21 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-a8a48b9a-ab64-4ea5-9f65-b4bb300d49d3 tempest-CreateVolumesFromSnapshotTest-696580006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:28:21 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-a8a48b9a-ab64-4ea5-9f65-b4bb300d49d3 tempest-CreateVolumesFromSnapshotTest-696580006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:28:21 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-a8a48b9a-ab64-4ea5-9f65-b4bb300d49d3 tempest-CreateVolumesFromSnapshotTest-696580006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:28:21 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-a8a48b9a-ab64-4ea5-9f65-b4bb300d49d3 tempest-CreateVolumesFromSnapshotTest-696580006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:28:21 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-a8a48b9a-ab64-4ea5-9f65-b4bb300d49d3 tempest-CreateVolumesFromSnapshotTest-696580006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:28:21 devstack sudo[103682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:28:21 devstack sudo[103682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:28:22 devstack sudo[103682]: pam_unix(sudo:session): session closed for user root Nov 04 10:28:22 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-a8a48b9a-ab64-4ea5-9f65-b4bb300d49d3 tempest-CreateVolumesFromSnapshotTest-696580006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.247s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:28:22 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-a8a48b9a-ab64-4ea5-9f65-b4bb300d49d3 tempest-CreateVolumesFromSnapshotTest-696580006 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:28:22 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-a8a48b9a-ab64-4ea5-9f65-b4bb300d49d3 tempest-CreateVolumesFromSnapshotTest-696580006 None] Deleted volume successfully. Nov 04 10:28:22 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-a8a48b9a-ab64-4ea5-9f65-b4bb300d49d3 tempest-CreateVolumesFromSnapshotTest-696580006 None] Lock "cinder-90525a8b-945e-4677-9a43-1ce183d7a94c-delete_volume" released by "delete_volume" :: held 1.170s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:28:22 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-17834e7b-d08b-40b5-9084-03d3a36becb2 tempest-CreateVolumesFromSnapshotTest-696580006 None] Acquiring lock "cinder-c309cf8f-b169-462e-a8bb-cdf42cc4ea03-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:28:22 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-17834e7b-d08b-40b5-9084-03d3a36becb2 tempest-CreateVolumesFromSnapshotTest-696580006 None] Lock "cinder-c309cf8f-b169-462e-a8bb-cdf42cc4ea03-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:28:22 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-17834e7b-d08b-40b5-9084-03d3a36becb2 tempest-CreateVolumesFromSnapshotTest-696580006 None] Acquiring lock "cinder-quobyte-c309cf8f-b169-462e-a8bb-cdf42cc4ea03" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:28:22 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-17834e7b-d08b-40b5-9084-03d3a36becb2 tempest-CreateVolumesFromSnapshotTest-696580006 None] Lock "cinder-quobyte-c309cf8f-b169-462e-a8bb-cdf42cc4ea03" acquired by "delete_volume" :: waited 0.014s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:28:22 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[473d4dbd-c49f-4648-8f25-275f7c4fdf13]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:28:22 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-17834e7b-d08b-40b5-9084-03d3a36becb2 tempest-CreateVolumesFromSnapshotTest-696580006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-c309cf8f-b169-462e-a8bb-cdf42cc4ea03 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:28:22 devstack sudo[103685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-c309cf8f-b169-462e-a8bb-cdf42cc4ea03 Nov 04 10:28:22 devstack sudo[103685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:28:22 devstack sudo[103685]: pam_unix(sudo:session): session closed for user root Nov 04 10:28:22 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-17834e7b-d08b-40b5-9084-03d3a36becb2 tempest-CreateVolumesFromSnapshotTest-696580006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-c309cf8f-b169-462e-a8bb-cdf42cc4ea03" returned: 0 in 0.387s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:28:22 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-17834e7b-d08b-40b5-9084-03d3a36becb2 tempest-CreateVolumesFromSnapshotTest-696580006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-c309cf8f-b169-462e-a8bb-cdf42cc4ea03 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:28:22 devstack sudo[103690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-c309cf8f-b169-462e-a8bb-cdf42cc4ea03 Nov 04 10:28:22 devstack sudo[103690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:28:22 devstack sudo[103690]: pam_unix(sudo:session): session closed for user root Nov 04 10:28:22 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-17834e7b-d08b-40b5-9084-03d3a36becb2 tempest-CreateVolumesFromSnapshotTest-696580006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-c309cf8f-b169-462e-a8bb-cdf42cc4ea03" returned: 0 in 0.255s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:28:22 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-17834e7b-d08b-40b5-9084-03d3a36becb2 tempest-CreateVolumesFromSnapshotTest-696580006 None] Lock "cinder-quobyte-c309cf8f-b169-462e-a8bb-cdf42cc4ea03" released by "delete_volume" :: held 0.683s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:28:22 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-17834e7b-d08b-40b5-9084-03d3a36becb2 tempest-CreateVolumesFromSnapshotTest-696580006 None] Created reservations ['9dcac4f9-55b9-41a2-816b-e6771af07bfb', 'd771809a-d9bd-40aa-b59f-5bce4f422d3f', 'c361d989-e413-4e12-af7f-2d33fd8f54fa', '51a5ef0a-afbd-4a4f-b16b-7a16deeeacb7'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:28:22 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-17834e7b-d08b-40b5-9084-03d3a36becb2 tempest-CreateVolumesFromSnapshotTest-696580006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:28:22 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-17834e7b-d08b-40b5-9084-03d3a36becb2 tempest-CreateVolumesFromSnapshotTest-696580006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:28:22 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-17834e7b-d08b-40b5-9084-03d3a36becb2 tempest-CreateVolumesFromSnapshotTest-696580006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:28:22 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-17834e7b-d08b-40b5-9084-03d3a36becb2 tempest-CreateVolumesFromSnapshotTest-696580006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:28:22 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-17834e7b-d08b-40b5-9084-03d3a36becb2 tempest-CreateVolumesFromSnapshotTest-696580006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:28:22 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-17834e7b-d08b-40b5-9084-03d3a36becb2 tempest-CreateVolumesFromSnapshotTest-696580006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:28:22 devstack sudo[103694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:28:22 devstack sudo[103694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:28:23 devstack sudo[103694]: pam_unix(sudo:session): session closed for user root Nov 04 10:28:23 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-17834e7b-d08b-40b5-9084-03d3a36becb2 tempest-CreateVolumesFromSnapshotTest-696580006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.270s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:28:23 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-17834e7b-d08b-40b5-9084-03d3a36becb2 tempest-CreateVolumesFromSnapshotTest-696580006 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:28:23 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-bdc9a949-741a-43c0-832e-233566facfd8 tempest-CreateVolumesFromSnapshotTest-696580006 None] Acquiring lock "cinder-bc013ec5-088b-47e5-85b4-e41c02e4b38c-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:28:23 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-17834e7b-d08b-40b5-9084-03d3a36becb2 tempest-CreateVolumesFromSnapshotTest-696580006 None] Deleted volume successfully. Nov 04 10:28:23 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-bdc9a949-741a-43c0-832e-233566facfd8 tempest-CreateVolumesFromSnapshotTest-696580006 None] Lock "cinder-bc013ec5-088b-47e5-85b4-e41c02e4b38c-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:28:23 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-17834e7b-d08b-40b5-9084-03d3a36becb2 tempest-CreateVolumesFromSnapshotTest-696580006 None] Lock "cinder-c309cf8f-b169-462e-a8bb-cdf42cc4ea03-delete_volume" released by "delete_volume" :: held 1.197s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:28:23 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-bdc9a949-741a-43c0-832e-233566facfd8 tempest-CreateVolumesFromSnapshotTest-696580006 None] Acquiring lock "cinder-quobyte-bc013ec5-088b-47e5-85b4-e41c02e4b38c" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:28:23 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-bdc9a949-741a-43c0-832e-233566facfd8 tempest-CreateVolumesFromSnapshotTest-696580006 None] Lock "cinder-quobyte-bc013ec5-088b-47e5-85b4-e41c02e4b38c" acquired by "delete_volume" :: waited 0.018s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:28:23 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e60bdc6-0813-4ba4-a6a9-7df91c0bc269]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:28:23 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-bdc9a949-741a-43c0-832e-233566facfd8 tempest-CreateVolumesFromSnapshotTest-696580006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-bc013ec5-088b-47e5-85b4-e41c02e4b38c {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:28:23 devstack sudo[103697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-bc013ec5-088b-47e5-85b4-e41c02e4b38c Nov 04 10:28:23 devstack sudo[103697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:28:23 devstack sudo[103697]: pam_unix(sudo:session): session closed for user root Nov 04 10:28:23 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-bdc9a949-741a-43c0-832e-233566facfd8 tempest-CreateVolumesFromSnapshotTest-696580006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-bc013ec5-088b-47e5-85b4-e41c02e4b38c" returned: 0 in 0.355s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:28:23 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-bdc9a949-741a-43c0-832e-233566facfd8 tempest-CreateVolumesFromSnapshotTest-696580006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-bc013ec5-088b-47e5-85b4-e41c02e4b38c {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:28:23 devstack sudo[103702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-bc013ec5-088b-47e5-85b4-e41c02e4b38c Nov 04 10:28:23 devstack sudo[103702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:28:23 devstack sudo[103702]: pam_unix(sudo:session): session closed for user root Nov 04 10:28:23 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-bdc9a949-741a-43c0-832e-233566facfd8 tempest-CreateVolumesFromSnapshotTest-696580006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-bc013ec5-088b-47e5-85b4-e41c02e4b38c" returned: 0 in 0.250s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:28:24 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-bdc9a949-741a-43c0-832e-233566facfd8 tempest-CreateVolumesFromSnapshotTest-696580006 None] Lock "cinder-quobyte-bc013ec5-088b-47e5-85b4-e41c02e4b38c" released by "delete_volume" :: held 0.653s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:28:24 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-bdc9a949-741a-43c0-832e-233566facfd8 tempest-CreateVolumesFromSnapshotTest-696580006 None] Created reservations ['225f49a0-f209-4058-8b78-261fbd5b8ffb', 'bd083ac9-ebc8-4d7f-924f-9e7f8902154e', 'fe715a3a-0680-4b80-a8e5-7017fc597db7', 'ef77cd79-088e-4b31-81aa-a21c9bc70131'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:28:24 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-bdc9a949-741a-43c0-832e-233566facfd8 tempest-CreateVolumesFromSnapshotTest-696580006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:28:24 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-bdc9a949-741a-43c0-832e-233566facfd8 tempest-CreateVolumesFromSnapshotTest-696580006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:28:24 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-bdc9a949-741a-43c0-832e-233566facfd8 tempest-CreateVolumesFromSnapshotTest-696580006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:28:24 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-bdc9a949-741a-43c0-832e-233566facfd8 tempest-CreateVolumesFromSnapshotTest-696580006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:28:24 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-bdc9a949-741a-43c0-832e-233566facfd8 tempest-CreateVolumesFromSnapshotTest-696580006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:28:24 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-bdc9a949-741a-43c0-832e-233566facfd8 tempest-CreateVolumesFromSnapshotTest-696580006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:28:24 devstack sudo[103705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:28:24 devstack sudo[103705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:28:24 devstack sudo[103705]: pam_unix(sudo:session): session closed for user root Nov 04 10:28:24 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-bdc9a949-741a-43c0-832e-233566facfd8 tempest-CreateVolumesFromSnapshotTest-696580006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.242s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:28:24 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-bdc9a949-741a-43c0-832e-233566facfd8 tempest-CreateVolumesFromSnapshotTest-696580006 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:28:24 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-bdc9a949-741a-43c0-832e-233566facfd8 tempest-CreateVolumesFromSnapshotTest-696580006 None] Deleted volume successfully. Nov 04 10:28:24 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-bdc9a949-741a-43c0-832e-233566facfd8 tempest-CreateVolumesFromSnapshotTest-696580006 None] Lock "cinder-bc013ec5-088b-47e5-85b4-e41c02e4b38c-delete_volume" released by "delete_volume" :: held 1.134s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:28:24 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-0016f2cb-759a-4a48-861e-d1c4d8d00650 tempest-CreateVolumesFromSnapshotTest-696580006 None] Acquiring lock "cinder-ada9c88c-6b20-4c84-9499-6924da6f9784-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:28:24 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-0016f2cb-759a-4a48-861e-d1c4d8d00650 tempest-CreateVolumesFromSnapshotTest-696580006 None] Lock "cinder-ada9c88c-6b20-4c84-9499-6924da6f9784-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:28:24 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-0016f2cb-759a-4a48-861e-d1c4d8d00650 tempest-CreateVolumesFromSnapshotTest-696580006 None] Acquiring lock "cinder-quobyte-ada9c88c-6b20-4c84-9499-6924da6f9784" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:28:24 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-0016f2cb-759a-4a48-861e-d1c4d8d00650 tempest-CreateVolumesFromSnapshotTest-696580006 None] Lock "cinder-quobyte-ada9c88c-6b20-4c84-9499-6924da6f9784" acquired by "delete_volume" :: waited 0.019s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:28:24 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc9bc343-7f70-4683-9895-858bcffcd227]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:28:24 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-0016f2cb-759a-4a48-861e-d1c4d8d00650 tempest-CreateVolumesFromSnapshotTest-696580006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-ada9c88c-6b20-4c84-9499-6924da6f9784 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:28:24 devstack sudo[103708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-ada9c88c-6b20-4c84-9499-6924da6f9784 Nov 04 10:28:24 devstack sudo[103708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:28:24 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2d1e0ee-c7a4-4bac-a79f-890446d2b08d tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:28:24 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-d2d1e0ee-c7a4-4bac-a79f-890446d2b08d tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Flow 'volume_create_manager' (ee3235de-9a32-4c2c-a144-1f965fffb52d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:28:24 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-d2d1e0ee-c7a4-4bac-a79f-890446d2b08d tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51656437-878c-4a63-9d55-696f31dfdb25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:28:24 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-d2d1e0ee-c7a4-4bac-a79f-890446d2b08d tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51656437-878c-4a63-9d55-696f31dfdb25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:28:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1559674581',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80af2632-ff4e-4148-b84b-a6893bb8732a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='942ec90965b7433ca1215d2d209866f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:28:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:28:25Z,use_quota=True,user_id='c8b8f44164914cac98edde16797983c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:28:24 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-d2d1e0ee-c7a4-4bac-a79f-890446d2b08d tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfa17782-658c-4255-ba88-8f23dfef16f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:28:24 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-d2d1e0ee-c7a4-4bac-a79f-890446d2b08d tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfa17782-658c-4255-ba88-8f23dfef16f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:28:24 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-d2d1e0ee-c7a4-4bac-a79f-890446d2b08d tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c64d6ae0-15c9-41c7-b434-8f33f7449a0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:28:24 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-d2d1e0ee-c7a4-4bac-a79f-890446d2b08d tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c64d6ae0-15c9-41c7-b434-8f33f7449a0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80af2632-ff4e-4148-b84b-a6893bb8732a', 'volume_name': 'volume-80af2632-ff4e-4148-b84b-a6893bb8732a', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:28:24 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-d2d1e0ee-c7a4-4bac-a79f-890446d2b08d tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (935d627d-932b-481a-9403-ea18b9a74537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:28:24 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-d2d1e0ee-c7a4-4bac-a79f-890446d2b08d tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (935d627d-932b-481a-9403-ea18b9a74537) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:28:24 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-d2d1e0ee-c7a4-4bac-a79f-890446d2b08d tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f92f24dd-8cda-44b0-b9ea-40b3b06b575f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:28:24 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-d2d1e0ee-c7a4-4bac-a79f-890446d2b08d tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Volume 80af2632-ff4e-4148-b84b-a6893bb8732a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80af2632-ff4e-4148-b84b-a6893bb8732a', 'volume_size': 1} Nov 04 10:28:24 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-d2d1e0ee-c7a4-4bac-a79f-890446d2b08d tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:28:24 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-d2d1e0ee-c7a4-4bac-a79f-890446d2b08d tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:28:24 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-d2d1e0ee-c7a4-4bac-a79f-890446d2b08d tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:28:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1559674581',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80af2632-ff4e-4148-b84b-a6893bb8732a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='942ec90965b7433ca1215d2d209866f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:28:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:28:25Z,use_quota=True,user_id='c8b8f44164914cac98edde16797983c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 10:28:24 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-d2d1e0ee-c7a4-4bac-a79f-890446d2b08d tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Creating volume 80af2632-ff4e-4148-b84b-a6893bb8732a {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:28:24 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-d2d1e0ee-c7a4-4bac-a79f-890446d2b08d tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:28:24 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-d2d1e0ee-c7a4-4bac-a79f-890446d2b08d tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:28:24 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-d2d1e0ee-c7a4-4bac-a79f-890446d2b08d tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:28:24 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-d2d1e0ee-c7a4-4bac-a79f-890446d2b08d tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:28:24 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-d2d1e0ee-c7a4-4bac-a79f-890446d2b08d tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:28:24 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-d2d1e0ee-c7a4-4bac-a79f-890446d2b08d tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Selected osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:28:24 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-d2d1e0ee-c7a4-4bac-a79f-890446d2b08d tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] casted to osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 Nov 04 10:28:24 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d2d1e0ee-c7a4-4bac-a79f-890446d2b08d tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-80af2632-ff4e-4148-b84b-a6893bb8732a 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:28:24 devstack sudo[103714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-80af2632-ff4e-4148-b84b-a6893bb8732a 1073741824 Nov 04 10:28:24 devstack sudo[103714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:28:24 devstack sudo[103708]: pam_unix(sudo:session): session closed for user root Nov 04 10:28:24 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-0016f2cb-759a-4a48-861e-d1c4d8d00650 tempest-CreateVolumesFromSnapshotTest-696580006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-ada9c88c-6b20-4c84-9499-6924da6f9784" returned: 0 in 0.371s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:28:24 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-0016f2cb-759a-4a48-861e-d1c4d8d00650 tempest-CreateVolumesFromSnapshotTest-696580006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-ada9c88c-6b20-4c84-9499-6924da6f9784 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:28:24 devstack sudo[103716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-ada9c88c-6b20-4c84-9499-6924da6f9784 Nov 04 10:28:24 devstack sudo[103716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:28:25 devstack sudo[103716]: pam_unix(sudo:session): session closed for user root Nov 04 10:28:25 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-0016f2cb-759a-4a48-861e-d1c4d8d00650 tempest-CreateVolumesFromSnapshotTest-696580006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-ada9c88c-6b20-4c84-9499-6924da6f9784" returned: 0 in 0.274s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:28:25 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-0016f2cb-759a-4a48-861e-d1c4d8d00650 tempest-CreateVolumesFromSnapshotTest-696580006 None] Lock "cinder-quobyte-ada9c88c-6b20-4c84-9499-6924da6f9784" released by "delete_volume" :: held 0.694s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:28:25 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-0016f2cb-759a-4a48-861e-d1c4d8d00650 tempest-CreateVolumesFromSnapshotTest-696580006 None] Created reservations ['fa20a289-5f72-4695-bad7-6a28a199438f', '7753fffb-415c-4077-a9e9-ac65e3104856', 'a711a1e7-2381-4cb6-8d1e-484cfa8642f9', '4442b1a1-72fa-4432-9730-fdfeaa4ad58a'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:28:25 devstack sudo[103714]: pam_unix(sudo:session): session closed for user root Nov 04 10:28:25 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d2d1e0ee-c7a4-4bac-a79f-890446d2b08d tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-80af2632-ff4e-4148-b84b-a6893bb8732a 1073741824" returned: 0 in 0.434s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:28:25 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-0016f2cb-759a-4a48-861e-d1c4d8d00650 tempest-CreateVolumesFromSnapshotTest-696580006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:28:25 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-0016f2cb-759a-4a48-861e-d1c4d8d00650 tempest-CreateVolumesFromSnapshotTest-696580006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:28:25 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-0016f2cb-759a-4a48-861e-d1c4d8d00650 tempest-CreateVolumesFromSnapshotTest-696580006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:28:25 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-0016f2cb-759a-4a48-861e-d1c4d8d00650 tempest-CreateVolumesFromSnapshotTest-696580006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:28:25 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-0016f2cb-759a-4a48-861e-d1c4d8d00650 tempest-CreateVolumesFromSnapshotTest-696580006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:28:25 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-0016f2cb-759a-4a48-861e-d1c4d8d00650 tempest-CreateVolumesFromSnapshotTest-696580006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:28:25 devstack sudo[103723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:28:25 devstack sudo[103723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:28:25 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d2d1e0ee-c7a4-4bac-a79f-890446d2b08d tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-80af2632-ff4e-4148-b84b-a6893bb8732a {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:28:25 devstack sudo[103725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-80af2632-ff4e-4148-b84b-a6893bb8732a Nov 04 10:28:25 devstack sudo[103725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:28:25 devstack sudo[103723]: pam_unix(sudo:session): session closed for user root Nov 04 10:28:25 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-0016f2cb-759a-4a48-861e-d1c4d8d00650 tempest-CreateVolumesFromSnapshotTest-696580006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.264s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:28:25 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-0016f2cb-759a-4a48-861e-d1c4d8d00650 tempest-CreateVolumesFromSnapshotTest-696580006 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:28:25 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-c1ee6ff2-14ba-4f16-94c9-3aa87c2a02e9 tempest-CreateVolumesFromSnapshotTest-696580006 None] Acquiring lock "cinder-ecd490e3-5a14-41a8-ac3a-c2a0dd1283db-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:28:25 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-0016f2cb-759a-4a48-861e-d1c4d8d00650 tempest-CreateVolumesFromSnapshotTest-696580006 None] Deleted volume successfully. Nov 04 10:28:25 devstack sudo[103725]: pam_unix(sudo:session): session closed for user root Nov 04 10:28:25 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d2d1e0ee-c7a4-4bac-a79f-890446d2b08d tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-80af2632-ff4e-4148-b84b-a6893bb8732a" returned: 0 in 0.279s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:28:25 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-d2d1e0ee-c7a4-4bac-a79f-890446d2b08d tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] <== create_volume: return (779ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 10:28:25 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-d2d1e0ee-c7a4-4bac-a79f-890446d2b08d tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.782s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:28:25 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-c1ee6ff2-14ba-4f16-94c9-3aa87c2a02e9 tempest-CreateVolumesFromSnapshotTest-696580006 None] Lock "cinder-ecd490e3-5a14-41a8-ac3a-c2a0dd1283db-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:28:25 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-0016f2cb-759a-4a48-861e-d1c4d8d00650 tempest-CreateVolumesFromSnapshotTest-696580006 None] Lock "cinder-ada9c88c-6b20-4c84-9499-6924da6f9784-delete_volume" released by "delete_volume" :: held 1.200s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:28:25 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-d2d1e0ee-c7a4-4bac-a79f-890446d2b08d tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f92f24dd-8cda-44b0-b9ea-40b3b06b575f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80af2632-ff4e-4148-b84b-a6893bb8732a', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:28:25 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-d2d1e0ee-c7a4-4bac-a79f-890446d2b08d tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (def85c64-f8cc-4c6a-9f05-15afbeefd18b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:28:25 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-c1ee6ff2-14ba-4f16-94c9-3aa87c2a02e9 tempest-CreateVolumesFromSnapshotTest-696580006 None] Acquiring lock "cinder-quobyte-ecd490e3-5a14-41a8-ac3a-c2a0dd1283db" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:28:25 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-d2d1e0ee-c7a4-4bac-a79f-890446d2b08d tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Volume volume-80af2632-ff4e-4148-b84b-a6893bb8732a (80af2632-ff4e-4148-b84b-a6893bb8732a): created successfully Nov 04 10:28:25 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-d2d1e0ee-c7a4-4bac-a79f-890446d2b08d tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (def85c64-f8cc-4c6a-9f05-15afbeefd18b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:28:25 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-d2d1e0ee-c7a4-4bac-a79f-890446d2b08d tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Flow 'volume_create_manager' (ee3235de-9a32-4c2c-a144-1f965fffb52d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:28:25 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-c1ee6ff2-14ba-4f16-94c9-3aa87c2a02e9 tempest-CreateVolumesFromSnapshotTest-696580006 None] Lock "cinder-quobyte-ecd490e3-5a14-41a8-ac3a-c2a0dd1283db" acquired by "delete_volume" :: waited 0.030s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:28:25 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-d2d1e0ee-c7a4-4bac-a79f-890446d2b08d tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Created volume successfully. Nov 04 10:28:25 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c732e9f-9599-4f7e-ac6f-efbab85225b1]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:28:25 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c1ee6ff2-14ba-4f16-94c9-3aa87c2a02e9 tempest-CreateVolumesFromSnapshotTest-696580006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-ecd490e3-5a14-41a8-ac3a-c2a0dd1283db {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:28:25 devstack sudo[103729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-ecd490e3-5a14-41a8-ac3a-c2a0dd1283db Nov 04 10:28:25 devstack sudo[103729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:28:26 devstack sudo[103729]: pam_unix(sudo:session): session closed for user root Nov 04 10:28:26 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c1ee6ff2-14ba-4f16-94c9-3aa87c2a02e9 tempest-CreateVolumesFromSnapshotTest-696580006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-ecd490e3-5a14-41a8-ac3a-c2a0dd1283db" returned: 0 in 0.342s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:28:26 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c1ee6ff2-14ba-4f16-94c9-3aa87c2a02e9 tempest-CreateVolumesFromSnapshotTest-696580006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-ecd490e3-5a14-41a8-ac3a-c2a0dd1283db {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:28:26 devstack sudo[103735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-ecd490e3-5a14-41a8-ac3a-c2a0dd1283db Nov 04 10:28:26 devstack sudo[103735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:28:26 devstack sudo[103735]: pam_unix(sudo:session): session closed for user root Nov 04 10:28:26 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c1ee6ff2-14ba-4f16-94c9-3aa87c2a02e9 tempest-CreateVolumesFromSnapshotTest-696580006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-ecd490e3-5a14-41a8-ac3a-c2a0dd1283db" returned: 0 in 0.250s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:28:26 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-c1ee6ff2-14ba-4f16-94c9-3aa87c2a02e9 tempest-CreateVolumesFromSnapshotTest-696580006 None] Lock "cinder-quobyte-ecd490e3-5a14-41a8-ac3a-c2a0dd1283db" released by "delete_volume" :: held 0.639s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:28:26 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-c1ee6ff2-14ba-4f16-94c9-3aa87c2a02e9 tempest-CreateVolumesFromSnapshotTest-696580006 None] Created reservations ['cbfcdf37-70c5-4e16-beb6-c00a3b79400f', '54a631cf-f532-45e6-9e66-df6ed82f836f', 'd133d959-b646-4ceb-b949-091e176ed098', 'fdd9463c-8c97-405c-bab0-a6ae089d3051'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:28:26 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-c1ee6ff2-14ba-4f16-94c9-3aa87c2a02e9 tempest-CreateVolumesFromSnapshotTest-696580006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:28:26 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-c1ee6ff2-14ba-4f16-94c9-3aa87c2a02e9 tempest-CreateVolumesFromSnapshotTest-696580006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:28:26 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-c1ee6ff2-14ba-4f16-94c9-3aa87c2a02e9 tempest-CreateVolumesFromSnapshotTest-696580006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:28:26 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-c1ee6ff2-14ba-4f16-94c9-3aa87c2a02e9 tempest-CreateVolumesFromSnapshotTest-696580006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:28:26 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-c1ee6ff2-14ba-4f16-94c9-3aa87c2a02e9 tempest-CreateVolumesFromSnapshotTest-696580006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:28:26 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c1ee6ff2-14ba-4f16-94c9-3aa87c2a02e9 tempest-CreateVolumesFromSnapshotTest-696580006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:28:26 devstack sudo[103738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:28:26 devstack sudo[103738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:28:26 devstack sudo[103738]: pam_unix(sudo:session): session closed for user root Nov 04 10:28:26 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c1ee6ff2-14ba-4f16-94c9-3aa87c2a02e9 tempest-CreateVolumesFromSnapshotTest-696580006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.266s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:28:26 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-c1ee6ff2-14ba-4f16-94c9-3aa87c2a02e9 tempest-CreateVolumesFromSnapshotTest-696580006 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:28:26 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-c1ee6ff2-14ba-4f16-94c9-3aa87c2a02e9 tempest-CreateVolumesFromSnapshotTest-696580006 None] Deleted volume successfully. Nov 04 10:28:26 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-c1ee6ff2-14ba-4f16-94c9-3aa87c2a02e9 tempest-CreateVolumesFromSnapshotTest-696580006 None] Lock "cinder-ecd490e3-5a14-41a8-ac3a-c2a0dd1283db-delete_volume" released by "delete_volume" :: held 1.123s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:28:26 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-ef7e5e9d-3313-4f4b-8ba3-c55ba2c26afc tempest-CreateVolumesFromSnapshotTest-696580006 None] Acquiring lock "cinder-4674d956-c06f-4ac9-a697-c237281f9b46-delete_snapshot" by "delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:28:26 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-ef7e5e9d-3313-4f4b-8ba3-c55ba2c26afc tempest-CreateVolumesFromSnapshotTest-696580006 None] Lock "cinder-4674d956-c06f-4ac9-a697-c237281f9b46-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:28:26 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-ef7e5e9d-3313-4f4b-8ba3-c55ba2c26afc tempest-CreateVolumesFromSnapshotTest-696580006 None] Acquiring lock "cinder-quobyte-9eec778b-8b1d-4fbb-bd3d-20069629b2a9" by "delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:28:26 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-ef7e5e9d-3313-4f4b-8ba3-c55ba2c26afc tempest-CreateVolumesFromSnapshotTest-696580006 None] Lock "cinder-quobyte-9eec778b-8b1d-4fbb-bd3d-20069629b2a9" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:28:26 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-ef7e5e9d-3313-4f4b-8ba3-c55ba2c26afc tempest-CreateVolumesFromSnapshotTest-696580006 None] Acquiring lock "cinder-quobyte-4674d956-c06f-4ac9-a697-c237281f9b46" by "_delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:28:26 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-ef7e5e9d-3313-4f4b-8ba3-c55ba2c26afc tempest-CreateVolumesFromSnapshotTest-696580006 None] Lock "cinder-quobyte-4674d956-c06f-4ac9-a697-c237281f9b46" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:28:26 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-ef7e5e9d-3313-4f4b-8ba3-c55ba2c26afc tempest-CreateVolumesFromSnapshotTest-696580006 None] Deleting offline snapshot 4674d956-c06f-4ac9-a697-c237281f9b46 of volume 9eec778b-8b1d-4fbb-bd3d-20069629b2a9 {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 10:28:26 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-ef7e5e9d-3313-4f4b-8ba3-c55ba2c26afc tempest-CreateVolumesFromSnapshotTest-696580006 None] snapshot_file for this snap is: volume-9eec778b-8b1d-4fbb-bd3d-20069629b2a9.4674d956-c06f-4ac9-a697-c237281f9b46 {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 10:28:26 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c73249f-22ca-4deb-b06c-997f8d33de05]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:28:26 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ef7e5e9d-3313-4f4b-8ba3-c55ba2c26afc tempest-CreateVolumesFromSnapshotTest-696580006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-9eec778b-8b1d-4fbb-bd3d-20069629b2a9.4674d956-c06f-4ac9-a697-c237281f9b46 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:28:27 devstack sudo[103741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-9eec778b-8b1d-4fbb-bd3d-20069629b2a9.4674d956-c06f-4ac9-a697-c237281f9b46 Nov 04 10:28:27 devstack sudo[103741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:28:27 devstack sudo[103741]: pam_unix(sudo:session): session closed for user root Nov 04 10:28:27 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ef7e5e9d-3313-4f4b-8ba3-c55ba2c26afc tempest-CreateVolumesFromSnapshotTest-696580006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-9eec778b-8b1d-4fbb-bd3d-20069629b2a9.4674d956-c06f-4ac9-a697-c237281f9b46" returned: 0 in 0.418s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:28:27 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-ef7e5e9d-3313-4f4b-8ba3-c55ba2c26afc tempest-CreateVolumesFromSnapshotTest-696580006 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9eec778b-8b1d-4fbb-bd3d-20069629b2a9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87068) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 10:28:27 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2f5fbc2-452f-4053-bbfb-29dec276db11]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:28:27 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ef7e5e9d-3313-4f4b-8ba3-c55ba2c26afc tempest-CreateVolumesFromSnapshotTest-696580006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-9eec778b-8b1d-4fbb-bd3d-20069629b2a9 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:28:27 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c6abd2b-1065-4192-97e7-b86c8930297b tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:28:27 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-0c6abd2b-1065-4192-97e7-b86c8930297b tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Flow 'volume_create_manager' (a4bd368a-31c2-418d-9105-4f8d64a1266a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:28:27 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-0c6abd2b-1065-4192-97e7-b86c8930297b tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12c68e1a-9df3-45e4-9bba-0f295050627d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:28:27 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-0c6abd2b-1065-4192-97e7-b86c8930297b tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12c68e1a-9df3-45e4-9bba-0f295050627d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:28:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1837112536',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59bc5b65-8a33-4cb9-a3be-7e1fc225def6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='942ec90965b7433ca1215d2d209866f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:28:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:28:27Z,use_quota=True,user_id='c8b8f44164914cac98edde16797983c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:28:27 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-0c6abd2b-1065-4192-97e7-b86c8930297b tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7dfae6f-51ae-4609-bb67-6d737785c06a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:28:27 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-0c6abd2b-1065-4192-97e7-b86c8930297b tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7dfae6f-51ae-4609-bb67-6d737785c06a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:28:27 devstack sudo[103750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-9eec778b-8b1d-4fbb-bd3d-20069629b2a9 Nov 04 10:28:27 devstack sudo[103750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:28:27 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-0c6abd2b-1065-4192-97e7-b86c8930297b tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f088a82-9564-4d5d-bff8-a68d08c71227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:28:27 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-0c6abd2b-1065-4192-97e7-b86c8930297b tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f088a82-9564-4d5d-bff8-a68d08c71227) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '59bc5b65-8a33-4cb9-a3be-7e1fc225def6', 'volume_name': 'volume-59bc5b65-8a33-4cb9-a3be-7e1fc225def6', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:28:27 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-0c6abd2b-1065-4192-97e7-b86c8930297b tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21dcaec9-d9a6-4e5f-b81c-e5c98d112720) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:28:27 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-0c6abd2b-1065-4192-97e7-b86c8930297b tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21dcaec9-d9a6-4e5f-b81c-e5c98d112720) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:28:27 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-0c6abd2b-1065-4192-97e7-b86c8930297b tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0254c28-d0b2-45fd-a003-e9b475175fe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:28:27 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-0c6abd2b-1065-4192-97e7-b86c8930297b tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Volume 59bc5b65-8a33-4cb9-a3be-7e1fc225def6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-59bc5b65-8a33-4cb9-a3be-7e1fc225def6', 'volume_size': 1} Nov 04 10:28:27 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-0c6abd2b-1065-4192-97e7-b86c8930297b tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:28:27 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-0c6abd2b-1065-4192-97e7-b86c8930297b tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:28:27 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-0c6abd2b-1065-4192-97e7-b86c8930297b tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:28:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1837112536',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59bc5b65-8a33-4cb9-a3be-7e1fc225def6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='942ec90965b7433ca1215d2d209866f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:28:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:28:27Z,use_quota=True,user_id='c8b8f44164914cac98edde16797983c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 10:28:27 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-0c6abd2b-1065-4192-97e7-b86c8930297b tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Creating volume 59bc5b65-8a33-4cb9-a3be-7e1fc225def6 {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:28:27 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-0c6abd2b-1065-4192-97e7-b86c8930297b tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:28:27 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-0c6abd2b-1065-4192-97e7-b86c8930297b tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:28:27 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-0c6abd2b-1065-4192-97e7-b86c8930297b tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:28:27 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-0c6abd2b-1065-4192-97e7-b86c8930297b tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:28:27 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-0c6abd2b-1065-4192-97e7-b86c8930297b tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:28:27 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-0c6abd2b-1065-4192-97e7-b86c8930297b tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Selected osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:28:27 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-0c6abd2b-1065-4192-97e7-b86c8930297b tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] casted to osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 Nov 04 10:28:27 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-0c6abd2b-1065-4192-97e7-b86c8930297b tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-59bc5b65-8a33-4cb9-a3be-7e1fc225def6 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:28:27 devstack sudo[103752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-59bc5b65-8a33-4cb9-a3be-7e1fc225def6 1073741824 Nov 04 10:28:27 devstack sudo[103752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:28:27 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-593d0271-5496-48d0-83cb-189b5d1d5d61 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:28:27 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-593d0271-5496-48d0-83cb-189b5d1d5d61 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Flow 'volume_create_manager' (e2070eae-e53e-47bc-9ad0-0a8e7256a291) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:28:27 devstack sudo[103750]: pam_unix(sudo:session): session closed for user root Nov 04 10:28:27 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-593d0271-5496-48d0-83cb-189b5d1d5d61 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7beb428f-e49a-424d-97ca-497027219906) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:28:27 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ef7e5e9d-3313-4f4b-8ba3-c55ba2c26afc tempest-CreateVolumesFromSnapshotTest-696580006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-9eec778b-8b1d-4fbb-bd3d-20069629b2a9" returned: 0 in 0.480s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:28:27 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ef7e5e9d-3313-4f4b-8ba3-c55ba2c26afc tempest-CreateVolumesFromSnapshotTest-696580006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-9eec778b-8b1d-4fbb-bd3d-20069629b2a9.4674d956-c06f-4ac9-a697-c237281f9b46 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:28:27 devstack sudo[103757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-9eec778b-8b1d-4fbb-bd3d-20069629b2a9.4674d956-c06f-4ac9-a697-c237281f9b46 Nov 04 10:28:27 devstack sudo[103757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:28:27 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-593d0271-5496-48d0-83cb-189b5d1d5d61 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7beb428f-e49a-424d-97ca-497027219906) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:28:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-398924642',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b13ff762-d220-4cf1-a6de-94b0020b7afc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='942ec90965b7433ca1215d2d209866f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:28:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:28:28Z,use_quota=True,user_id='c8b8f44164914cac98edde16797983c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:28:27 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-593d0271-5496-48d0-83cb-189b5d1d5d61 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93e1054f-d7f6-4f99-a940-6a50a4f069a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:28:27 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-593d0271-5496-48d0-83cb-189b5d1d5d61 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93e1054f-d7f6-4f99-a940-6a50a4f069a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:28:27 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-593d0271-5496-48d0-83cb-189b5d1d5d61 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4ad7a22-f1ef-4e2d-bdb0-09b6a0d333f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:28:27 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-593d0271-5496-48d0-83cb-189b5d1d5d61 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4ad7a22-f1ef-4e2d-bdb0-09b6a0d333f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b13ff762-d220-4cf1-a6de-94b0020b7afc', 'volume_name': 'volume-b13ff762-d220-4cf1-a6de-94b0020b7afc', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:28:27 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-593d0271-5496-48d0-83cb-189b5d1d5d61 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51646da1-cb72-4e23-b619-674fa39c3d15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:28:27 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-593d0271-5496-48d0-83cb-189b5d1d5d61 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51646da1-cb72-4e23-b619-674fa39c3d15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:28:27 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-593d0271-5496-48d0-83cb-189b5d1d5d61 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24bd64d5-19a6-49c5-adb7-24b6a14ec801) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:28:27 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-593d0271-5496-48d0-83cb-189b5d1d5d61 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Volume b13ff762-d220-4cf1-a6de-94b0020b7afc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b13ff762-d220-4cf1-a6de-94b0020b7afc', 'volume_size': 1} Nov 04 10:28:27 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-593d0271-5496-48d0-83cb-189b5d1d5d61 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:28:28 devstack sudo[103752]: pam_unix(sudo:session): session closed for user root Nov 04 10:28:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-0c6abd2b-1065-4192-97e7-b86c8930297b tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-59bc5b65-8a33-4cb9-a3be-7e1fc225def6 1073741824" returned: 0 in 0.626s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:28:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-0c6abd2b-1065-4192-97e7-b86c8930297b tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-59bc5b65-8a33-4cb9-a3be-7e1fc225def6 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:28:28 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b137253-6672-436d-bd01-22940b929d26 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:28:28 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-3b137253-6672-436d-bd01-22940b929d26 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Flow 'volume_create_manager' (2ad62d15-2483-4ff1-9174-787fc9daf907) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:28:28 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-3b137253-6672-436d-bd01-22940b929d26 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (779d2a5c-79a9-4c86-9411-2d9e13989559) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:28:28 devstack sudo[103766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-59bc5b65-8a33-4cb9-a3be-7e1fc225def6 Nov 04 10:28:28 devstack sudo[103766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:28:28 devstack sudo[103757]: pam_unix(sudo:session): session closed for user root Nov 04 10:28:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ef7e5e9d-3313-4f4b-8ba3-c55ba2c26afc tempest-CreateVolumesFromSnapshotTest-696580006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-9eec778b-8b1d-4fbb-bd3d-20069629b2a9.4674d956-c06f-4ac9-a697-c237281f9b46" returned: 0 in 0.427s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:28:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ef7e5e9d-3313-4f4b-8ba3-c55ba2c26afc tempest-CreateVolumesFromSnapshotTest-696580006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-9eec778b-8b1d-4fbb-bd3d-20069629b2a9.4674d956-c06f-4ac9-a697-c237281f9b46 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:28:28 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-3b137253-6672-436d-bd01-22940b929d26 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (779d2a5c-79a9-4c86-9411-2d9e13989559) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:28:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1117569365',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2896646-c33f-4a82-9251-91d11942df4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='942ec90965b7433ca1215d2d209866f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:28:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:28:28Z,use_quota=True,user_id='c8b8f44164914cac98edde16797983c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:28:28 devstack sudo[103768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-9eec778b-8b1d-4fbb-bd3d-20069629b2a9.4674d956-c06f-4ac9-a697-c237281f9b46 Nov 04 10:28:28 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-3b137253-6672-436d-bd01-22940b929d26 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8591809-2d59-4391-9311-55d2ce396b4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:28:28 devstack sudo[103768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:28:28 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-3b137253-6672-436d-bd01-22940b929d26 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8591809-2d59-4391-9311-55d2ce396b4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:28:28 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-3b137253-6672-436d-bd01-22940b929d26 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33018124-23e0-4ed9-9181-2df9fe5078e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:28:28 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-3b137253-6672-436d-bd01-22940b929d26 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33018124-23e0-4ed9-9181-2df9fe5078e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2896646-c33f-4a82-9251-91d11942df4b', 'volume_name': 'volume-b2896646-c33f-4a82-9251-91d11942df4b', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:28:28 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-3b137253-6672-436d-bd01-22940b929d26 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22f51ab7-4e6d-4ccc-92de-01775af52eca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:28:28 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-3b137253-6672-436d-bd01-22940b929d26 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22f51ab7-4e6d-4ccc-92de-01775af52eca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:28:28 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-3b137253-6672-436d-bd01-22940b929d26 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29d776bd-f355-4b78-86e8-20d242b648b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:28:28 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-3b137253-6672-436d-bd01-22940b929d26 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Volume b2896646-c33f-4a82-9251-91d11942df4b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2896646-c33f-4a82-9251-91d11942df4b', 'volume_size': 1} Nov 04 10:28:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-3b137253-6672-436d-bd01-22940b929d26 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:28:28 devstack sudo[103766]: pam_unix(sudo:session): session closed for user root Nov 04 10:28:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-0c6abd2b-1065-4192-97e7-b86c8930297b tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-59bc5b65-8a33-4cb9-a3be-7e1fc225def6" returned: 0 in 0.327s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:28:28 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-0c6abd2b-1065-4192-97e7-b86c8930297b tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] <== create_volume: return (1019ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 10:28:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-0c6abd2b-1065-4192-97e7-b86c8930297b tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.022s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:28:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-593d0271-5496-48d0-83cb-189b5d1d5d61 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.616s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:28:28 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-593d0271-5496-48d0-83cb-189b5d1d5d61 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:28:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-398924642',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b13ff762-d220-4cf1-a6de-94b0020b7afc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='942ec90965b7433ca1215d2d209866f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:28:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:28:28Z,use_quota=True,user_id='c8b8f44164914cac98edde16797983c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 10:28:28 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-593d0271-5496-48d0-83cb-189b5d1d5d61 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Creating volume b13ff762-d220-4cf1-a6de-94b0020b7afc {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:28:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-593d0271-5496-48d0-83cb-189b5d1d5d61 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:28:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-593d0271-5496-48d0-83cb-189b5d1d5d61 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:28:28 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-593d0271-5496-48d0-83cb-189b5d1d5d61 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:28:28 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-593d0271-5496-48d0-83cb-189b5d1d5d61 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:28:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-593d0271-5496-48d0-83cb-189b5d1d5d61 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:28:28 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-593d0271-5496-48d0-83cb-189b5d1d5d61 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Selected osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:28:28 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-593d0271-5496-48d0-83cb-189b5d1d5d61 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] casted to osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 Nov 04 10:28:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-593d0271-5496-48d0-83cb-189b5d1d5d61 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b13ff762-d220-4cf1-a6de-94b0020b7afc 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:28:28 devstack sudo[103772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b13ff762-d220-4cf1-a6de-94b0020b7afc 1073741824 Nov 04 10:28:28 devstack sudo[103772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:28:28 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-0c6abd2b-1065-4192-97e7-b86c8930297b tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0254c28-d0b2-45fd-a003-e9b475175fe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59bc5b65-8a33-4cb9-a3be-7e1fc225def6', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:28:28 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-0c6abd2b-1065-4192-97e7-b86c8930297b tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e7c4bb2-a5b0-4ee1-a6f2-8e0f3c5ff3c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:28:28 devstack sudo[103768]: pam_unix(sudo:session): session closed for user root Nov 04 10:28:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ef7e5e9d-3313-4f4b-8ba3-c55ba2c26afc tempest-CreateVolumesFromSnapshotTest-696580006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-9eec778b-8b1d-4fbb-bd3d-20069629b2a9.4674d956-c06f-4ac9-a697-c237281f9b46" returned: 0 in 0.363s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:28:28 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-0c6abd2b-1065-4192-97e7-b86c8930297b tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Volume volume-59bc5b65-8a33-4cb9-a3be-7e1fc225def6 (59bc5b65-8a33-4cb9-a3be-7e1fc225def6): created successfully Nov 04 10:28:28 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-0c6abd2b-1065-4192-97e7-b86c8930297b tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e7c4bb2-a5b0-4ee1-a6f2-8e0f3c5ff3c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:28:28 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-0c6abd2b-1065-4192-97e7-b86c8930297b tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Flow 'volume_create_manager' (a4bd368a-31c2-418d-9105-4f8d64a1266a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:28:28 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-ef7e5e9d-3313-4f4b-8ba3-c55ba2c26afc tempest-CreateVolumesFromSnapshotTest-696580006 None] Lock "cinder-quobyte-4674d956-c06f-4ac9-a697-c237281f9b46" released by "_delete_snapshot" :: held 1.856s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:28:28 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-0c6abd2b-1065-4192-97e7-b86c8930297b tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Created volume successfully. Nov 04 10:28:28 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-ef7e5e9d-3313-4f4b-8ba3-c55ba2c26afc tempest-CreateVolumesFromSnapshotTest-696580006 None] Lock "cinder-quobyte-9eec778b-8b1d-4fbb-bd3d-20069629b2a9" released by "delete_snapshot" :: held 1.892s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:28:28 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-1aa0d34c-bc24-4ca7-b904-d54778652886 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:28:28 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1aa0d34c-bc24-4ca7-b904-d54778652886 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Flow 'volume_create_manager' (4c934436-69a1-4846-801f-03ae614f7abe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:28:28 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1aa0d34c-bc24-4ca7-b904-d54778652886 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a6c81e1-176e-431c-b7bd-bd77dc32c86b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:28:28 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1aa0d34c-bc24-4ca7-b904-d54778652886 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a6c81e1-176e-431c-b7bd-bd77dc32c86b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:28:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-85866615',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d390f32a-1fca-4d05-956d-128905883764,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='942ec90965b7433ca1215d2d209866f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:28:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:28:29Z,use_quota=True,user_id='c8b8f44164914cac98edde16797983c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:28:28 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1aa0d34c-bc24-4ca7-b904-d54778652886 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20e88ec0-1476-4352-ae5e-57349b5c210f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:28:28 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1aa0d34c-bc24-4ca7-b904-d54778652886 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20e88ec0-1476-4352-ae5e-57349b5c210f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:28:28 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1aa0d34c-bc24-4ca7-b904-d54778652886 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae5f18fd-00cf-48c7-b8d0-cd2d474ac4cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:28:28 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1aa0d34c-bc24-4ca7-b904-d54778652886 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae5f18fd-00cf-48c7-b8d0-cd2d474ac4cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd390f32a-1fca-4d05-956d-128905883764', 'volume_name': 'volume-d390f32a-1fca-4d05-956d-128905883764', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:28:28 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1aa0d34c-bc24-4ca7-b904-d54778652886 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa3b8c79-c558-4e8c-b420-db6b4427a1e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:28:28 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1aa0d34c-bc24-4ca7-b904-d54778652886 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa3b8c79-c558-4e8c-b420-db6b4427a1e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:28:28 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1aa0d34c-bc24-4ca7-b904-d54778652886 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a52070f8-9846-4d73-bde3-ac441b00a457) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:28:28 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-1aa0d34c-bc24-4ca7-b904-d54778652886 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Volume d390f32a-1fca-4d05-956d-128905883764: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d390f32a-1fca-4d05-956d-128905883764', 'volume_size': 1} Nov 04 10:28:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-1aa0d34c-bc24-4ca7-b904-d54778652886 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:28:28 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-ef7e5e9d-3313-4f4b-8ba3-c55ba2c26afc tempest-CreateVolumesFromSnapshotTest-696580006 None] Created reservations ['746b4002-f71e-4256-ab20-e406245a8707', 'f1728a2f-e9a1-4a77-9799-99a97cee01f7', '2f79a8fe-3bf8-40e6-b908-5d519d4d29dd', '58c3da73-273b-4ed3-874b-b0dd3db290fc'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:28:28 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-ef7e5e9d-3313-4f4b-8ba3-c55ba2c26afc tempest-CreateVolumesFromSnapshotTest-696580006 None] Delete snapshot completed successfully. Nov 04 10:28:29 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-ef7e5e9d-3313-4f4b-8ba3-c55ba2c26afc tempest-CreateVolumesFromSnapshotTest-696580006 None] Lock "cinder-4674d956-c06f-4ac9-a697-c237281f9b46-delete_snapshot" released by "delete_snapshot" :: held 2.166s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:28:29 devstack sudo[103772]: pam_unix(sudo:session): session closed for user root Nov 04 10:28:29 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-593d0271-5496-48d0-83cb-189b5d1d5d61 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b13ff762-d220-4cf1-a6de-94b0020b7afc 1073741824" returned: 0 in 0.556s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:28:29 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-076544c8-a78d-4c5d-9f9f-8e0780614238 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:28:29 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-076544c8-a78d-4c5d-9f9f-8e0780614238 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Flow 'volume_create_manager' (21ebfcc1-1323-49ee-aa6a-c8f5780b6321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:28:29 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-076544c8-a78d-4c5d-9f9f-8e0780614238 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a179d745-a2ea-4f85-9baf-30910f8f4db1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:28:29 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-076544c8-a78d-4c5d-9f9f-8e0780614238 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a179d745-a2ea-4f85-9baf-30910f8f4db1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:28:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-424540589',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c8c25d6-9dc1-4e5e-81e5-414c145dd941,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='942ec90965b7433ca1215d2d209866f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:28:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:28:29Z,use_quota=True,user_id='c8b8f44164914cac98edde16797983c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:28:29 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-076544c8-a78d-4c5d-9f9f-8e0780614238 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ad6b3b8-6c8f-45bd-8fbd-c0420167e40f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:28:29 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-076544c8-a78d-4c5d-9f9f-8e0780614238 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ad6b3b8-6c8f-45bd-8fbd-c0420167e40f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:28:29 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-076544c8-a78d-4c5d-9f9f-8e0780614238 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3645fad0-22a9-47b8-8e5c-73a612b399c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:28:29 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-076544c8-a78d-4c5d-9f9f-8e0780614238 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3645fad0-22a9-47b8-8e5c-73a612b399c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c8c25d6-9dc1-4e5e-81e5-414c145dd941', 'volume_name': 'volume-5c8c25d6-9dc1-4e5e-81e5-414c145dd941', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:28:29 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-076544c8-a78d-4c5d-9f9f-8e0780614238 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2a9dbea-817c-4d77-a719-77e122c34452) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:28:29 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-076544c8-a78d-4c5d-9f9f-8e0780614238 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2a9dbea-817c-4d77-a719-77e122c34452) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:28:29 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-076544c8-a78d-4c5d-9f9f-8e0780614238 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d14c079-5504-433f-a12d-4d4ed28deaae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:28:29 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-076544c8-a78d-4c5d-9f9f-8e0780614238 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Volume 5c8c25d6-9dc1-4e5e-81e5-414c145dd941: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c8c25d6-9dc1-4e5e-81e5-414c145dd941', 'volume_size': 1} Nov 04 10:28:29 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-076544c8-a78d-4c5d-9f9f-8e0780614238 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:28:29 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-593d0271-5496-48d0-83cb-189b5d1d5d61 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b13ff762-d220-4cf1-a6de-94b0020b7afc {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:28:29 devstack sudo[103780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b13ff762-d220-4cf1-a6de-94b0020b7afc Nov 04 10:28:29 devstack sudo[103780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:28:29 devstack sudo[103780]: pam_unix(sudo:session): session closed for user root Nov 04 10:28:29 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-593d0271-5496-48d0-83cb-189b5d1d5d61 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b13ff762-d220-4cf1-a6de-94b0020b7afc" returned: 0 in 0.261s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:28:29 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-593d0271-5496-48d0-83cb-189b5d1d5d61 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] <== create_volume: return (943ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 10:28:29 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-593d0271-5496-48d0-83cb-189b5d1d5d61 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.948s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:28:29 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-3b137253-6672-436d-bd01-22940b929d26 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.151s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:28:29 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-3b137253-6672-436d-bd01-22940b929d26 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:28:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1117569365',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2896646-c33f-4a82-9251-91d11942df4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='942ec90965b7433ca1215d2d209866f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:28:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:28:28Z,use_quota=True,user_id='c8b8f44164914cac98edde16797983c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 10:28:29 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-3b137253-6672-436d-bd01-22940b929d26 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Creating volume b2896646-c33f-4a82-9251-91d11942df4b {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:28:29 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-3b137253-6672-436d-bd01-22940b929d26 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:28:29 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-3b137253-6672-436d-bd01-22940b929d26 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:28:29 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-3b137253-6672-436d-bd01-22940b929d26 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:28:29 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-3b137253-6672-436d-bd01-22940b929d26 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:28:29 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-3b137253-6672-436d-bd01-22940b929d26 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:28:29 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-3b137253-6672-436d-bd01-22940b929d26 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Selected osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:28:29 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-3b137253-6672-436d-bd01-22940b929d26 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] casted to osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 Nov 04 10:28:29 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-3b137253-6672-436d-bd01-22940b929d26 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b2896646-c33f-4a82-9251-91d11942df4b 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:28:29 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-593d0271-5496-48d0-83cb-189b5d1d5d61 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24bd64d5-19a6-49c5-adb7-24b6a14ec801) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b13ff762-d220-4cf1-a6de-94b0020b7afc', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:28:29 devstack sudo[103783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b2896646-c33f-4a82-9251-91d11942df4b 1073741824 Nov 04 10:28:29 devstack sudo[103783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:28:29 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-593d0271-5496-48d0-83cb-189b5d1d5d61 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f89148f-c11e-46a3-8502-80876776fc9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:28:29 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-593d0271-5496-48d0-83cb-189b5d1d5d61 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Volume volume-b13ff762-d220-4cf1-a6de-94b0020b7afc (b13ff762-d220-4cf1-a6de-94b0020b7afc): created successfully Nov 04 10:28:29 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-593d0271-5496-48d0-83cb-189b5d1d5d61 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f89148f-c11e-46a3-8502-80876776fc9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:28:29 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-593d0271-5496-48d0-83cb-189b5d1d5d61 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Flow 'volume_create_manager' (e2070eae-e53e-47bc-9ad0-0a8e7256a291) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:28:29 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-593d0271-5496-48d0-83cb-189b5d1d5d61 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Created volume successfully. Nov 04 10:28:29 devstack sudo[103783]: pam_unix(sudo:session): session closed for user root Nov 04 10:28:29 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-3b137253-6672-436d-bd01-22940b929d26 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b2896646-c33f-4a82-9251-91d11942df4b 1073741824" returned: 0 in 0.402s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:28:29 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-3b137253-6672-436d-bd01-22940b929d26 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b2896646-c33f-4a82-9251-91d11942df4b {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:28:29 devstack sudo[103789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b2896646-c33f-4a82-9251-91d11942df4b Nov 04 10:28:29 devstack sudo[103789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:28:30 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-b58b1564-2479-45f7-8b3e-f0910f649f46 tempest-CreateVolumesFromSnapshotTest-696580006 None] Acquiring lock "cinder-9eec778b-8b1d-4fbb-bd3d-20069629b2a9-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:28:30 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-b58b1564-2479-45f7-8b3e-f0910f649f46 tempest-CreateVolumesFromSnapshotTest-696580006 None] Lock "cinder-9eec778b-8b1d-4fbb-bd3d-20069629b2a9-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:28:30 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-b58b1564-2479-45f7-8b3e-f0910f649f46 tempest-CreateVolumesFromSnapshotTest-696580006 None] Acquiring lock "cinder-quobyte-9eec778b-8b1d-4fbb-bd3d-20069629b2a9" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:28:30 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-b58b1564-2479-45f7-8b3e-f0910f649f46 tempest-CreateVolumesFromSnapshotTest-696580006 None] Lock "cinder-quobyte-9eec778b-8b1d-4fbb-bd3d-20069629b2a9" acquired by "delete_volume" :: waited 0.015s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:28:30 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[490019d4-9bcd-4e12-9878-0daebcfec2cb]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:28:30 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-b58b1564-2479-45f7-8b3e-f0910f649f46 tempest-CreateVolumesFromSnapshotTest-696580006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-9eec778b-8b1d-4fbb-bd3d-20069629b2a9 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:28:30 devstack sudo[103789]: pam_unix(sudo:session): session closed for user root Nov 04 10:28:30 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-3b137253-6672-436d-bd01-22940b929d26 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b2896646-c33f-4a82-9251-91d11942df4b" returned: 0 in 0.281s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:28:30 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-3b137253-6672-436d-bd01-22940b929d26 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] <== create_volume: return (730ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 10:28:30 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-3b137253-6672-436d-bd01-22940b929d26 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.733s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:28:30 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-1aa0d34c-bc24-4ca7-b904-d54778652886 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.390s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:28:30 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-1aa0d34c-bc24-4ca7-b904-d54778652886 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:28:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-85866615',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d390f32a-1fca-4d05-956d-128905883764,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='942ec90965b7433ca1215d2d209866f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:28:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:28:29Z,use_quota=True,user_id='c8b8f44164914cac98edde16797983c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 10:28:30 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-1aa0d34c-bc24-4ca7-b904-d54778652886 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Creating volume d390f32a-1fca-4d05-956d-128905883764 {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:28:30 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-1aa0d34c-bc24-4ca7-b904-d54778652886 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:28:30 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-1aa0d34c-bc24-4ca7-b904-d54778652886 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:28:30 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-1aa0d34c-bc24-4ca7-b904-d54778652886 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:28:30 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-1aa0d34c-bc24-4ca7-b904-d54778652886 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:28:30 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-1aa0d34c-bc24-4ca7-b904-d54778652886 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:28:30 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-1aa0d34c-bc24-4ca7-b904-d54778652886 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Selected osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:28:30 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-1aa0d34c-bc24-4ca7-b904-d54778652886 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] casted to osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 Nov 04 10:28:30 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-1aa0d34c-bc24-4ca7-b904-d54778652886 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-d390f32a-1fca-4d05-956d-128905883764 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:28:30 devstack sudo[103793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-d390f32a-1fca-4d05-956d-128905883764 1073741824 Nov 04 10:28:30 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-3b137253-6672-436d-bd01-22940b929d26 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29d776bd-f355-4b78-86e8-20d242b648b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2896646-c33f-4a82-9251-91d11942df4b', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:28:30 devstack sudo[103793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:28:30 devstack sudo[103791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-9eec778b-8b1d-4fbb-bd3d-20069629b2a9 Nov 04 10:28:30 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-3b137253-6672-436d-bd01-22940b929d26 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b37299e-0b84-41b4-9c15-f4948529f593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:28:30 devstack sudo[103791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:28:30 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-3b137253-6672-436d-bd01-22940b929d26 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Volume volume-b2896646-c33f-4a82-9251-91d11942df4b (b2896646-c33f-4a82-9251-91d11942df4b): created successfully Nov 04 10:28:30 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-3b137253-6672-436d-bd01-22940b929d26 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b37299e-0b84-41b4-9c15-f4948529f593) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:28:30 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-3b137253-6672-436d-bd01-22940b929d26 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Flow 'volume_create_manager' (2ad62d15-2483-4ff1-9174-787fc9daf907) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:28:30 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-3b137253-6672-436d-bd01-22940b929d26 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Created volume successfully. Nov 04 10:28:30 devstack sudo[103791]: pam_unix(sudo:session): session closed for user root Nov 04 10:28:30 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-b58b1564-2479-45f7-8b3e-f0910f649f46 tempest-CreateVolumesFromSnapshotTest-696580006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-9eec778b-8b1d-4fbb-bd3d-20069629b2a9" returned: 0 in 0.368s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:28:30 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-b58b1564-2479-45f7-8b3e-f0910f649f46 tempest-CreateVolumesFromSnapshotTest-696580006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-9eec778b-8b1d-4fbb-bd3d-20069629b2a9 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:28:30 devstack sudo[103802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-9eec778b-8b1d-4fbb-bd3d-20069629b2a9 Nov 04 10:28:30 devstack sudo[103802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:28:30 devstack sudo[103793]: pam_unix(sudo:session): session closed for user root Nov 04 10:28:30 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-1aa0d34c-bc24-4ca7-b904-d54778652886 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-d390f32a-1fca-4d05-956d-128905883764 1073741824" returned: 0 in 0.439s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:28:30 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-1aa0d34c-bc24-4ca7-b904-d54778652886 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-d390f32a-1fca-4d05-956d-128905883764 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:28:30 devstack sudo[103805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-d390f32a-1fca-4d05-956d-128905883764 Nov 04 10:28:30 devstack sudo[103805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:28:30 devstack sudo[103802]: pam_unix(sudo:session): session closed for user root Nov 04 10:28:30 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-b58b1564-2479-45f7-8b3e-f0910f649f46 tempest-CreateVolumesFromSnapshotTest-696580006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-9eec778b-8b1d-4fbb-bd3d-20069629b2a9" returned: 0 in 0.279s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:28:30 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-b58b1564-2479-45f7-8b3e-f0910f649f46 tempest-CreateVolumesFromSnapshotTest-696580006 None] Lock "cinder-quobyte-9eec778b-8b1d-4fbb-bd3d-20069629b2a9" released by "delete_volume" :: held 0.739s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:28:30 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-b58b1564-2479-45f7-8b3e-f0910f649f46 tempest-CreateVolumesFromSnapshotTest-696580006 None] Created reservations ['3e4ae945-cae7-42a4-9ac0-0737feb808b1', 'ae7bc70b-b885-422b-a85c-c222c8622d40', 'f12c8952-71ad-4075-abf4-b8fcdd6c8edf', '5f906f84-a12a-4215-a53e-2ba17e145bcf'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:28:30 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-b58b1564-2479-45f7-8b3e-f0910f649f46 tempest-CreateVolumesFromSnapshotTest-696580006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:28:30 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-b58b1564-2479-45f7-8b3e-f0910f649f46 tempest-CreateVolumesFromSnapshotTest-696580006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:28:30 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-b58b1564-2479-45f7-8b3e-f0910f649f46 tempest-CreateVolumesFromSnapshotTest-696580006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:28:30 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-b58b1564-2479-45f7-8b3e-f0910f649f46 tempest-CreateVolumesFromSnapshotTest-696580006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:28:30 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-b58b1564-2479-45f7-8b3e-f0910f649f46 tempest-CreateVolumesFromSnapshotTest-696580006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:28:30 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-b58b1564-2479-45f7-8b3e-f0910f649f46 tempest-CreateVolumesFromSnapshotTest-696580006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:28:30 devstack sudo[103805]: pam_unix(sudo:session): session closed for user root Nov 04 10:28:30 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-1aa0d34c-bc24-4ca7-b904-d54778652886 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-d390f32a-1fca-4d05-956d-128905883764" returned: 0 in 0.262s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:28:30 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-1aa0d34c-bc24-4ca7-b904-d54778652886 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] <== create_volume: return (741ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 10:28:30 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-1aa0d34c-bc24-4ca7-b904-d54778652886 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.745s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:28:30 devstack sudo[103809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:28:30 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-076544c8-a78d-4c5d-9f9f-8e0780614238 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.768s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:28:30 devstack sudo[103809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:28:30 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-076544c8-a78d-4c5d-9f9f-8e0780614238 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:28:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-424540589',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c8c25d6-9dc1-4e5e-81e5-414c145dd941,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='942ec90965b7433ca1215d2d209866f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:28:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:28:29Z,use_quota=True,user_id='c8b8f44164914cac98edde16797983c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 10:28:30 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-076544c8-a78d-4c5d-9f9f-8e0780614238 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Creating volume 5c8c25d6-9dc1-4e5e-81e5-414c145dd941 {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:28:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-076544c8-a78d-4c5d-9f9f-8e0780614238 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:28:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-076544c8-a78d-4c5d-9f9f-8e0780614238 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:28:31 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-076544c8-a78d-4c5d-9f9f-8e0780614238 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:28:31 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-076544c8-a78d-4c5d-9f9f-8e0780614238 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:28:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-076544c8-a78d-4c5d-9f9f-8e0780614238 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:28:31 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-076544c8-a78d-4c5d-9f9f-8e0780614238 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Selected osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:28:31 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-076544c8-a78d-4c5d-9f9f-8e0780614238 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] casted to osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 Nov 04 10:28:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-076544c8-a78d-4c5d-9f9f-8e0780614238 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-5c8c25d6-9dc1-4e5e-81e5-414c145dd941 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:28:31 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1aa0d34c-bc24-4ca7-b904-d54778652886 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a52070f8-9846-4d73-bde3-ac441b00a457) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d390f32a-1fca-4d05-956d-128905883764', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:28:31 devstack sudo[103811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-5c8c25d6-9dc1-4e5e-81e5-414c145dd941 1073741824 Nov 04 10:28:31 devstack sudo[103811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:28:31 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1aa0d34c-bc24-4ca7-b904-d54778652886 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b184b227-9e3e-47b7-bb6a-cd77b914c84e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:28:31 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-1aa0d34c-bc24-4ca7-b904-d54778652886 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Volume volume-d390f32a-1fca-4d05-956d-128905883764 (d390f32a-1fca-4d05-956d-128905883764): created successfully Nov 04 10:28:31 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1aa0d34c-bc24-4ca7-b904-d54778652886 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b184b227-9e3e-47b7-bb6a-cd77b914c84e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:28:31 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1aa0d34c-bc24-4ca7-b904-d54778652886 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Flow 'volume_create_manager' (4c934436-69a1-4846-801f-03ae614f7abe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:28:31 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-1aa0d34c-bc24-4ca7-b904-d54778652886 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Created volume successfully. Nov 04 10:28:31 devstack sudo[103809]: pam_unix(sudo:session): session closed for user root Nov 04 10:28:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-b58b1564-2479-45f7-8b3e-f0910f649f46 tempest-CreateVolumesFromSnapshotTest-696580006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.255s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:28:31 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-b58b1564-2479-45f7-8b3e-f0910f649f46 tempest-CreateVolumesFromSnapshotTest-696580006 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:28:31 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-b58b1564-2479-45f7-8b3e-f0910f649f46 tempest-CreateVolumesFromSnapshotTest-696580006 None] Deleted volume successfully. Nov 04 10:28:31 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-b58b1564-2479-45f7-8b3e-f0910f649f46 tempest-CreateVolumesFromSnapshotTest-696580006 None] Lock "cinder-9eec778b-8b1d-4fbb-bd3d-20069629b2a9-delete_volume" released by "delete_volume" :: held 1.220s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:28:31 devstack sudo[103811]: pam_unix(sudo:session): session closed for user root Nov 04 10:28:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-076544c8-a78d-4c5d-9f9f-8e0780614238 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-5c8c25d6-9dc1-4e5e-81e5-414c145dd941 1073741824" returned: 0 in 0.514s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:28:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-076544c8-a78d-4c5d-9f9f-8e0780614238 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-5c8c25d6-9dc1-4e5e-81e5-414c145dd941 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:28:31 devstack sudo[103818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-5c8c25d6-9dc1-4e5e-81e5-414c145dd941 Nov 04 10:28:31 devstack sudo[103818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:28:31 devstack sudo[103818]: pam_unix(sudo:session): session closed for user root Nov 04 10:28:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-076544c8-a78d-4c5d-9f9f-8e0780614238 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-5c8c25d6-9dc1-4e5e-81e5-414c145dd941" returned: 0 in 0.265s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:28:31 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-076544c8-a78d-4c5d-9f9f-8e0780614238 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] <== create_volume: return (966ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 10:28:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-076544c8-a78d-4c5d-9f9f-8e0780614238 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.970s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:28:31 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-076544c8-a78d-4c5d-9f9f-8e0780614238 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d14c079-5504-433f-a12d-4d4ed28deaae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c8c25d6-9dc1-4e5e-81e5-414c145dd941', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:28:31 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-076544c8-a78d-4c5d-9f9f-8e0780614238 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23a71c95-4b09-490f-8a3f-0869cbab1526) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:28:32 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-076544c8-a78d-4c5d-9f9f-8e0780614238 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Volume volume-5c8c25d6-9dc1-4e5e-81e5-414c145dd941 (5c8c25d6-9dc1-4e5e-81e5-414c145dd941): created successfully Nov 04 10:28:32 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-076544c8-a78d-4c5d-9f9f-8e0780614238 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23a71c95-4b09-490f-8a3f-0869cbab1526) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:28:32 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-076544c8-a78d-4c5d-9f9f-8e0780614238 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Flow 'volume_create_manager' (21ebfcc1-1323-49ee-aa6a-c8f5780b6321) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:28:32 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-076544c8-a78d-4c5d-9f9f-8e0780614238 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Created volume successfully. Nov 04 10:28:32 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-a8e97f97-1a87-4b42-9f3e-cf6eaa89ec73 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Acquiring lock "cinder-5c8c25d6-9dc1-4e5e-81e5-414c145dd941-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:28:32 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-a8e97f97-1a87-4b42-9f3e-cf6eaa89ec73 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Lock "cinder-5c8c25d6-9dc1-4e5e-81e5-414c145dd941-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:28:32 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-a8e97f97-1a87-4b42-9f3e-cf6eaa89ec73 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Acquiring lock "cinder-quobyte-5c8c25d6-9dc1-4e5e-81e5-414c145dd941" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:28:32 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-a8e97f97-1a87-4b42-9f3e-cf6eaa89ec73 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Lock "cinder-quobyte-5c8c25d6-9dc1-4e5e-81e5-414c145dd941" acquired by "delete_volume" :: waited 0.022s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:28:32 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c1aa5f3-6b77-45f6-8f64-2e65899e3fb3]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:28:32 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-a8e97f97-1a87-4b42-9f3e-cf6eaa89ec73 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-5c8c25d6-9dc1-4e5e-81e5-414c145dd941 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:28:32 devstack sudo[103821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-5c8c25d6-9dc1-4e5e-81e5-414c145dd941 Nov 04 10:28:32 devstack sudo[103821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:28:33 devstack sudo[103821]: pam_unix(sudo:session): session closed for user root Nov 04 10:28:33 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-a8e97f97-1a87-4b42-9f3e-cf6eaa89ec73 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-5c8c25d6-9dc1-4e5e-81e5-414c145dd941" returned: 0 in 0.402s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:28:33 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-a8e97f97-1a87-4b42-9f3e-cf6eaa89ec73 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-5c8c25d6-9dc1-4e5e-81e5-414c145dd941 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:28:33 devstack sudo[103827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-5c8c25d6-9dc1-4e5e-81e5-414c145dd941 Nov 04 10:28:33 devstack sudo[103827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:28:33 devstack sudo[103827]: pam_unix(sudo:session): session closed for user root Nov 04 10:28:33 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-a8e97f97-1a87-4b42-9f3e-cf6eaa89ec73 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-5c8c25d6-9dc1-4e5e-81e5-414c145dd941" returned: 0 in 0.262s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:28:33 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-a8e97f97-1a87-4b42-9f3e-cf6eaa89ec73 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Lock "cinder-quobyte-5c8c25d6-9dc1-4e5e-81e5-414c145dd941" released by "delete_volume" :: held 0.708s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:28:33 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-a8e97f97-1a87-4b42-9f3e-cf6eaa89ec73 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Created reservations ['bd91f507-00fd-4199-a93d-1600ba015b62', '4ad3df76-253a-486a-bc7f-02e37aa328f4', '59c43d38-dcbd-4cb3-b6f4-9fc6a43c9dbd', 'd86fbb29-eef6-4131-92a9-5b14c3e7eea7'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:28:33 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-a8e97f97-1a87-4b42-9f3e-cf6eaa89ec73 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:28:33 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-a8e97f97-1a87-4b42-9f3e-cf6eaa89ec73 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:28:33 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-a8e97f97-1a87-4b42-9f3e-cf6eaa89ec73 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:28:33 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-a8e97f97-1a87-4b42-9f3e-cf6eaa89ec73 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:28:33 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-a8e97f97-1a87-4b42-9f3e-cf6eaa89ec73 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:28:33 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-a8e97f97-1a87-4b42-9f3e-cf6eaa89ec73 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:28:33 devstack sudo[103830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:28:33 devstack sudo[103830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:28:33 devstack sudo[103830]: pam_unix(sudo:session): session closed for user root Nov 04 10:28:33 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-a8e97f97-1a87-4b42-9f3e-cf6eaa89ec73 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.254s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:28:33 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-a8e97f97-1a87-4b42-9f3e-cf6eaa89ec73 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:28:33 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-a8e97f97-1a87-4b42-9f3e-cf6eaa89ec73 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Deleted volume successfully. Nov 04 10:28:33 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-b4265857-ce23-4aad-9f11-190b374d9968 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Acquiring lock "cinder-d390f32a-1fca-4d05-956d-128905883764-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:28:33 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-a8e97f97-1a87-4b42-9f3e-cf6eaa89ec73 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Lock "cinder-5c8c25d6-9dc1-4e5e-81e5-414c145dd941-delete_volume" released by "delete_volume" :: held 1.202s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:28:33 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-b4265857-ce23-4aad-9f11-190b374d9968 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Lock "cinder-d390f32a-1fca-4d05-956d-128905883764-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:28:33 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-b4265857-ce23-4aad-9f11-190b374d9968 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Acquiring lock "cinder-quobyte-d390f32a-1fca-4d05-956d-128905883764" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:28:33 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-b4265857-ce23-4aad-9f11-190b374d9968 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Lock "cinder-quobyte-d390f32a-1fca-4d05-956d-128905883764" acquired by "delete_volume" :: waited 0.021s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:28:33 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cc3d3df-b6f4-44b6-8039-fb50a2c7c412]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:28:33 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-b4265857-ce23-4aad-9f11-190b374d9968 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-d390f32a-1fca-4d05-956d-128905883764 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:28:34 devstack sudo[103833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-d390f32a-1fca-4d05-956d-128905883764 Nov 04 10:28:34 devstack sudo[103833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:28:34 devstack sudo[103833]: pam_unix(sudo:session): session closed for user root Nov 04 10:28:34 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-b4265857-ce23-4aad-9f11-190b374d9968 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-d390f32a-1fca-4d05-956d-128905883764" returned: 0 in 0.408s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:28:34 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-b4265857-ce23-4aad-9f11-190b374d9968 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-d390f32a-1fca-4d05-956d-128905883764 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:28:34 devstack sudo[103839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-d390f32a-1fca-4d05-956d-128905883764 Nov 04 10:28:34 devstack sudo[103839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:28:34 devstack sudo[103839]: pam_unix(sudo:session): session closed for user root Nov 04 10:28:34 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-b4265857-ce23-4aad-9f11-190b374d9968 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-d390f32a-1fca-4d05-956d-128905883764" returned: 0 in 0.268s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:28:34 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-b4265857-ce23-4aad-9f11-190b374d9968 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Lock "cinder-quobyte-d390f32a-1fca-4d05-956d-128905883764" released by "delete_volume" :: held 0.721s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:28:34 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-b4265857-ce23-4aad-9f11-190b374d9968 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Created reservations ['a3d7c1ab-571c-4295-ad5c-60375852907e', 'b0d17d39-34a5-4c51-9286-b53c6be97341', '1ff85a27-1684-4132-8d82-62bf673e5b49', '551dfc5a-85f6-4f00-8478-6470630ed75b'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:28:34 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-b4265857-ce23-4aad-9f11-190b374d9968 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:28:34 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-b4265857-ce23-4aad-9f11-190b374d9968 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:28:34 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-b4265857-ce23-4aad-9f11-190b374d9968 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:28:34 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-b4265857-ce23-4aad-9f11-190b374d9968 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:28:34 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-b4265857-ce23-4aad-9f11-190b374d9968 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:28:34 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-b4265857-ce23-4aad-9f11-190b374d9968 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:28:34 devstack sudo[103842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:28:34 devstack sudo[103842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:28:34 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5c68f1a-1ada-4d75-a431-f8d2c061b24e tempest-ProjectReaderTests-1176210283 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:28:34 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-f5c68f1a-1ada-4d75-a431-f8d2c061b24e tempest-ProjectReaderTests-1176210283 None] Flow 'volume_create_manager' (c7c37401-36c5-4152-96ff-c7d6459d92b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:28:34 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-f5c68f1a-1ada-4d75-a431-f8d2c061b24e tempest-ProjectReaderTests-1176210283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab6855d5-8403-4b1e-a675-67ca18ac4006) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:28:34 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-f5c68f1a-1ada-4d75-a431-f8d2c061b24e tempest-ProjectReaderTests-1176210283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab6855d5-8403-4b1e-a675-67ca18ac4006) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:28:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-165601890',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01b92de6-f1f6-42b0-8077-194e5ac27b33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d7b925f2c9a4971b5a7fd86e7890800',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:28:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:28:35Z,use_quota=True,user_id='7d778d0ba27a49d5b24046ba9edd8bc6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:28:34 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-f5c68f1a-1ada-4d75-a431-f8d2c061b24e tempest-ProjectReaderTests-1176210283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9f0e936-ecfe-4583-aea2-c830968ebea3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:28:34 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-f5c68f1a-1ada-4d75-a431-f8d2c061b24e tempest-ProjectReaderTests-1176210283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9f0e936-ecfe-4583-aea2-c830968ebea3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:28:34 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-f5c68f1a-1ada-4d75-a431-f8d2c061b24e tempest-ProjectReaderTests-1176210283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eadd63c1-475d-4fe9-884d-67f13493f034) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:28:34 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-f5c68f1a-1ada-4d75-a431-f8d2c061b24e tempest-ProjectReaderTests-1176210283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eadd63c1-475d-4fe9-884d-67f13493f034) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '01b92de6-f1f6-42b0-8077-194e5ac27b33', 'volume_name': 'volume-01b92de6-f1f6-42b0-8077-194e5ac27b33', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:28:35 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-f5c68f1a-1ada-4d75-a431-f8d2c061b24e tempest-ProjectReaderTests-1176210283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5aa389e-9276-4a6f-b6d7-7df9a8067d5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:28:35 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-f5c68f1a-1ada-4d75-a431-f8d2c061b24e tempest-ProjectReaderTests-1176210283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5aa389e-9276-4a6f-b6d7-7df9a8067d5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:28:35 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-f5c68f1a-1ada-4d75-a431-f8d2c061b24e tempest-ProjectReaderTests-1176210283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47507e81-f547-4da9-aa36-bb57be3381c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:28:35 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-f5c68f1a-1ada-4d75-a431-f8d2c061b24e tempest-ProjectReaderTests-1176210283 None] Volume 01b92de6-f1f6-42b0-8077-194e5ac27b33: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-01b92de6-f1f6-42b0-8077-194e5ac27b33', 'volume_size': 1} Nov 04 10:28:35 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-f5c68f1a-1ada-4d75-a431-f8d2c061b24e tempest-ProjectReaderTests-1176210283 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:28:35 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-f5c68f1a-1ada-4d75-a431-f8d2c061b24e tempest-ProjectReaderTests-1176210283 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:28:35 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-f5c68f1a-1ada-4d75-a431-f8d2c061b24e tempest-ProjectReaderTests-1176210283 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:28:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-165601890',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01b92de6-f1f6-42b0-8077-194e5ac27b33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d7b925f2c9a4971b5a7fd86e7890800',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:28:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:28:35Z,use_quota=True,user_id='7d778d0ba27a49d5b24046ba9edd8bc6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 10:28:35 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-f5c68f1a-1ada-4d75-a431-f8d2c061b24e tempest-ProjectReaderTests-1176210283 None] Creating volume 01b92de6-f1f6-42b0-8077-194e5ac27b33 {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:28:35 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-f5c68f1a-1ada-4d75-a431-f8d2c061b24e tempest-ProjectReaderTests-1176210283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:28:35 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-f5c68f1a-1ada-4d75-a431-f8d2c061b24e tempest-ProjectReaderTests-1176210283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:28:35 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-f5c68f1a-1ada-4d75-a431-f8d2c061b24e tempest-ProjectReaderTests-1176210283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:28:35 devstack sudo[103842]: pam_unix(sudo:session): session closed for user root Nov 04 10:28:35 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-f5c68f1a-1ada-4d75-a431-f8d2c061b24e tempest-ProjectReaderTests-1176210283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:28:35 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-f5c68f1a-1ada-4d75-a431-f8d2c061b24e tempest-ProjectReaderTests-1176210283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:28:35 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-f5c68f1a-1ada-4d75-a431-f8d2c061b24e tempest-ProjectReaderTests-1176210283 None] Selected osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:28:35 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-f5c68f1a-1ada-4d75-a431-f8d2c061b24e tempest-ProjectReaderTests-1176210283 None] casted to osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 Nov 04 10:28:35 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f5c68f1a-1ada-4d75-a431-f8d2c061b24e tempest-ProjectReaderTests-1176210283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-01b92de6-f1f6-42b0-8077-194e5ac27b33 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:28:35 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-4c52700f-2127-433d-9c71-f15c4aefe3f7 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Acquiring lock "cinder-b2896646-c33f-4a82-9251-91d11942df4b-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:28:35 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-b4265857-ce23-4aad-9f11-190b374d9968 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.279s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:28:35 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-b4265857-ce23-4aad-9f11-190b374d9968 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:28:35 devstack sudo[103845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-01b92de6-f1f6-42b0-8077-194e5ac27b33 1073741824 Nov 04 10:28:35 devstack sudo[103845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:28:35 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-b4265857-ce23-4aad-9f11-190b374d9968 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Deleted volume successfully. Nov 04 10:28:35 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-4c52700f-2127-433d-9c71-f15c4aefe3f7 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Lock "cinder-b2896646-c33f-4a82-9251-91d11942df4b-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:28:35 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-b4265857-ce23-4aad-9f11-190b374d9968 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Lock "cinder-d390f32a-1fca-4d05-956d-128905883764-delete_volume" released by "delete_volume" :: held 1.261s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:28:35 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-4c52700f-2127-433d-9c71-f15c4aefe3f7 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Acquiring lock "cinder-quobyte-b2896646-c33f-4a82-9251-91d11942df4b" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:28:35 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-4c52700f-2127-433d-9c71-f15c4aefe3f7 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Lock "cinder-quobyte-b2896646-c33f-4a82-9251-91d11942df4b" acquired by "delete_volume" :: waited 0.013s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:28:35 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[27e6639e-57a7-4e3b-bf8c-3dd74e30e6c5]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:28:35 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-4c52700f-2127-433d-9c71-f15c4aefe3f7 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b2896646-c33f-4a82-9251-91d11942df4b {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:28:35 devstack sudo[103847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b2896646-c33f-4a82-9251-91d11942df4b Nov 04 10:28:35 devstack sudo[103847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:28:35 devstack sudo[103845]: pam_unix(sudo:session): session closed for user root Nov 04 10:28:35 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f5c68f1a-1ada-4d75-a431-f8d2c061b24e tempest-ProjectReaderTests-1176210283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-01b92de6-f1f6-42b0-8077-194e5ac27b33 1073741824" returned: 0 in 0.450s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:28:35 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f5c68f1a-1ada-4d75-a431-f8d2c061b24e tempest-ProjectReaderTests-1176210283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-01b92de6-f1f6-42b0-8077-194e5ac27b33 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:28:35 devstack sudo[103854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-01b92de6-f1f6-42b0-8077-194e5ac27b33 Nov 04 10:28:35 devstack sudo[103854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:28:35 devstack sudo[103847]: pam_unix(sudo:session): session closed for user root Nov 04 10:28:35 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-4c52700f-2127-433d-9c71-f15c4aefe3f7 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b2896646-c33f-4a82-9251-91d11942df4b" returned: 0 in 0.440s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:28:35 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-4c52700f-2127-433d-9c71-f15c4aefe3f7 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b2896646-c33f-4a82-9251-91d11942df4b {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:28:35 devstack sudo[103857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b2896646-c33f-4a82-9251-91d11942df4b Nov 04 10:28:35 devstack sudo[103857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:28:35 devstack sudo[103854]: pam_unix(sudo:session): session closed for user root Nov 04 10:28:35 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f5c68f1a-1ada-4d75-a431-f8d2c061b24e tempest-ProjectReaderTests-1176210283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-01b92de6-f1f6-42b0-8077-194e5ac27b33" returned: 0 in 0.264s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:28:35 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-f5c68f1a-1ada-4d75-a431-f8d2c061b24e tempest-ProjectReaderTests-1176210283 None] <== create_volume: return (757ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 10:28:35 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-f5c68f1a-1ada-4d75-a431-f8d2c061b24e tempest-ProjectReaderTests-1176210283 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.760s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:28:35 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-f5c68f1a-1ada-4d75-a431-f8d2c061b24e tempest-ProjectReaderTests-1176210283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47507e81-f547-4da9-aa36-bb57be3381c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01b92de6-f1f6-42b0-8077-194e5ac27b33', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:28:35 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-f5c68f1a-1ada-4d75-a431-f8d2c061b24e tempest-ProjectReaderTests-1176210283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68128ba4-d0ee-4aab-90c9-bb16e840dc39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:28:35 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-f5c68f1a-1ada-4d75-a431-f8d2c061b24e tempest-ProjectReaderTests-1176210283 None] Volume volume-01b92de6-f1f6-42b0-8077-194e5ac27b33 (01b92de6-f1f6-42b0-8077-194e5ac27b33): created successfully Nov 04 10:28:35 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-f5c68f1a-1ada-4d75-a431-f8d2c061b24e tempest-ProjectReaderTests-1176210283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68128ba4-d0ee-4aab-90c9-bb16e840dc39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:28:35 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-f5c68f1a-1ada-4d75-a431-f8d2c061b24e tempest-ProjectReaderTests-1176210283 None] Flow 'volume_create_manager' (c7c37401-36c5-4152-96ff-c7d6459d92b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:28:35 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-f5c68f1a-1ada-4d75-a431-f8d2c061b24e tempest-ProjectReaderTests-1176210283 None] Created volume successfully. Nov 04 10:28:35 devstack sudo[103857]: pam_unix(sudo:session): session closed for user root Nov 04 10:28:35 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-4c52700f-2127-433d-9c71-f15c4aefe3f7 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b2896646-c33f-4a82-9251-91d11942df4b" returned: 0 in 0.279s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:28:35 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-4c52700f-2127-433d-9c71-f15c4aefe3f7 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Lock "cinder-quobyte-b2896646-c33f-4a82-9251-91d11942df4b" released by "delete_volume" :: held 0.760s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:28:35 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-4c52700f-2127-433d-9c71-f15c4aefe3f7 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Created reservations ['a05f8154-5ea0-4408-a805-a57ee6410d1d', '5716951c-8bbb-4bb4-9661-ae43c04fdc7a', '055f9d40-cb07-4749-8412-ce7d1a9be083', '544adeb8-64e6-47a8-8640-4396ff8326a1'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:28:35 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-4c52700f-2127-433d-9c71-f15c4aefe3f7 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:28:35 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-4c52700f-2127-433d-9c71-f15c4aefe3f7 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:28:35 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-4c52700f-2127-433d-9c71-f15c4aefe3f7 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:28:35 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-4c52700f-2127-433d-9c71-f15c4aefe3f7 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:28:35 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-4c52700f-2127-433d-9c71-f15c4aefe3f7 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:28:36 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-4c52700f-2127-433d-9c71-f15c4aefe3f7 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:28:36 devstack sudo[103861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:28:36 devstack sudo[103861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:28:36 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-279d5976-5839-4b6b-9606-d5951637ab54 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Acquiring lock "cinder-b13ff762-d220-4cf1-a6de-94b0020b7afc-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:28:36 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-279d5976-5839-4b6b-9606-d5951637ab54 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Lock "cinder-b13ff762-d220-4cf1-a6de-94b0020b7afc-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:28:36 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-279d5976-5839-4b6b-9606-d5951637ab54 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Acquiring lock "cinder-quobyte-b13ff762-d220-4cf1-a6de-94b0020b7afc" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:28:36 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-279d5976-5839-4b6b-9606-d5951637ab54 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Lock "cinder-quobyte-b13ff762-d220-4cf1-a6de-94b0020b7afc" acquired by "delete_volume" :: waited 0.019s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:28:36 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[bca6b3aa-bd7b-4f87-b399-8c8814099e0a]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:28:36 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-279d5976-5839-4b6b-9606-d5951637ab54 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b13ff762-d220-4cf1-a6de-94b0020b7afc {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:28:36 devstack sudo[103861]: pam_unix(sudo:session): session closed for user root Nov 04 10:28:36 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-4c52700f-2127-433d-9c71-f15c4aefe3f7 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.283s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:28:36 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-4c52700f-2127-433d-9c71-f15c4aefe3f7 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:28:36 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-4c52700f-2127-433d-9c71-f15c4aefe3f7 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Deleted volume successfully. Nov 04 10:28:36 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-4c52700f-2127-433d-9c71-f15c4aefe3f7 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Lock "cinder-b2896646-c33f-4a82-9251-91d11942df4b-delete_volume" released by "delete_volume" :: held 1.241s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:28:36 devstack sudo[103864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b13ff762-d220-4cf1-a6de-94b0020b7afc Nov 04 10:28:36 devstack sudo[103864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:28:36 devstack sudo[103864]: pam_unix(sudo:session): session closed for user root Nov 04 10:28:36 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-279d5976-5839-4b6b-9606-d5951637ab54 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b13ff762-d220-4cf1-a6de-94b0020b7afc" returned: 0 in 0.376s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:28:36 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-279d5976-5839-4b6b-9606-d5951637ab54 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b13ff762-d220-4cf1-a6de-94b0020b7afc {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:28:36 devstack sudo[103869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b13ff762-d220-4cf1-a6de-94b0020b7afc Nov 04 10:28:36 devstack sudo[103869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:28:36 devstack sudo[103869]: pam_unix(sudo:session): session closed for user root Nov 04 10:28:36 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-279d5976-5839-4b6b-9606-d5951637ab54 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b13ff762-d220-4cf1-a6de-94b0020b7afc" returned: 0 in 0.263s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:28:36 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-279d5976-5839-4b6b-9606-d5951637ab54 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Lock "cinder-quobyte-b13ff762-d220-4cf1-a6de-94b0020b7afc" released by "delete_volume" :: held 0.690s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:28:36 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-279d5976-5839-4b6b-9606-d5951637ab54 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Created reservations ['387fb6fa-e82a-4783-852b-0b481b65bdb1', 'bce4196e-638d-4cc7-8fc0-c41696653043', 'c00b411a-77d4-4228-8641-6e66101dc077', '4e6200ea-3ebc-483f-805f-ef16ca264de2'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:28:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-279d5976-5839-4b6b-9606-d5951637ab54 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:28:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-279d5976-5839-4b6b-9606-d5951637ab54 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:28:37 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-279d5976-5839-4b6b-9606-d5951637ab54 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:28:37 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-279d5976-5839-4b6b-9606-d5951637ab54 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:28:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-279d5976-5839-4b6b-9606-d5951637ab54 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:28:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-279d5976-5839-4b6b-9606-d5951637ab54 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:28:37 devstack sudo[103872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:28:37 devstack sudo[103872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:28:37 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-390d0098-3ba6-43b5-8a25-f37a9032234f tempest-ProjectReaderTests-1176210283 None] Acquiring lock "cinder-01b92de6-f1f6-42b0-8077-194e5ac27b33-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:28:37 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-390d0098-3ba6-43b5-8a25-f37a9032234f tempest-ProjectReaderTests-1176210283 None] Lock "cinder-01b92de6-f1f6-42b0-8077-194e5ac27b33-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:28:37 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-390d0098-3ba6-43b5-8a25-f37a9032234f tempest-ProjectReaderTests-1176210283 None] Acquiring lock "cinder-quobyte-01b92de6-f1f6-42b0-8077-194e5ac27b33" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:28:37 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-390d0098-3ba6-43b5-8a25-f37a9032234f tempest-ProjectReaderTests-1176210283 None] Lock "cinder-quobyte-01b92de6-f1f6-42b0-8077-194e5ac27b33" acquired by "delete_volume" :: waited 0.026s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:28:37 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[34a448a1-a43f-44fa-8107-e866a61439a1]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:28:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-390d0098-3ba6-43b5-8a25-f37a9032234f tempest-ProjectReaderTests-1176210283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-01b92de6-f1f6-42b0-8077-194e5ac27b33 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:28:37 devstack sudo[103872]: pam_unix(sudo:session): session closed for user root Nov 04 10:28:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-279d5976-5839-4b6b-9606-d5951637ab54 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.264s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:28:37 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-279d5976-5839-4b6b-9606-d5951637ab54 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:28:37 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-279d5976-5839-4b6b-9606-d5951637ab54 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Deleted volume successfully. Nov 04 10:28:37 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-583b1813-64bb-4f8a-bcb2-5a85ede9346d tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Acquiring lock "cinder-59bc5b65-8a33-4cb9-a3be-7e1fc225def6-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:28:37 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-583b1813-64bb-4f8a-bcb2-5a85ede9346d tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Lock "cinder-59bc5b65-8a33-4cb9-a3be-7e1fc225def6-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:28:37 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-279d5976-5839-4b6b-9606-d5951637ab54 tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Lock "cinder-b13ff762-d220-4cf1-a6de-94b0020b7afc-delete_volume" released by "delete_volume" :: held 1.204s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:28:37 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-583b1813-64bb-4f8a-bcb2-5a85ede9346d tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Acquiring lock "cinder-quobyte-59bc5b65-8a33-4cb9-a3be-7e1fc225def6" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:28:37 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-583b1813-64bb-4f8a-bcb2-5a85ede9346d tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Lock "cinder-quobyte-59bc5b65-8a33-4cb9-a3be-7e1fc225def6" acquired by "delete_volume" :: waited 0.019s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:28:37 devstack sudo[103875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-01b92de6-f1f6-42b0-8077-194e5ac27b33 Nov 04 10:28:37 devstack sudo[103875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:28:37 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[aee67a37-7c63-45d2-85fc-0469db6f5f0d]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:28:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-583b1813-64bb-4f8a-bcb2-5a85ede9346d tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-59bc5b65-8a33-4cb9-a3be-7e1fc225def6 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:28:37 devstack sudo[103877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-59bc5b65-8a33-4cb9-a3be-7e1fc225def6 Nov 04 10:28:37 devstack sudo[103877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:28:37 devstack sudo[103875]: pam_unix(sudo:session): session closed for user root Nov 04 10:28:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-390d0098-3ba6-43b5-8a25-f37a9032234f tempest-ProjectReaderTests-1176210283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-01b92de6-f1f6-42b0-8077-194e5ac27b33" returned: 0 in 0.389s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:28:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-390d0098-3ba6-43b5-8a25-f37a9032234f tempest-ProjectReaderTests-1176210283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-01b92de6-f1f6-42b0-8077-194e5ac27b33 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:28:37 devstack sudo[103882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-01b92de6-f1f6-42b0-8077-194e5ac27b33 Nov 04 10:28:37 devstack sudo[103882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:28:37 devstack sudo[103877]: pam_unix(sudo:session): session closed for user root Nov 04 10:28:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-583b1813-64bb-4f8a-bcb2-5a85ede9346d tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-59bc5b65-8a33-4cb9-a3be-7e1fc225def6" returned: 0 in 0.396s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:28:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-583b1813-64bb-4f8a-bcb2-5a85ede9346d tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-59bc5b65-8a33-4cb9-a3be-7e1fc225def6 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:28:37 devstack sudo[103887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-59bc5b65-8a33-4cb9-a3be-7e1fc225def6 Nov 04 10:28:37 devstack sudo[103887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:28:37 devstack sudo[103882]: pam_unix(sudo:session): session closed for user root Nov 04 10:28:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-390d0098-3ba6-43b5-8a25-f37a9032234f tempest-ProjectReaderTests-1176210283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-01b92de6-f1f6-42b0-8077-194e5ac27b33" returned: 0 in 0.263s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:28:37 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-390d0098-3ba6-43b5-8a25-f37a9032234f tempest-ProjectReaderTests-1176210283 None] Lock "cinder-quobyte-01b92de6-f1f6-42b0-8077-194e5ac27b33" released by "delete_volume" :: held 0.721s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:28:38 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-390d0098-3ba6-43b5-8a25-f37a9032234f tempest-ProjectReaderTests-1176210283 None] Created reservations ['cbb71454-4ed8-43fa-9323-e3c3d5900aca', '7f250836-fcfb-493f-8b50-44750ebf883c', 'dd013ad6-d287-41d1-8fb3-c26d9d82f6eb', '8bb82a5c-92e8-42f2-b4f3-f9b7b1af0eee'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:28:38 devstack sudo[103887]: pam_unix(sudo:session): session closed for user root Nov 04 10:28:38 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-583b1813-64bb-4f8a-bcb2-5a85ede9346d tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-59bc5b65-8a33-4cb9-a3be-7e1fc225def6" returned: 0 in 0.250s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:28:38 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-583b1813-64bb-4f8a-bcb2-5a85ede9346d tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Lock "cinder-quobyte-59bc5b65-8a33-4cb9-a3be-7e1fc225def6" released by "delete_volume" :: held 0.694s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:28:38 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-390d0098-3ba6-43b5-8a25-f37a9032234f tempest-ProjectReaderTests-1176210283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:28:38 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-390d0098-3ba6-43b5-8a25-f37a9032234f tempest-ProjectReaderTests-1176210283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:28:38 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-390d0098-3ba6-43b5-8a25-f37a9032234f tempest-ProjectReaderTests-1176210283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:28:38 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-390d0098-3ba6-43b5-8a25-f37a9032234f tempest-ProjectReaderTests-1176210283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:28:38 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-390d0098-3ba6-43b5-8a25-f37a9032234f tempest-ProjectReaderTests-1176210283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:28:38 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-390d0098-3ba6-43b5-8a25-f37a9032234f tempest-ProjectReaderTests-1176210283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:28:38 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-583b1813-64bb-4f8a-bcb2-5a85ede9346d tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Created reservations ['33925cf3-fd08-4498-81e3-d125cac09bab', 'd11a0315-0455-4362-8f41-37f2d7ddabd1', 'dae6830c-85d9-4e46-8ca5-f7da097463a3', '9c678623-0af4-40b0-8bad-18f3633bf319'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:28:38 devstack sudo[103891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:28:38 devstack sudo[103891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:28:38 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-583b1813-64bb-4f8a-bcb2-5a85ede9346d tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:28:38 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-583b1813-64bb-4f8a-bcb2-5a85ede9346d tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:28:38 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-583b1813-64bb-4f8a-bcb2-5a85ede9346d tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:28:38 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-583b1813-64bb-4f8a-bcb2-5a85ede9346d tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:28:38 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-583b1813-64bb-4f8a-bcb2-5a85ede9346d tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:28:38 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-583b1813-64bb-4f8a-bcb2-5a85ede9346d tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:28:38 devstack sudo[103893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:28:38 devstack sudo[103893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:28:38 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-2ba6bbf7-0b1b-4188-8331-44d352c9854d tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Acquiring lock "cinder-80af2632-ff4e-4148-b84b-a6893bb8732a-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:28:38 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-2ba6bbf7-0b1b-4188-8331-44d352c9854d tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Lock "cinder-80af2632-ff4e-4148-b84b-a6893bb8732a-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:28:38 devstack sudo[103891]: pam_unix(sudo:session): session closed for user root Nov 04 10:28:38 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-390d0098-3ba6-43b5-8a25-f37a9032234f tempest-ProjectReaderTests-1176210283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.351s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:28:38 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-390d0098-3ba6-43b5-8a25-f37a9032234f tempest-ProjectReaderTests-1176210283 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:28:38 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-390d0098-3ba6-43b5-8a25-f37a9032234f tempest-ProjectReaderTests-1176210283 None] Deleted volume successfully. Nov 04 10:28:38 devstack sudo[103893]: pam_unix(sudo:session): session closed for user root Nov 04 10:28:38 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-390d0098-3ba6-43b5-8a25-f37a9032234f tempest-ProjectReaderTests-1176210283 None] Lock "cinder-01b92de6-f1f6-42b0-8077-194e5ac27b33-delete_volume" released by "delete_volume" :: held 1.500s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:28:38 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-583b1813-64bb-4f8a-bcb2-5a85ede9346d tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.325s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:28:38 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-583b1813-64bb-4f8a-bcb2-5a85ede9346d tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:28:38 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-2ba6bbf7-0b1b-4188-8331-44d352c9854d tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Acquiring lock "cinder-quobyte-80af2632-ff4e-4148-b84b-a6893bb8732a" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:28:38 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-583b1813-64bb-4f8a-bcb2-5a85ede9346d tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Deleted volume successfully. Nov 04 10:28:38 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-2ba6bbf7-0b1b-4188-8331-44d352c9854d tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Lock "cinder-quobyte-80af2632-ff4e-4148-b84b-a6893bb8732a" acquired by "delete_volume" :: waited 0.025s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:28:38 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-583b1813-64bb-4f8a-bcb2-5a85ede9346d tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Lock "cinder-59bc5b65-8a33-4cb9-a3be-7e1fc225def6-delete_volume" released by "delete_volume" :: held 1.360s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:28:38 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[61a190ab-e5c9-42dd-a343-c0bbe56260e9]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:28:38 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-2ba6bbf7-0b1b-4188-8331-44d352c9854d tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-80af2632-ff4e-4148-b84b-a6893bb8732a {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:28:38 devstack sudo[103897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-80af2632-ff4e-4148-b84b-a6893bb8732a Nov 04 10:28:38 devstack sudo[103897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:28:38 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a4d622e-0d9a-43be-bc97-1b01b45e81e1 tempest-ProjectReaderTests-1176210283 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:28:38 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-9a4d622e-0d9a-43be-bc97-1b01b45e81e1 tempest-ProjectReaderTests-1176210283 None] Flow 'volume_create_manager' (d4536264-f864-46cc-afaf-0a9dacc48cb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:28:38 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-9a4d622e-0d9a-43be-bc97-1b01b45e81e1 tempest-ProjectReaderTests-1176210283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f959af3-56ca-4e77-a41c-f3a9d17833d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:28:38 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-9a4d622e-0d9a-43be-bc97-1b01b45e81e1 tempest-ProjectReaderTests-1176210283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f959af3-56ca-4e77-a41c-f3a9d17833d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:28:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1956413915',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a644c34d-05d8-48be-b536-0aaef7a572eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d7b925f2c9a4971b5a7fd86e7890800',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:28:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:28:39Z,use_quota=True,user_id='7d778d0ba27a49d5b24046ba9edd8bc6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:28:38 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-9a4d622e-0d9a-43be-bc97-1b01b45e81e1 tempest-ProjectReaderTests-1176210283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fed5c41-37d5-46ec-adec-a1543f3a5cea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:28:38 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-9a4d622e-0d9a-43be-bc97-1b01b45e81e1 tempest-ProjectReaderTests-1176210283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fed5c41-37d5-46ec-adec-a1543f3a5cea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:28:38 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-9a4d622e-0d9a-43be-bc97-1b01b45e81e1 tempest-ProjectReaderTests-1176210283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7604cb3-0010-46b2-97c3-681e877347ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:28:38 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-9a4d622e-0d9a-43be-bc97-1b01b45e81e1 tempest-ProjectReaderTests-1176210283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7604cb3-0010-46b2-97c3-681e877347ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a644c34d-05d8-48be-b536-0aaef7a572eb', 'volume_name': 'volume-a644c34d-05d8-48be-b536-0aaef7a572eb', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:28:38 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-9a4d622e-0d9a-43be-bc97-1b01b45e81e1 tempest-ProjectReaderTests-1176210283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb881b17-b2b5-4ad1-9040-3c2a2bc3fb41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:28:38 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-9a4d622e-0d9a-43be-bc97-1b01b45e81e1 tempest-ProjectReaderTests-1176210283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb881b17-b2b5-4ad1-9040-3c2a2bc3fb41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:28:38 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-9a4d622e-0d9a-43be-bc97-1b01b45e81e1 tempest-ProjectReaderTests-1176210283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb446895-5156-468f-a388-fca7a944751d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:28:38 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-9a4d622e-0d9a-43be-bc97-1b01b45e81e1 tempest-ProjectReaderTests-1176210283 None] Volume a644c34d-05d8-48be-b536-0aaef7a572eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a644c34d-05d8-48be-b536-0aaef7a572eb', 'volume_size': 1} Nov 04 10:28:38 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-9a4d622e-0d9a-43be-bc97-1b01b45e81e1 tempest-ProjectReaderTests-1176210283 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:28:38 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-9a4d622e-0d9a-43be-bc97-1b01b45e81e1 tempest-ProjectReaderTests-1176210283 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:28:38 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-9a4d622e-0d9a-43be-bc97-1b01b45e81e1 tempest-ProjectReaderTests-1176210283 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:28:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1956413915',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a644c34d-05d8-48be-b536-0aaef7a572eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d7b925f2c9a4971b5a7fd86e7890800',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:28:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:28:39Z,use_quota=True,user_id='7d778d0ba27a49d5b24046ba9edd8bc6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 10:28:38 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-9a4d622e-0d9a-43be-bc97-1b01b45e81e1 tempest-ProjectReaderTests-1176210283 None] Creating volume a644c34d-05d8-48be-b536-0aaef7a572eb {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:28:38 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-9a4d622e-0d9a-43be-bc97-1b01b45e81e1 tempest-ProjectReaderTests-1176210283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:28:38 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-9a4d622e-0d9a-43be-bc97-1b01b45e81e1 tempest-ProjectReaderTests-1176210283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:28:38 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-9a4d622e-0d9a-43be-bc97-1b01b45e81e1 tempest-ProjectReaderTests-1176210283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:28:38 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-9a4d622e-0d9a-43be-bc97-1b01b45e81e1 tempest-ProjectReaderTests-1176210283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:28:38 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-9a4d622e-0d9a-43be-bc97-1b01b45e81e1 tempest-ProjectReaderTests-1176210283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:28:38 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-9a4d622e-0d9a-43be-bc97-1b01b45e81e1 tempest-ProjectReaderTests-1176210283 None] Selected osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:28:38 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-9a4d622e-0d9a-43be-bc97-1b01b45e81e1 tempest-ProjectReaderTests-1176210283 None] casted to osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 Nov 04 10:28:38 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-9a4d622e-0d9a-43be-bc97-1b01b45e81e1 tempest-ProjectReaderTests-1176210283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-a644c34d-05d8-48be-b536-0aaef7a572eb 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:28:39 devstack sudo[103899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-a644c34d-05d8-48be-b536-0aaef7a572eb 1073741824 Nov 04 10:28:39 devstack sudo[103899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:28:39 devstack sudo[103897]: pam_unix(sudo:session): session closed for user root Nov 04 10:28:39 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-2ba6bbf7-0b1b-4188-8331-44d352c9854d tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-80af2632-ff4e-4148-b84b-a6893bb8732a" returned: 0 in 0.377s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:28:39 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-2ba6bbf7-0b1b-4188-8331-44d352c9854d tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-80af2632-ff4e-4148-b84b-a6893bb8732a {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:28:39 devstack sudo[103904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-80af2632-ff4e-4148-b84b-a6893bb8732a Nov 04 10:28:39 devstack sudo[103904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:28:39 devstack sudo[103899]: pam_unix(sudo:session): session closed for user root Nov 04 10:28:39 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-9a4d622e-0d9a-43be-bc97-1b01b45e81e1 tempest-ProjectReaderTests-1176210283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-a644c34d-05d8-48be-b536-0aaef7a572eb 1073741824" returned: 0 in 0.426s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:28:39 devstack sudo[103904]: pam_unix(sudo:session): session closed for user root Nov 04 10:28:39 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-2ba6bbf7-0b1b-4188-8331-44d352c9854d tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-80af2632-ff4e-4148-b84b-a6893bb8732a" returned: 0 in 0.288s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:28:39 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-2ba6bbf7-0b1b-4188-8331-44d352c9854d tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Lock "cinder-quobyte-80af2632-ff4e-4148-b84b-a6893bb8732a" released by "delete_volume" :: held 0.719s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:28:39 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-9a4d622e-0d9a-43be-bc97-1b01b45e81e1 tempest-ProjectReaderTests-1176210283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-a644c34d-05d8-48be-b536-0aaef7a572eb {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:28:39 devstack sudo[103910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-a644c34d-05d8-48be-b536-0aaef7a572eb Nov 04 10:28:39 devstack sudo[103910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:28:39 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-2ba6bbf7-0b1b-4188-8331-44d352c9854d tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Created reservations ['02658c5c-7bbe-4cb3-94f5-bf78bb4ae9c6', '0ce4256d-d3df-4d1c-bbf9-b041485bc8de', 'e2731d27-7438-48d1-b32f-98151cf9b29a', 'f3db845e-8ef1-4150-acc8-a885dfaff324'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:28:39 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-2ba6bbf7-0b1b-4188-8331-44d352c9854d tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:28:39 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-2ba6bbf7-0b1b-4188-8331-44d352c9854d tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:28:39 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-2ba6bbf7-0b1b-4188-8331-44d352c9854d tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:28:39 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-2ba6bbf7-0b1b-4188-8331-44d352c9854d tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:28:39 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-2ba6bbf7-0b1b-4188-8331-44d352c9854d tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:28:39 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-2ba6bbf7-0b1b-4188-8331-44d352c9854d tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:28:39 devstack sudo[103912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:28:39 devstack sudo[103912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:28:39 devstack sudo[103910]: pam_unix(sudo:session): session closed for user root Nov 04 10:28:39 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-9a4d622e-0d9a-43be-bc97-1b01b45e81e1 tempest-ProjectReaderTests-1176210283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-a644c34d-05d8-48be-b536-0aaef7a572eb" returned: 0 in 0.254s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:28:39 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-9a4d622e-0d9a-43be-bc97-1b01b45e81e1 tempest-ProjectReaderTests-1176210283 None] <== create_volume: return (729ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 10:28:39 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-9a4d622e-0d9a-43be-bc97-1b01b45e81e1 tempest-ProjectReaderTests-1176210283 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.733s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:28:39 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-9a4d622e-0d9a-43be-bc97-1b01b45e81e1 tempest-ProjectReaderTests-1176210283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb446895-5156-468f-a388-fca7a944751d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a644c34d-05d8-48be-b536-0aaef7a572eb', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:28:39 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-9a4d622e-0d9a-43be-bc97-1b01b45e81e1 tempest-ProjectReaderTests-1176210283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce22a5a2-f3f4-44cf-bd38-c33cb482c282) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:28:39 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-9a4d622e-0d9a-43be-bc97-1b01b45e81e1 tempest-ProjectReaderTests-1176210283 None] Volume volume-a644c34d-05d8-48be-b536-0aaef7a572eb (a644c34d-05d8-48be-b536-0aaef7a572eb): created successfully Nov 04 10:28:39 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-9a4d622e-0d9a-43be-bc97-1b01b45e81e1 tempest-ProjectReaderTests-1176210283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce22a5a2-f3f4-44cf-bd38-c33cb482c282) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:28:39 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-9a4d622e-0d9a-43be-bc97-1b01b45e81e1 tempest-ProjectReaderTests-1176210283 None] Flow 'volume_create_manager' (d4536264-f864-46cc-afaf-0a9dacc48cb1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:28:39 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-9a4d622e-0d9a-43be-bc97-1b01b45e81e1 tempest-ProjectReaderTests-1176210283 None] Created volume successfully. Nov 04 10:28:39 devstack sudo[103912]: pam_unix(sudo:session): session closed for user root Nov 04 10:28:39 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-2ba6bbf7-0b1b-4188-8331-44d352c9854d tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.281s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:28:39 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-2ba6bbf7-0b1b-4188-8331-44d352c9854d tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:28:39 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-2ba6bbf7-0b1b-4188-8331-44d352c9854d tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Deleted volume successfully. Nov 04 10:28:39 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-2ba6bbf7-0b1b-4188-8331-44d352c9854d tempest-CreateVolumesFromSourceVolumeTest-1754298982 None] Lock "cinder-80af2632-ff4e-4148-b84b-a6893bb8732a-delete_volume" released by "delete_volume" :: held 1.280s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:28:39 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-a73b88a2-0f5f-46da-85e0-c859ce8c09e0 tempest-ProjectReaderTests-1176210283 None] Acquiring lock "cinder-a644c34d-05d8-48be-b536-0aaef7a572eb-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:28:39 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-a73b88a2-0f5f-46da-85e0-c859ce8c09e0 tempest-ProjectReaderTests-1176210283 None] Lock "cinder-a644c34d-05d8-48be-b536-0aaef7a572eb-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:28:40 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-a73b88a2-0f5f-46da-85e0-c859ce8c09e0 tempest-ProjectReaderTests-1176210283 None] Acquiring lock "cinder-quobyte-a644c34d-05d8-48be-b536-0aaef7a572eb" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:28:40 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-a73b88a2-0f5f-46da-85e0-c859ce8c09e0 tempest-ProjectReaderTests-1176210283 None] Lock "cinder-quobyte-a644c34d-05d8-48be-b536-0aaef7a572eb" acquired by "delete_volume" :: waited 0.018s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:28:40 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b7e5bca-650f-4399-9746-c517d6f8e523]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:28:40 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-a73b88a2-0f5f-46da-85e0-c859ce8c09e0 tempest-ProjectReaderTests-1176210283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-a644c34d-05d8-48be-b536-0aaef7a572eb {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:28:40 devstack sudo[103916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-a644c34d-05d8-48be-b536-0aaef7a572eb Nov 04 10:28:40 devstack sudo[103916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:28:40 devstack sudo[103916]: pam_unix(sudo:session): session closed for user root Nov 04 10:28:40 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-a73b88a2-0f5f-46da-85e0-c859ce8c09e0 tempest-ProjectReaderTests-1176210283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-a644c34d-05d8-48be-b536-0aaef7a572eb" returned: 0 in 0.395s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:28:40 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-a73b88a2-0f5f-46da-85e0-c859ce8c09e0 tempest-ProjectReaderTests-1176210283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-a644c34d-05d8-48be-b536-0aaef7a572eb {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:28:40 devstack sudo[103921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-a644c34d-05d8-48be-b536-0aaef7a572eb Nov 04 10:28:40 devstack sudo[103921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:28:40 devstack sudo[103921]: pam_unix(sudo:session): session closed for user root Nov 04 10:28:40 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-a73b88a2-0f5f-46da-85e0-c859ce8c09e0 tempest-ProjectReaderTests-1176210283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-a644c34d-05d8-48be-b536-0aaef7a572eb" returned: 0 in 0.257s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:28:40 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-a73b88a2-0f5f-46da-85e0-c859ce8c09e0 tempest-ProjectReaderTests-1176210283 None] Lock "cinder-quobyte-a644c34d-05d8-48be-b536-0aaef7a572eb" released by "delete_volume" :: held 0.697s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:28:40 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-a73b88a2-0f5f-46da-85e0-c859ce8c09e0 tempest-ProjectReaderTests-1176210283 None] Created reservations ['714d43a9-75ff-404b-b386-2e0a47f08304', '3e598969-1010-4a85-a84c-14df9ecd8678', 'bb571fe3-f12a-4444-81ed-17c16907f824', '1918b152-7897-4941-8d50-8498c3dbcefa'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:28:40 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-a73b88a2-0f5f-46da-85e0-c859ce8c09e0 tempest-ProjectReaderTests-1176210283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:28:40 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-a73b88a2-0f5f-46da-85e0-c859ce8c09e0 tempest-ProjectReaderTests-1176210283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:28:40 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-a73b88a2-0f5f-46da-85e0-c859ce8c09e0 tempest-ProjectReaderTests-1176210283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:28:40 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-a73b88a2-0f5f-46da-85e0-c859ce8c09e0 tempest-ProjectReaderTests-1176210283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:28:40 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-a73b88a2-0f5f-46da-85e0-c859ce8c09e0 tempest-ProjectReaderTests-1176210283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:28:40 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-a73b88a2-0f5f-46da-85e0-c859ce8c09e0 tempest-ProjectReaderTests-1176210283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:28:40 devstack sudo[103924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:28:40 devstack sudo[103924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:28:41 devstack sudo[103924]: pam_unix(sudo:session): session closed for user root Nov 04 10:28:41 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-a73b88a2-0f5f-46da-85e0-c859ce8c09e0 tempest-ProjectReaderTests-1176210283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.276s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:28:41 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-a73b88a2-0f5f-46da-85e0-c859ce8c09e0 tempest-ProjectReaderTests-1176210283 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:28:41 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-a73b88a2-0f5f-46da-85e0-c859ce8c09e0 tempest-ProjectReaderTests-1176210283 None] Deleted volume successfully. Nov 04 10:28:41 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-a73b88a2-0f5f-46da-85e0-c859ce8c09e0 tempest-ProjectReaderTests-1176210283 None] Lock "cinder-a644c34d-05d8-48be-b536-0aaef7a572eb-delete_volume" released by "delete_volume" :: held 1.187s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:28:43 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-172bc7bc-d430-4c9a-9173-69a30d061ea0 tempest-VolumeDependencyTests-527307853 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:28:43 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-172bc7bc-d430-4c9a-9173-69a30d061ea0 tempest-VolumeDependencyTests-527307853 None] Flow 'volume_create_manager' (91508991-fe9c-45e5-8c51-cb7161fdb323) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:28:43 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-172bc7bc-d430-4c9a-9173-69a30d061ea0 tempest-VolumeDependencyTests-527307853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee000a3b-216f-4309-92e6-83f7945b9c56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:28:43 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-172bc7bc-d430-4c9a-9173-69a30d061ea0 tempest-VolumeDependencyTests-527307853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee000a3b-216f-4309-92e6-83f7945b9c56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:28:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1281451007',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6badf503-f85d-41fc-8405-d3a9cb72a59d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ec85fd545db431bbfc1dbe898388318',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:28:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:28:43Z,use_quota=True,user_id='3ca98703d7af411ba97874733f2ef6b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:28:43 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-172bc7bc-d430-4c9a-9173-69a30d061ea0 tempest-VolumeDependencyTests-527307853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce0ac057-215a-4a18-86b0-1a9145381265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:28:43 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-172bc7bc-d430-4c9a-9173-69a30d061ea0 tempest-VolumeDependencyTests-527307853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce0ac057-215a-4a18-86b0-1a9145381265) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:28:43 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-172bc7bc-d430-4c9a-9173-69a30d061ea0 tempest-VolumeDependencyTests-527307853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f8ac774-3149-403b-aa8d-6f87e887202a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:28:43 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-172bc7bc-d430-4c9a-9173-69a30d061ea0 tempest-VolumeDependencyTests-527307853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f8ac774-3149-403b-aa8d-6f87e887202a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6badf503-f85d-41fc-8405-d3a9cb72a59d', 'volume_name': 'volume-6badf503-f85d-41fc-8405-d3a9cb72a59d', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:28:43 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-172bc7bc-d430-4c9a-9173-69a30d061ea0 tempest-VolumeDependencyTests-527307853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0420701c-3b35-4817-a236-81a546415b3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:28:43 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-172bc7bc-d430-4c9a-9173-69a30d061ea0 tempest-VolumeDependencyTests-527307853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0420701c-3b35-4817-a236-81a546415b3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:28:43 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-172bc7bc-d430-4c9a-9173-69a30d061ea0 tempest-VolumeDependencyTests-527307853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e523d40-e4ed-47d3-ae0e-a15bbf15def1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:28:43 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-172bc7bc-d430-4c9a-9173-69a30d061ea0 tempest-VolumeDependencyTests-527307853 None] Volume 6badf503-f85d-41fc-8405-d3a9cb72a59d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6badf503-f85d-41fc-8405-d3a9cb72a59d', 'volume_size': 1} Nov 04 10:28:43 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-172bc7bc-d430-4c9a-9173-69a30d061ea0 tempest-VolumeDependencyTests-527307853 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:28:43 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-172bc7bc-d430-4c9a-9173-69a30d061ea0 tempest-VolumeDependencyTests-527307853 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:28:43 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-172bc7bc-d430-4c9a-9173-69a30d061ea0 tempest-VolumeDependencyTests-527307853 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:28:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1281451007',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6badf503-f85d-41fc-8405-d3a9cb72a59d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ec85fd545db431bbfc1dbe898388318',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:28:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:28:43Z,use_quota=True,user_id='3ca98703d7af411ba97874733f2ef6b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 10:28:43 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-172bc7bc-d430-4c9a-9173-69a30d061ea0 tempest-VolumeDependencyTests-527307853 None] Creating volume 6badf503-f85d-41fc-8405-d3a9cb72a59d {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:28:43 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-172bc7bc-d430-4c9a-9173-69a30d061ea0 tempest-VolumeDependencyTests-527307853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:28:43 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-172bc7bc-d430-4c9a-9173-69a30d061ea0 tempest-VolumeDependencyTests-527307853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:28:43 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-172bc7bc-d430-4c9a-9173-69a30d061ea0 tempest-VolumeDependencyTests-527307853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:28:43 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-172bc7bc-d430-4c9a-9173-69a30d061ea0 tempest-VolumeDependencyTests-527307853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:28:43 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-172bc7bc-d430-4c9a-9173-69a30d061ea0 tempest-VolumeDependencyTests-527307853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:28:43 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-172bc7bc-d430-4c9a-9173-69a30d061ea0 tempest-VolumeDependencyTests-527307853 None] Selected osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:28:43 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-172bc7bc-d430-4c9a-9173-69a30d061ea0 tempest-VolumeDependencyTests-527307853 None] casted to osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 Nov 04 10:28:43 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-172bc7bc-d430-4c9a-9173-69a30d061ea0 tempest-VolumeDependencyTests-527307853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6badf503-f85d-41fc-8405-d3a9cb72a59d 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:28:43 devstack sudo[103928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6badf503-f85d-41fc-8405-d3a9cb72a59d 1073741824 Nov 04 10:28:43 devstack sudo[103928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:28:43 devstack sudo[103928]: pam_unix(sudo:session): session closed for user root Nov 04 10:28:43 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-172bc7bc-d430-4c9a-9173-69a30d061ea0 tempest-VolumeDependencyTests-527307853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6badf503-f85d-41fc-8405-d3a9cb72a59d 1073741824" returned: 0 in 0.458s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:28:43 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-172bc7bc-d430-4c9a-9173-69a30d061ea0 tempest-VolumeDependencyTests-527307853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6badf503-f85d-41fc-8405-d3a9cb72a59d {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:28:43 devstack sudo[103934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6badf503-f85d-41fc-8405-d3a9cb72a59d Nov 04 10:28:43 devstack sudo[103934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:28:43 devstack sudo[103934]: pam_unix(sudo:session): session closed for user root Nov 04 10:28:43 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-172bc7bc-d430-4c9a-9173-69a30d061ea0 tempest-VolumeDependencyTests-527307853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6badf503-f85d-41fc-8405-d3a9cb72a59d" returned: 0 in 0.250s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:28:43 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-172bc7bc-d430-4c9a-9173-69a30d061ea0 tempest-VolumeDependencyTests-527307853 None] <== create_volume: return (751ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 10:28:43 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-172bc7bc-d430-4c9a-9173-69a30d061ea0 tempest-VolumeDependencyTests-527307853 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.754s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:28:43 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-172bc7bc-d430-4c9a-9173-69a30d061ea0 tempest-VolumeDependencyTests-527307853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e523d40-e4ed-47d3-ae0e-a15bbf15def1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6badf503-f85d-41fc-8405-d3a9cb72a59d', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:28:43 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-172bc7bc-d430-4c9a-9173-69a30d061ea0 tempest-VolumeDependencyTests-527307853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39bbf3ae-641c-43e9-a3a5-e95d2da20561) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:28:43 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-172bc7bc-d430-4c9a-9173-69a30d061ea0 tempest-VolumeDependencyTests-527307853 None] Volume volume-6badf503-f85d-41fc-8405-d3a9cb72a59d (6badf503-f85d-41fc-8405-d3a9cb72a59d): created successfully Nov 04 10:28:43 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-172bc7bc-d430-4c9a-9173-69a30d061ea0 tempest-VolumeDependencyTests-527307853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39bbf3ae-641c-43e9-a3a5-e95d2da20561) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:28:43 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-172bc7bc-d430-4c9a-9173-69a30d061ea0 tempest-VolumeDependencyTests-527307853 None] Flow 'volume_create_manager' (91508991-fe9c-45e5-8c51-cb7161fdb323) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:28:43 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-172bc7bc-d430-4c9a-9173-69a30d061ea0 tempest-VolumeDependencyTests-527307853 None] Created volume successfully. Nov 04 10:28:44 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-2a2f8632-56d1-4fef-8688-2b52d2e650fe tempest-VolumeDependencyTests-527307853 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:28:44 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-2a2f8632-56d1-4fef-8688-2b52d2e650fe tempest-VolumeDependencyTests-527307853 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:28:44 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-2a2f8632-56d1-4fef-8688-2b52d2e650fe tempest-VolumeDependencyTests-527307853 None] Creating offline snapshot cd2b2be3-d1e9-4ed1-98ac-04fc330c01de of volume 6badf503-f85d-41fc-8405-d3a9cb72a59d {{(pid=87068) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 10:28:44 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[01cf24aa-f889-435c-a2e2-e1b7015607b4]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:28:44 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-2a2f8632-56d1-4fef-8688-2b52d2e650fe tempest-VolumeDependencyTests-527307853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6badf503-f85d-41fc-8405-d3a9cb72a59d {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:28:44 devstack sudo[103937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6badf503-f85d-41fc-8405-d3a9cb72a59d Nov 04 10:28:44 devstack sudo[103937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:28:44 devstack sudo[103937]: pam_unix(sudo:session): session closed for user root Nov 04 10:28:44 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-2a2f8632-56d1-4fef-8688-2b52d2e650fe tempest-VolumeDependencyTests-527307853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6badf503-f85d-41fc-8405-d3a9cb72a59d" returned: 0 in 0.381s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:28:44 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-2a2f8632-56d1-4fef-8688-2b52d2e650fe tempest-VolumeDependencyTests-527307853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6badf503-f85d-41fc-8405-d3a9cb72a59d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6badf503-f85d-41fc-8405-d3a9cb72a59d.cd2b2be3-d1e9-4ed1-98ac-04fc330c01de 1G {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:28:44 devstack sudo[103942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6badf503-f85d-41fc-8405-d3a9cb72a59d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6badf503-f85d-41fc-8405-d3a9cb72a59d.cd2b2be3-d1e9-4ed1-98ac-04fc330c01de 1G Nov 04 10:28:44 devstack sudo[103942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:28:45 devstack sudo[103942]: pam_unix(sudo:session): session closed for user root Nov 04 10:28:45 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-2a2f8632-56d1-4fef-8688-2b52d2e650fe tempest-VolumeDependencyTests-527307853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6badf503-f85d-41fc-8405-d3a9cb72a59d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6badf503-f85d-41fc-8405-d3a9cb72a59d.cd2b2be3-d1e9-4ed1-98ac-04fc330c01de 1G" returned: 0 in 0.459s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:28:45 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-2a2f8632-56d1-4fef-8688-2b52d2e650fe tempest-VolumeDependencyTests-527307853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6badf503-f85d-41fc-8405-d3a9cb72a59d -F qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6badf503-f85d-41fc-8405-d3a9cb72a59d.cd2b2be3-d1e9-4ed1-98ac-04fc330c01de {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:28:45 devstack sudo[103947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6badf503-f85d-41fc-8405-d3a9cb72a59d -F qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6badf503-f85d-41fc-8405-d3a9cb72a59d.cd2b2be3-d1e9-4ed1-98ac-04fc330c01de Nov 04 10:28:45 devstack sudo[103947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:28:45 devstack sudo[103947]: pam_unix(sudo:session): session closed for user root Nov 04 10:28:45 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-2a2f8632-56d1-4fef-8688-2b52d2e650fe tempest-VolumeDependencyTests-527307853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6badf503-f85d-41fc-8405-d3a9cb72a59d -F qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6badf503-f85d-41fc-8405-d3a9cb72a59d.cd2b2be3-d1e9-4ed1-98ac-04fc330c01de" returned: 0 in 0.322s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:28:45 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-2a2f8632-56d1-4fef-8688-2b52d2e650fe tempest-VolumeDependencyTests-527307853 None] /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6badf503-f85d-41fc-8405-d3a9cb72a59d.cd2b2be3-d1e9-4ed1-98ac-04fc330c01de is being set with open permissions: ugo+rw Nov 04 10:28:45 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-2a2f8632-56d1-4fef-8688-2b52d2e650fe tempest-VolumeDependencyTests-527307853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6badf503-f85d-41fc-8405-d3a9cb72a59d.cd2b2be3-d1e9-4ed1-98ac-04fc330c01de {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:28:45 devstack sudo[103952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6badf503-f85d-41fc-8405-d3a9cb72a59d.cd2b2be3-d1e9-4ed1-98ac-04fc330c01de Nov 04 10:28:45 devstack sudo[103952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:28:45 devstack sudo[103952]: pam_unix(sudo:session): session closed for user root Nov 04 10:28:45 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-2a2f8632-56d1-4fef-8688-2b52d2e650fe tempest-VolumeDependencyTests-527307853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6badf503-f85d-41fc-8405-d3a9cb72a59d.cd2b2be3-d1e9-4ed1-98ac-04fc330c01de" returned: 0 in 0.262s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:28:45 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-2a2f8632-56d1-4fef-8688-2b52d2e650fe tempest-VolumeDependencyTests-527307853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6badf503-f85d-41fc-8405-d3a9cb72a59d.info {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:28:45 devstack sudo[103955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6badf503-f85d-41fc-8405-d3a9cb72a59d.info Nov 04 10:28:45 devstack sudo[103955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:28:45 devstack sudo[103955]: pam_unix(sudo:session): session closed for user root Nov 04 10:28:46 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-2a2f8632-56d1-4fef-8688-2b52d2e650fe tempest-VolumeDependencyTests-527307853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6badf503-f85d-41fc-8405-d3a9cb72a59d.info" returned: 0 in 0.274s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:28:46 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-2a2f8632-56d1-4fef-8688-2b52d2e650fe tempest-VolumeDependencyTests-527307853 None] /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6badf503-f85d-41fc-8405-d3a9cb72a59d.info is being set with open permissions: ugo+rw Nov 04 10:28:46 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-2a2f8632-56d1-4fef-8688-2b52d2e650fe tempest-VolumeDependencyTests-527307853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6badf503-f85d-41fc-8405-d3a9cb72a59d.info {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:28:46 devstack sudo[103958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6badf503-f85d-41fc-8405-d3a9cb72a59d.info Nov 04 10:28:46 devstack sudo[103958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:28:46 devstack sudo[103958]: pam_unix(sudo:session): session closed for user root Nov 04 10:28:46 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-2a2f8632-56d1-4fef-8688-2b52d2e650fe tempest-VolumeDependencyTests-527307853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6badf503-f85d-41fc-8405-d3a9cb72a59d.info" returned: 0 in 0.274s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:28:46 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-2a2f8632-56d1-4fef-8688-2b52d2e650fe tempest-VolumeDependencyTests-527307853 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.094s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:28:46 devstack cinder-volume[87068]: DEBUG dbcounter [-] [87068] Writing DB stats cinder:SELECT=139,cinder:UPDATE=187,cinder:INSERT=49,cinder:DELETE=11 {{(pid=87068) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 10:28:46 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-2a2f8632-56d1-4fef-8688-2b52d2e650fe tempest-VolumeDependencyTests-527307853 None] Create snapshot completed successfully Nov 04 10:28:47 devstack cinder-volume[87068]: DEBUG dbcounter [-] [87068] Writing DB stats cinder:SELECT=145,cinder:UPDATE=206,cinder:INSERT=44,cinder:DELETE=23 {{(pid=87068) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 10:28:47 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-dcd4f5ef-2f45-49cb-b833-0ded9d2b713b tempest-VolumeDependencyTests-527307853 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:28:47 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-dcd4f5ef-2f45-49cb-b833-0ded9d2b713b tempest-VolumeDependencyTests-527307853 None] Flow 'volume_create_manager' (6937a7ff-47c6-4583-bea9-c797f197b253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:28:47 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-dcd4f5ef-2f45-49cb-b833-0ded9d2b713b tempest-VolumeDependencyTests-527307853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b34c50e4-c683-42d7-a104-bc1b954b510b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:28:47 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-dcd4f5ef-2f45-49cb-b833-0ded9d2b713b tempest-VolumeDependencyTests-527307853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b34c50e4-c683-42d7-a104-bc1b954b510b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:28:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1056822232',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2587ebe0-9982-4f71-a8c9-bf7884fc720b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ec85fd545db431bbfc1dbe898388318',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:28:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=cd2b2be3-d1e9-4ed1-98ac-04fc330c01de,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:28:48Z,use_quota=True,user_id='3ca98703d7af411ba97874733f2ef6b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:28:47 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-dcd4f5ef-2f45-49cb-b833-0ded9d2b713b tempest-VolumeDependencyTests-527307853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9915853-9cf2-4531-8e94-8f4f496f1fe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:28:47 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-dcd4f5ef-2f45-49cb-b833-0ded9d2b713b tempest-VolumeDependencyTests-527307853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9915853-9cf2-4531-8e94-8f4f496f1fe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:28:47 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-dcd4f5ef-2f45-49cb-b833-0ded9d2b713b tempest-VolumeDependencyTests-527307853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07b3110f-6ee7-46c2-bb51-00c8702f5c8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:28:47 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-dcd4f5ef-2f45-49cb-b833-0ded9d2b713b tempest-VolumeDependencyTests-527307853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07b3110f-6ee7-46c2-bb51-00c8702f5c8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '2587ebe0-9982-4f71-a8c9-bf7884fc720b', 'volume_name': 'volume-2587ebe0-9982-4f71-a8c9-bf7884fc720b', 'volume_size': 1, 'snapshot_id': 'cd2b2be3-d1e9-4ed1-98ac-04fc330c01de'}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:28:47 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-dcd4f5ef-2f45-49cb-b833-0ded9d2b713b tempest-VolumeDependencyTests-527307853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d745fe1-f201-4128-a5a0-cbc5e2c4ee46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:28:47 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-dcd4f5ef-2f45-49cb-b833-0ded9d2b713b tempest-VolumeDependencyTests-527307853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d745fe1-f201-4128-a5a0-cbc5e2c4ee46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:28:47 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-dcd4f5ef-2f45-49cb-b833-0ded9d2b713b tempest-VolumeDependencyTests-527307853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f91b9407-ea7d-4229-b011-c6d0d328cc7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:28:47 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-dcd4f5ef-2f45-49cb-b833-0ded9d2b713b tempest-VolumeDependencyTests-527307853 None] Volume 2587ebe0-9982-4f71-a8c9-bf7884fc720b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-2587ebe0-9982-4f71-a8c9-bf7884fc720b', 'volume_size': 1, 'snapshot_id': 'cd2b2be3-d1e9-4ed1-98ac-04fc330c01de'} Nov 04 10:28:48 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-dcd4f5ef-2f45-49cb-b833-0ded9d2b713b tempest-VolumeDependencyTests-527307853 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:28:48 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-dcd4f5ef-2f45-49cb-b833-0ded9d2b713b tempest-VolumeDependencyTests-527307853 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:28:48 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-dcd4f5ef-2f45-49cb-b833-0ded9d2b713b tempest-VolumeDependencyTests-527307853 None] Acquiring lock "cinder-quobyte-cd2b2be3-d1e9-4ed1-98ac-04fc330c01de-2587ebe0-9982-4f71-a8c9-bf7884fc720b" by "_create_volume_from_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:28:48 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-dcd4f5ef-2f45-49cb-b833-0ded9d2b713b tempest-VolumeDependencyTests-527307853 None] Lock "cinder-quobyte-cd2b2be3-d1e9-4ed1-98ac-04fc330c01de-2587ebe0-9982-4f71-a8c9-bf7884fc720b" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:28:48 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-dcd4f5ef-2f45-49cb-b833-0ded9d2b713b tempest-VolumeDependencyTests-527307853 None] Creating volume 2587ebe0-9982-4f71-a8c9-bf7884fc720b from snapshot cd2b2be3-d1e9-4ed1-98ac-04fc330c01de {{(pid=87068) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 04 10:28:48 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-dcd4f5ef-2f45-49cb-b833-0ded9d2b713b tempest-VolumeDependencyTests-527307853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:28:48 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-dcd4f5ef-2f45-49cb-b833-0ded9d2b713b tempest-VolumeDependencyTests-527307853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:28:48 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-dcd4f5ef-2f45-49cb-b833-0ded9d2b713b tempest-VolumeDependencyTests-527307853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:28:48 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-dcd4f5ef-2f45-49cb-b833-0ded9d2b713b tempest-VolumeDependencyTests-527307853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:28:48 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-dcd4f5ef-2f45-49cb-b833-0ded9d2b713b tempest-VolumeDependencyTests-527307853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:28:48 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-dcd4f5ef-2f45-49cb-b833-0ded9d2b713b tempest-VolumeDependencyTests-527307853 None] Selected osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:28:48 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-dcd4f5ef-2f45-49cb-b833-0ded9d2b713b tempest-VolumeDependencyTests-527307853 None] Acquiring lock "cinder-quobyte-2587ebe0-9982-4f71-a8c9-bf7884fc720b" by "_copy_volume_from_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:28:48 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-dcd4f5ef-2f45-49cb-b833-0ded9d2b713b tempest-VolumeDependencyTests-527307853 None] Lock "cinder-quobyte-2587ebe0-9982-4f71-a8c9-bf7884fc720b" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:28:48 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-dcd4f5ef-2f45-49cb-b833-0ded9d2b713b tempest-VolumeDependencyTests-527307853 None] snapshot: cd2b2be3-d1e9-4ed1-98ac-04fc330c01de, volume: 2587ebe0-9982-4f71-a8c9-bf7884fc720b, {{(pid=87068) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 04 10:28:48 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-dcd4f5ef-2f45-49cb-b833-0ded9d2b713b tempest-VolumeDependencyTests-527307853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:28:48 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-dcd4f5ef-2f45-49cb-b833-0ded9d2b713b tempest-VolumeDependencyTests-527307853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:28:48 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-dcd4f5ef-2f45-49cb-b833-0ded9d2b713b tempest-VolumeDependencyTests-527307853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:28:48 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-dcd4f5ef-2f45-49cb-b833-0ded9d2b713b tempest-VolumeDependencyTests-527307853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:28:48 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-dcd4f5ef-2f45-49cb-b833-0ded9d2b713b tempest-VolumeDependencyTests-527307853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:28:48 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f4000d3-e1c7-4ad9-aeba-94234290d4d1]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:28:48 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-dcd4f5ef-2f45-49cb-b833-0ded9d2b713b tempest-VolumeDependencyTests-527307853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6badf503-f85d-41fc-8405-d3a9cb72a59d.cd2b2be3-d1e9-4ed1-98ac-04fc330c01de {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:28:48 devstack sudo[104004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6badf503-f85d-41fc-8405-d3a9cb72a59d.cd2b2be3-d1e9-4ed1-98ac-04fc330c01de Nov 04 10:28:48 devstack sudo[104004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:28:48 devstack sudo[104004]: pam_unix(sudo:session): session closed for user root Nov 04 10:28:48 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-dcd4f5ef-2f45-49cb-b833-0ded9d2b713b tempest-VolumeDependencyTests-527307853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6badf503-f85d-41fc-8405-d3a9cb72a59d.cd2b2be3-d1e9-4ed1-98ac-04fc330c01de" returned: 0 in 0.363s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:28:48 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-dcd4f5ef-2f45-49cb-b833-0ded9d2b713b tempest-VolumeDependencyTests-527307853 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6badf503-f85d-41fc-8405-d3a9cb72a59d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87068) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 10:28:48 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a9d18d3-698a-42e2-aa3d-62686115e693]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:28:48 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-dcd4f5ef-2f45-49cb-b833-0ded9d2b713b tempest-VolumeDependencyTests-527307853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6badf503-f85d-41fc-8405-d3a9cb72a59d {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:28:48 devstack sudo[104010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6badf503-f85d-41fc-8405-d3a9cb72a59d Nov 04 10:28:48 devstack sudo[104010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:28:48 devstack sudo[104010]: pam_unix(sudo:session): session closed for user root Nov 04 10:28:48 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-dcd4f5ef-2f45-49cb-b833-0ded9d2b713b tempest-VolumeDependencyTests-527307853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6badf503-f85d-41fc-8405-d3a9cb72a59d" returned: 0 in 0.347s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:28:48 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-dcd4f5ef-2f45-49cb-b833-0ded9d2b713b tempest-VolumeDependencyTests-527307853 None] will copy from snapshot at /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6badf503-f85d-41fc-8405-d3a9cb72a59d {{(pid=87068) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 04 10:28:48 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-dcd4f5ef-2f45-49cb-b833-0ded9d2b713b tempest-VolumeDependencyTests-527307853 None] Creating direct copy from snapshot {{(pid=87068) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 04 10:28:48 devstack cinder-volume[87068]: DEBUG cinder.utils [None req-dcd4f5ef-2f45-49cb-b833-0ded9d2b713b tempest-VolumeDependencyTests-527307853 None] Path /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-2587ebe0-9982-4f71-a8c9-bf7884fc720b not found in is_blk_device check {{(pid=87068) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 04 10:28:48 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-dcd4f5ef-2f45-49cb-b833-0ded9d2b713b tempest-VolumeDependencyTests-527307853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6badf503-f85d-41fc-8405-d3a9cb72a59d /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-2587ebe0-9982-4f71-a8c9-bf7884fc720b {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:28:48 devstack sudo[104015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6badf503-f85d-41fc-8405-d3a9cb72a59d /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-2587ebe0-9982-4f71-a8c9-bf7884fc720b Nov 04 10:28:48 devstack sudo[104015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:28:53 devstack cinder-volume[87068]: DEBUG oslo_service.periodic_task [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87068) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 10:28:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:28:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:28:53 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:28:53 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:28:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:28:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:28:53 devstack sudo[104029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:28:53 devstack sudo[104029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:28:54 devstack sudo[104015]: pam_unix(sudo:session): session closed for user root Nov 04 10:28:54 devstack sudo[104029]: pam_unix(sudo:session): session closed for user root Nov 04 10:28:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-dcd4f5ef-2f45-49cb-b833-0ded9d2b713b tempest-VolumeDependencyTests-527307853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6badf503-f85d-41fc-8405-d3a9cb72a59d /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-2587ebe0-9982-4f71-a8c9-bf7884fc720b" returned: 0 in 5.336s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:28:54 devstack cinder-volume[87068]: DEBUG cinder.image.image_utils [None req-dcd4f5ef-2f45-49cb-b833-0ded9d2b713b tempest-VolumeDependencyTests-527307853 None] Image conversion details: src /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6badf503-f85d-41fc-8405-d3a9cb72a59d, size 1024.00 MB, duration 5.34 sec, destination /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-2587ebe0-9982-4f71-a8c9-bf7884fc720b {{(pid=87068) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 04 10:28:54 devstack cinder-volume[87068]: INFO cinder.image.image_utils [None req-dcd4f5ef-2f45-49cb-b833-0ded9d2b713b tempest-VolumeDependencyTests-527307853 None] Converted 1024.00 MB image at 191.86 MB/s Nov 04 10:28:54 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-dcd4f5ef-2f45-49cb-b833-0ded9d2b713b tempest-VolumeDependencyTests-527307853 None] /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-2587ebe0-9982-4f71-a8c9-bf7884fc720b is being set with open permissions: ugo+rw Nov 04 10:28:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-dcd4f5ef-2f45-49cb-b833-0ded9d2b713b tempest-VolumeDependencyTests-527307853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-2587ebe0-9982-4f71-a8c9-bf7884fc720b {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:28:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.390s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:28:54 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:28:54 devstack cinder-volume[87068]: DEBUG oslo_service.periodic_task [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Running periodic task VolumeManager._thread_info {{(pid=87068) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 10:28:54 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] thread count: 28 {{(pid=87068) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 04 10:28:54 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] thread info: [<_MainThread(MainThread, started 126275656192128)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87068) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 04 10:28:54 devstack sudo[104032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-2587ebe0-9982-4f71-a8c9-bf7884fc720b Nov 04 10:28:54 devstack sudo[104032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:28:54 devstack sudo[104032]: pam_unix(sudo:session): session closed for user root Nov 04 10:28:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-dcd4f5ef-2f45-49cb-b833-0ded9d2b713b tempest-VolumeDependencyTests-527307853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-2587ebe0-9982-4f71-a8c9-bf7884fc720b" returned: 0 in 0.236s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:28:54 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-dcd4f5ef-2f45-49cb-b833-0ded9d2b713b tempest-VolumeDependencyTests-527307853 None] Lock "cinder-quobyte-2587ebe0-9982-4f71-a8c9-bf7884fc720b" released by "_copy_volume_from_snapshot" :: held 6.367s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:28:54 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-dcd4f5ef-2f45-49cb-b833-0ded9d2b713b tempest-VolumeDependencyTests-527307853 None] Lock "cinder-quobyte-cd2b2be3-d1e9-4ed1-98ac-04fc330c01de-2587ebe0-9982-4f71-a8c9-bf7884fc720b" released by "_create_volume_from_snapshot" :: held 6.425s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:28:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-dcd4f5ef-2f45-49cb-b833-0ded9d2b713b tempest-VolumeDependencyTests-527307853 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.438s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:28:54 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-dcd4f5ef-2f45-49cb-b833-0ded9d2b713b tempest-VolumeDependencyTests-527307853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f91b9407-ea7d-4229-b011-c6d0d328cc7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2587ebe0-9982-4f71-a8c9-bf7884fc720b', 'volume_size': 1, 'snapshot_id': 'cd2b2be3-d1e9-4ed1-98ac-04fc330c01de'}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:28:54 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-dcd4f5ef-2f45-49cb-b833-0ded9d2b713b tempest-VolumeDependencyTests-527307853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbd7bba9-c352-432d-90eb-56b4e9c1f580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:28:54 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-dcd4f5ef-2f45-49cb-b833-0ded9d2b713b tempest-VolumeDependencyTests-527307853 None] Volume volume-2587ebe0-9982-4f71-a8c9-bf7884fc720b (2587ebe0-9982-4f71-a8c9-bf7884fc720b): created successfully Nov 04 10:28:54 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-dcd4f5ef-2f45-49cb-b833-0ded9d2b713b tempest-VolumeDependencyTests-527307853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbd7bba9-c352-432d-90eb-56b4e9c1f580) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:28:54 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-dcd4f5ef-2f45-49cb-b833-0ded9d2b713b tempest-VolumeDependencyTests-527307853 None] Flow 'volume_create_manager' (6937a7ff-47c6-4583-bea9-c797f197b253) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:28:54 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-dcd4f5ef-2f45-49cb-b833-0ded9d2b713b tempest-VolumeDependencyTests-527307853 None] Created volume successfully. Nov 04 10:28:55 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-1db1d00e-7d0d-4b7f-a3e8-74e32a40a551 tempest-VolumeDependencyTests-527307853 None] Acquiring lock "cinder-cd2b2be3-d1e9-4ed1-98ac-04fc330c01de-delete_snapshot" by "delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:28:55 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-1db1d00e-7d0d-4b7f-a3e8-74e32a40a551 tempest-VolumeDependencyTests-527307853 None] Lock "cinder-cd2b2be3-d1e9-4ed1-98ac-04fc330c01de-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:28:55 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-1db1d00e-7d0d-4b7f-a3e8-74e32a40a551 tempest-VolumeDependencyTests-527307853 None] Acquiring lock "cinder-quobyte-6badf503-f85d-41fc-8405-d3a9cb72a59d" by "delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:28:55 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-1db1d00e-7d0d-4b7f-a3e8-74e32a40a551 tempest-VolumeDependencyTests-527307853 None] Lock "cinder-quobyte-6badf503-f85d-41fc-8405-d3a9cb72a59d" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:28:55 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-1db1d00e-7d0d-4b7f-a3e8-74e32a40a551 tempest-VolumeDependencyTests-527307853 None] Acquiring lock "cinder-quobyte-cd2b2be3-d1e9-4ed1-98ac-04fc330c01de" by "_delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:28:55 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-1db1d00e-7d0d-4b7f-a3e8-74e32a40a551 tempest-VolumeDependencyTests-527307853 None] Lock "cinder-quobyte-cd2b2be3-d1e9-4ed1-98ac-04fc330c01de" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:28:55 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-1db1d00e-7d0d-4b7f-a3e8-74e32a40a551 tempest-VolumeDependencyTests-527307853 None] Deleting offline snapshot cd2b2be3-d1e9-4ed1-98ac-04fc330c01de of volume 6badf503-f85d-41fc-8405-d3a9cb72a59d {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 10:28:55 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-1db1d00e-7d0d-4b7f-a3e8-74e32a40a551 tempest-VolumeDependencyTests-527307853 None] snapshot_file for this snap is: volume-6badf503-f85d-41fc-8405-d3a9cb72a59d.cd2b2be3-d1e9-4ed1-98ac-04fc330c01de {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 10:28:55 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff386be1-6845-48dc-9aff-a53ea235ac99]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:28:55 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-1db1d00e-7d0d-4b7f-a3e8-74e32a40a551 tempest-VolumeDependencyTests-527307853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6badf503-f85d-41fc-8405-d3a9cb72a59d.cd2b2be3-d1e9-4ed1-98ac-04fc330c01de {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:28:55 devstack sudo[104035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6badf503-f85d-41fc-8405-d3a9cb72a59d.cd2b2be3-d1e9-4ed1-98ac-04fc330c01de Nov 04 10:28:55 devstack sudo[104035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:28:55 devstack sudo[104035]: pam_unix(sudo:session): session closed for user root Nov 04 10:28:55 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-1db1d00e-7d0d-4b7f-a3e8-74e32a40a551 tempest-VolumeDependencyTests-527307853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6badf503-f85d-41fc-8405-d3a9cb72a59d.cd2b2be3-d1e9-4ed1-98ac-04fc330c01de" returned: 0 in 0.340s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:28:55 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-1db1d00e-7d0d-4b7f-a3e8-74e32a40a551 tempest-VolumeDependencyTests-527307853 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6badf503-f85d-41fc-8405-d3a9cb72a59d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87068) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 10:28:55 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a24b036-9714-43ee-89d4-500d747e28ab]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:28:55 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-1db1d00e-7d0d-4b7f-a3e8-74e32a40a551 tempest-VolumeDependencyTests-527307853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6badf503-f85d-41fc-8405-d3a9cb72a59d {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:28:55 devstack sudo[104040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6badf503-f85d-41fc-8405-d3a9cb72a59d Nov 04 10:28:55 devstack sudo[104040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:28:56 devstack sudo[104040]: pam_unix(sudo:session): session closed for user root Nov 04 10:28:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-1db1d00e-7d0d-4b7f-a3e8-74e32a40a551 tempest-VolumeDependencyTests-527307853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6badf503-f85d-41fc-8405-d3a9cb72a59d" returned: 0 in 0.526s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:28:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-1db1d00e-7d0d-4b7f-a3e8-74e32a40a551 tempest-VolumeDependencyTests-527307853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6badf503-f85d-41fc-8405-d3a9cb72a59d.cd2b2be3-d1e9-4ed1-98ac-04fc330c01de {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:28:56 devstack sudo[104046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6badf503-f85d-41fc-8405-d3a9cb72a59d.cd2b2be3-d1e9-4ed1-98ac-04fc330c01de Nov 04 10:28:56 devstack sudo[104046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:28:56 devstack sudo[104046]: pam_unix(sudo:session): session closed for user root Nov 04 10:28:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-1db1d00e-7d0d-4b7f-a3e8-74e32a40a551 tempest-VolumeDependencyTests-527307853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6badf503-f85d-41fc-8405-d3a9cb72a59d.cd2b2be3-d1e9-4ed1-98ac-04fc330c01de" returned: 0 in 0.315s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:28:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-1db1d00e-7d0d-4b7f-a3e8-74e32a40a551 tempest-VolumeDependencyTests-527307853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6badf503-f85d-41fc-8405-d3a9cb72a59d.cd2b2be3-d1e9-4ed1-98ac-04fc330c01de {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:28:56 devstack sudo[104052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6badf503-f85d-41fc-8405-d3a9cb72a59d.cd2b2be3-d1e9-4ed1-98ac-04fc330c01de Nov 04 10:28:56 devstack sudo[104052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:28:56 devstack sudo[104052]: pam_unix(sudo:session): session closed for user root Nov 04 10:28:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-1db1d00e-7d0d-4b7f-a3e8-74e32a40a551 tempest-VolumeDependencyTests-527307853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6badf503-f85d-41fc-8405-d3a9cb72a59d.cd2b2be3-d1e9-4ed1-98ac-04fc330c01de" returned: 0 in 0.235s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:28:56 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-1db1d00e-7d0d-4b7f-a3e8-74e32a40a551 tempest-VolumeDependencyTests-527307853 None] Lock "cinder-quobyte-cd2b2be3-d1e9-4ed1-98ac-04fc330c01de" released by "_delete_snapshot" :: held 1.516s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:28:56 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-1db1d00e-7d0d-4b7f-a3e8-74e32a40a551 tempest-VolumeDependencyTests-527307853 None] Lock "cinder-quobyte-6badf503-f85d-41fc-8405-d3a9cb72a59d" released by "delete_snapshot" :: held 1.537s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:28:57 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-1db1d00e-7d0d-4b7f-a3e8-74e32a40a551 tempest-VolumeDependencyTests-527307853 None] Created reservations ['e4ce2983-213f-4ab0-b4ad-fe9ca7147563', '20ded155-65be-428e-8d9b-23ac43f45db3', '58d13971-0cc8-44b1-b34b-e4a5583df627', '7940e029-7779-43ea-a1f8-b0b53d78c866'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:28:57 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-1db1d00e-7d0d-4b7f-a3e8-74e32a40a551 tempest-VolumeDependencyTests-527307853 None] Delete snapshot completed successfully. Nov 04 10:28:57 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-1db1d00e-7d0d-4b7f-a3e8-74e32a40a551 tempest-VolumeDependencyTests-527307853 None] Lock "cinder-cd2b2be3-d1e9-4ed1-98ac-04fc330c01de-delete_snapshot" released by "delete_snapshot" :: held 1.670s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:28:57 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-efc90bcc-050e-48ee-a0c7-f4984f38e2d6 tempest-VolumeDependencyTests-527307853 None] Acquiring lock "cinder-6badf503-f85d-41fc-8405-d3a9cb72a59d-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:28:57 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-efc90bcc-050e-48ee-a0c7-f4984f38e2d6 tempest-VolumeDependencyTests-527307853 None] Lock "cinder-6badf503-f85d-41fc-8405-d3a9cb72a59d-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:28:57 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-efc90bcc-050e-48ee-a0c7-f4984f38e2d6 tempest-VolumeDependencyTests-527307853 None] Acquiring lock "cinder-quobyte-6badf503-f85d-41fc-8405-d3a9cb72a59d" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:28:57 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-efc90bcc-050e-48ee-a0c7-f4984f38e2d6 tempest-VolumeDependencyTests-527307853 None] Lock "cinder-quobyte-6badf503-f85d-41fc-8405-d3a9cb72a59d" acquired by "delete_volume" :: waited 0.014s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:28:57 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[f00b7397-d6e2-4a94-a4f7-49e65ec00b6d]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:28:57 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-efc90bcc-050e-48ee-a0c7-f4984f38e2d6 tempest-VolumeDependencyTests-527307853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6badf503-f85d-41fc-8405-d3a9cb72a59d {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:28:57 devstack sudo[104056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6badf503-f85d-41fc-8405-d3a9cb72a59d Nov 04 10:28:57 devstack sudo[104056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:28:58 devstack sudo[104056]: pam_unix(sudo:session): session closed for user root Nov 04 10:28:58 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-efc90bcc-050e-48ee-a0c7-f4984f38e2d6 tempest-VolumeDependencyTests-527307853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6badf503-f85d-41fc-8405-d3a9cb72a59d" returned: 0 in 0.353s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:28:58 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-efc90bcc-050e-48ee-a0c7-f4984f38e2d6 tempest-VolumeDependencyTests-527307853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6badf503-f85d-41fc-8405-d3a9cb72a59d {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:28:58 devstack sudo[104062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6badf503-f85d-41fc-8405-d3a9cb72a59d Nov 04 10:28:58 devstack sudo[104062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:28:58 devstack sudo[104062]: pam_unix(sudo:session): session closed for user root Nov 04 10:28:58 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-efc90bcc-050e-48ee-a0c7-f4984f38e2d6 tempest-VolumeDependencyTests-527307853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6badf503-f85d-41fc-8405-d3a9cb72a59d" returned: 0 in 0.254s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:28:58 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-efc90bcc-050e-48ee-a0c7-f4984f38e2d6 tempest-VolumeDependencyTests-527307853 None] Lock "cinder-quobyte-6badf503-f85d-41fc-8405-d3a9cb72a59d" released by "delete_volume" :: held 0.666s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:28:58 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-efc90bcc-050e-48ee-a0c7-f4984f38e2d6 tempest-VolumeDependencyTests-527307853 None] Created reservations ['6f6a1fde-3cfc-4ab1-be89-7167d7c094ff', 'ef97cecd-a836-4c53-9207-f96070aa78f0', '6191e95c-7df9-4e7f-b57e-3cfb028069c6', '9d42c19d-7857-4cfc-85a6-e6755c685122'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:28:58 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-efc90bcc-050e-48ee-a0c7-f4984f38e2d6 tempest-VolumeDependencyTests-527307853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:28:58 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-efc90bcc-050e-48ee-a0c7-f4984f38e2d6 tempest-VolumeDependencyTests-527307853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:28:58 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-efc90bcc-050e-48ee-a0c7-f4984f38e2d6 tempest-VolumeDependencyTests-527307853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:28:58 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-efc90bcc-050e-48ee-a0c7-f4984f38e2d6 tempest-VolumeDependencyTests-527307853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:28:58 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-efc90bcc-050e-48ee-a0c7-f4984f38e2d6 tempest-VolumeDependencyTests-527307853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:28:58 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-efc90bcc-050e-48ee-a0c7-f4984f38e2d6 tempest-VolumeDependencyTests-527307853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:28:58 devstack sudo[104065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:28:58 devstack sudo[104065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:28:58 devstack sudo[104065]: pam_unix(sudo:session): session closed for user root Nov 04 10:28:58 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-efc90bcc-050e-48ee-a0c7-f4984f38e2d6 tempest-VolumeDependencyTests-527307853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.245s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:28:58 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-efc90bcc-050e-48ee-a0c7-f4984f38e2d6 tempest-VolumeDependencyTests-527307853 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:28:58 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-efc90bcc-050e-48ee-a0c7-f4984f38e2d6 tempest-VolumeDependencyTests-527307853 None] Deleted volume successfully. Nov 04 10:28:58 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-efc90bcc-050e-48ee-a0c7-f4984f38e2d6 tempest-VolumeDependencyTests-527307853 None] Lock "cinder-6badf503-f85d-41fc-8405-d3a9cb72a59d-delete_volume" released by "delete_volume" :: held 1.107s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:28:58 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-38eb45cc-1bf7-47a5-afb1-0afa5b7b52e2 tempest-VolumeDependencyTests-527307853 None] Acquiring lock "cinder-2587ebe0-9982-4f71-a8c9-bf7884fc720b-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:28:58 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-38eb45cc-1bf7-47a5-afb1-0afa5b7b52e2 tempest-VolumeDependencyTests-527307853 None] Lock "cinder-2587ebe0-9982-4f71-a8c9-bf7884fc720b-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:28:58 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-38eb45cc-1bf7-47a5-afb1-0afa5b7b52e2 tempest-VolumeDependencyTests-527307853 None] Acquiring lock "cinder-quobyte-2587ebe0-9982-4f71-a8c9-bf7884fc720b" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:28:58 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-38eb45cc-1bf7-47a5-afb1-0afa5b7b52e2 tempest-VolumeDependencyTests-527307853 None] Lock "cinder-quobyte-2587ebe0-9982-4f71-a8c9-bf7884fc720b" acquired by "delete_volume" :: waited 0.016s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:28:58 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[618c41be-cdb5-44f1-9c02-20b94403aa2c]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:28:58 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-38eb45cc-1bf7-47a5-afb1-0afa5b7b52e2 tempest-VolumeDependencyTests-527307853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-2587ebe0-9982-4f71-a8c9-bf7884fc720b {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:28:58 devstack sudo[104068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-2587ebe0-9982-4f71-a8c9-bf7884fc720b Nov 04 10:28:58 devstack sudo[104068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:28:59 devstack sudo[104068]: pam_unix(sudo:session): session closed for user root Nov 04 10:28:59 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-38eb45cc-1bf7-47a5-afb1-0afa5b7b52e2 tempest-VolumeDependencyTests-527307853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-2587ebe0-9982-4f71-a8c9-bf7884fc720b" returned: 0 in 0.364s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:28:59 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-38eb45cc-1bf7-47a5-afb1-0afa5b7b52e2 tempest-VolumeDependencyTests-527307853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-2587ebe0-9982-4f71-a8c9-bf7884fc720b {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:28:59 devstack sudo[104073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-2587ebe0-9982-4f71-a8c9-bf7884fc720b Nov 04 10:28:59 devstack sudo[104073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:28:59 devstack sudo[104073]: pam_unix(sudo:session): session closed for user root Nov 04 10:28:59 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-38eb45cc-1bf7-47a5-afb1-0afa5b7b52e2 tempest-VolumeDependencyTests-527307853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-2587ebe0-9982-4f71-a8c9-bf7884fc720b" returned: 0 in 0.254s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:28:59 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-38eb45cc-1bf7-47a5-afb1-0afa5b7b52e2 tempest-VolumeDependencyTests-527307853 None] Lock "cinder-quobyte-2587ebe0-9982-4f71-a8c9-bf7884fc720b" released by "delete_volume" :: held 0.658s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:28:59 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-38eb45cc-1bf7-47a5-afb1-0afa5b7b52e2 tempest-VolumeDependencyTests-527307853 None] Created reservations ['a42d0bdf-01ae-4bb4-a2c8-84acacb08147', '70b0969b-c3e9-497f-a5f1-0d3432f1465b', '53fa923c-22d4-434a-95e5-df66a71b406b', '04ea2ef3-424a-45f5-9084-330b50320699'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:28:59 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-38eb45cc-1bf7-47a5-afb1-0afa5b7b52e2 tempest-VolumeDependencyTests-527307853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:28:59 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-38eb45cc-1bf7-47a5-afb1-0afa5b7b52e2 tempest-VolumeDependencyTests-527307853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:28:59 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-38eb45cc-1bf7-47a5-afb1-0afa5b7b52e2 tempest-VolumeDependencyTests-527307853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:28:59 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-38eb45cc-1bf7-47a5-afb1-0afa5b7b52e2 tempest-VolumeDependencyTests-527307853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:28:59 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-38eb45cc-1bf7-47a5-afb1-0afa5b7b52e2 tempest-VolumeDependencyTests-527307853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:28:59 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-38eb45cc-1bf7-47a5-afb1-0afa5b7b52e2 tempest-VolumeDependencyTests-527307853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:28:59 devstack sudo[104076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:28:59 devstack sudo[104076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:28:59 devstack sudo[104076]: pam_unix(sudo:session): session closed for user root Nov 04 10:28:59 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-38eb45cc-1bf7-47a5-afb1-0afa5b7b52e2 tempest-VolumeDependencyTests-527307853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.237s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:28:59 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-38eb45cc-1bf7-47a5-afb1-0afa5b7b52e2 tempest-VolumeDependencyTests-527307853 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:28:59 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-38eb45cc-1bf7-47a5-afb1-0afa5b7b52e2 tempest-VolumeDependencyTests-527307853 None] Deleted volume successfully. Nov 04 10:28:59 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-38eb45cc-1bf7-47a5-afb1-0afa5b7b52e2 tempest-VolumeDependencyTests-527307853 None] Lock "cinder-2587ebe0-9982-4f71-a8c9-bf7884fc720b-delete_volume" released by "delete_volume" :: held 1.092s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:29:04 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-97f2a962-0fc6-4e9f-b453-42fbde4826ab tempest-VolumeImageDependencyTests-321839274 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:29:04 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-97f2a962-0fc6-4e9f-b453-42fbde4826ab tempest-VolumeImageDependencyTests-321839274 None] Flow 'volume_create_manager' (0b8e6f28-cf85-4e70-bca0-73aedb46a453) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:29:04 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-97f2a962-0fc6-4e9f-b453-42fbde4826ab tempest-VolumeImageDependencyTests-321839274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf1d1715-1fc4-40dd-8871-b726b00b7b9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:29:04 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-97f2a962-0fc6-4e9f-b453-42fbde4826ab tempest-VolumeImageDependencyTests-321839274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf1d1715-1fc4-40dd-8871-b726b00b7b9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:29:04Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0f345fb-5396-45f9-b17a-c95a07d60f0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99dc69c7c4b84b0f9141b8991e66dbc9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:29:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:29:05Z,use_quota=True,user_id='956087fba7824aa99f095b4b172fe5c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:29:04 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-97f2a962-0fc6-4e9f-b453-42fbde4826ab tempest-VolumeImageDependencyTests-321839274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (235150c8-0748-42dd-98e5-9bee06db9b43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:29:04 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-97f2a962-0fc6-4e9f-b453-42fbde4826ab tempest-VolumeImageDependencyTests-321839274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (235150c8-0748-42dd-98e5-9bee06db9b43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:29:04 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-97f2a962-0fc6-4e9f-b453-42fbde4826ab tempest-VolumeImageDependencyTests-321839274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (197a799a-b444-4910-b0ba-683855baf94f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:29:04 devstack cinder-volume[87068]: DEBUG cinder.image.glance [None req-97f2a962-0fc6-4e9f-b453-42fbde4826ab tempest-VolumeImageDependencyTests-321839274 None] Creating Keystone auth plugin from conf {{(pid=87068) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 04 10:29:05 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-97f2a962-0fc6-4e9f-b453-42fbde4826ab tempest-VolumeImageDependencyTests-321839274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (197a799a-b444-4910-b0ba-683855baf94f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b0f345fb-5396-45f9-b17a-c95a07d60f0c', 'volume_name': 'volume-b0f345fb-5396-45f9-b17a-c95a07d60f0c', 'volume_size': 1, 'image_id': '1c716612-6df2-47bf-a6b6-49d6ced0a96e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1c716612-6df2-47bf-a6b6-49d6ced0a96e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '63dd7955ab49dbba8244338fbf344fba', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '99dc69c7c4b84b0f9141b8991e66dbc9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '67c5413b05828bf4e5529b61dadadff66509ee9babed8d6d991747326c864067277cd8f95fc1d4b090bb39ea4a2a27696da01838be0a2cb2a39e253b80a4d14b', 'id': '1c716612-6df2-47bf-a6b6-49d6ced0a96e', 'created_at': datetime.datetime(2026, 11, 4, 9, 29, 3, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 9, 29, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1c716612-6df2-47bf-a6b6-49d6ced0a96e/file', 'properties': {}}, 'image_service': }' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:29:05 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-97f2a962-0fc6-4e9f-b453-42fbde4826ab tempest-VolumeImageDependencyTests-321839274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3302bb21-e1db-4fca-b242-df13020694c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:29:05 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-97f2a962-0fc6-4e9f-b453-42fbde4826ab tempest-VolumeImageDependencyTests-321839274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3302bb21-e1db-4fca-b242-df13020694c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:29:05 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-97f2a962-0fc6-4e9f-b453-42fbde4826ab tempest-VolumeImageDependencyTests-321839274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (138bfdba-80de-4035-9b3c-a7c7792a05e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:29:05 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-97f2a962-0fc6-4e9f-b453-42fbde4826ab tempest-VolumeImageDependencyTests-321839274 None] Volume b0f345fb-5396-45f9-b17a-c95a07d60f0c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b0f345fb-5396-45f9-b17a-c95a07d60f0c', 'volume_size': 1, 'image_id': '1c716612-6df2-47bf-a6b6-49d6ced0a96e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1c716612-6df2-47bf-a6b6-49d6ced0a96e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '63dd7955ab49dbba8244338fbf344fba', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '99dc69c7c4b84b0f9141b8991e66dbc9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '67c5413b05828bf4e5529b61dadadff66509ee9babed8d6d991747326c864067277cd8f95fc1d4b090bb39ea4a2a27696da01838be0a2cb2a39e253b80a4d14b', 'id': '1c716612-6df2-47bf-a6b6-49d6ced0a96e', 'created_at': datetime.datetime(2026, 11, 4, 9, 29, 3, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 9, 29, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1c716612-6df2-47bf-a6b6-49d6ced0a96e/file', 'properties': {}}, 'image_service': } Nov 04 10:29:05 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-97f2a962-0fc6-4e9f-b453-42fbde4826ab tempest-VolumeImageDependencyTests-321839274 None] Trying to clone b0f345fb-5396-45f9-b17a-c95a07d60f0c from image 1c716612-6df2-47bf-a6b6-49d6ced0a96e at location (None, [{'url': 'file:///opt/stack/data/glance/images/1c716612-6df2-47bf-a6b6-49d6ced0a96e', 'metadata': {}}]). {{(pid=87068) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 04 10:29:05 devstack cinder-volume[87068]: DEBUG cinder.image.image_utils [None req-97f2a962-0fc6-4e9f-b453-42fbde4826ab tempest-VolumeImageDependencyTests-321839274 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_1c716612-6df2-47bf-a6b6-49d6ced0a96e_5qcqgkr5devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87068) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 04 10:29:05 devstack cinder-volume[87068]: INFO cinder.image.image_utils [None req-97f2a962-0fc6-4e9f-b453-42fbde4826ab tempest-VolumeImageDependencyTests-321839274 None] Image download 0.00 MB at 0.00 MB/s Nov 04 10:29:05 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2ef7702-7a05-4caf-9cca-2025c16f5601]: (4, 'raw') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:29:05 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-97f2a962-0fc6-4e9f-b453-42fbde4826ab tempest-VolumeImageDependencyTests-321839274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1c716612-6df2-47bf-a6b6-49d6ced0a96e_5qcqgkr5devstack@QuobyteHD {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:29:05 devstack sudo[104080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1c716612-6df2-47bf-a6b6-49d6ced0a96e_5qcqgkr5devstack@QuobyteHD Nov 04 10:29:05 devstack sudo[104080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:29:05 devstack sudo[104080]: pam_unix(sudo:session): session closed for user root Nov 04 10:29:05 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-97f2a962-0fc6-4e9f-b453-42fbde4826ab tempest-VolumeImageDependencyTests-321839274 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1c716612-6df2-47bf-a6b6-49d6ced0a96e_5qcqgkr5devstack@QuobyteHD" returned: 0 in 0.326s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:29:05 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-97f2a962-0fc6-4e9f-b453-42fbde4826ab tempest-VolumeImageDependencyTests-321839274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1c716612-6df2-47bf-a6b6-49d6ced0a96e_5qcqgkr5devstack@QuobyteHD {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:29:05 devstack sudo[104084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1c716612-6df2-47bf-a6b6-49d6ced0a96e_5qcqgkr5devstack@QuobyteHD Nov 04 10:29:05 devstack sudo[104084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:29:05 devstack sudo[104084]: pam_unix(sudo:session): session closed for user root Nov 04 10:29:05 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-97f2a962-0fc6-4e9f-b453-42fbde4826ab tempest-VolumeImageDependencyTests-321839274 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1c716612-6df2-47bf-a6b6-49d6ced0a96e_5qcqgkr5devstack@QuobyteHD" returned: 1 in 0.311s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:29:05 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-97f2a962-0fc6-4e9f-b453-42fbde4826ab tempest-VolumeImageDependencyTests-321839274 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1c716612-6df2-47bf-a6b6-49d6ced0a96e_5qcqgkr5devstack@QuobyteHD' failed. Not Retrying. {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 04 10:29:05 devstack cinder-volume[87068]: DEBUG cinder.image.image_utils [None req-97f2a962-0fc6-4e9f-b453-42fbde4826ab tempest-VolumeImageDependencyTests-321839274 None] Temporary image 1c716612-6df2-47bf-a6b6-49d6ced0a96e is fetched for user 956087fba7824aa99f095b4b172fe5c9. {{(pid=87068) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 04 10:29:05 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce1bf5e4-abef-47a1-aef8-343428953afe]: (4, 'raw') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:29:05 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-97f2a962-0fc6-4e9f-b453-42fbde4826ab tempest-VolumeImageDependencyTests-321839274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1c716612-6df2-47bf-a6b6-49d6ced0a96e_5qcqgkr5devstack@QuobyteHD {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:29:05 devstack sudo[104089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1c716612-6df2-47bf-a6b6-49d6ced0a96e_5qcqgkr5devstack@QuobyteHD Nov 04 10:29:05 devstack sudo[104089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:29:06 devstack sudo[104089]: pam_unix(sudo:session): session closed for user root Nov 04 10:29:06 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-97f2a962-0fc6-4e9f-b453-42fbde4826ab tempest-VolumeImageDependencyTests-321839274 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1c716612-6df2-47bf-a6b6-49d6ced0a96e_5qcqgkr5devstack@QuobyteHD" returned: 0 in 0.328s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:29:06 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-97f2a962-0fc6-4e9f-b453-42fbde4826ab tempest-VolumeImageDependencyTests-321839274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1c716612-6df2-47bf-a6b6-49d6ced0a96e_5qcqgkr5devstack@QuobyteHD {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:29:06 devstack sudo[104093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1c716612-6df2-47bf-a6b6-49d6ced0a96e_5qcqgkr5devstack@QuobyteHD Nov 04 10:29:06 devstack sudo[104093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:29:06 devstack sudo[104093]: pam_unix(sudo:session): session closed for user root Nov 04 10:29:06 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-97f2a962-0fc6-4e9f-b453-42fbde4826ab tempest-VolumeImageDependencyTests-321839274 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1c716612-6df2-47bf-a6b6-49d6ced0a96e_5qcqgkr5devstack@QuobyteHD" returned: 1 in 0.307s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:29:06 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-97f2a962-0fc6-4e9f-b453-42fbde4826ab tempest-VolumeImageDependencyTests-321839274 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1c716612-6df2-47bf-a6b6-49d6ced0a96e_5qcqgkr5devstack@QuobyteHD' failed. Not Retrying. {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 04 10:29:06 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-97f2a962-0fc6-4e9f-b453-42fbde4826ab tempest-VolumeImageDependencyTests-321839274 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:29:06 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-97f2a962-0fc6-4e9f-b453-42fbde4826ab tempest-VolumeImageDependencyTests-321839274 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:29:06 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-97f2a962-0fc6-4e9f-b453-42fbde4826ab tempest-VolumeImageDependencyTests-321839274 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:29:04Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0f345fb-5396-45f9-b17a-c95a07d60f0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99dc69c7c4b84b0f9141b8991e66dbc9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:29:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:29:05Z,use_quota=True,user_id='956087fba7824aa99f095b4b172fe5c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 10:29:06 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-97f2a962-0fc6-4e9f-b453-42fbde4826ab tempest-VolumeImageDependencyTests-321839274 None] Creating volume b0f345fb-5396-45f9-b17a-c95a07d60f0c {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:29:06 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-97f2a962-0fc6-4e9f-b453-42fbde4826ab tempest-VolumeImageDependencyTests-321839274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:29:06 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-97f2a962-0fc6-4e9f-b453-42fbde4826ab tempest-VolumeImageDependencyTests-321839274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:29:06 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-97f2a962-0fc6-4e9f-b453-42fbde4826ab tempest-VolumeImageDependencyTests-321839274 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:29:06 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-97f2a962-0fc6-4e9f-b453-42fbde4826ab tempest-VolumeImageDependencyTests-321839274 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:29:06 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-97f2a962-0fc6-4e9f-b453-42fbde4826ab tempest-VolumeImageDependencyTests-321839274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:29:06 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-97f2a962-0fc6-4e9f-b453-42fbde4826ab tempest-VolumeImageDependencyTests-321839274 None] Selected osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:29:06 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-97f2a962-0fc6-4e9f-b453-42fbde4826ab tempest-VolumeImageDependencyTests-321839274 None] casted to osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 Nov 04 10:29:06 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-97f2a962-0fc6-4e9f-b453-42fbde4826ab tempest-VolumeImageDependencyTests-321839274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b0f345fb-5396-45f9-b17a-c95a07d60f0c 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:29:06 devstack sudo[104098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b0f345fb-5396-45f9-b17a-c95a07d60f0c 1073741824 Nov 04 10:29:06 devstack sudo[104098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:29:06 devstack sudo[104098]: pam_unix(sudo:session): session closed for user root Nov 04 10:29:06 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-97f2a962-0fc6-4e9f-b453-42fbde4826ab tempest-VolumeImageDependencyTests-321839274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b0f345fb-5396-45f9-b17a-c95a07d60f0c 1073741824" returned: 0 in 0.407s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:29:06 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-97f2a962-0fc6-4e9f-b453-42fbde4826ab tempest-VolumeImageDependencyTests-321839274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b0f345fb-5396-45f9-b17a-c95a07d60f0c {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:29:06 devstack sudo[104104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b0f345fb-5396-45f9-b17a-c95a07d60f0c Nov 04 10:29:06 devstack sudo[104104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:29:07 devstack sudo[104104]: pam_unix(sudo:session): session closed for user root Nov 04 10:29:07 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-97f2a962-0fc6-4e9f-b453-42fbde4826ab tempest-VolumeImageDependencyTests-321839274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b0f345fb-5396-45f9-b17a-c95a07d60f0c" returned: 0 in 0.239s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:29:07 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-97f2a962-0fc6-4e9f-b453-42fbde4826ab tempest-VolumeImageDependencyTests-321839274 None] <== create_volume: return (686ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 10:29:07 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-97f2a962-0fc6-4e9f-b453-42fbde4826ab tempest-VolumeImageDependencyTests-321839274 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.689s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:29:07 devstack cinder-volume[87068]: DEBUG cinder.volume.volume_utils [None req-97f2a962-0fc6-4e9f-b453-42fbde4826ab tempest-VolumeImageDependencyTests-321839274 None] Attempting download of 1c716612-6df2-47bf-a6b6-49d6ced0a96e ((None, [{'url': 'file:///opt/stack/data/glance/images/1c716612-6df2-47bf-a6b6-49d6ced0a96e', 'metadata': {}}])) to volume b0f345fb-5396-45f9-b17a-c95a07d60f0c. {{(pid=87068) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 04 10:29:07 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a88d0a1-6cd8-4ad0-b34b-c1c51523f11a]: (4, 'raw') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:29:07 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-97f2a962-0fc6-4e9f-b453-42fbde4826ab tempest-VolumeImageDependencyTests-321839274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1c716612-6df2-47bf-a6b6-49d6ced0a96e_fmhm4i8v {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:29:07 devstack sudo[104107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1c716612-6df2-47bf-a6b6-49d6ced0a96e_fmhm4i8v Nov 04 10:29:07 devstack sudo[104107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:29:07 devstack sudo[104107]: pam_unix(sudo:session): session closed for user root Nov 04 10:29:07 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-97f2a962-0fc6-4e9f-b453-42fbde4826ab tempest-VolumeImageDependencyTests-321839274 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1c716612-6df2-47bf-a6b6-49d6ced0a96e_fmhm4i8v" returned: 0 in 0.317s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:29:07 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-97f2a962-0fc6-4e9f-b453-42fbde4826ab tempest-VolumeImageDependencyTests-321839274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1c716612-6df2-47bf-a6b6-49d6ced0a96e_fmhm4i8v {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:29:07 devstack sudo[104111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1c716612-6df2-47bf-a6b6-49d6ced0a96e_fmhm4i8v Nov 04 10:29:07 devstack sudo[104111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:29:07 devstack sudo[104111]: pam_unix(sudo:session): session closed for user root Nov 04 10:29:07 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-97f2a962-0fc6-4e9f-b453-42fbde4826ab tempest-VolumeImageDependencyTests-321839274 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1c716612-6df2-47bf-a6b6-49d6ced0a96e_fmhm4i8v" returned: 1 in 0.325s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:29:07 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-97f2a962-0fc6-4e9f-b453-42fbde4826ab tempest-VolumeImageDependencyTests-321839274 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1c716612-6df2-47bf-a6b6-49d6ced0a96e_fmhm4i8v' failed. Not Retrying. {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 04 10:29:07 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[bed43453-8307-4241-a9c4-ad61270ce87a]: (4, 'raw') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:29:07 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-97f2a962-0fc6-4e9f-b453-42fbde4826ab tempest-VolumeImageDependencyTests-321839274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1c716612-6df2-47bf-a6b6-49d6ced0a96e_5qcqgkr5devstack@QuobyteHD {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:29:08 devstack sudo[104115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1c716612-6df2-47bf-a6b6-49d6ced0a96e_5qcqgkr5devstack@QuobyteHD Nov 04 10:29:08 devstack sudo[104115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:29:08 devstack sudo[104115]: pam_unix(sudo:session): session closed for user root Nov 04 10:29:08 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-97f2a962-0fc6-4e9f-b453-42fbde4826ab tempest-VolumeImageDependencyTests-321839274 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1c716612-6df2-47bf-a6b6-49d6ced0a96e_5qcqgkr5devstack@QuobyteHD" returned: 0 in 0.326s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:29:08 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-97f2a962-0fc6-4e9f-b453-42fbde4826ab tempest-VolumeImageDependencyTests-321839274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1c716612-6df2-47bf-a6b6-49d6ced0a96e_5qcqgkr5devstack@QuobyteHD {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:29:08 devstack sudo[104119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1c716612-6df2-47bf-a6b6-49d6ced0a96e_5qcqgkr5devstack@QuobyteHD Nov 04 10:29:08 devstack sudo[104119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:29:08 devstack sudo[104119]: pam_unix(sudo:session): session closed for user root Nov 04 10:29:08 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-97f2a962-0fc6-4e9f-b453-42fbde4826ab tempest-VolumeImageDependencyTests-321839274 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1c716612-6df2-47bf-a6b6-49d6ced0a96e_5qcqgkr5devstack@QuobyteHD" returned: 1 in 0.308s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:29:08 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-97f2a962-0fc6-4e9f-b453-42fbde4826ab tempest-VolumeImageDependencyTests-321839274 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1c716612-6df2-47bf-a6b6-49d6ced0a96e_5qcqgkr5devstack@QuobyteHD' failed. Not Retrying. {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 04 10:29:08 devstack cinder-volume[87068]: DEBUG cinder.image.image_utils [None req-97f2a962-0fc6-4e9f-b453-42fbde4826ab tempest-VolumeImageDependencyTests-321839274 None] 1c716612-6df2-47bf-a6b6-49d6ced0a96e was raw, converting to qcow2 {{(pid=87068) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 04 10:29:08 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-97f2a962-0fc6-4e9f-b453-42fbde4826ab tempest-VolumeImageDependencyTests-321839274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_1c716612-6df2-47bf-a6b6-49d6ced0a96e_5qcqgkr5devstack@QuobyteHD /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b0f345fb-5396-45f9-b17a-c95a07d60f0c {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:29:08 devstack sudo[104124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_1c716612-6df2-47bf-a6b6-49d6ced0a96e_5qcqgkr5devstack@QuobyteHD /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b0f345fb-5396-45f9-b17a-c95a07d60f0c Nov 04 10:29:08 devstack sudo[104124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:29:09 devstack sudo[104124]: pam_unix(sudo:session): session closed for user root Nov 04 10:29:09 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-97f2a962-0fc6-4e9f-b453-42fbde4826ab tempest-VolumeImageDependencyTests-321839274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_1c716612-6df2-47bf-a6b6-49d6ced0a96e_5qcqgkr5devstack@QuobyteHD /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b0f345fb-5396-45f9-b17a-c95a07d60f0c" returned: 0 in 0.465s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:29:09 devstack cinder-volume[87068]: DEBUG cinder.image.image_utils [None req-97f2a962-0fc6-4e9f-b453-42fbde4826ab tempest-VolumeImageDependencyTests-321839274 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_1c716612-6df2-47bf-a6b6-49d6ced0a96e_5qcqgkr5devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b0f345fb-5396-45f9-b17a-c95a07d60f0c {{(pid=87068) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 04 10:29:09 devstack cinder-volume[87068]: INFO cinder.image.image_utils [None req-97f2a962-0fc6-4e9f-b453-42fbde4826ab tempest-VolumeImageDependencyTests-321839274 None] Converted 0.00 MB image at 0.00 MB/s Nov 04 10:29:09 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-97f2a962-0fc6-4e9f-b453-42fbde4826ab tempest-VolumeImageDependencyTests-321839274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b0f345fb-5396-45f9-b17a-c95a07d60f0c 1G {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:29:09 devstack sudo[104130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b0f345fb-5396-45f9-b17a-c95a07d60f0c 1G Nov 04 10:29:09 devstack sudo[104130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:29:09 devstack sudo[104130]: pam_unix(sudo:session): session closed for user root Nov 04 10:29:09 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-97f2a962-0fc6-4e9f-b453-42fbde4826ab tempest-VolumeImageDependencyTests-321839274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b0f345fb-5396-45f9-b17a-c95a07d60f0c 1G" returned: 0 in 0.300s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:29:09 devstack cinder-volume[87068]: DEBUG cinder.volume.volume_utils [None req-97f2a962-0fc6-4e9f-b453-42fbde4826ab tempest-VolumeImageDependencyTests-321839274 None] Downloaded image 1c716612-6df2-47bf-a6b6-49d6ced0a96e ((None, [{'url': 'file:///opt/stack/data/glance/images/1c716612-6df2-47bf-a6b6-49d6ced0a96e', 'metadata': {}}])) to volume b0f345fb-5396-45f9-b17a-c95a07d60f0c successfully. {{(pid=87068) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 04 10:29:09 devstack cinder-volume[87068]: DEBUG cinder.image.image_utils [None req-97f2a962-0fc6-4e9f-b453-42fbde4826ab tempest-VolumeImageDependencyTests-321839274 None] Temporary image 1c716612-6df2-47bf-a6b6-49d6ced0a96e for user 956087fba7824aa99f095b4b172fe5c9 is deleted. {{(pid=87068) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 04 10:29:09 devstack cinder-volume[87068]: DEBUG cinder.volume.volume_utils [None req-97f2a962-0fc6-4e9f-b453-42fbde4826ab tempest-VolumeImageDependencyTests-321839274 None] Marking volume b0f345fb-5396-45f9-b17a-c95a07d60f0c as bootable. {{(pid=87068) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 04 10:29:09 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-97f2a962-0fc6-4e9f-b453-42fbde4826ab tempest-VolumeImageDependencyTests-321839274 None] Copying metadata from image 1c716612-6df2-47bf-a6b6-49d6ced0a96e to b0f345fb-5396-45f9-b17a-c95a07d60f0c. {{(pid=87068) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 04 10:29:09 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-97f2a962-0fc6-4e9f-b453-42fbde4826ab tempest-VolumeImageDependencyTests-321839274 None] Creating volume glance metadata for volume b0f345fb-5396-45f9-b17a-c95a07d60f0c backed by image 1c716612-6df2-47bf-a6b6-49d6ced0a96e with: {'image_id': '1c716612-6df2-47bf-a6b6-49d6ced0a96e', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '63dd7955ab49dbba8244338fbf344fba', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87068) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 04 10:29:09 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-97f2a962-0fc6-4e9f-b453-42fbde4826ab tempest-VolumeImageDependencyTests-321839274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (138bfdba-80de-4035-9b3c-a7c7792a05e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0f345fb-5396-45f9-b17a-c95a07d60f0c', 'volume_size': 1, 'image_id': '1c716612-6df2-47bf-a6b6-49d6ced0a96e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1c716612-6df2-47bf-a6b6-49d6ced0a96e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '63dd7955ab49dbba8244338fbf344fba', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '99dc69c7c4b84b0f9141b8991e66dbc9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '67c5413b05828bf4e5529b61dadadff66509ee9babed8d6d991747326c864067277cd8f95fc1d4b090bb39ea4a2a27696da01838be0a2cb2a39e253b80a4d14b', 'id': '1c716612-6df2-47bf-a6b6-49d6ced0a96e', 'created_at': datetime.datetime(2026, 11, 4, 9, 29, 3, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 9, 29, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1c716612-6df2-47bf-a6b6-49d6ced0a96e/file', 'properties': {}}, 'image_service': }' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:29:09 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-97f2a962-0fc6-4e9f-b453-42fbde4826ab tempest-VolumeImageDependencyTests-321839274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad178d68-2432-415d-bdcf-d8f29e3738f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:29:09 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-97f2a962-0fc6-4e9f-b453-42fbde4826ab tempest-VolumeImageDependencyTests-321839274 None] Volume volume-b0f345fb-5396-45f9-b17a-c95a07d60f0c (b0f345fb-5396-45f9-b17a-c95a07d60f0c): created successfully Nov 04 10:29:09 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-97f2a962-0fc6-4e9f-b453-42fbde4826ab tempest-VolumeImageDependencyTests-321839274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad178d68-2432-415d-bdcf-d8f29e3738f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:29:09 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-97f2a962-0fc6-4e9f-b453-42fbde4826ab tempest-VolumeImageDependencyTests-321839274 None] Flow 'volume_create_manager' (0b8e6f28-cf85-4e70-bca0-73aedb46a453) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:29:09 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-97f2a962-0fc6-4e9f-b453-42fbde4826ab tempest-VolumeImageDependencyTests-321839274 None] Created volume successfully. Nov 04 10:29:10 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-f9466615-0780-4679-a074-360646227626 tempest-VolumeImageDependencyTests-321839274 None] Acquiring lock "cinder-b0f345fb-5396-45f9-b17a-c95a07d60f0c-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:29:10 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-f9466615-0780-4679-a074-360646227626 tempest-VolumeImageDependencyTests-321839274 None] Lock "cinder-b0f345fb-5396-45f9-b17a-c95a07d60f0c-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:29:10 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-f9466615-0780-4679-a074-360646227626 tempest-VolumeImageDependencyTests-321839274 None] Acquiring lock "cinder-quobyte-b0f345fb-5396-45f9-b17a-c95a07d60f0c" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:29:10 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-f9466615-0780-4679-a074-360646227626 tempest-VolumeImageDependencyTests-321839274 None] Lock "cinder-quobyte-b0f345fb-5396-45f9-b17a-c95a07d60f0c" acquired by "delete_volume" :: waited 0.015s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:29:10 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed90b47c-fa6f-4c7c-8bfb-a0a2ff94fe0d]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:29:10 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f9466615-0780-4679-a074-360646227626 tempest-VolumeImageDependencyTests-321839274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b0f345fb-5396-45f9-b17a-c95a07d60f0c {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:29:10 devstack sudo[104135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b0f345fb-5396-45f9-b17a-c95a07d60f0c Nov 04 10:29:10 devstack sudo[104135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:29:10 devstack sudo[104135]: pam_unix(sudo:session): session closed for user root Nov 04 10:29:10 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f9466615-0780-4679-a074-360646227626 tempest-VolumeImageDependencyTests-321839274 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b0f345fb-5396-45f9-b17a-c95a07d60f0c" returned: 0 in 0.353s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:29:10 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f9466615-0780-4679-a074-360646227626 tempest-VolumeImageDependencyTests-321839274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b0f345fb-5396-45f9-b17a-c95a07d60f0c {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:29:10 devstack sudo[104140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b0f345fb-5396-45f9-b17a-c95a07d60f0c Nov 04 10:29:10 devstack sudo[104140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:29:10 devstack sudo[104140]: pam_unix(sudo:session): session closed for user root Nov 04 10:29:10 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f9466615-0780-4679-a074-360646227626 tempest-VolumeImageDependencyTests-321839274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b0f345fb-5396-45f9-b17a-c95a07d60f0c" returned: 0 in 0.237s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:29:10 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-f9466615-0780-4679-a074-360646227626 tempest-VolumeImageDependencyTests-321839274 None] Lock "cinder-quobyte-b0f345fb-5396-45f9-b17a-c95a07d60f0c" released by "delete_volume" :: held 0.633s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:29:10 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-f9466615-0780-4679-a074-360646227626 tempest-VolumeImageDependencyTests-321839274 None] Created reservations ['8de96037-bdde-4a77-85ac-0156d3766bb1', '11f80627-d828-4fb0-807c-96ec9850df5c', '2e11b7af-bbac-4c70-b572-3e21c3715087', 'fde91fb6-a4b7-479e-a3f0-25a4e9eb57c9'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:29:10 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-f9466615-0780-4679-a074-360646227626 tempest-VolumeImageDependencyTests-321839274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:29:10 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-f9466615-0780-4679-a074-360646227626 tempest-VolumeImageDependencyTests-321839274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:29:10 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-f9466615-0780-4679-a074-360646227626 tempest-VolumeImageDependencyTests-321839274 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:29:10 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-f9466615-0780-4679-a074-360646227626 tempest-VolumeImageDependencyTests-321839274 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:29:10 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-f9466615-0780-4679-a074-360646227626 tempest-VolumeImageDependencyTests-321839274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:29:10 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f9466615-0780-4679-a074-360646227626 tempest-VolumeImageDependencyTests-321839274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:29:10 devstack sudo[104143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:29:10 devstack sudo[104143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:29:11 devstack sudo[104143]: pam_unix(sudo:session): session closed for user root Nov 04 10:29:11 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f9466615-0780-4679-a074-360646227626 tempest-VolumeImageDependencyTests-321839274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.243s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:29:11 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-f9466615-0780-4679-a074-360646227626 tempest-VolumeImageDependencyTests-321839274 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:29:11 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-f9466615-0780-4679-a074-360646227626 tempest-VolumeImageDependencyTests-321839274 None] Deleted volume successfully. Nov 04 10:29:11 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-f9466615-0780-4679-a074-360646227626 tempest-VolumeImageDependencyTests-321839274 None] Lock "cinder-b0f345fb-5396-45f9-b17a-c95a07d60f0c-delete_volume" released by "delete_volume" :: held 1.072s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:29:20 devstack cinder-volume[87068]: DEBUG dbcounter [-] [87068] Writing DB stats cinder:SELECT=33,cinder:UPDATE=36,cinder:INSERT=16,cinder:DELETE=2 {{(pid=87068) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 10:29:21 devstack cinder-volume[87068]: DEBUG dbcounter [-] [87068] Writing DB stats cinder:UPDATE=38,cinder:SELECT=29,cinder:INSERT=11,cinder:DELETE=3 {{(pid=87068) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 10:29:36 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1a9c429-b58e-48d4-9100-4ce62cdec5f0 tempest-SnapshotDependencyTests-240315140 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:29:36 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-e1a9c429-b58e-48d4-9100-4ce62cdec5f0 tempest-SnapshotDependencyTests-240315140 None] Flow 'volume_create_manager' (50eedc77-531c-46c7-9a7b-2211cdb681e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:29:36 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-e1a9c429-b58e-48d4-9100-4ce62cdec5f0 tempest-SnapshotDependencyTests-240315140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d5634a0-c586-451c-b68f-af4831d0fa53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:29:36 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-e1a9c429-b58e-48d4-9100-4ce62cdec5f0 tempest-SnapshotDependencyTests-240315140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d5634a0-c586-451c-b68f-af4831d0fa53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:29:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-816830627',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf1b3cb0-3c5d-4d82-aff9-742c499f84a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fac5a3f3e13439690c8285762c6a995',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:29:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:29:36Z,use_quota=True,user_id='fbab55ae55164e6f9cf4551c7d87c66a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:29:36 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-e1a9c429-b58e-48d4-9100-4ce62cdec5f0 tempest-SnapshotDependencyTests-240315140 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f14c854b-5df0-4901-ba68-a86552313497) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:29:36 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-e1a9c429-b58e-48d4-9100-4ce62cdec5f0 tempest-SnapshotDependencyTests-240315140 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f14c854b-5df0-4901-ba68-a86552313497) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:29:36 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-e1a9c429-b58e-48d4-9100-4ce62cdec5f0 tempest-SnapshotDependencyTests-240315140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f48a824-26f4-4dad-b4b0-82916caa2249) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:29:36 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-e1a9c429-b58e-48d4-9100-4ce62cdec5f0 tempest-SnapshotDependencyTests-240315140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f48a824-26f4-4dad-b4b0-82916caa2249) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf1b3cb0-3c5d-4d82-aff9-742c499f84a3', 'volume_name': 'volume-cf1b3cb0-3c5d-4d82-aff9-742c499f84a3', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:29:36 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-e1a9c429-b58e-48d4-9100-4ce62cdec5f0 tempest-SnapshotDependencyTests-240315140 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37ef2ab3-5768-4387-9c9e-fbc8b8581c6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:29:36 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-e1a9c429-b58e-48d4-9100-4ce62cdec5f0 tempest-SnapshotDependencyTests-240315140 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37ef2ab3-5768-4387-9c9e-fbc8b8581c6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:29:36 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-e1a9c429-b58e-48d4-9100-4ce62cdec5f0 tempest-SnapshotDependencyTests-240315140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5734cea-c6b6-4a82-a546-1475a8ef5d04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:29:36 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-e1a9c429-b58e-48d4-9100-4ce62cdec5f0 tempest-SnapshotDependencyTests-240315140 None] Volume cf1b3cb0-3c5d-4d82-aff9-742c499f84a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf1b3cb0-3c5d-4d82-aff9-742c499f84a3', 'volume_size': 1} Nov 04 10:29:36 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-e1a9c429-b58e-48d4-9100-4ce62cdec5f0 tempest-SnapshotDependencyTests-240315140 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:29:36 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-e1a9c429-b58e-48d4-9100-4ce62cdec5f0 tempest-SnapshotDependencyTests-240315140 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:29:36 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-e1a9c429-b58e-48d4-9100-4ce62cdec5f0 tempest-SnapshotDependencyTests-240315140 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:29:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-816830627',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf1b3cb0-3c5d-4d82-aff9-742c499f84a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fac5a3f3e13439690c8285762c6a995',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:29:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:29:36Z,use_quota=True,user_id='fbab55ae55164e6f9cf4551c7d87c66a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 10:29:36 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-e1a9c429-b58e-48d4-9100-4ce62cdec5f0 tempest-SnapshotDependencyTests-240315140 None] Creating volume cf1b3cb0-3c5d-4d82-aff9-742c499f84a3 {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:29:36 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-e1a9c429-b58e-48d4-9100-4ce62cdec5f0 tempest-SnapshotDependencyTests-240315140 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:29:36 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-e1a9c429-b58e-48d4-9100-4ce62cdec5f0 tempest-SnapshotDependencyTests-240315140 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:29:36 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-e1a9c429-b58e-48d4-9100-4ce62cdec5f0 tempest-SnapshotDependencyTests-240315140 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:29:36 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-e1a9c429-b58e-48d4-9100-4ce62cdec5f0 tempest-SnapshotDependencyTests-240315140 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:29:36 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-e1a9c429-b58e-48d4-9100-4ce62cdec5f0 tempest-SnapshotDependencyTests-240315140 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:29:36 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-e1a9c429-b58e-48d4-9100-4ce62cdec5f0 tempest-SnapshotDependencyTests-240315140 None] Selected osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:29:36 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-e1a9c429-b58e-48d4-9100-4ce62cdec5f0 tempest-SnapshotDependencyTests-240315140 None] casted to osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 Nov 04 10:29:36 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-e1a9c429-b58e-48d4-9100-4ce62cdec5f0 tempest-SnapshotDependencyTests-240315140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-cf1b3cb0-3c5d-4d82-aff9-742c499f84a3 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:29:36 devstack sudo[104153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-cf1b3cb0-3c5d-4d82-aff9-742c499f84a3 1073741824 Nov 04 10:29:36 devstack sudo[104153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:29:36 devstack sudo[104153]: pam_unix(sudo:session): session closed for user root Nov 04 10:29:36 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-e1a9c429-b58e-48d4-9100-4ce62cdec5f0 tempest-SnapshotDependencyTests-240315140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-cf1b3cb0-3c5d-4d82-aff9-742c499f84a3 1073741824" returned: 0 in 0.422s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:29:36 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-e1a9c429-b58e-48d4-9100-4ce62cdec5f0 tempest-SnapshotDependencyTests-240315140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-cf1b3cb0-3c5d-4d82-aff9-742c499f84a3 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:29:36 devstack sudo[104158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-cf1b3cb0-3c5d-4d82-aff9-742c499f84a3 Nov 04 10:29:36 devstack sudo[104158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:29:37 devstack sudo[104158]: pam_unix(sudo:session): session closed for user root Nov 04 10:29:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-e1a9c429-b58e-48d4-9100-4ce62cdec5f0 tempest-SnapshotDependencyTests-240315140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-cf1b3cb0-3c5d-4d82-aff9-742c499f84a3" returned: 0 in 0.230s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:29:37 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-e1a9c429-b58e-48d4-9100-4ce62cdec5f0 tempest-SnapshotDependencyTests-240315140 None] <== create_volume: return (692ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 10:29:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-e1a9c429-b58e-48d4-9100-4ce62cdec5f0 tempest-SnapshotDependencyTests-240315140 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.695s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:29:37 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-e1a9c429-b58e-48d4-9100-4ce62cdec5f0 tempest-SnapshotDependencyTests-240315140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5734cea-c6b6-4a82-a546-1475a8ef5d04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf1b3cb0-3c5d-4d82-aff9-742c499f84a3', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:29:37 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-e1a9c429-b58e-48d4-9100-4ce62cdec5f0 tempest-SnapshotDependencyTests-240315140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f66af3b8-4a16-4a5b-8650-d191d1a89e2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:29:37 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-e1a9c429-b58e-48d4-9100-4ce62cdec5f0 tempest-SnapshotDependencyTests-240315140 None] Volume volume-cf1b3cb0-3c5d-4d82-aff9-742c499f84a3 (cf1b3cb0-3c5d-4d82-aff9-742c499f84a3): created successfully Nov 04 10:29:37 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-e1a9c429-b58e-48d4-9100-4ce62cdec5f0 tempest-SnapshotDependencyTests-240315140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f66af3b8-4a16-4a5b-8650-d191d1a89e2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:29:37 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-e1a9c429-b58e-48d4-9100-4ce62cdec5f0 tempest-SnapshotDependencyTests-240315140 None] Flow 'volume_create_manager' (50eedc77-531c-46c7-9a7b-2211cdb681e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:29:37 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-e1a9c429-b58e-48d4-9100-4ce62cdec5f0 tempest-SnapshotDependencyTests-240315140 None] Created volume successfully. Nov 04 10:29:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-a41cffea-7dc8-4097-aa5d-2a12174635c9 tempest-SnapshotDependencyTests-240315140 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:29:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-a41cffea-7dc8-4097-aa5d-2a12174635c9 tempest-SnapshotDependencyTests-240315140 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:29:37 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-a41cffea-7dc8-4097-aa5d-2a12174635c9 tempest-SnapshotDependencyTests-240315140 None] Creating offline snapshot 490398a1-d1c9-47c9-9fad-2cfe8c8aa3b5 of volume cf1b3cb0-3c5d-4d82-aff9-742c499f84a3 {{(pid=87068) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 10:29:37 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6123073-9769-42c1-8943-e807e3805603]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:29:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-a41cffea-7dc8-4097-aa5d-2a12174635c9 tempest-SnapshotDependencyTests-240315140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-cf1b3cb0-3c5d-4d82-aff9-742c499f84a3 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:29:37 devstack sudo[104161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-cf1b3cb0-3c5d-4d82-aff9-742c499f84a3 Nov 04 10:29:37 devstack sudo[104161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:29:37 devstack sudo[104161]: pam_unix(sudo:session): session closed for user root Nov 04 10:29:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-a41cffea-7dc8-4097-aa5d-2a12174635c9 tempest-SnapshotDependencyTests-240315140 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-cf1b3cb0-3c5d-4d82-aff9-742c499f84a3" returned: 0 in 0.344s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:29:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-a41cffea-7dc8-4097-aa5d-2a12174635c9 tempest-SnapshotDependencyTests-240315140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-cf1b3cb0-3c5d-4d82-aff9-742c499f84a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-cf1b3cb0-3c5d-4d82-aff9-742c499f84a3.490398a1-d1c9-47c9-9fad-2cfe8c8aa3b5 1G {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:29:37 devstack sudo[104166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-cf1b3cb0-3c5d-4d82-aff9-742c499f84a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-cf1b3cb0-3c5d-4d82-aff9-742c499f84a3.490398a1-d1c9-47c9-9fad-2cfe8c8aa3b5 1G Nov 04 10:29:37 devstack sudo[104166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:29:38 devstack sudo[104166]: pam_unix(sudo:session): session closed for user root Nov 04 10:29:38 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-a41cffea-7dc8-4097-aa5d-2a12174635c9 tempest-SnapshotDependencyTests-240315140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-cf1b3cb0-3c5d-4d82-aff9-742c499f84a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-cf1b3cb0-3c5d-4d82-aff9-742c499f84a3.490398a1-d1c9-47c9-9fad-2cfe8c8aa3b5 1G" returned: 0 in 0.388s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:29:38 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-a41cffea-7dc8-4097-aa5d-2a12174635c9 tempest-SnapshotDependencyTests-240315140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf1b3cb0-3c5d-4d82-aff9-742c499f84a3 -F qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-cf1b3cb0-3c5d-4d82-aff9-742c499f84a3.490398a1-d1c9-47c9-9fad-2cfe8c8aa3b5 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:29:38 devstack sudo[104171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf1b3cb0-3c5d-4d82-aff9-742c499f84a3 -F qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-cf1b3cb0-3c5d-4d82-aff9-742c499f84a3.490398a1-d1c9-47c9-9fad-2cfe8c8aa3b5 Nov 04 10:29:38 devstack sudo[104171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:29:38 devstack sudo[104171]: pam_unix(sudo:session): session closed for user root Nov 04 10:29:38 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-a41cffea-7dc8-4097-aa5d-2a12174635c9 tempest-SnapshotDependencyTests-240315140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf1b3cb0-3c5d-4d82-aff9-742c499f84a3 -F qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-cf1b3cb0-3c5d-4d82-aff9-742c499f84a3.490398a1-d1c9-47c9-9fad-2cfe8c8aa3b5" returned: 0 in 0.297s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:29:38 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-a41cffea-7dc8-4097-aa5d-2a12174635c9 tempest-SnapshotDependencyTests-240315140 None] /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-cf1b3cb0-3c5d-4d82-aff9-742c499f84a3.490398a1-d1c9-47c9-9fad-2cfe8c8aa3b5 is being set with open permissions: ugo+rw Nov 04 10:29:38 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-a41cffea-7dc8-4097-aa5d-2a12174635c9 tempest-SnapshotDependencyTests-240315140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-cf1b3cb0-3c5d-4d82-aff9-742c499f84a3.490398a1-d1c9-47c9-9fad-2cfe8c8aa3b5 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:29:38 devstack sudo[104176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-cf1b3cb0-3c5d-4d82-aff9-742c499f84a3.490398a1-d1c9-47c9-9fad-2cfe8c8aa3b5 Nov 04 10:29:38 devstack sudo[104176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:29:38 devstack sudo[104176]: pam_unix(sudo:session): session closed for user root Nov 04 10:29:38 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-a41cffea-7dc8-4097-aa5d-2a12174635c9 tempest-SnapshotDependencyTests-240315140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-cf1b3cb0-3c5d-4d82-aff9-742c499f84a3.490398a1-d1c9-47c9-9fad-2cfe8c8aa3b5" returned: 0 in 0.251s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:29:38 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-a41cffea-7dc8-4097-aa5d-2a12174635c9 tempest-SnapshotDependencyTests-240315140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-cf1b3cb0-3c5d-4d82-aff9-742c499f84a3.info {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:29:38 devstack sudo[104179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-cf1b3cb0-3c5d-4d82-aff9-742c499f84a3.info Nov 04 10:29:38 devstack sudo[104179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:29:39 devstack sudo[104179]: pam_unix(sudo:session): session closed for user root Nov 04 10:29:39 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-a41cffea-7dc8-4097-aa5d-2a12174635c9 tempest-SnapshotDependencyTests-240315140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-cf1b3cb0-3c5d-4d82-aff9-742c499f84a3.info" returned: 0 in 0.242s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:29:39 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-a41cffea-7dc8-4097-aa5d-2a12174635c9 tempest-SnapshotDependencyTests-240315140 None] /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-cf1b3cb0-3c5d-4d82-aff9-742c499f84a3.info is being set with open permissions: ugo+rw Nov 04 10:29:39 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-a41cffea-7dc8-4097-aa5d-2a12174635c9 tempest-SnapshotDependencyTests-240315140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-cf1b3cb0-3c5d-4d82-aff9-742c499f84a3.info {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:29:39 devstack sudo[104182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-cf1b3cb0-3c5d-4d82-aff9-742c499f84a3.info Nov 04 10:29:39 devstack sudo[104182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:29:39 devstack sudo[104182]: pam_unix(sudo:session): session closed for user root Nov 04 10:29:39 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-a41cffea-7dc8-4097-aa5d-2a12174635c9 tempest-SnapshotDependencyTests-240315140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-cf1b3cb0-3c5d-4d82-aff9-742c499f84a3.info" returned: 0 in 0.244s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:29:39 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-a41cffea-7dc8-4097-aa5d-2a12174635c9 tempest-SnapshotDependencyTests-240315140 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.863s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:29:39 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-a41cffea-7dc8-4097-aa5d-2a12174635c9 tempest-SnapshotDependencyTests-240315140 None] Create snapshot completed successfully Nov 04 10:29:40 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-78282821-c01b-4d10-aca6-2c40244d5d55 tempest-SnapshotDependencyTests-240315140 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:29:40 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-78282821-c01b-4d10-aca6-2c40244d5d55 tempest-SnapshotDependencyTests-240315140 None] Flow 'volume_create_manager' (f05313b8-8f5d-4f96-97f4-0e5915bebb4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:29:40 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-78282821-c01b-4d10-aca6-2c40244d5d55 tempest-SnapshotDependencyTests-240315140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb842b6a-a844-4b4d-bced-9ceb157a7d13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:29:40 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-78282821-c01b-4d10-aca6-2c40244d5d55 tempest-SnapshotDependencyTests-240315140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb842b6a-a844-4b4d-bced-9ceb157a7d13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:29:40Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d9fb0a0-f0c2-4e44-9e8e-5b4fbe332a48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fac5a3f3e13439690c8285762c6a995',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:29:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=490398a1-d1c9-47c9-9fad-2cfe8c8aa3b5,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:29:40Z,use_quota=True,user_id='fbab55ae55164e6f9cf4551c7d87c66a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:29:40 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-78282821-c01b-4d10-aca6-2c40244d5d55 tempest-SnapshotDependencyTests-240315140 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b171bf58-63e6-43db-a41b-31af0fe575ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:29:40 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-78282821-c01b-4d10-aca6-2c40244d5d55 tempest-SnapshotDependencyTests-240315140 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b171bf58-63e6-43db-a41b-31af0fe575ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:29:40 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-78282821-c01b-4d10-aca6-2c40244d5d55 tempest-SnapshotDependencyTests-240315140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f612462-6411-4ab1-832b-e53abb62d53c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:29:40 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-78282821-c01b-4d10-aca6-2c40244d5d55 tempest-SnapshotDependencyTests-240315140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f612462-6411-4ab1-832b-e53abb62d53c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '1d9fb0a0-f0c2-4e44-9e8e-5b4fbe332a48', 'volume_name': 'volume-1d9fb0a0-f0c2-4e44-9e8e-5b4fbe332a48', 'volume_size': 1, 'snapshot_id': '490398a1-d1c9-47c9-9fad-2cfe8c8aa3b5'}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:29:40 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-78282821-c01b-4d10-aca6-2c40244d5d55 tempest-SnapshotDependencyTests-240315140 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce1a7fee-d7ff-4b22-a60d-833aba3b75e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:29:40 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-78282821-c01b-4d10-aca6-2c40244d5d55 tempest-SnapshotDependencyTests-240315140 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce1a7fee-d7ff-4b22-a60d-833aba3b75e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:29:40 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-78282821-c01b-4d10-aca6-2c40244d5d55 tempest-SnapshotDependencyTests-240315140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b79e8d5c-b749-459d-bd54-4bde6bec9c53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:29:40 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-78282821-c01b-4d10-aca6-2c40244d5d55 tempest-SnapshotDependencyTests-240315140 None] Volume 1d9fb0a0-f0c2-4e44-9e8e-5b4fbe332a48: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-1d9fb0a0-f0c2-4e44-9e8e-5b4fbe332a48', 'volume_size': 1, 'snapshot_id': '490398a1-d1c9-47c9-9fad-2cfe8c8aa3b5'} Nov 04 10:29:40 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-78282821-c01b-4d10-aca6-2c40244d5d55 tempest-SnapshotDependencyTests-240315140 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:29:40 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-78282821-c01b-4d10-aca6-2c40244d5d55 tempest-SnapshotDependencyTests-240315140 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:29:40 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-78282821-c01b-4d10-aca6-2c40244d5d55 tempest-SnapshotDependencyTests-240315140 None] Acquiring lock "cinder-quobyte-490398a1-d1c9-47c9-9fad-2cfe8c8aa3b5-1d9fb0a0-f0c2-4e44-9e8e-5b4fbe332a48" by "_create_volume_from_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:29:40 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-78282821-c01b-4d10-aca6-2c40244d5d55 tempest-SnapshotDependencyTests-240315140 None] Lock "cinder-quobyte-490398a1-d1c9-47c9-9fad-2cfe8c8aa3b5-1d9fb0a0-f0c2-4e44-9e8e-5b4fbe332a48" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:29:40 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-78282821-c01b-4d10-aca6-2c40244d5d55 tempest-SnapshotDependencyTests-240315140 None] Creating volume 1d9fb0a0-f0c2-4e44-9e8e-5b4fbe332a48 from snapshot 490398a1-d1c9-47c9-9fad-2cfe8c8aa3b5 {{(pid=87068) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 04 10:29:40 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-78282821-c01b-4d10-aca6-2c40244d5d55 tempest-SnapshotDependencyTests-240315140 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:29:40 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-78282821-c01b-4d10-aca6-2c40244d5d55 tempest-SnapshotDependencyTests-240315140 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:29:40 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-78282821-c01b-4d10-aca6-2c40244d5d55 tempest-SnapshotDependencyTests-240315140 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:29:40 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-78282821-c01b-4d10-aca6-2c40244d5d55 tempest-SnapshotDependencyTests-240315140 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:29:40 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-78282821-c01b-4d10-aca6-2c40244d5d55 tempest-SnapshotDependencyTests-240315140 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:29:40 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-78282821-c01b-4d10-aca6-2c40244d5d55 tempest-SnapshotDependencyTests-240315140 None] Selected osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:29:40 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-78282821-c01b-4d10-aca6-2c40244d5d55 tempest-SnapshotDependencyTests-240315140 None] Acquiring lock "cinder-quobyte-1d9fb0a0-f0c2-4e44-9e8e-5b4fbe332a48" by "_copy_volume_from_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:29:40 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-78282821-c01b-4d10-aca6-2c40244d5d55 tempest-SnapshotDependencyTests-240315140 None] Lock "cinder-quobyte-1d9fb0a0-f0c2-4e44-9e8e-5b4fbe332a48" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:29:40 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-78282821-c01b-4d10-aca6-2c40244d5d55 tempest-SnapshotDependencyTests-240315140 None] snapshot: 490398a1-d1c9-47c9-9fad-2cfe8c8aa3b5, volume: 1d9fb0a0-f0c2-4e44-9e8e-5b4fbe332a48, {{(pid=87068) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 04 10:29:40 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-78282821-c01b-4d10-aca6-2c40244d5d55 tempest-SnapshotDependencyTests-240315140 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:29:40 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-78282821-c01b-4d10-aca6-2c40244d5d55 tempest-SnapshotDependencyTests-240315140 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:29:40 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-78282821-c01b-4d10-aca6-2c40244d5d55 tempest-SnapshotDependencyTests-240315140 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:29:40 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-78282821-c01b-4d10-aca6-2c40244d5d55 tempest-SnapshotDependencyTests-240315140 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:29:40 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-78282821-c01b-4d10-aca6-2c40244d5d55 tempest-SnapshotDependencyTests-240315140 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:29:40 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeb26398-45fc-4e33-956b-4cafe08fc282]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:29:40 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-78282821-c01b-4d10-aca6-2c40244d5d55 tempest-SnapshotDependencyTests-240315140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-cf1b3cb0-3c5d-4d82-aff9-742c499f84a3.490398a1-d1c9-47c9-9fad-2cfe8c8aa3b5 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:29:40 devstack sudo[104185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-cf1b3cb0-3c5d-4d82-aff9-742c499f84a3.490398a1-d1c9-47c9-9fad-2cfe8c8aa3b5 Nov 04 10:29:40 devstack sudo[104185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:29:40 devstack sudo[104185]: pam_unix(sudo:session): session closed for user root Nov 04 10:29:40 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-78282821-c01b-4d10-aca6-2c40244d5d55 tempest-SnapshotDependencyTests-240315140 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-cf1b3cb0-3c5d-4d82-aff9-742c499f84a3.490398a1-d1c9-47c9-9fad-2cfe8c8aa3b5" returned: 0 in 0.344s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:29:40 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-78282821-c01b-4d10-aca6-2c40244d5d55 tempest-SnapshotDependencyTests-240315140 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cf1b3cb0-3c5d-4d82-aff9-742c499f84a3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87068) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 10:29:40 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c3ccd6f-57a9-4bb3-9292-4ddf2d4d5953]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:29:40 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-78282821-c01b-4d10-aca6-2c40244d5d55 tempest-SnapshotDependencyTests-240315140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-cf1b3cb0-3c5d-4d82-aff9-742c499f84a3 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:29:40 devstack sudo[104190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-cf1b3cb0-3c5d-4d82-aff9-742c499f84a3 Nov 04 10:29:40 devstack sudo[104190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:29:41 devstack sudo[104190]: pam_unix(sudo:session): session closed for user root Nov 04 10:29:41 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-78282821-c01b-4d10-aca6-2c40244d5d55 tempest-SnapshotDependencyTests-240315140 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-cf1b3cb0-3c5d-4d82-aff9-742c499f84a3" returned: 0 in 0.358s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:29:41 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-78282821-c01b-4d10-aca6-2c40244d5d55 tempest-SnapshotDependencyTests-240315140 None] will copy from snapshot at /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-cf1b3cb0-3c5d-4d82-aff9-742c499f84a3 {{(pid=87068) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 04 10:29:41 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-78282821-c01b-4d10-aca6-2c40244d5d55 tempest-SnapshotDependencyTests-240315140 None] Creating direct copy from snapshot {{(pid=87068) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 04 10:29:41 devstack cinder-volume[87068]: DEBUG cinder.utils [None req-78282821-c01b-4d10-aca6-2c40244d5d55 tempest-SnapshotDependencyTests-240315140 None] Path /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-1d9fb0a0-f0c2-4e44-9e8e-5b4fbe332a48 not found in is_blk_device check {{(pid=87068) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 04 10:29:41 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-78282821-c01b-4d10-aca6-2c40244d5d55 tempest-SnapshotDependencyTests-240315140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-cf1b3cb0-3c5d-4d82-aff9-742c499f84a3 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-1d9fb0a0-f0c2-4e44-9e8e-5b4fbe332a48 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:29:41 devstack sudo[104195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-cf1b3cb0-3c5d-4d82-aff9-742c499f84a3 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-1d9fb0a0-f0c2-4e44-9e8e-5b4fbe332a48 Nov 04 10:29:41 devstack sudo[104195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:29:46 devstack sudo[104195]: pam_unix(sudo:session): session closed for user root Nov 04 10:29:46 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-78282821-c01b-4d10-aca6-2c40244d5d55 tempest-SnapshotDependencyTests-240315140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-cf1b3cb0-3c5d-4d82-aff9-742c499f84a3 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-1d9fb0a0-f0c2-4e44-9e8e-5b4fbe332a48" returned: 0 in 5.440s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:29:46 devstack cinder-volume[87068]: DEBUG cinder.image.image_utils [None req-78282821-c01b-4d10-aca6-2c40244d5d55 tempest-SnapshotDependencyTests-240315140 None] Image conversion details: src /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-cf1b3cb0-3c5d-4d82-aff9-742c499f84a3, size 1024.00 MB, duration 5.44 sec, destination /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-1d9fb0a0-f0c2-4e44-9e8e-5b4fbe332a48 {{(pid=87068) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 04 10:29:46 devstack cinder-volume[87068]: INFO cinder.image.image_utils [None req-78282821-c01b-4d10-aca6-2c40244d5d55 tempest-SnapshotDependencyTests-240315140 None] Converted 1024.00 MB image at 188.20 MB/s Nov 04 10:29:46 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-78282821-c01b-4d10-aca6-2c40244d5d55 tempest-SnapshotDependencyTests-240315140 None] /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-1d9fb0a0-f0c2-4e44-9e8e-5b4fbe332a48 is being set with open permissions: ugo+rw Nov 04 10:29:46 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-78282821-c01b-4d10-aca6-2c40244d5d55 tempest-SnapshotDependencyTests-240315140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-1d9fb0a0-f0c2-4e44-9e8e-5b4fbe332a48 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:29:46 devstack sudo[104208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-1d9fb0a0-f0c2-4e44-9e8e-5b4fbe332a48 Nov 04 10:29:46 devstack sudo[104208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:29:46 devstack sudo[104208]: pam_unix(sudo:session): session closed for user root Nov 04 10:29:46 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-78282821-c01b-4d10-aca6-2c40244d5d55 tempest-SnapshotDependencyTests-240315140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-1d9fb0a0-f0c2-4e44-9e8e-5b4fbe332a48" returned: 0 in 0.231s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:29:46 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-78282821-c01b-4d10-aca6-2c40244d5d55 tempest-SnapshotDependencyTests-240315140 None] Lock "cinder-quobyte-1d9fb0a0-f0c2-4e44-9e8e-5b4fbe332a48" released by "_copy_volume_from_snapshot" :: held 6.455s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:29:46 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-78282821-c01b-4d10-aca6-2c40244d5d55 tempest-SnapshotDependencyTests-240315140 None] Lock "cinder-quobyte-490398a1-d1c9-47c9-9fad-2cfe8c8aa3b5-1d9fb0a0-f0c2-4e44-9e8e-5b4fbe332a48" released by "_create_volume_from_snapshot" :: held 6.514s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:29:46 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-78282821-c01b-4d10-aca6-2c40244d5d55 tempest-SnapshotDependencyTests-240315140 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.528s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:29:46 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-78282821-c01b-4d10-aca6-2c40244d5d55 tempest-SnapshotDependencyTests-240315140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b79e8d5c-b749-459d-bd54-4bde6bec9c53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d9fb0a0-f0c2-4e44-9e8e-5b4fbe332a48', 'volume_size': 1, 'snapshot_id': '490398a1-d1c9-47c9-9fad-2cfe8c8aa3b5'}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:29:46 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-78282821-c01b-4d10-aca6-2c40244d5d55 tempest-SnapshotDependencyTests-240315140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48d6dedf-fcc7-40e4-af36-51ffb1514854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:29:46 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-78282821-c01b-4d10-aca6-2c40244d5d55 tempest-SnapshotDependencyTests-240315140 None] Volume volume-1d9fb0a0-f0c2-4e44-9e8e-5b4fbe332a48 (1d9fb0a0-f0c2-4e44-9e8e-5b4fbe332a48): created successfully Nov 04 10:29:46 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-78282821-c01b-4d10-aca6-2c40244d5d55 tempest-SnapshotDependencyTests-240315140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48d6dedf-fcc7-40e4-af36-51ffb1514854) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:29:46 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-78282821-c01b-4d10-aca6-2c40244d5d55 tempest-SnapshotDependencyTests-240315140 None] Flow 'volume_create_manager' (f05313b8-8f5d-4f96-97f4-0e5915bebb4a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:29:46 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-78282821-c01b-4d10-aca6-2c40244d5d55 tempest-SnapshotDependencyTests-240315140 None] Created volume successfully. Nov 04 10:29:47 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-a89b516b-655b-4d6b-a7eb-10c394c5425f tempest-SnapshotDependencyTests-240315140 None] Acquiring lock "cinder-490398a1-d1c9-47c9-9fad-2cfe8c8aa3b5-delete_snapshot" by "delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:29:47 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-a89b516b-655b-4d6b-a7eb-10c394c5425f tempest-SnapshotDependencyTests-240315140 None] Lock "cinder-490398a1-d1c9-47c9-9fad-2cfe8c8aa3b5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:29:47 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-a89b516b-655b-4d6b-a7eb-10c394c5425f tempest-SnapshotDependencyTests-240315140 None] Acquiring lock "cinder-quobyte-cf1b3cb0-3c5d-4d82-aff9-742c499f84a3" by "delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:29:47 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-a89b516b-655b-4d6b-a7eb-10c394c5425f tempest-SnapshotDependencyTests-240315140 None] Lock "cinder-quobyte-cf1b3cb0-3c5d-4d82-aff9-742c499f84a3" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:29:47 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-a89b516b-655b-4d6b-a7eb-10c394c5425f tempest-SnapshotDependencyTests-240315140 None] Acquiring lock "cinder-quobyte-490398a1-d1c9-47c9-9fad-2cfe8c8aa3b5" by "_delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:29:47 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-a89b516b-655b-4d6b-a7eb-10c394c5425f tempest-SnapshotDependencyTests-240315140 None] Lock "cinder-quobyte-490398a1-d1c9-47c9-9fad-2cfe8c8aa3b5" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:29:47 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-a89b516b-655b-4d6b-a7eb-10c394c5425f tempest-SnapshotDependencyTests-240315140 None] Deleting offline snapshot 490398a1-d1c9-47c9-9fad-2cfe8c8aa3b5 of volume cf1b3cb0-3c5d-4d82-aff9-742c499f84a3 {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 10:29:47 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-a89b516b-655b-4d6b-a7eb-10c394c5425f tempest-SnapshotDependencyTests-240315140 None] snapshot_file for this snap is: volume-cf1b3cb0-3c5d-4d82-aff9-742c499f84a3.490398a1-d1c9-47c9-9fad-2cfe8c8aa3b5 {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 10:29:47 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[86fd2317-78ba-46dc-9480-3e16e85a477e]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:29:47 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-a89b516b-655b-4d6b-a7eb-10c394c5425f tempest-SnapshotDependencyTests-240315140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-cf1b3cb0-3c5d-4d82-aff9-742c499f84a3.490398a1-d1c9-47c9-9fad-2cfe8c8aa3b5 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:29:47 devstack sudo[104253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-cf1b3cb0-3c5d-4d82-aff9-742c499f84a3.490398a1-d1c9-47c9-9fad-2cfe8c8aa3b5 Nov 04 10:29:47 devstack sudo[104253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:29:48 devstack sudo[104253]: pam_unix(sudo:session): session closed for user root Nov 04 10:29:48 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-a89b516b-655b-4d6b-a7eb-10c394c5425f tempest-SnapshotDependencyTests-240315140 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-cf1b3cb0-3c5d-4d82-aff9-742c499f84a3.490398a1-d1c9-47c9-9fad-2cfe8c8aa3b5" returned: 0 in 0.330s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:29:48 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-a89b516b-655b-4d6b-a7eb-10c394c5425f tempest-SnapshotDependencyTests-240315140 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cf1b3cb0-3c5d-4d82-aff9-742c499f84a3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87068) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 10:29:48 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9a9d4da-d718-4b28-90f7-e607863281c8]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:29:48 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-a89b516b-655b-4d6b-a7eb-10c394c5425f tempest-SnapshotDependencyTests-240315140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-cf1b3cb0-3c5d-4d82-aff9-742c499f84a3 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:29:48 devstack sudo[104258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-cf1b3cb0-3c5d-4d82-aff9-742c499f84a3 Nov 04 10:29:48 devstack sudo[104258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:29:48 devstack sudo[104258]: pam_unix(sudo:session): session closed for user root Nov 04 10:29:48 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-a89b516b-655b-4d6b-a7eb-10c394c5425f tempest-SnapshotDependencyTests-240315140 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-cf1b3cb0-3c5d-4d82-aff9-742c499f84a3" returned: 0 in 0.497s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:29:48 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-a89b516b-655b-4d6b-a7eb-10c394c5425f tempest-SnapshotDependencyTests-240315140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-cf1b3cb0-3c5d-4d82-aff9-742c499f84a3.490398a1-d1c9-47c9-9fad-2cfe8c8aa3b5 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:29:48 devstack sudo[104263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-cf1b3cb0-3c5d-4d82-aff9-742c499f84a3.490398a1-d1c9-47c9-9fad-2cfe8c8aa3b5 Nov 04 10:29:48 devstack sudo[104263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:29:49 devstack sudo[104263]: pam_unix(sudo:session): session closed for user root Nov 04 10:29:49 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-a89b516b-655b-4d6b-a7eb-10c394c5425f tempest-SnapshotDependencyTests-240315140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-cf1b3cb0-3c5d-4d82-aff9-742c499f84a3.490398a1-d1c9-47c9-9fad-2cfe8c8aa3b5" returned: 0 in 0.310s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:29:49 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-a89b516b-655b-4d6b-a7eb-10c394c5425f tempest-SnapshotDependencyTests-240315140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-cf1b3cb0-3c5d-4d82-aff9-742c499f84a3.490398a1-d1c9-47c9-9fad-2cfe8c8aa3b5 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:29:49 devstack sudo[104269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-cf1b3cb0-3c5d-4d82-aff9-742c499f84a3.490398a1-d1c9-47c9-9fad-2cfe8c8aa3b5 Nov 04 10:29:49 devstack sudo[104269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:29:49 devstack sudo[104269]: pam_unix(sudo:session): session closed for user root Nov 04 10:29:49 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-a89b516b-655b-4d6b-a7eb-10c394c5425f tempest-SnapshotDependencyTests-240315140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-cf1b3cb0-3c5d-4d82-aff9-742c499f84a3.490398a1-d1c9-47c9-9fad-2cfe8c8aa3b5" returned: 0 in 0.242s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:29:49 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-a89b516b-655b-4d6b-a7eb-10c394c5425f tempest-SnapshotDependencyTests-240315140 None] Lock "cinder-quobyte-490398a1-d1c9-47c9-9fad-2cfe8c8aa3b5" released by "_delete_snapshot" :: held 1.480s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:29:49 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-a89b516b-655b-4d6b-a7eb-10c394c5425f tempest-SnapshotDependencyTests-240315140 None] Lock "cinder-quobyte-cf1b3cb0-3c5d-4d82-aff9-742c499f84a3" released by "delete_snapshot" :: held 1.500s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:29:49 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-a89b516b-655b-4d6b-a7eb-10c394c5425f tempest-SnapshotDependencyTests-240315140 None] Created reservations ['d334f6e6-ded2-4b17-99fe-f4ed54744cc3', '48e3f91e-bef5-4d51-bdc2-ce95bc680186', '63c6d3da-f8e7-433b-8f2e-2ed581589588', '04e98ad9-9935-4fb0-aadd-27ea0683a636'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:29:49 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-a89b516b-655b-4d6b-a7eb-10c394c5425f tempest-SnapshotDependencyTests-240315140 None] Delete snapshot completed successfully. Nov 04 10:29:49 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-a89b516b-655b-4d6b-a7eb-10c394c5425f tempest-SnapshotDependencyTests-240315140 None] Lock "cinder-490398a1-d1c9-47c9-9fad-2cfe8c8aa3b5-delete_snapshot" released by "delete_snapshot" :: held 1.626s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:29:49 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-3f8dc38d-377d-40c7-b5f5-7581e8675381 tempest-SnapshotDependencyTests-240315140 None] Acquiring lock "cinder-cf1b3cb0-3c5d-4d82-aff9-742c499f84a3-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:29:49 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-3f8dc38d-377d-40c7-b5f5-7581e8675381 tempest-SnapshotDependencyTests-240315140 None] Lock "cinder-cf1b3cb0-3c5d-4d82-aff9-742c499f84a3-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:29:49 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-3f8dc38d-377d-40c7-b5f5-7581e8675381 tempest-SnapshotDependencyTests-240315140 None] Acquiring lock "cinder-quobyte-cf1b3cb0-3c5d-4d82-aff9-742c499f84a3" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:29:49 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-3f8dc38d-377d-40c7-b5f5-7581e8675381 tempest-SnapshotDependencyTests-240315140 None] Lock "cinder-quobyte-cf1b3cb0-3c5d-4d82-aff9-742c499f84a3" acquired by "delete_volume" :: waited 0.015s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:29:50 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[2289ed84-c309-409e-9e67-e0cd0d003465]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:29:50 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-3f8dc38d-377d-40c7-b5f5-7581e8675381 tempest-SnapshotDependencyTests-240315140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-cf1b3cb0-3c5d-4d82-aff9-742c499f84a3 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:29:50 devstack sudo[104273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-cf1b3cb0-3c5d-4d82-aff9-742c499f84a3 Nov 04 10:29:50 devstack sudo[104273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:29:50 devstack sudo[104273]: pam_unix(sudo:session): session closed for user root Nov 04 10:29:50 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-3f8dc38d-377d-40c7-b5f5-7581e8675381 tempest-SnapshotDependencyTests-240315140 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-cf1b3cb0-3c5d-4d82-aff9-742c499f84a3" returned: 0 in 0.356s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:29:50 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-3f8dc38d-377d-40c7-b5f5-7581e8675381 tempest-SnapshotDependencyTests-240315140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-cf1b3cb0-3c5d-4d82-aff9-742c499f84a3 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:29:50 devstack sudo[104278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-cf1b3cb0-3c5d-4d82-aff9-742c499f84a3 Nov 04 10:29:50 devstack sudo[104278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:29:50 devstack sudo[104278]: pam_unix(sudo:session): session closed for user root Nov 04 10:29:50 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-3f8dc38d-377d-40c7-b5f5-7581e8675381 tempest-SnapshotDependencyTests-240315140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-cf1b3cb0-3c5d-4d82-aff9-742c499f84a3" returned: 0 in 0.233s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:29:50 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-3f8dc38d-377d-40c7-b5f5-7581e8675381 tempest-SnapshotDependencyTests-240315140 None] Lock "cinder-quobyte-cf1b3cb0-3c5d-4d82-aff9-742c499f84a3" released by "delete_volume" :: held 0.654s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:29:50 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-3f8dc38d-377d-40c7-b5f5-7581e8675381 tempest-SnapshotDependencyTests-240315140 None] Created reservations ['5cfcc35e-3c28-4810-89a3-b0a302890a8e', '58d173d9-1663-4926-925f-55df3f8a9a4e', 'cfca6b65-caa9-419a-8299-88b60a2b907e', 'd72e8743-bd84-438b-80b3-6aa715d12f98'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:29:50 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-3f8dc38d-377d-40c7-b5f5-7581e8675381 tempest-SnapshotDependencyTests-240315140 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:29:50 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-3f8dc38d-377d-40c7-b5f5-7581e8675381 tempest-SnapshotDependencyTests-240315140 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:29:50 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-3f8dc38d-377d-40c7-b5f5-7581e8675381 tempest-SnapshotDependencyTests-240315140 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:29:50 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-3f8dc38d-377d-40c7-b5f5-7581e8675381 tempest-SnapshotDependencyTests-240315140 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:29:50 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-3f8dc38d-377d-40c7-b5f5-7581e8675381 tempest-SnapshotDependencyTests-240315140 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:29:50 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-3f8dc38d-377d-40c7-b5f5-7581e8675381 tempest-SnapshotDependencyTests-240315140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:29:50 devstack sudo[104281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:29:50 devstack sudo[104281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:29:50 devstack sudo[104281]: pam_unix(sudo:session): session closed for user root Nov 04 10:29:50 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-3f8dc38d-377d-40c7-b5f5-7581e8675381 tempest-SnapshotDependencyTests-240315140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.228s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:29:50 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-3f8dc38d-377d-40c7-b5f5-7581e8675381 tempest-SnapshotDependencyTests-240315140 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:29:50 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-3f8dc38d-377d-40c7-b5f5-7581e8675381 tempest-SnapshotDependencyTests-240315140 None] Deleted volume successfully. Nov 04 10:29:51 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-3f8dc38d-377d-40c7-b5f5-7581e8675381 tempest-SnapshotDependencyTests-240315140 None] Lock "cinder-cf1b3cb0-3c5d-4d82-aff9-742c499f84a3-delete_volume" released by "delete_volume" :: held 1.154s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:29:51 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-b082d863-44a0-4d9d-be16-20aa1f51a056 tempest-SnapshotDependencyTests-240315140 None] Acquiring lock "cinder-1d9fb0a0-f0c2-4e44-9e8e-5b4fbe332a48-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:29:51 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-b082d863-44a0-4d9d-be16-20aa1f51a056 tempest-SnapshotDependencyTests-240315140 None] Lock "cinder-1d9fb0a0-f0c2-4e44-9e8e-5b4fbe332a48-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:29:51 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-b082d863-44a0-4d9d-be16-20aa1f51a056 tempest-SnapshotDependencyTests-240315140 None] Acquiring lock "cinder-quobyte-1d9fb0a0-f0c2-4e44-9e8e-5b4fbe332a48" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:29:51 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-b082d863-44a0-4d9d-be16-20aa1f51a056 tempest-SnapshotDependencyTests-240315140 None] Lock "cinder-quobyte-1d9fb0a0-f0c2-4e44-9e8e-5b4fbe332a48" acquired by "delete_volume" :: waited 0.015s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:29:51 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2859c33-303c-4a03-b349-06ca0aa1efdc]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:29:51 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-b082d863-44a0-4d9d-be16-20aa1f51a056 tempest-SnapshotDependencyTests-240315140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-1d9fb0a0-f0c2-4e44-9e8e-5b4fbe332a48 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:29:51 devstack sudo[104284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-1d9fb0a0-f0c2-4e44-9e8e-5b4fbe332a48 Nov 04 10:29:51 devstack sudo[104284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:29:51 devstack sudo[104284]: pam_unix(sudo:session): session closed for user root Nov 04 10:29:51 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-b082d863-44a0-4d9d-be16-20aa1f51a056 tempest-SnapshotDependencyTests-240315140 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-1d9fb0a0-f0c2-4e44-9e8e-5b4fbe332a48" returned: 0 in 0.334s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:29:51 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-b082d863-44a0-4d9d-be16-20aa1f51a056 tempest-SnapshotDependencyTests-240315140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-1d9fb0a0-f0c2-4e44-9e8e-5b4fbe332a48 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:29:51 devstack sudo[104289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-1d9fb0a0-f0c2-4e44-9e8e-5b4fbe332a48 Nov 04 10:29:51 devstack sudo[104289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:29:51 devstack sudo[104289]: pam_unix(sudo:session): session closed for user root Nov 04 10:29:51 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-b082d863-44a0-4d9d-be16-20aa1f51a056 tempest-SnapshotDependencyTests-240315140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-1d9fb0a0-f0c2-4e44-9e8e-5b4fbe332a48" returned: 0 in 0.226s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:29:51 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-b082d863-44a0-4d9d-be16-20aa1f51a056 tempest-SnapshotDependencyTests-240315140 None] Lock "cinder-quobyte-1d9fb0a0-f0c2-4e44-9e8e-5b4fbe332a48" released by "delete_volume" :: held 0.600s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:29:51 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-b082d863-44a0-4d9d-be16-20aa1f51a056 tempest-SnapshotDependencyTests-240315140 None] Created reservations ['eb4ded98-cc9b-4e6d-9197-44a807e6017d', '25bfac30-c0a5-441b-87cb-804df8c26ca1', '0d20c08e-04a1-44c9-981d-9ad56a219cd3', 'f8f9aa60-8980-4f02-830c-86c9d6442a36'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:29:52 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-b082d863-44a0-4d9d-be16-20aa1f51a056 tempest-SnapshotDependencyTests-240315140 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:29:52 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-b082d863-44a0-4d9d-be16-20aa1f51a056 tempest-SnapshotDependencyTests-240315140 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:29:52 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-b082d863-44a0-4d9d-be16-20aa1f51a056 tempest-SnapshotDependencyTests-240315140 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:29:52 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-b082d863-44a0-4d9d-be16-20aa1f51a056 tempest-SnapshotDependencyTests-240315140 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:29:52 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-b082d863-44a0-4d9d-be16-20aa1f51a056 tempest-SnapshotDependencyTests-240315140 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:29:52 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-b082d863-44a0-4d9d-be16-20aa1f51a056 tempest-SnapshotDependencyTests-240315140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:29:52 devstack sudo[104292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:29:52 devstack sudo[104292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:29:52 devstack sudo[104292]: pam_unix(sudo:session): session closed for user root Nov 04 10:29:52 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-b082d863-44a0-4d9d-be16-20aa1f51a056 tempest-SnapshotDependencyTests-240315140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.226s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:29:52 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-b082d863-44a0-4d9d-be16-20aa1f51a056 tempest-SnapshotDependencyTests-240315140 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:29:52 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-b082d863-44a0-4d9d-be16-20aa1f51a056 tempest-SnapshotDependencyTests-240315140 None] Deleted volume successfully. Nov 04 10:29:52 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-b082d863-44a0-4d9d-be16-20aa1f51a056 tempest-SnapshotDependencyTests-240315140 None] Lock "cinder-1d9fb0a0-f0c2-4e44-9e8e-5b4fbe332a48-delete_volume" released by "delete_volume" :: held 1.026s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:29:53 devstack cinder-volume[87068]: DEBUG oslo_service.periodic_task [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87068) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 10:29:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:29:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:29:53 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:29:53 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:29:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:29:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:29:53 devstack sudo[104296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:29:53 devstack sudo[104296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:29:54 devstack sudo[104296]: pam_unix(sudo:session): session closed for user root Nov 04 10:29:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.248s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:29:54 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:29:54 devstack cinder-volume[87068]: DEBUG oslo_service.periodic_task [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Running periodic task VolumeManager._thread_info {{(pid=87068) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 10:29:54 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] thread count: 28 {{(pid=87068) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 04 10:29:54 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] thread info: [<_MainThread(MainThread, started 126275656192128)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87068) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 04 10:30:01 devstack cinder-volume[87068]: DEBUG dbcounter [-] [87068] Writing DB stats cinder:SELECT=23,cinder:UPDATE=33,cinder:DELETE=1,cinder:INSERT=6 {{(pid=87068) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 10:30:02 devstack cinder-volume[87068]: DEBUG dbcounter [-] [87068] Writing DB stats cinder:SELECT=27,cinder:UPDATE=26,cinder:INSERT=9,cinder:DELETE=4 {{(pid=87068) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 10:30:13 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-fcae6b0e-f33d-4e20-b865-9af45810a53a tempest-CreateVolumesFromImageTest-1351866360 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:30:13 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-fcae6b0e-f33d-4e20-b865-9af45810a53a tempest-CreateVolumesFromImageTest-1351866360 None] Flow 'volume_create_manager' (e8066dbe-3624-4878-a62f-7319ecbd6f57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:30:13 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-fcae6b0e-f33d-4e20-b865-9af45810a53a tempest-CreateVolumesFromImageTest-1351866360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a493cf22-6587-40e3-9937-00c781523916) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:30:13 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-fcae6b0e-f33d-4e20-b865-9af45810a53a tempest-CreateVolumesFromImageTest-1351866360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a493cf22-6587-40e3-9937-00c781523916) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:30:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-496247330',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e7f6275-2d94-48bc-a780-a2773cbe3a2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f82cedfbc624c55baa50f6e6391345a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:30:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:30:13Z,use_quota=True,user_id='18db31573d204cb08b7952dc094edafc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:30:13 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-fcae6b0e-f33d-4e20-b865-9af45810a53a tempest-CreateVolumesFromImageTest-1351866360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbcd2148-2127-4d5a-ab1e-5585d0eab57c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:30:13 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-fcae6b0e-f33d-4e20-b865-9af45810a53a tempest-CreateVolumesFromImageTest-1351866360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbcd2148-2127-4d5a-ab1e-5585d0eab57c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:30:13 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-fcae6b0e-f33d-4e20-b865-9af45810a53a tempest-CreateVolumesFromImageTest-1351866360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1df08840-c625-480a-8d30-f29a29f811c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:30:13 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-fcae6b0e-f33d-4e20-b865-9af45810a53a tempest-CreateVolumesFromImageTest-1351866360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1df08840-c625-480a-8d30-f29a29f811c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e7f6275-2d94-48bc-a780-a2773cbe3a2c', 'volume_name': 'volume-6e7f6275-2d94-48bc-a780-a2773cbe3a2c', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:30:13 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-fcae6b0e-f33d-4e20-b865-9af45810a53a tempest-CreateVolumesFromImageTest-1351866360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1080bad4-dc61-49cc-98b4-9aede348e68c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:30:13 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-fcae6b0e-f33d-4e20-b865-9af45810a53a tempest-CreateVolumesFromImageTest-1351866360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1080bad4-dc61-49cc-98b4-9aede348e68c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:30:13 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-fcae6b0e-f33d-4e20-b865-9af45810a53a tempest-CreateVolumesFromImageTest-1351866360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31f9bc28-36ea-4944-a0ac-7f0217c7d3da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:30:13 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-fcae6b0e-f33d-4e20-b865-9af45810a53a tempest-CreateVolumesFromImageTest-1351866360 None] Volume 6e7f6275-2d94-48bc-a780-a2773cbe3a2c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e7f6275-2d94-48bc-a780-a2773cbe3a2c', 'volume_size': 1} Nov 04 10:30:13 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-fcae6b0e-f33d-4e20-b865-9af45810a53a tempest-CreateVolumesFromImageTest-1351866360 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:30:13 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-fcae6b0e-f33d-4e20-b865-9af45810a53a tempest-CreateVolumesFromImageTest-1351866360 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:30:13 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-fcae6b0e-f33d-4e20-b865-9af45810a53a tempest-CreateVolumesFromImageTest-1351866360 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:30:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-496247330',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e7f6275-2d94-48bc-a780-a2773cbe3a2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f82cedfbc624c55baa50f6e6391345a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:30:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:30:13Z,use_quota=True,user_id='18db31573d204cb08b7952dc094edafc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 10:30:13 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-fcae6b0e-f33d-4e20-b865-9af45810a53a tempest-CreateVolumesFromImageTest-1351866360 None] Creating volume 6e7f6275-2d94-48bc-a780-a2773cbe3a2c {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:30:13 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-fcae6b0e-f33d-4e20-b865-9af45810a53a tempest-CreateVolumesFromImageTest-1351866360 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:30:13 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-fcae6b0e-f33d-4e20-b865-9af45810a53a tempest-CreateVolumesFromImageTest-1351866360 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:30:13 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-fcae6b0e-f33d-4e20-b865-9af45810a53a tempest-CreateVolumesFromImageTest-1351866360 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:30:13 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-fcae6b0e-f33d-4e20-b865-9af45810a53a tempest-CreateVolumesFromImageTest-1351866360 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:30:13 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-fcae6b0e-f33d-4e20-b865-9af45810a53a tempest-CreateVolumesFromImageTest-1351866360 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:30:13 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-fcae6b0e-f33d-4e20-b865-9af45810a53a tempest-CreateVolumesFromImageTest-1351866360 None] Selected osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:30:13 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-fcae6b0e-f33d-4e20-b865-9af45810a53a tempest-CreateVolumesFromImageTest-1351866360 None] casted to osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 Nov 04 10:30:13 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-fcae6b0e-f33d-4e20-b865-9af45810a53a tempest-CreateVolumesFromImageTest-1351866360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6e7f6275-2d94-48bc-a780-a2773cbe3a2c 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:30:13 devstack sudo[104348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6e7f6275-2d94-48bc-a780-a2773cbe3a2c 1073741824 Nov 04 10:30:13 devstack sudo[104348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:30:13 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce1aa056-de48-498f-a6c5-e28f143ce547 tempest-CreateVolumesFromSnapshotTest-517992082 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:30:13 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-ce1aa056-de48-498f-a6c5-e28f143ce547 tempest-CreateVolumesFromSnapshotTest-517992082 None] Flow 'volume_create_manager' (2ad666c4-6637-4ec5-97b0-f58e9a098dff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:30:13 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-ce1aa056-de48-498f-a6c5-e28f143ce547 tempest-CreateVolumesFromSnapshotTest-517992082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4290485-ca18-4764-8958-ea9e5224084e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:30:13 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-ce1aa056-de48-498f-a6c5-e28f143ce547 tempest-CreateVolumesFromSnapshotTest-517992082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4290485-ca18-4764-8958-ea9e5224084e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:30:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1660146447',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57c7cbf6-588a-4ef6-b974-ae90bbd9ed87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5941a1c11d24eceb16585ffd817bf0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:30:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:30:14Z,use_quota=True,user_id='4d75921ff5fb466e8d542434b8a4125b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:30:13 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-ce1aa056-de48-498f-a6c5-e28f143ce547 tempest-CreateVolumesFromSnapshotTest-517992082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2073c575-a7f3-455a-82ca-0704743daa54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:30:13 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-ce1aa056-de48-498f-a6c5-e28f143ce547 tempest-CreateVolumesFromSnapshotTest-517992082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2073c575-a7f3-455a-82ca-0704743daa54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:30:13 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-ce1aa056-de48-498f-a6c5-e28f143ce547 tempest-CreateVolumesFromSnapshotTest-517992082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fd6121d-6b3b-4f08-8df6-aef07490d3e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:30:13 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-ce1aa056-de48-498f-a6c5-e28f143ce547 tempest-CreateVolumesFromSnapshotTest-517992082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fd6121d-6b3b-4f08-8df6-aef07490d3e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57c7cbf6-588a-4ef6-b974-ae90bbd9ed87', 'volume_name': 'volume-57c7cbf6-588a-4ef6-b974-ae90bbd9ed87', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:30:13 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-ce1aa056-de48-498f-a6c5-e28f143ce547 tempest-CreateVolumesFromSnapshotTest-517992082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75beb2c0-4b2a-4bcd-9b1a-b10ec9c497d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:30:13 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-ce1aa056-de48-498f-a6c5-e28f143ce547 tempest-CreateVolumesFromSnapshotTest-517992082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75beb2c0-4b2a-4bcd-9b1a-b10ec9c497d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:30:13 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-ce1aa056-de48-498f-a6c5-e28f143ce547 tempest-CreateVolumesFromSnapshotTest-517992082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40471bd9-b551-4b70-8fea-f3fc37861435) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:30:13 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-ce1aa056-de48-498f-a6c5-e28f143ce547 tempest-CreateVolumesFromSnapshotTest-517992082 None] Volume 57c7cbf6-588a-4ef6-b974-ae90bbd9ed87: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57c7cbf6-588a-4ef6-b974-ae90bbd9ed87', 'volume_size': 1} Nov 04 10:30:13 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-ce1aa056-de48-498f-a6c5-e28f143ce547 tempest-CreateVolumesFromSnapshotTest-517992082 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:30:14 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-e393d57b-84bc-4081-aaea-6f6fd78dcb47 tempest-CreateVolumesFromImageTest-1351866360 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:30:14 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-e393d57b-84bc-4081-aaea-6f6fd78dcb47 tempest-CreateVolumesFromImageTest-1351866360 None] Flow 'volume_create_manager' (977feb09-4566-4c25-89e9-bb6a4c756b5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:30:14 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-e393d57b-84bc-4081-aaea-6f6fd78dcb47 tempest-CreateVolumesFromImageTest-1351866360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31807a35-fbaa-4a70-8eb6-e6a642e88636) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:30:14 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-e393d57b-84bc-4081-aaea-6f6fd78dcb47 tempest-CreateVolumesFromImageTest-1351866360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31807a35-fbaa-4a70-8eb6-e6a642e88636) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:30:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-215661305',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=526b760f-2c05-4f80-8669-ea33a69d0a05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f82cedfbc624c55baa50f6e6391345a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:30:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:30:14Z,use_quota=True,user_id='18db31573d204cb08b7952dc094edafc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:30:14 devstack sudo[104348]: pam_unix(sudo:session): session closed for user root Nov 04 10:30:14 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-e393d57b-84bc-4081-aaea-6f6fd78dcb47 tempest-CreateVolumesFromImageTest-1351866360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06e726e0-2c1f-4d99-8113-ee1cc8a981e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:30:14 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-e393d57b-84bc-4081-aaea-6f6fd78dcb47 tempest-CreateVolumesFromImageTest-1351866360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06e726e0-2c1f-4d99-8113-ee1cc8a981e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:30:14 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-e393d57b-84bc-4081-aaea-6f6fd78dcb47 tempest-CreateVolumesFromImageTest-1351866360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6b5d5b0-7f28-467b-9dc1-580761d74968) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:30:14 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-e393d57b-84bc-4081-aaea-6f6fd78dcb47 tempest-CreateVolumesFromImageTest-1351866360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6b5d5b0-7f28-467b-9dc1-580761d74968) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '526b760f-2c05-4f80-8669-ea33a69d0a05', 'volume_name': 'volume-526b760f-2c05-4f80-8669-ea33a69d0a05', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:30:14 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-e393d57b-84bc-4081-aaea-6f6fd78dcb47 tempest-CreateVolumesFromImageTest-1351866360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bb44797-fecf-401e-bdb8-8e9880935c99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:30:14 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-e393d57b-84bc-4081-aaea-6f6fd78dcb47 tempest-CreateVolumesFromImageTest-1351866360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bb44797-fecf-401e-bdb8-8e9880935c99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:30:14 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-e393d57b-84bc-4081-aaea-6f6fd78dcb47 tempest-CreateVolumesFromImageTest-1351866360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83752c74-a9d5-491c-8177-825d35a61235) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:30:14 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-e393d57b-84bc-4081-aaea-6f6fd78dcb47 tempest-CreateVolumesFromImageTest-1351866360 None] Volume 526b760f-2c05-4f80-8669-ea33a69d0a05: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-526b760f-2c05-4f80-8669-ea33a69d0a05', 'volume_size': 1} Nov 04 10:30:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-e393d57b-84bc-4081-aaea-6f6fd78dcb47 tempest-CreateVolumesFromImageTest-1351866360 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:30:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-fcae6b0e-f33d-4e20-b865-9af45810a53a tempest-CreateVolumesFromImageTest-1351866360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6e7f6275-2d94-48bc-a780-a2773cbe3a2c 1073741824" returned: 0 in 0.833s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:30:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-fcae6b0e-f33d-4e20-b865-9af45810a53a tempest-CreateVolumesFromImageTest-1351866360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6e7f6275-2d94-48bc-a780-a2773cbe3a2c {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:30:14 devstack sudo[104354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6e7f6275-2d94-48bc-a780-a2773cbe3a2c Nov 04 10:30:14 devstack sudo[104354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:30:14 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-80fabf3e-2967-410b-b513-5ab0594027e7 tempest-CinderUnicodeTest-1040606135 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:30:14 devstack sudo[104354]: pam_unix(sudo:session): session closed for user root Nov 04 10:30:14 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-80fabf3e-2967-410b-b513-5ab0594027e7 tempest-CinderUnicodeTest-1040606135 None] Flow 'volume_create_manager' (58b066f3-cdc9-43ce-b787-d478b7e1a706) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:30:14 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-80fabf3e-2967-410b-b513-5ab0594027e7 tempest-CinderUnicodeTest-1040606135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (915a4b6d-b01b-438e-ae37-5260399eb40f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:30:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-fcae6b0e-f33d-4e20-b865-9af45810a53a tempest-CreateVolumesFromImageTest-1351866360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6e7f6275-2d94-48bc-a780-a2773cbe3a2c" returned: 0 in 0.337s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:30:14 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-fcae6b0e-f33d-4e20-b865-9af45810a53a tempest-CreateVolumesFromImageTest-1351866360 None] <== create_volume: return (1215ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 10:30:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-fcae6b0e-f33d-4e20-b865-9af45810a53a tempest-CreateVolumesFromImageTest-1351866360 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.218s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:30:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-ce1aa056-de48-498f-a6c5-e28f143ce547 tempest-CreateVolumesFromSnapshotTest-517992082 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.865s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:30:14 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-ce1aa056-de48-498f-a6c5-e28f143ce547 tempest-CreateVolumesFromSnapshotTest-517992082 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:30:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1660146447',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57c7cbf6-588a-4ef6-b974-ae90bbd9ed87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5941a1c11d24eceb16585ffd817bf0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:30:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:30:14Z,use_quota=True,user_id='4d75921ff5fb466e8d542434b8a4125b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 10:30:14 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-ce1aa056-de48-498f-a6c5-e28f143ce547 tempest-CreateVolumesFromSnapshotTest-517992082 None] Creating volume 57c7cbf6-588a-4ef6-b974-ae90bbd9ed87 {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:30:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-ce1aa056-de48-498f-a6c5-e28f143ce547 tempest-CreateVolumesFromSnapshotTest-517992082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:30:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-ce1aa056-de48-498f-a6c5-e28f143ce547 tempest-CreateVolumesFromSnapshotTest-517992082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:30:14 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-ce1aa056-de48-498f-a6c5-e28f143ce547 tempest-CreateVolumesFromSnapshotTest-517992082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:30:14 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-ce1aa056-de48-498f-a6c5-e28f143ce547 tempest-CreateVolumesFromSnapshotTest-517992082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:30:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-ce1aa056-de48-498f-a6c5-e28f143ce547 tempest-CreateVolumesFromSnapshotTest-517992082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:30:14 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-ce1aa056-de48-498f-a6c5-e28f143ce547 tempest-CreateVolumesFromSnapshotTest-517992082 None] Selected osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:30:14 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-ce1aa056-de48-498f-a6c5-e28f143ce547 tempest-CreateVolumesFromSnapshotTest-517992082 None] casted to osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 Nov 04 10:30:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ce1aa056-de48-498f-a6c5-e28f143ce547 tempest-CreateVolumesFromSnapshotTest-517992082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-57c7cbf6-588a-4ef6-b974-ae90bbd9ed87 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:30:14 devstack sudo[104358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-57c7cbf6-588a-4ef6-b974-ae90bbd9ed87 1073741824 Nov 04 10:30:14 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-80fabf3e-2967-410b-b513-5ab0594027e7 tempest-CinderUnicodeTest-1040606135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (915a4b6d-b01b-438e-ae37-5260399eb40f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:30:14Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d49599b-6de8-4aa7-88ea-d29030b36dac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='858da449a96244549d00c5544f187c8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:30:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:30:15Z,use_quota=True,user_id='6af30b1ea31e46e780eeb1177584407d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:30:14 devstack sudo[104358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:30:14 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-80fabf3e-2967-410b-b513-5ab0594027e7 tempest-CinderUnicodeTest-1040606135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5274747-cdb6-4b62-a28b-8720e139c428) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:30:14 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-80fabf3e-2967-410b-b513-5ab0594027e7 tempest-CinderUnicodeTest-1040606135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5274747-cdb6-4b62-a28b-8720e139c428) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:30:14 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-80fabf3e-2967-410b-b513-5ab0594027e7 tempest-CinderUnicodeTest-1040606135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3aa5c633-c745-47ce-8f98-7f1381686eb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:30:14 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-80fabf3e-2967-410b-b513-5ab0594027e7 tempest-CinderUnicodeTest-1040606135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3aa5c633-c745-47ce-8f98-7f1381686eb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d49599b-6de8-4aa7-88ea-d29030b36dac', 'volume_name': 'volume-0d49599b-6de8-4aa7-88ea-d29030b36dac', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:30:14 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-80fabf3e-2967-410b-b513-5ab0594027e7 tempest-CinderUnicodeTest-1040606135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (505bc79f-6104-49cf-acbf-be64a4d2c6e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:30:14 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-80fabf3e-2967-410b-b513-5ab0594027e7 tempest-CinderUnicodeTest-1040606135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (505bc79f-6104-49cf-acbf-be64a4d2c6e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:30:14 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-80fabf3e-2967-410b-b513-5ab0594027e7 tempest-CinderUnicodeTest-1040606135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccb25237-14e2-4f50-b334-6c52861bd32d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:30:14 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-80fabf3e-2967-410b-b513-5ab0594027e7 tempest-CinderUnicodeTest-1040606135 None] Volume 0d49599b-6de8-4aa7-88ea-d29030b36dac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d49599b-6de8-4aa7-88ea-d29030b36dac', 'volume_size': 1} Nov 04 10:30:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-80fabf3e-2967-410b-b513-5ab0594027e7 tempest-CinderUnicodeTest-1040606135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:30:14 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-fcae6b0e-f33d-4e20-b865-9af45810a53a tempest-CreateVolumesFromImageTest-1351866360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31f9bc28-36ea-4944-a0ac-7f0217c7d3da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e7f6275-2d94-48bc-a780-a2773cbe3a2c', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:30:14 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-fcae6b0e-f33d-4e20-b865-9af45810a53a tempest-CreateVolumesFromImageTest-1351866360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55ec1d84-2337-492d-bc76-b10eeefa3c3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:30:14 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-fcae6b0e-f33d-4e20-b865-9af45810a53a tempest-CreateVolumesFromImageTest-1351866360 None] Volume volume-6e7f6275-2d94-48bc-a780-a2773cbe3a2c (6e7f6275-2d94-48bc-a780-a2773cbe3a2c): created successfully Nov 04 10:30:14 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-fcae6b0e-f33d-4e20-b865-9af45810a53a tempest-CreateVolumesFromImageTest-1351866360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55ec1d84-2337-492d-bc76-b10eeefa3c3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:30:14 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-fcae6b0e-f33d-4e20-b865-9af45810a53a tempest-CreateVolumesFromImageTest-1351866360 None] Flow 'volume_create_manager' (e8066dbe-3624-4878-a62f-7319ecbd6f57) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:30:14 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-904047ae-539e-4731-91aa-692693d3c85f tempest-CreateVolumesFromImageTest-1351866360 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:30:14 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-904047ae-539e-4731-91aa-692693d3c85f tempest-CreateVolumesFromImageTest-1351866360 None] Flow 'volume_create_manager' (5523bf88-7c73-47a8-8641-b4222ce1c48c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:30:14 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-904047ae-539e-4731-91aa-692693d3c85f tempest-CreateVolumesFromImageTest-1351866360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1066739-b40b-4c20-bcfd-a38afd32f606) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:30:14 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-fcae6b0e-f33d-4e20-b865-9af45810a53a tempest-CreateVolumesFromImageTest-1351866360 None] Created volume successfully. Nov 04 10:30:14 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-904047ae-539e-4731-91aa-692693d3c85f tempest-CreateVolumesFromImageTest-1351866360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1066739-b40b-4c20-bcfd-a38afd32f606) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:30:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1453847384',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36ad933e-f173-4bd4-b277-9e543999a979,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f82cedfbc624c55baa50f6e6391345a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:30:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:30:15Z,use_quota=True,user_id='18db31573d204cb08b7952dc094edafc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:30:14 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-904047ae-539e-4731-91aa-692693d3c85f tempest-CreateVolumesFromImageTest-1351866360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e28c772-496b-4dd0-ac0d-3cecf7918bb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:30:14 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-904047ae-539e-4731-91aa-692693d3c85f tempest-CreateVolumesFromImageTest-1351866360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e28c772-496b-4dd0-ac0d-3cecf7918bb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:30:14 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-904047ae-539e-4731-91aa-692693d3c85f tempest-CreateVolumesFromImageTest-1351866360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6154de15-f450-4b2f-b22c-6958902226ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:30:14 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-904047ae-539e-4731-91aa-692693d3c85f tempest-CreateVolumesFromImageTest-1351866360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6154de15-f450-4b2f-b22c-6958902226ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36ad933e-f173-4bd4-b277-9e543999a979', 'volume_name': 'volume-36ad933e-f173-4bd4-b277-9e543999a979', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:30:14 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-904047ae-539e-4731-91aa-692693d3c85f tempest-CreateVolumesFromImageTest-1351866360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11b93fa5-4eaf-434d-9298-bddbe9a9cb7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:30:14 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-904047ae-539e-4731-91aa-692693d3c85f tempest-CreateVolumesFromImageTest-1351866360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11b93fa5-4eaf-434d-9298-bddbe9a9cb7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:30:14 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-904047ae-539e-4731-91aa-692693d3c85f tempest-CreateVolumesFromImageTest-1351866360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a9a149a-63cb-46be-acc8-3332209bd380) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:30:14 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-904047ae-539e-4731-91aa-692693d3c85f tempest-CreateVolumesFromImageTest-1351866360 None] Volume 36ad933e-f173-4bd4-b277-9e543999a979: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36ad933e-f173-4bd4-b277-9e543999a979', 'volume_size': 1} Nov 04 10:30:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-904047ae-539e-4731-91aa-692693d3c85f tempest-CreateVolumesFromImageTest-1351866360 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:30:15 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6e71c19-6b15-466f-8347-bed6a33b0f8f tempest-CreateVolumesFromImageTest-1351866360 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:30:15 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-d6e71c19-6b15-466f-8347-bed6a33b0f8f tempest-CreateVolumesFromImageTest-1351866360 None] Flow 'volume_create_manager' (284afb61-e5c7-45de-81a1-1f4957e7857b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:30:15 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-d6e71c19-6b15-466f-8347-bed6a33b0f8f tempest-CreateVolumesFromImageTest-1351866360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4967f1cb-4363-4f92-990f-a3eeb65b40ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:30:15 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-d6e71c19-6b15-466f-8347-bed6a33b0f8f tempest-CreateVolumesFromImageTest-1351866360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4967f1cb-4363-4f92-990f-a3eeb65b40ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:30:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1209791527',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd166963-ca58-47be-9ac9-83b51c76d8ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f82cedfbc624c55baa50f6e6391345a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:30:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:30:15Z,use_quota=True,user_id='18db31573d204cb08b7952dc094edafc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:30:15 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-d6e71c19-6b15-466f-8347-bed6a33b0f8f tempest-CreateVolumesFromImageTest-1351866360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (053414f1-d5df-414f-aa68-18c2ff2482ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:30:15 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-d6e71c19-6b15-466f-8347-bed6a33b0f8f tempest-CreateVolumesFromImageTest-1351866360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (053414f1-d5df-414f-aa68-18c2ff2482ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:30:15 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-d6e71c19-6b15-466f-8347-bed6a33b0f8f tempest-CreateVolumesFromImageTest-1351866360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35f98ac9-9fec-4e49-a580-d4ede52e5440) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:30:15 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-d6e71c19-6b15-466f-8347-bed6a33b0f8f tempest-CreateVolumesFromImageTest-1351866360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35f98ac9-9fec-4e49-a580-d4ede52e5440) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd166963-ca58-47be-9ac9-83b51c76d8ef', 'volume_name': 'volume-cd166963-ca58-47be-9ac9-83b51c76d8ef', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:30:15 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-d6e71c19-6b15-466f-8347-bed6a33b0f8f tempest-CreateVolumesFromImageTest-1351866360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (724d304f-b481-4d1f-a83b-24b919518da9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:30:15 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-d6e71c19-6b15-466f-8347-bed6a33b0f8f tempest-CreateVolumesFromImageTest-1351866360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (724d304f-b481-4d1f-a83b-24b919518da9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:30:15 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-d6e71c19-6b15-466f-8347-bed6a33b0f8f tempest-CreateVolumesFromImageTest-1351866360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (012a0d4b-5b2c-4c53-8a55-6bea83619086) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:30:15 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-d6e71c19-6b15-466f-8347-bed6a33b0f8f tempest-CreateVolumesFromImageTest-1351866360 None] Volume cd166963-ca58-47be-9ac9-83b51c76d8ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd166963-ca58-47be-9ac9-83b51c76d8ef', 'volume_size': 1} Nov 04 10:30:15 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-d6e71c19-6b15-466f-8347-bed6a33b0f8f tempest-CreateVolumesFromImageTest-1351866360 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:30:15 devstack sudo[104358]: pam_unix(sudo:session): session closed for user root Nov 04 10:30:15 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ce1aa056-de48-498f-a6c5-e28f143ce547 tempest-CreateVolumesFromSnapshotTest-517992082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-57c7cbf6-588a-4ef6-b974-ae90bbd9ed87 1073741824" returned: 0 in 0.618s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:30:15 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ce1aa056-de48-498f-a6c5-e28f143ce547 tempest-CreateVolumesFromSnapshotTest-517992082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-57c7cbf6-588a-4ef6-b974-ae90bbd9ed87 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:30:15 devstack sudo[104364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-57c7cbf6-588a-4ef6-b974-ae90bbd9ed87 Nov 04 10:30:15 devstack sudo[104364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:30:15 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-23bd1ca1-1b4f-4595-a195-5af68e5810aa tempest-CreateVolumesFromImageTest-1351866360 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:30:15 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-23bd1ca1-1b4f-4595-a195-5af68e5810aa tempest-CreateVolumesFromImageTest-1351866360 None] Flow 'volume_create_manager' (8ccfaff7-a640-45b8-9311-ba50b42ef871) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:30:15 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-23bd1ca1-1b4f-4595-a195-5af68e5810aa tempest-CreateVolumesFromImageTest-1351866360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21894dc4-93eb-4d1e-bd91-6386ebd95015) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:30:15 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-23bd1ca1-1b4f-4595-a195-5af68e5810aa tempest-CreateVolumesFromImageTest-1351866360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21894dc4-93eb-4d1e-bd91-6386ebd95015) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:30:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1697544184',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00a99c7b-3253-4089-9d1d-8bafa0f2ab42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f82cedfbc624c55baa50f6e6391345a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:30:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:30:16Z,use_quota=True,user_id='18db31573d204cb08b7952dc094edafc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:30:15 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-23bd1ca1-1b4f-4595-a195-5af68e5810aa tempest-CreateVolumesFromImageTest-1351866360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb4a7d36-93c9-409e-ba2f-6c8d57f2a607) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:30:15 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-23bd1ca1-1b4f-4595-a195-5af68e5810aa tempest-CreateVolumesFromImageTest-1351866360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb4a7d36-93c9-409e-ba2f-6c8d57f2a607) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:30:15 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-23bd1ca1-1b4f-4595-a195-5af68e5810aa tempest-CreateVolumesFromImageTest-1351866360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fe6a5f7-1024-4ccd-85cc-bbf4d96141aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:30:15 devstack sudo[104364]: pam_unix(sudo:session): session closed for user root Nov 04 10:30:15 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-23bd1ca1-1b4f-4595-a195-5af68e5810aa tempest-CreateVolumesFromImageTest-1351866360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fe6a5f7-1024-4ccd-85cc-bbf4d96141aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00a99c7b-3253-4089-9d1d-8bafa0f2ab42', 'volume_name': 'volume-00a99c7b-3253-4089-9d1d-8bafa0f2ab42', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:30:15 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-23bd1ca1-1b4f-4595-a195-5af68e5810aa tempest-CreateVolumesFromImageTest-1351866360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc78998d-b9f0-446b-b08f-5bd353b72c82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:30:15 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-23bd1ca1-1b4f-4595-a195-5af68e5810aa tempest-CreateVolumesFromImageTest-1351866360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc78998d-b9f0-446b-b08f-5bd353b72c82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:30:15 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-23bd1ca1-1b4f-4595-a195-5af68e5810aa tempest-CreateVolumesFromImageTest-1351866360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d052915-c7da-49ed-a2b9-03716329a3f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:30:15 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-23bd1ca1-1b4f-4595-a195-5af68e5810aa tempest-CreateVolumesFromImageTest-1351866360 None] Volume 00a99c7b-3253-4089-9d1d-8bafa0f2ab42: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00a99c7b-3253-4089-9d1d-8bafa0f2ab42', 'volume_size': 1} Nov 04 10:30:15 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-23bd1ca1-1b4f-4595-a195-5af68e5810aa tempest-CreateVolumesFromImageTest-1351866360 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:30:15 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ce1aa056-de48-498f-a6c5-e28f143ce547 tempest-CreateVolumesFromSnapshotTest-517992082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-57c7cbf6-588a-4ef6-b974-ae90bbd9ed87" returned: 0 in 0.317s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:30:15 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-ce1aa056-de48-498f-a6c5-e28f143ce547 tempest-CreateVolumesFromSnapshotTest-517992082 None] <== create_volume: return (990ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 10:30:15 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-ce1aa056-de48-498f-a6c5-e28f143ce547 tempest-CreateVolumesFromSnapshotTest-517992082 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.995s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:30:15 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-e393d57b-84bc-4081-aaea-6f6fd78dcb47 tempest-CreateVolumesFromImageTest-1351866360 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.383s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:30:15 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-e393d57b-84bc-4081-aaea-6f6fd78dcb47 tempest-CreateVolumesFromImageTest-1351866360 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:30:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-215661305',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=526b760f-2c05-4f80-8669-ea33a69d0a05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f82cedfbc624c55baa50f6e6391345a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:30:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:30:14Z,use_quota=True,user_id='18db31573d204cb08b7952dc094edafc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 10:30:15 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-e393d57b-84bc-4081-aaea-6f6fd78dcb47 tempest-CreateVolumesFromImageTest-1351866360 None] Creating volume 526b760f-2c05-4f80-8669-ea33a69d0a05 {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:30:15 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-e393d57b-84bc-4081-aaea-6f6fd78dcb47 tempest-CreateVolumesFromImageTest-1351866360 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:30:15 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-e393d57b-84bc-4081-aaea-6f6fd78dcb47 tempest-CreateVolumesFromImageTest-1351866360 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:30:15 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-e393d57b-84bc-4081-aaea-6f6fd78dcb47 tempest-CreateVolumesFromImageTest-1351866360 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:30:15 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-e393d57b-84bc-4081-aaea-6f6fd78dcb47 tempest-CreateVolumesFromImageTest-1351866360 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:30:15 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-e393d57b-84bc-4081-aaea-6f6fd78dcb47 tempest-CreateVolumesFromImageTest-1351866360 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:30:15 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-e393d57b-84bc-4081-aaea-6f6fd78dcb47 tempest-CreateVolumesFromImageTest-1351866360 None] Selected osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:30:15 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-e393d57b-84bc-4081-aaea-6f6fd78dcb47 tempest-CreateVolumesFromImageTest-1351866360 None] casted to osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 Nov 04 10:30:15 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-e393d57b-84bc-4081-aaea-6f6fd78dcb47 tempest-CreateVolumesFromImageTest-1351866360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-526b760f-2c05-4f80-8669-ea33a69d0a05 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:30:15 devstack sudo[104367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-526b760f-2c05-4f80-8669-ea33a69d0a05 1073741824 Nov 04 10:30:15 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-ce1aa056-de48-498f-a6c5-e28f143ce547 tempest-CreateVolumesFromSnapshotTest-517992082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40471bd9-b551-4b70-8fea-f3fc37861435) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57c7cbf6-588a-4ef6-b974-ae90bbd9ed87', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:30:15 devstack sudo[104367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:30:15 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-ce1aa056-de48-498f-a6c5-e28f143ce547 tempest-CreateVolumesFromSnapshotTest-517992082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45baff6c-4690-4ea8-acf6-d15267e29639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:30:15 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-ce1aa056-de48-498f-a6c5-e28f143ce547 tempest-CreateVolumesFromSnapshotTest-517992082 None] Volume volume-57c7cbf6-588a-4ef6-b974-ae90bbd9ed87 (57c7cbf6-588a-4ef6-b974-ae90bbd9ed87): created successfully Nov 04 10:30:15 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-ce1aa056-de48-498f-a6c5-e28f143ce547 tempest-CreateVolumesFromSnapshotTest-517992082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45baff6c-4690-4ea8-acf6-d15267e29639) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:30:15 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-ce1aa056-de48-498f-a6c5-e28f143ce547 tempest-CreateVolumesFromSnapshotTest-517992082 None] Flow 'volume_create_manager' (2ad666c4-6637-4ec5-97b0-f58e9a098dff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:30:15 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-ce1aa056-de48-498f-a6c5-e28f143ce547 tempest-CreateVolumesFromSnapshotTest-517992082 None] Created volume successfully. Nov 04 10:30:16 devstack sudo[104367]: pam_unix(sudo:session): session closed for user root Nov 04 10:30:16 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-e393d57b-84bc-4081-aaea-6f6fd78dcb47 tempest-CreateVolumesFromImageTest-1351866360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-526b760f-2c05-4f80-8669-ea33a69d0a05 1073741824" returned: 0 in 0.476s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:30:16 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-e393d57b-84bc-4081-aaea-6f6fd78dcb47 tempest-CreateVolumesFromImageTest-1351866360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-526b760f-2c05-4f80-8669-ea33a69d0a05 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:30:16 devstack sudo[104373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-526b760f-2c05-4f80-8669-ea33a69d0a05 Nov 04 10:30:16 devstack sudo[104373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:30:16 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-3516e756-3a5e-473e-b145-23646946be0d tempest-CreateVolumesFromSnapshotTest-517992082 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:30:16 devstack sudo[104373]: pam_unix(sudo:session): session closed for user root Nov 04 10:30:16 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-e393d57b-84bc-4081-aaea-6f6fd78dcb47 tempest-CreateVolumesFromImageTest-1351866360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-526b760f-2c05-4f80-8669-ea33a69d0a05" returned: 0 in 0.328s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:30:16 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-e393d57b-84bc-4081-aaea-6f6fd78dcb47 tempest-CreateVolumesFromImageTest-1351866360 None] <== create_volume: return (850ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 10:30:16 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-e393d57b-84bc-4081-aaea-6f6fd78dcb47 tempest-CreateVolumesFromImageTest-1351866360 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.852s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:30:16 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-80fabf3e-2967-410b-b513-5ab0594027e7 tempest-CinderUnicodeTest-1040606135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.745s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:30:16 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-80fabf3e-2967-410b-b513-5ab0594027e7 tempest-CinderUnicodeTest-1040606135 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:30:14Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d49599b-6de8-4aa7-88ea-d29030b36dac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='858da449a96244549d00c5544f187c8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:30:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:30:15Z,use_quota=True,user_id='6af30b1ea31e46e780eeb1177584407d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 10:30:16 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-80fabf3e-2967-410b-b513-5ab0594027e7 tempest-CinderUnicodeTest-1040606135 None] Creating volume 0d49599b-6de8-4aa7-88ea-d29030b36dac {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:30:16 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-80fabf3e-2967-410b-b513-5ab0594027e7 tempest-CinderUnicodeTest-1040606135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:30:16 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-80fabf3e-2967-410b-b513-5ab0594027e7 tempest-CinderUnicodeTest-1040606135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:30:16 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-80fabf3e-2967-410b-b513-5ab0594027e7 tempest-CinderUnicodeTest-1040606135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:30:16 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-80fabf3e-2967-410b-b513-5ab0594027e7 tempest-CinderUnicodeTest-1040606135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:30:16 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-80fabf3e-2967-410b-b513-5ab0594027e7 tempest-CinderUnicodeTest-1040606135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:30:16 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-80fabf3e-2967-410b-b513-5ab0594027e7 tempest-CinderUnicodeTest-1040606135 None] Selected osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:30:16 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-80fabf3e-2967-410b-b513-5ab0594027e7 tempest-CinderUnicodeTest-1040606135 None] casted to osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 Nov 04 10:30:16 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-80fabf3e-2967-410b-b513-5ab0594027e7 tempest-CinderUnicodeTest-1040606135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-0d49599b-6de8-4aa7-88ea-d29030b36dac 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:30:16 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-e393d57b-84bc-4081-aaea-6f6fd78dcb47 tempest-CreateVolumesFromImageTest-1351866360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83752c74-a9d5-491c-8177-825d35a61235) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-526b760f-2c05-4f80-8669-ea33a69d0a05', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:30:16 devstack sudo[104376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-0d49599b-6de8-4aa7-88ea-d29030b36dac 1073741824 Nov 04 10:30:16 devstack sudo[104376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:30:16 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-e393d57b-84bc-4081-aaea-6f6fd78dcb47 tempest-CreateVolumesFromImageTest-1351866360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cf843d4-2cb1-43dc-af30-3f0dc4b03ae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:30:16 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-e393d57b-84bc-4081-aaea-6f6fd78dcb47 tempest-CreateVolumesFromImageTest-1351866360 None] Volume volume-526b760f-2c05-4f80-8669-ea33a69d0a05 (526b760f-2c05-4f80-8669-ea33a69d0a05): created successfully Nov 04 10:30:16 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-e393d57b-84bc-4081-aaea-6f6fd78dcb47 tempest-CreateVolumesFromImageTest-1351866360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cf843d4-2cb1-43dc-af30-3f0dc4b03ae9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:30:16 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-e393d57b-84bc-4081-aaea-6f6fd78dcb47 tempest-CreateVolumesFromImageTest-1351866360 None] Flow 'volume_create_manager' (977feb09-4566-4c25-89e9-bb6a4c756b5b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:30:16 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-e393d57b-84bc-4081-aaea-6f6fd78dcb47 tempest-CreateVolumesFromImageTest-1351866360 None] Created volume successfully. Nov 04 10:30:17 devstack sudo[104376]: pam_unix(sudo:session): session closed for user root Nov 04 10:30:17 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-80fabf3e-2967-410b-b513-5ab0594027e7 tempest-CinderUnicodeTest-1040606135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-0d49599b-6de8-4aa7-88ea-d29030b36dac 1073741824" returned: 0 in 0.456s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:30:17 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-80fabf3e-2967-410b-b513-5ab0594027e7 tempest-CinderUnicodeTest-1040606135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-0d49599b-6de8-4aa7-88ea-d29030b36dac {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:30:17 devstack sudo[104382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-0d49599b-6de8-4aa7-88ea-d29030b36dac Nov 04 10:30:17 devstack sudo[104382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:30:17 devstack sudo[104382]: pam_unix(sudo:session): session closed for user root Nov 04 10:30:17 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-80fabf3e-2967-410b-b513-5ab0594027e7 tempest-CinderUnicodeTest-1040606135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-0d49599b-6de8-4aa7-88ea-d29030b36dac" returned: 0 in 0.247s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:30:17 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-80fabf3e-2967-410b-b513-5ab0594027e7 tempest-CinderUnicodeTest-1040606135 None] <== create_volume: return (741ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 10:30:17 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-80fabf3e-2967-410b-b513-5ab0594027e7 tempest-CinderUnicodeTest-1040606135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.745s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:30:17 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-904047ae-539e-4731-91aa-692693d3c85f tempest-CreateVolumesFromImageTest-1351866360 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.322s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:30:17 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-904047ae-539e-4731-91aa-692693d3c85f tempest-CreateVolumesFromImageTest-1351866360 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:30:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1453847384',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36ad933e-f173-4bd4-b277-9e543999a979,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f82cedfbc624c55baa50f6e6391345a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:30:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:30:15Z,use_quota=True,user_id='18db31573d204cb08b7952dc094edafc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 10:30:17 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-904047ae-539e-4731-91aa-692693d3c85f tempest-CreateVolumesFromImageTest-1351866360 None] Creating volume 36ad933e-f173-4bd4-b277-9e543999a979 {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:30:17 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-904047ae-539e-4731-91aa-692693d3c85f tempest-CreateVolumesFromImageTest-1351866360 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:30:17 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-904047ae-539e-4731-91aa-692693d3c85f tempest-CreateVolumesFromImageTest-1351866360 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:30:17 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-904047ae-539e-4731-91aa-692693d3c85f tempest-CreateVolumesFromImageTest-1351866360 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:30:17 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-904047ae-539e-4731-91aa-692693d3c85f tempest-CreateVolumesFromImageTest-1351866360 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:30:17 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-904047ae-539e-4731-91aa-692693d3c85f tempest-CreateVolumesFromImageTest-1351866360 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:30:17 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-904047ae-539e-4731-91aa-692693d3c85f tempest-CreateVolumesFromImageTest-1351866360 None] Selected osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:30:17 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-904047ae-539e-4731-91aa-692693d3c85f tempest-CreateVolumesFromImageTest-1351866360 None] casted to osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 Nov 04 10:30:17 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-904047ae-539e-4731-91aa-692693d3c85f tempest-CreateVolumesFromImageTest-1351866360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-36ad933e-f173-4bd4-b277-9e543999a979 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:30:17 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-80fabf3e-2967-410b-b513-5ab0594027e7 tempest-CinderUnicodeTest-1040606135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccb25237-14e2-4f50-b334-6c52861bd32d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d49599b-6de8-4aa7-88ea-d29030b36dac', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:30:17 devstack sudo[104385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-36ad933e-f173-4bd4-b277-9e543999a979 1073741824 Nov 04 10:30:17 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-80fabf3e-2967-410b-b513-5ab0594027e7 tempest-CinderUnicodeTest-1040606135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83a4fdbf-5fed-4869-97a2-cb756c99e8f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:30:17 devstack sudo[104385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:30:17 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-80fabf3e-2967-410b-b513-5ab0594027e7 tempest-CinderUnicodeTest-1040606135 None] Volume volume-0d49599b-6de8-4aa7-88ea-d29030b36dac (0d49599b-6de8-4aa7-88ea-d29030b36dac): created successfully Nov 04 10:30:17 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-80fabf3e-2967-410b-b513-5ab0594027e7 tempest-CinderUnicodeTest-1040606135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83a4fdbf-5fed-4869-97a2-cb756c99e8f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:30:17 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-80fabf3e-2967-410b-b513-5ab0594027e7 tempest-CinderUnicodeTest-1040606135 None] Flow 'volume_create_manager' (58b066f3-cdc9-43ce-b787-d478b7e1a706) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:30:17 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-80fabf3e-2967-410b-b513-5ab0594027e7 tempest-CinderUnicodeTest-1040606135 None] Created volume successfully. Nov 04 10:30:17 devstack sudo[104385]: pam_unix(sudo:session): session closed for user root Nov 04 10:30:17 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-904047ae-539e-4731-91aa-692693d3c85f tempest-CreateVolumesFromImageTest-1351866360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-36ad933e-f173-4bd4-b277-9e543999a979 1073741824" returned: 0 in 0.535s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:30:17 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-904047ae-539e-4731-91aa-692693d3c85f tempest-CreateVolumesFromImageTest-1351866360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-36ad933e-f173-4bd4-b277-9e543999a979 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:30:17 devstack sudo[104391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-36ad933e-f173-4bd4-b277-9e543999a979 Nov 04 10:30:17 devstack sudo[104391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:30:18 devstack sudo[104391]: pam_unix(sudo:session): session closed for user root Nov 04 10:30:18 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-904047ae-539e-4731-91aa-692693d3c85f tempest-CreateVolumesFromImageTest-1351866360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-36ad933e-f173-4bd4-b277-9e543999a979" returned: 0 in 0.286s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:30:18 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-904047ae-539e-4731-91aa-692693d3c85f tempest-CreateVolumesFromImageTest-1351866360 None] <== create_volume: return (866ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 10:30:18 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-904047ae-539e-4731-91aa-692693d3c85f tempest-CreateVolumesFromImageTest-1351866360 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.868s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:30:18 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-d6e71c19-6b15-466f-8347-bed6a33b0f8f tempest-CreateVolumesFromImageTest-1351866360 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.907s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:30:18 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-d6e71c19-6b15-466f-8347-bed6a33b0f8f tempest-CreateVolumesFromImageTest-1351866360 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:30:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1209791527',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd166963-ca58-47be-9ac9-83b51c76d8ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f82cedfbc624c55baa50f6e6391345a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:30:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:30:15Z,use_quota=True,user_id='18db31573d204cb08b7952dc094edafc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 10:30:18 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-d6e71c19-6b15-466f-8347-bed6a33b0f8f tempest-CreateVolumesFromImageTest-1351866360 None] Creating volume cd166963-ca58-47be-9ac9-83b51c76d8ef {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:30:18 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-d6e71c19-6b15-466f-8347-bed6a33b0f8f tempest-CreateVolumesFromImageTest-1351866360 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:30:18 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-d6e71c19-6b15-466f-8347-bed6a33b0f8f tempest-CreateVolumesFromImageTest-1351866360 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:30:18 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-d6e71c19-6b15-466f-8347-bed6a33b0f8f tempest-CreateVolumesFromImageTest-1351866360 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:30:18 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-d6e71c19-6b15-466f-8347-bed6a33b0f8f tempest-CreateVolumesFromImageTest-1351866360 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:30:18 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-d6e71c19-6b15-466f-8347-bed6a33b0f8f tempest-CreateVolumesFromImageTest-1351866360 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:30:18 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-d6e71c19-6b15-466f-8347-bed6a33b0f8f tempest-CreateVolumesFromImageTest-1351866360 None] Selected osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:30:18 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-d6e71c19-6b15-466f-8347-bed6a33b0f8f tempest-CreateVolumesFromImageTest-1351866360 None] casted to osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 Nov 04 10:30:18 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d6e71c19-6b15-466f-8347-bed6a33b0f8f tempest-CreateVolumesFromImageTest-1351866360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-cd166963-ca58-47be-9ac9-83b51c76d8ef 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:30:18 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-904047ae-539e-4731-91aa-692693d3c85f tempest-CreateVolumesFromImageTest-1351866360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a9a149a-63cb-46be-acc8-3332209bd380) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36ad933e-f173-4bd4-b277-9e543999a979', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:30:18 devstack sudo[104394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-cd166963-ca58-47be-9ac9-83b51c76d8ef 1073741824 Nov 04 10:30:18 devstack sudo[104394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:30:18 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-904047ae-539e-4731-91aa-692693d3c85f tempest-CreateVolumesFromImageTest-1351866360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (499fc379-f904-4d24-b491-99d7f0647277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:30:18 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-904047ae-539e-4731-91aa-692693d3c85f tempest-CreateVolumesFromImageTest-1351866360 None] Volume volume-36ad933e-f173-4bd4-b277-9e543999a979 (36ad933e-f173-4bd4-b277-9e543999a979): created successfully Nov 04 10:30:18 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-904047ae-539e-4731-91aa-692693d3c85f tempest-CreateVolumesFromImageTest-1351866360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (499fc379-f904-4d24-b491-99d7f0647277) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:30:18 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-904047ae-539e-4731-91aa-692693d3c85f tempest-CreateVolumesFromImageTest-1351866360 None] Flow 'volume_create_manager' (5523bf88-7c73-47a8-8641-b4222ce1c48c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:30:18 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-904047ae-539e-4731-91aa-692693d3c85f tempest-CreateVolumesFromImageTest-1351866360 None] Created volume successfully. Nov 04 10:30:18 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-7942a01c-3636-47a8-9a04-1b33535333d7 tempest-VolumeAndVolumeTypeFromImageTest-1875562462 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:30:18 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7942a01c-3636-47a8-9a04-1b33535333d7 tempest-VolumeAndVolumeTypeFromImageTest-1875562462 None] Flow 'volume_create_manager' (ac3cbc53-80b1-4f58-8edd-dfc5bde17d27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:30:18 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7942a01c-3636-47a8-9a04-1b33535333d7 tempest-VolumeAndVolumeTypeFromImageTest-1875562462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08436546-8500-4ba1-b823-22ae8ffd05b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:30:18 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7942a01c-3636-47a8-9a04-1b33535333d7 tempest-VolumeAndVolumeTypeFromImageTest-1875562462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08436546-8500-4ba1-b823-22ae8ffd05b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:30:18Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbd55b2a-d0a1-4726-ae3a-e7163764b17d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b62e885cb344834b13fddb74340c843',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:30:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:30:18Z,use_quota=True,user_id='c82f3efa970c4650a8b7bd1743cad070',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a6e932a-43d4-4faf-a2c9-e20552413a5e),volume_type_id=9a6e932a-43d4-4faf-a2c9-e20552413a5e)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:30:18 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7942a01c-3636-47a8-9a04-1b33535333d7 tempest-VolumeAndVolumeTypeFromImageTest-1875562462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d6eabf6-c557-4d28-a1e5-d26b1a28e143) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:30:18 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7942a01c-3636-47a8-9a04-1b33535333d7 tempest-VolumeAndVolumeTypeFromImageTest-1875562462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d6eabf6-c557-4d28-a1e5-d26b1a28e143) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:30:18 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7942a01c-3636-47a8-9a04-1b33535333d7 tempest-VolumeAndVolumeTypeFromImageTest-1875562462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d8ae3fe-fb0c-4fa9-8d66-b7f62a1c7717) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:30:18 devstack cinder-volume[87068]: DEBUG cinder.image.glance [None req-7942a01c-3636-47a8-9a04-1b33535333d7 tempest-VolumeAndVolumeTypeFromImageTest-1875562462 None] Creating Keystone auth plugin from conf {{(pid=87068) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 04 10:30:18 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-9348af68-7037-4a6d-88e5-bde81c866401 tempest-CinderUnicodeTest-1040606135 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:30:18 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-9348af68-7037-4a6d-88e5-bde81c866401 tempest-CinderUnicodeTest-1040606135 None] Flow 'volume_create_manager' (f56ea045-fa27-48fd-98ea-3a2a6fb05f0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:30:18 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-9348af68-7037-4a6d-88e5-bde81c866401 tempest-CinderUnicodeTest-1040606135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac1cf782-57cf-48c4-a7c0-c03e59d80d4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:30:18 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-9348af68-7037-4a6d-88e5-bde81c866401 tempest-CinderUnicodeTest-1040606135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac1cf782-57cf-48c4-a7c0-c03e59d80d4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:30:18Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-438142682',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=409b0aa5-7e47-4141-9795-0fe590993207,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='858da449a96244549d00c5544f187c8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:30:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:30:18Z,use_quota=True,user_id='6af30b1ea31e46e780eeb1177584407d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:30:18 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-9348af68-7037-4a6d-88e5-bde81c866401 tempest-CinderUnicodeTest-1040606135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35d7e1c4-2180-47c1-9e06-58659c04ca8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:30:18 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-9348af68-7037-4a6d-88e5-bde81c866401 tempest-CinderUnicodeTest-1040606135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35d7e1c4-2180-47c1-9e06-58659c04ca8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:30:18 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-9348af68-7037-4a6d-88e5-bde81c866401 tempest-CinderUnicodeTest-1040606135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1947fb3-fe43-45b2-9eaa-dea9966092f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:30:18 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-9348af68-7037-4a6d-88e5-bde81c866401 tempest-CinderUnicodeTest-1040606135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1947fb3-fe43-45b2-9eaa-dea9966092f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '409b0aa5-7e47-4141-9795-0fe590993207', 'volume_name': 'volume-409b0aa5-7e47-4141-9795-0fe590993207', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:30:18 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-9348af68-7037-4a6d-88e5-bde81c866401 tempest-CinderUnicodeTest-1040606135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b858ce9-5892-45df-878d-897c37015913) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:30:18 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-9348af68-7037-4a6d-88e5-bde81c866401 tempest-CinderUnicodeTest-1040606135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b858ce9-5892-45df-878d-897c37015913) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:30:18 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-9348af68-7037-4a6d-88e5-bde81c866401 tempest-CinderUnicodeTest-1040606135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7bfb450-c842-46f7-97a3-828d9e5440b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:30:18 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-9348af68-7037-4a6d-88e5-bde81c866401 tempest-CinderUnicodeTest-1040606135 None] Volume 409b0aa5-7e47-4141-9795-0fe590993207: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-409b0aa5-7e47-4141-9795-0fe590993207', 'volume_size': 1} Nov 04 10:30:18 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-9348af68-7037-4a6d-88e5-bde81c866401 tempest-CinderUnicodeTest-1040606135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:30:18 devstack sudo[104394]: pam_unix(sudo:session): session closed for user root Nov 04 10:30:18 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d6e71c19-6b15-466f-8347-bed6a33b0f8f tempest-CreateVolumesFromImageTest-1351866360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-cd166963-ca58-47be-9ac9-83b51c76d8ef 1073741824" returned: 0 in 0.468s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:30:18 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d6e71c19-6b15-466f-8347-bed6a33b0f8f tempest-CreateVolumesFromImageTest-1351866360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-cd166963-ca58-47be-9ac9-83b51c76d8ef {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:30:18 devstack sudo[104400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-cd166963-ca58-47be-9ac9-83b51c76d8ef Nov 04 10:30:18 devstack sudo[104400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:30:18 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7942a01c-3636-47a8-9a04-1b33535333d7 tempest-VolumeAndVolumeTypeFromImageTest-1875562462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d8ae3fe-fb0c-4fa9-8d66-b7f62a1c7717) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'bbd55b2a-d0a1-4726-ae3a-e7163764b17d', 'volume_name': 'volume-bbd55b2a-d0a1-4726-ae3a-e7163764b17d', 'volume_size': 1, 'image_id': '297e3214-fd85-4792-9370-3b6e49ceb78a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/297e3214-fd85-4792-9370-3b6e49ceb78a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e615c1d8df7e79decaf8ec53d19cf45f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '6b62e885cb344834b13fddb74340c843', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '14dd830cb87a8cebdaeb3e91c12d8d2db5f57b16c2c56b9664e874543ce7ddf33fd87e4bd6afb93323e2033c0005148de6464c36dba02f6117d9ff4e66960800', 'id': '297e3214-fd85-4792-9370-3b6e49ceb78a', 'created_at': datetime.datetime(2026, 11, 4, 9, 30, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 9, 30, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/297e3214-fd85-4792-9370-3b6e49ceb78a/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:30:18 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7942a01c-3636-47a8-9a04-1b33535333d7 tempest-VolumeAndVolumeTypeFromImageTest-1875562462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (beefeebc-1ccd-4fb2-b4df-40a9da7d8199) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:30:18 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7942a01c-3636-47a8-9a04-1b33535333d7 tempest-VolumeAndVolumeTypeFromImageTest-1875562462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (beefeebc-1ccd-4fb2-b4df-40a9da7d8199) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:30:18 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7942a01c-3636-47a8-9a04-1b33535333d7 tempest-VolumeAndVolumeTypeFromImageTest-1875562462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f20ea9df-84f6-4bf7-8261-3f3e55a2c748) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:30:18 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-7942a01c-3636-47a8-9a04-1b33535333d7 tempest-VolumeAndVolumeTypeFromImageTest-1875562462 None] Volume bbd55b2a-d0a1-4726-ae3a-e7163764b17d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-bbd55b2a-d0a1-4726-ae3a-e7163764b17d', 'volume_size': 1, 'image_id': '297e3214-fd85-4792-9370-3b6e49ceb78a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/297e3214-fd85-4792-9370-3b6e49ceb78a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e615c1d8df7e79decaf8ec53d19cf45f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '6b62e885cb344834b13fddb74340c843', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '14dd830cb87a8cebdaeb3e91c12d8d2db5f57b16c2c56b9664e874543ce7ddf33fd87e4bd6afb93323e2033c0005148de6464c36dba02f6117d9ff4e66960800', 'id': '297e3214-fd85-4792-9370-3b6e49ceb78a', 'created_at': datetime.datetime(2026, 11, 4, 9, 30, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 9, 30, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/297e3214-fd85-4792-9370-3b6e49ceb78a/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Nov 04 10:30:18 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-7942a01c-3636-47a8-9a04-1b33535333d7 tempest-VolumeAndVolumeTypeFromImageTest-1875562462 None] Trying to clone bbd55b2a-d0a1-4726-ae3a-e7163764b17d from image 297e3214-fd85-4792-9370-3b6e49ceb78a at location (None, [{'url': 'file:///opt/stack/data/glance/images/297e3214-fd85-4792-9370-3b6e49ceb78a', 'metadata': {}}]). {{(pid=87068) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 04 10:30:18 devstack cinder-volume[87068]: DEBUG cinder.image.image_utils [None req-7942a01c-3636-47a8-9a04-1b33535333d7 tempest-VolumeAndVolumeTypeFromImageTest-1875562462 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_297e3214-fd85-4792-9370-3b6e49ceb78a_zv6gtawjdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87068) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 04 10:30:18 devstack cinder-volume[87068]: INFO cinder.image.image_utils [None req-7942a01c-3636-47a8-9a04-1b33535333d7 tempest-VolumeAndVolumeTypeFromImageTest-1875562462 None] Image download 0.00 MB at 0.00 MB/s Nov 04 10:30:18 devstack sudo[104400]: pam_unix(sudo:session): session closed for user root Nov 04 10:30:18 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d6e71c19-6b15-466f-8347-bed6a33b0f8f tempest-CreateVolumesFromImageTest-1351866360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-cd166963-ca58-47be-9ac9-83b51c76d8ef" returned: 0 in 0.276s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:30:18 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-d6e71c19-6b15-466f-8347-bed6a33b0f8f tempest-CreateVolumesFromImageTest-1351866360 None] <== create_volume: return (785ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 10:30:18 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-d6e71c19-6b15-466f-8347-bed6a33b0f8f tempest-CreateVolumesFromImageTest-1351866360 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.788s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:30:18 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-23bd1ca1-1b4f-4595-a195-5af68e5810aa tempest-CreateVolumesFromImageTest-1351866360 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.279s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:30:18 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-23bd1ca1-1b4f-4595-a195-5af68e5810aa tempest-CreateVolumesFromImageTest-1351866360 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:30:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1697544184',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00a99c7b-3253-4089-9d1d-8bafa0f2ab42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f82cedfbc624c55baa50f6e6391345a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:30:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:30:16Z,use_quota=True,user_id='18db31573d204cb08b7952dc094edafc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 10:30:18 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-23bd1ca1-1b4f-4595-a195-5af68e5810aa tempest-CreateVolumesFromImageTest-1351866360 None] Creating volume 00a99c7b-3253-4089-9d1d-8bafa0f2ab42 {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:30:18 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-23bd1ca1-1b4f-4595-a195-5af68e5810aa tempest-CreateVolumesFromImageTest-1351866360 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:30:18 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-23bd1ca1-1b4f-4595-a195-5af68e5810aa tempest-CreateVolumesFromImageTest-1351866360 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:30:18 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-23bd1ca1-1b4f-4595-a195-5af68e5810aa tempest-CreateVolumesFromImageTest-1351866360 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:30:18 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-23bd1ca1-1b4f-4595-a195-5af68e5810aa tempest-CreateVolumesFromImageTest-1351866360 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:30:18 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-23bd1ca1-1b4f-4595-a195-5af68e5810aa tempest-CreateVolumesFromImageTest-1351866360 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:30:18 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-23bd1ca1-1b4f-4595-a195-5af68e5810aa tempest-CreateVolumesFromImageTest-1351866360 None] Selected osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:30:18 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-23bd1ca1-1b4f-4595-a195-5af68e5810aa tempest-CreateVolumesFromImageTest-1351866360 None] casted to osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 Nov 04 10:30:19 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-23bd1ca1-1b4f-4595-a195-5af68e5810aa tempest-CreateVolumesFromImageTest-1351866360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-00a99c7b-3253-4089-9d1d-8bafa0f2ab42 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:30:19 devstack sudo[104403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-00a99c7b-3253-4089-9d1d-8bafa0f2ab42 1073741824 Nov 04 10:30:19 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-d6e71c19-6b15-466f-8347-bed6a33b0f8f tempest-CreateVolumesFromImageTest-1351866360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (012a0d4b-5b2c-4c53-8a55-6bea83619086) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd166963-ca58-47be-9ac9-83b51c76d8ef', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:30:19 devstack sudo[104403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:30:19 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-d6e71c19-6b15-466f-8347-bed6a33b0f8f tempest-CreateVolumesFromImageTest-1351866360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22b91ae3-1b5e-4a57-961c-fc91f3a57314) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:30:19 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[feb31b86-caa1-4a53-ba09-38e36a584d03]: (4, 'raw') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:30:19 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7942a01c-3636-47a8-9a04-1b33535333d7 tempest-VolumeAndVolumeTypeFromImageTest-1875562462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_297e3214-fd85-4792-9370-3b6e49ceb78a_zv6gtawjdevstack@QuobyteHD {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:30:19 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-d6e71c19-6b15-466f-8347-bed6a33b0f8f tempest-CreateVolumesFromImageTest-1351866360 None] Volume volume-cd166963-ca58-47be-9ac9-83b51c76d8ef (cd166963-ca58-47be-9ac9-83b51c76d8ef): created successfully Nov 04 10:30:19 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-d6e71c19-6b15-466f-8347-bed6a33b0f8f tempest-CreateVolumesFromImageTest-1351866360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22b91ae3-1b5e-4a57-961c-fc91f3a57314) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:30:19 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-d6e71c19-6b15-466f-8347-bed6a33b0f8f tempest-CreateVolumesFromImageTest-1351866360 None] Flow 'volume_create_manager' (284afb61-e5c7-45de-81a1-1f4957e7857b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:30:19 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-d6e71c19-6b15-466f-8347-bed6a33b0f8f tempest-CreateVolumesFromImageTest-1351866360 None] Created volume successfully. Nov 04 10:30:19 devstack sudo[104405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_297e3214-fd85-4792-9370-3b6e49ceb78a_zv6gtawjdevstack@QuobyteHD Nov 04 10:30:19 devstack sudo[104405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:30:19 devstack sudo[104405]: pam_unix(sudo:session): session closed for user root Nov 04 10:30:19 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7942a01c-3636-47a8-9a04-1b33535333d7 tempest-VolumeAndVolumeTypeFromImageTest-1875562462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_297e3214-fd85-4792-9370-3b6e49ceb78a_zv6gtawjdevstack@QuobyteHD" returned: 0 in 0.348s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:30:19 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7942a01c-3636-47a8-9a04-1b33535333d7 tempest-VolumeAndVolumeTypeFromImageTest-1875562462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_297e3214-fd85-4792-9370-3b6e49ceb78a_zv6gtawjdevstack@QuobyteHD {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:30:19 devstack sudo[104403]: pam_unix(sudo:session): session closed for user root Nov 04 10:30:19 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-23bd1ca1-1b4f-4595-a195-5af68e5810aa tempest-CreateVolumesFromImageTest-1351866360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-00a99c7b-3253-4089-9d1d-8bafa0f2ab42 1073741824" returned: 0 in 0.454s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:30:19 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-23bd1ca1-1b4f-4595-a195-5af68e5810aa tempest-CreateVolumesFromImageTest-1351866360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-00a99c7b-3253-4089-9d1d-8bafa0f2ab42 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:30:19 devstack sudo[104412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_297e3214-fd85-4792-9370-3b6e49ceb78a_zv6gtawjdevstack@QuobyteHD Nov 04 10:30:19 devstack sudo[104412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:30:19 devstack sudo[104413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-00a99c7b-3253-4089-9d1d-8bafa0f2ab42 Nov 04 10:30:19 devstack sudo[104413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:30:19 devstack sudo[104412]: pam_unix(sudo:session): session closed for user root Nov 04 10:30:19 devstack sudo[104413]: pam_unix(sudo:session): session closed for user root Nov 04 10:30:19 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7942a01c-3636-47a8-9a04-1b33535333d7 tempest-VolumeAndVolumeTypeFromImageTest-1875562462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_297e3214-fd85-4792-9370-3b6e49ceb78a_zv6gtawjdevstack@QuobyteHD" returned: 1 in 0.338s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:30:19 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7942a01c-3636-47a8-9a04-1b33535333d7 tempest-VolumeAndVolumeTypeFromImageTest-1875562462 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_297e3214-fd85-4792-9370-3b6e49ceb78a_zv6gtawjdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 04 10:30:19 devstack cinder-volume[87068]: DEBUG cinder.image.image_utils [None req-7942a01c-3636-47a8-9a04-1b33535333d7 tempest-VolumeAndVolumeTypeFromImageTest-1875562462 None] Temporary image 297e3214-fd85-4792-9370-3b6e49ceb78a is fetched for user c82f3efa970c4650a8b7bd1743cad070. {{(pid=87068) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 04 10:30:19 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-23bd1ca1-1b4f-4595-a195-5af68e5810aa tempest-CreateVolumesFromImageTest-1351866360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-00a99c7b-3253-4089-9d1d-8bafa0f2ab42" returned: 0 in 0.249s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:30:19 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-23bd1ca1-1b4f-4595-a195-5af68e5810aa tempest-CreateVolumesFromImageTest-1351866360 None] <== create_volume: return (741ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 10:30:19 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-23bd1ca1-1b4f-4595-a195-5af68e5810aa tempest-CreateVolumesFromImageTest-1351866360 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.743s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:30:19 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-3516e756-3a5e-473e-b145-23646946be0d tempest-CreateVolumesFromSnapshotTest-517992082 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.204s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:30:19 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-23bd1ca1-1b4f-4595-a195-5af68e5810aa tempest-CreateVolumesFromImageTest-1351866360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d052915-c7da-49ed-a2b9-03716329a3f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00a99c7b-3253-4089-9d1d-8bafa0f2ab42', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:30:19 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-23bd1ca1-1b4f-4595-a195-5af68e5810aa tempest-CreateVolumesFromImageTest-1351866360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdadc8f5-2296-41f3-9d0f-deb2633b3d78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:30:19 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-3516e756-3a5e-473e-b145-23646946be0d tempest-CreateVolumesFromSnapshotTest-517992082 None] Creating offline snapshot 5deb6274-4543-46d7-a157-ea40935512ea of volume 57c7cbf6-588a-4ef6-b974-ae90bbd9ed87 {{(pid=87068) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 10:30:19 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-23bd1ca1-1b4f-4595-a195-5af68e5810aa tempest-CreateVolumesFromImageTest-1351866360 None] Volume volume-00a99c7b-3253-4089-9d1d-8bafa0f2ab42 (00a99c7b-3253-4089-9d1d-8bafa0f2ab42): created successfully Nov 04 10:30:19 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-23bd1ca1-1b4f-4595-a195-5af68e5810aa tempest-CreateVolumesFromImageTest-1351866360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdadc8f5-2296-41f3-9d0f-deb2633b3d78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:30:19 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-23bd1ca1-1b4f-4595-a195-5af68e5810aa tempest-CreateVolumesFromImageTest-1351866360 None] Flow 'volume_create_manager' (8ccfaff7-a640-45b8-9311-ba50b42ef871) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:30:19 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1a89a62-a926-48fd-a916-c519ea29194c]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:30:19 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-3516e756-3a5e-473e-b145-23646946be0d tempest-CreateVolumesFromSnapshotTest-517992082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-57c7cbf6-588a-4ef6-b974-ae90bbd9ed87 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:30:19 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-23bd1ca1-1b4f-4595-a195-5af68e5810aa tempest-CreateVolumesFromImageTest-1351866360 None] Created volume successfully. Nov 04 10:30:19 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b3a2afa-8ccf-45a3-b86c-22516b830603]: (4, 'raw') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:30:19 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7942a01c-3636-47a8-9a04-1b33535333d7 tempest-VolumeAndVolumeTypeFromImageTest-1875562462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_297e3214-fd85-4792-9370-3b6e49ceb78a_zv6gtawjdevstack@QuobyteHD {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:30:19 devstack sudo[104420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-57c7cbf6-588a-4ef6-b974-ae90bbd9ed87 Nov 04 10:30:19 devstack sudo[104420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:30:19 devstack sudo[104421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_297e3214-fd85-4792-9370-3b6e49ceb78a_zv6gtawjdevstack@QuobyteHD Nov 04 10:30:19 devstack sudo[104421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:30:20 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-caea2bbb-0b5d-4d33-92d4-11d82e54463f tempest-CreateVolumesFromImageTest-1351866360 None] Acquiring lock "cinder-00a99c7b-3253-4089-9d1d-8bafa0f2ab42-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:30:20 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-caea2bbb-0b5d-4d33-92d4-11d82e54463f tempest-CreateVolumesFromImageTest-1351866360 None] Lock "cinder-00a99c7b-3253-4089-9d1d-8bafa0f2ab42-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:30:20 devstack sudo[104421]: pam_unix(sudo:session): session closed for user root Nov 04 10:30:20 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7942a01c-3636-47a8-9a04-1b33535333d7 tempest-VolumeAndVolumeTypeFromImageTest-1875562462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_297e3214-fd85-4792-9370-3b6e49ceb78a_zv6gtawjdevstack@QuobyteHD" returned: 0 in 0.359s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:30:20 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7942a01c-3636-47a8-9a04-1b33535333d7 tempest-VolumeAndVolumeTypeFromImageTest-1875562462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_297e3214-fd85-4792-9370-3b6e49ceb78a_zv6gtawjdevstack@QuobyteHD {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:30:20 devstack sudo[104420]: pam_unix(sudo:session): session closed for user root Nov 04 10:30:20 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-3516e756-3a5e-473e-b145-23646946be0d tempest-CreateVolumesFromSnapshotTest-517992082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-57c7cbf6-588a-4ef6-b974-ae90bbd9ed87" returned: 0 in 0.411s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:30:20 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-3516e756-3a5e-473e-b145-23646946be0d tempest-CreateVolumesFromSnapshotTest-517992082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-57c7cbf6-588a-4ef6-b974-ae90bbd9ed87,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-57c7cbf6-588a-4ef6-b974-ae90bbd9ed87.5deb6274-4543-46d7-a157-ea40935512ea 1G {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:30:20 devstack sudo[104430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-57c7cbf6-588a-4ef6-b974-ae90bbd9ed87,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-57c7cbf6-588a-4ef6-b974-ae90bbd9ed87.5deb6274-4543-46d7-a157-ea40935512ea 1G Nov 04 10:30:20 devstack sudo[104430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:30:20 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-caea2bbb-0b5d-4d33-92d4-11d82e54463f tempest-CreateVolumesFromImageTest-1351866360 None] Acquiring lock "cinder-quobyte-00a99c7b-3253-4089-9d1d-8bafa0f2ab42" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:30:20 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-caea2bbb-0b5d-4d33-92d4-11d82e54463f tempest-CreateVolumesFromImageTest-1351866360 None] Lock "cinder-quobyte-00a99c7b-3253-4089-9d1d-8bafa0f2ab42" acquired by "delete_volume" :: waited 0.027s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:30:20 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[94035097-886d-4d2c-8fb3-4506c332c42f]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:30:20 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-caea2bbb-0b5d-4d33-92d4-11d82e54463f tempest-CreateVolumesFromImageTest-1351866360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-00a99c7b-3253-4089-9d1d-8bafa0f2ab42 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:30:20 devstack sudo[104429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_297e3214-fd85-4792-9370-3b6e49ceb78a_zv6gtawjdevstack@QuobyteHD Nov 04 10:30:20 devstack sudo[104429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:30:20 devstack sudo[104432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-00a99c7b-3253-4089-9d1d-8bafa0f2ab42 Nov 04 10:30:20 devstack sudo[104432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:30:20 devstack sudo[104429]: pam_unix(sudo:session): session closed for user root Nov 04 10:30:20 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7942a01c-3636-47a8-9a04-1b33535333d7 tempest-VolumeAndVolumeTypeFromImageTest-1875562462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_297e3214-fd85-4792-9370-3b6e49ceb78a_zv6gtawjdevstack@QuobyteHD" returned: 1 in 0.399s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:30:20 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7942a01c-3636-47a8-9a04-1b33535333d7 tempest-VolumeAndVolumeTypeFromImageTest-1875562462 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_297e3214-fd85-4792-9370-3b6e49ceb78a_zv6gtawjdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 04 10:30:20 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-7942a01c-3636-47a8-9a04-1b33535333d7 tempest-VolumeAndVolumeTypeFromImageTest-1875562462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:30:20 devstack sudo[104430]: pam_unix(sudo:session): session closed for user root Nov 04 10:30:20 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-3516e756-3a5e-473e-b145-23646946be0d tempest-CreateVolumesFromSnapshotTest-517992082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-57c7cbf6-588a-4ef6-b974-ae90bbd9ed87,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-57c7cbf6-588a-4ef6-b974-ae90bbd9ed87.5deb6274-4543-46d7-a157-ea40935512ea 1G" returned: 0 in 0.465s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:30:20 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-3516e756-3a5e-473e-b145-23646946be0d tempest-CreateVolumesFromSnapshotTest-517992082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-57c7cbf6-588a-4ef6-b974-ae90bbd9ed87 -F qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-57c7cbf6-588a-4ef6-b974-ae90bbd9ed87.5deb6274-4543-46d7-a157-ea40935512ea {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:30:20 devstack sudo[104432]: pam_unix(sudo:session): session closed for user root Nov 04 10:30:20 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-caea2bbb-0b5d-4d33-92d4-11d82e54463f tempest-CreateVolumesFromImageTest-1351866360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-00a99c7b-3253-4089-9d1d-8bafa0f2ab42" returned: 0 in 0.384s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:30:20 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-caea2bbb-0b5d-4d33-92d4-11d82e54463f tempest-CreateVolumesFromImageTest-1351866360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-00a99c7b-3253-4089-9d1d-8bafa0f2ab42 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:30:20 devstack sudo[104444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-57c7cbf6-588a-4ef6-b974-ae90bbd9ed87 -F qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-57c7cbf6-588a-4ef6-b974-ae90bbd9ed87.5deb6274-4543-46d7-a157-ea40935512ea Nov 04 10:30:20 devstack sudo[104444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:30:20 devstack sudo[104445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-00a99c7b-3253-4089-9d1d-8bafa0f2ab42 Nov 04 10:30:20 devstack sudo[104445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:30:20 devstack sudo[104445]: pam_unix(sudo:session): session closed for user root Nov 04 10:30:20 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-caea2bbb-0b5d-4d33-92d4-11d82e54463f tempest-CreateVolumesFromImageTest-1351866360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-00a99c7b-3253-4089-9d1d-8bafa0f2ab42" returned: 0 in 0.237s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:30:20 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-caea2bbb-0b5d-4d33-92d4-11d82e54463f tempest-CreateVolumesFromImageTest-1351866360 None] Lock "cinder-quobyte-00a99c7b-3253-4089-9d1d-8bafa0f2ab42" released by "delete_volume" :: held 0.687s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:30:20 devstack sudo[104444]: pam_unix(sudo:session): session closed for user root Nov 04 10:30:20 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-3516e756-3a5e-473e-b145-23646946be0d tempest-CreateVolumesFromSnapshotTest-517992082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-57c7cbf6-588a-4ef6-b974-ae90bbd9ed87 -F qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-57c7cbf6-588a-4ef6-b974-ae90bbd9ed87.5deb6274-4543-46d7-a157-ea40935512ea" returned: 0 in 0.286s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:30:20 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-3516e756-3a5e-473e-b145-23646946be0d tempest-CreateVolumesFromSnapshotTest-517992082 None] /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-57c7cbf6-588a-4ef6-b974-ae90bbd9ed87.5deb6274-4543-46d7-a157-ea40935512ea is being set with open permissions: ugo+rw Nov 04 10:30:20 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-3516e756-3a5e-473e-b145-23646946be0d tempest-CreateVolumesFromSnapshotTest-517992082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-57c7cbf6-588a-4ef6-b974-ae90bbd9ed87.5deb6274-4543-46d7-a157-ea40935512ea {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:30:20 devstack sudo[104452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-57c7cbf6-588a-4ef6-b974-ae90bbd9ed87.5deb6274-4543-46d7-a157-ea40935512ea Nov 04 10:30:20 devstack sudo[104452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:30:21 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-caea2bbb-0b5d-4d33-92d4-11d82e54463f tempest-CreateVolumesFromImageTest-1351866360 None] Created reservations ['85d40b3a-b902-44cf-9428-990926a21017', 'e045bef9-8040-4094-9e75-d1b7713e5b9e', '66e7314e-6cc3-45e2-a104-fb5ca5e79674', '57b256ba-842b-4ff8-acc9-b8951b50fddd'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:30:21 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-caea2bbb-0b5d-4d33-92d4-11d82e54463f tempest-CreateVolumesFromImageTest-1351866360 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:30:21 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-caea2bbb-0b5d-4d33-92d4-11d82e54463f tempest-CreateVolumesFromImageTest-1351866360 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:30:21 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-caea2bbb-0b5d-4d33-92d4-11d82e54463f tempest-CreateVolumesFromImageTest-1351866360 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:30:21 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-caea2bbb-0b5d-4d33-92d4-11d82e54463f tempest-CreateVolumesFromImageTest-1351866360 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:30:21 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-caea2bbb-0b5d-4d33-92d4-11d82e54463f tempest-CreateVolumesFromImageTest-1351866360 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:30:21 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-caea2bbb-0b5d-4d33-92d4-11d82e54463f tempest-CreateVolumesFromImageTest-1351866360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:30:21 devstack sudo[104454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:30:21 devstack sudo[104454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:30:21 devstack sudo[104452]: pam_unix(sudo:session): session closed for user root Nov 04 10:30:21 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-3516e756-3a5e-473e-b145-23646946be0d tempest-CreateVolumesFromSnapshotTest-517992082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-57c7cbf6-588a-4ef6-b974-ae90bbd9ed87.5deb6274-4543-46d7-a157-ea40935512ea" returned: 0 in 0.245s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:30:21 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-3516e756-3a5e-473e-b145-23646946be0d tempest-CreateVolumesFromSnapshotTest-517992082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-57c7cbf6-588a-4ef6-b974-ae90bbd9ed87.info {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:30:21 devstack sudo[104457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-57c7cbf6-588a-4ef6-b974-ae90bbd9ed87.info Nov 04 10:30:21 devstack sudo[104457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:30:21 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-4f21b834-d892-4d20-aa9e-85fae619ae28 tempest-CreateVolumesFromImageTest-1351866360 None] Acquiring lock "cinder-cd166963-ca58-47be-9ac9-83b51c76d8ef-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:30:21 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-4f21b834-d892-4d20-aa9e-85fae619ae28 tempest-CreateVolumesFromImageTest-1351866360 None] Lock "cinder-cd166963-ca58-47be-9ac9-83b51c76d8ef-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:30:21 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-4f21b834-d892-4d20-aa9e-85fae619ae28 tempest-CreateVolumesFromImageTest-1351866360 None] Acquiring lock "cinder-quobyte-cd166963-ca58-47be-9ac9-83b51c76d8ef" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:30:21 devstack sudo[104454]: pam_unix(sudo:session): session closed for user root Nov 04 10:30:21 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-caea2bbb-0b5d-4d33-92d4-11d82e54463f tempest-CreateVolumesFromImageTest-1351866360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.340s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:30:21 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-caea2bbb-0b5d-4d33-92d4-11d82e54463f tempest-CreateVolumesFromImageTest-1351866360 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:30:21 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-4f21b834-d892-4d20-aa9e-85fae619ae28 tempest-CreateVolumesFromImageTest-1351866360 None] Lock "cinder-quobyte-cd166963-ca58-47be-9ac9-83b51c76d8ef" acquired by "delete_volume" :: waited 0.017s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:30:21 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-caea2bbb-0b5d-4d33-92d4-11d82e54463f tempest-CreateVolumesFromImageTest-1351866360 None] Deleted volume successfully. Nov 04 10:30:21 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3023fd9-ca3a-4c56-a0c4-c0b2c842346b]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:30:21 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-4f21b834-d892-4d20-aa9e-85fae619ae28 tempest-CreateVolumesFromImageTest-1351866360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-cd166963-ca58-47be-9ac9-83b51c76d8ef {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:30:21 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-caea2bbb-0b5d-4d33-92d4-11d82e54463f tempest-CreateVolumesFromImageTest-1351866360 None] Lock "cinder-00a99c7b-3253-4089-9d1d-8bafa0f2ab42-delete_volume" released by "delete_volume" :: held 1.310s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:30:21 devstack sudo[104457]: pam_unix(sudo:session): session closed for user root Nov 04 10:30:21 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-3516e756-3a5e-473e-b145-23646946be0d tempest-CreateVolumesFromSnapshotTest-517992082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-57c7cbf6-588a-4ef6-b974-ae90bbd9ed87.info" returned: 0 in 0.318s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:30:21 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-3516e756-3a5e-473e-b145-23646946be0d tempest-CreateVolumesFromSnapshotTest-517992082 None] /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-57c7cbf6-588a-4ef6-b974-ae90bbd9ed87.info is being set with open permissions: ugo+rw Nov 04 10:30:21 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-3516e756-3a5e-473e-b145-23646946be0d tempest-CreateVolumesFromSnapshotTest-517992082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-57c7cbf6-588a-4ef6-b974-ae90bbd9ed87.info {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:30:21 devstack sudo[104460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-cd166963-ca58-47be-9ac9-83b51c76d8ef Nov 04 10:30:21 devstack sudo[104460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:30:21 devstack sudo[104462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-57c7cbf6-588a-4ef6-b974-ae90bbd9ed87.info Nov 04 10:30:21 devstack sudo[104462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:30:21 devstack sudo[104462]: pam_unix(sudo:session): session closed for user root Nov 04 10:30:21 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-3516e756-3a5e-473e-b145-23646946be0d tempest-CreateVolumesFromSnapshotTest-517992082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-57c7cbf6-588a-4ef6-b974-ae90bbd9ed87.info" returned: 0 in 0.255s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:30:21 devstack sudo[104460]: pam_unix(sudo:session): session closed for user root Nov 04 10:30:21 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-3516e756-3a5e-473e-b145-23646946be0d tempest-CreateVolumesFromSnapshotTest-517992082 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.105s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:30:21 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-9348af68-7037-4a6d-88e5-bde81c866401 tempest-CinderUnicodeTest-1040606135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.174s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:30:21 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-9348af68-7037-4a6d-88e5-bde81c866401 tempest-CinderUnicodeTest-1040606135 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:30:18Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-438142682',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=409b0aa5-7e47-4141-9795-0fe590993207,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='858da449a96244549d00c5544f187c8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:30:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:30:18Z,use_quota=True,user_id='6af30b1ea31e46e780eeb1177584407d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 10:30:21 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-9348af68-7037-4a6d-88e5-bde81c866401 tempest-CinderUnicodeTest-1040606135 None] Creating volume 409b0aa5-7e47-4141-9795-0fe590993207 {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:30:21 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-9348af68-7037-4a6d-88e5-bde81c866401 tempest-CinderUnicodeTest-1040606135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:30:21 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-9348af68-7037-4a6d-88e5-bde81c866401 tempest-CinderUnicodeTest-1040606135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:30:21 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-9348af68-7037-4a6d-88e5-bde81c866401 tempest-CinderUnicodeTest-1040606135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:30:21 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-9348af68-7037-4a6d-88e5-bde81c866401 tempest-CinderUnicodeTest-1040606135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:30:21 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-9348af68-7037-4a6d-88e5-bde81c866401 tempest-CinderUnicodeTest-1040606135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:30:21 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-9348af68-7037-4a6d-88e5-bde81c866401 tempest-CinderUnicodeTest-1040606135 None] Selected osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:30:21 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-9348af68-7037-4a6d-88e5-bde81c866401 tempest-CinderUnicodeTest-1040606135 None] casted to osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 Nov 04 10:30:21 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-9348af68-7037-4a6d-88e5-bde81c866401 tempest-CinderUnicodeTest-1040606135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-409b0aa5-7e47-4141-9795-0fe590993207 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:30:21 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-4f21b834-d892-4d20-aa9e-85fae619ae28 tempest-CreateVolumesFromImageTest-1351866360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-cd166963-ca58-47be-9ac9-83b51c76d8ef" returned: 0 in 0.405s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:30:21 devstack sudo[104469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-409b0aa5-7e47-4141-9795-0fe590993207 1073741824 Nov 04 10:30:21 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-4f21b834-d892-4d20-aa9e-85fae619ae28 tempest-CreateVolumesFromImageTest-1351866360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-cd166963-ca58-47be-9ac9-83b51c76d8ef {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:30:21 devstack sudo[104469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:30:21 devstack sudo[104471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-cd166963-ca58-47be-9ac9-83b51c76d8ef Nov 04 10:30:21 devstack sudo[104471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:30:21 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-3516e756-3a5e-473e-b145-23646946be0d tempest-CreateVolumesFromSnapshotTest-517992082 None] Create snapshot completed successfully Nov 04 10:30:22 devstack sudo[104471]: pam_unix(sudo:session): session closed for user root Nov 04 10:30:22 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-4f21b834-d892-4d20-aa9e-85fae619ae28 tempest-CreateVolumesFromImageTest-1351866360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-cd166963-ca58-47be-9ac9-83b51c76d8ef" returned: 0 in 0.243s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:30:22 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-4f21b834-d892-4d20-aa9e-85fae619ae28 tempest-CreateVolumesFromImageTest-1351866360 None] Lock "cinder-quobyte-cd166963-ca58-47be-9ac9-83b51c76d8ef" released by "delete_volume" :: held 0.699s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:30:22 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-4f21b834-d892-4d20-aa9e-85fae619ae28 tempest-CreateVolumesFromImageTest-1351866360 None] Created reservations ['25a19340-100a-413c-84f3-409e7600b841', '9cddf862-12cc-4151-aa8f-2a41a2c4f558', '40ed0f8b-1e0a-4bf5-986f-be7f3cbf1d18', 'fd84ec05-ffb0-4819-83d2-cbbe2b5d94bd'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:30:22 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-4f21b834-d892-4d20-aa9e-85fae619ae28 tempest-CreateVolumesFromImageTest-1351866360 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:30:22 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-4f21b834-d892-4d20-aa9e-85fae619ae28 tempest-CreateVolumesFromImageTest-1351866360 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:30:22 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-4f21b834-d892-4d20-aa9e-85fae619ae28 tempest-CreateVolumesFromImageTest-1351866360 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:30:22 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-4f21b834-d892-4d20-aa9e-85fae619ae28 tempest-CreateVolumesFromImageTest-1351866360 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:30:22 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-4f21b834-d892-4d20-aa9e-85fae619ae28 tempest-CreateVolumesFromImageTest-1351866360 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:30:22 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-4f21b834-d892-4d20-aa9e-85fae619ae28 tempest-CreateVolumesFromImageTest-1351866360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:30:22 devstack sudo[104478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:30:22 devstack sudo[104478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:30:22 devstack sudo[104469]: pam_unix(sudo:session): session closed for user root Nov 04 10:30:22 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-9348af68-7037-4a6d-88e5-bde81c866401 tempest-CinderUnicodeTest-1040606135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-409b0aa5-7e47-4141-9795-0fe590993207 1073741824" returned: 0 in 0.450s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:30:22 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-9348af68-7037-4a6d-88e5-bde81c866401 tempest-CinderUnicodeTest-1040606135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-409b0aa5-7e47-4141-9795-0fe590993207 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:30:22 devstack sudo[104480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-409b0aa5-7e47-4141-9795-0fe590993207 Nov 04 10:30:22 devstack sudo[104480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:30:22 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-a9456cff-7d19-424a-bcc7-0916e09c290e tempest-CreateVolumesFromImageTest-1351866360 None] Acquiring lock "cinder-36ad933e-f173-4bd4-b277-9e543999a979-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:30:22 devstack sudo[104478]: pam_unix(sudo:session): session closed for user root Nov 04 10:30:22 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-4f21b834-d892-4d20-aa9e-85fae619ae28 tempest-CreateVolumesFromImageTest-1351866360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.279s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:30:22 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-4f21b834-d892-4d20-aa9e-85fae619ae28 tempest-CreateVolumesFromImageTest-1351866360 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:30:22 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-a9456cff-7d19-424a-bcc7-0916e09c290e tempest-CreateVolumesFromImageTest-1351866360 None] Lock "cinder-36ad933e-f173-4bd4-b277-9e543999a979-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:30:22 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-4f21b834-d892-4d20-aa9e-85fae619ae28 tempest-CreateVolumesFromImageTest-1351866360 None] Deleted volume successfully. Nov 04 10:30:22 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-4f21b834-d892-4d20-aa9e-85fae619ae28 tempest-CreateVolumesFromImageTest-1351866360 None] Lock "cinder-cd166963-ca58-47be-9ac9-83b51c76d8ef-delete_volume" released by "delete_volume" :: held 1.212s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:30:22 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-a9456cff-7d19-424a-bcc7-0916e09c290e tempest-CreateVolumesFromImageTest-1351866360 None] Acquiring lock "cinder-quobyte-36ad933e-f173-4bd4-b277-9e543999a979" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:30:22 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-a9456cff-7d19-424a-bcc7-0916e09c290e tempest-CreateVolumesFromImageTest-1351866360 None] Lock "cinder-quobyte-36ad933e-f173-4bd4-b277-9e543999a979" acquired by "delete_volume" :: waited 0.021s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:30:22 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[591cb712-15ca-4b7b-a8b6-fc280baaecf3]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:30:22 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-a9456cff-7d19-424a-bcc7-0916e09c290e tempest-CreateVolumesFromImageTest-1351866360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-36ad933e-f173-4bd4-b277-9e543999a979 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:30:22 devstack sudo[104480]: pam_unix(sudo:session): session closed for user root Nov 04 10:30:22 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-9348af68-7037-4a6d-88e5-bde81c866401 tempest-CinderUnicodeTest-1040606135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-409b0aa5-7e47-4141-9795-0fe590993207" returned: 0 in 0.343s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:30:22 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-9348af68-7037-4a6d-88e5-bde81c866401 tempest-CinderUnicodeTest-1040606135 None] <== create_volume: return (843ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 10:30:22 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-9348af68-7037-4a6d-88e5-bde81c866401 tempest-CinderUnicodeTest-1040606135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.846s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:30:22 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-7942a01c-3636-47a8-9a04-1b33535333d7 tempest-VolumeAndVolumeTypeFromImageTest-1875562462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.099s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:30:22 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-7942a01c-3636-47a8-9a04-1b33535333d7 tempest-VolumeAndVolumeTypeFromImageTest-1875562462 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:30:18Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbd55b2a-d0a1-4726-ae3a-e7163764b17d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b62e885cb344834b13fddb74340c843',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:30:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:30:18Z,use_quota=True,user_id='c82f3efa970c4650a8b7bd1743cad070',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a6e932a-43d4-4faf-a2c9-e20552413a5e),volume_type_id=9a6e932a-43d4-4faf-a2c9-e20552413a5e)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 10:30:22 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-7942a01c-3636-47a8-9a04-1b33535333d7 tempest-VolumeAndVolumeTypeFromImageTest-1875562462 None] Creating volume bbd55b2a-d0a1-4726-ae3a-e7163764b17d {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:30:22 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-7942a01c-3636-47a8-9a04-1b33535333d7 tempest-VolumeAndVolumeTypeFromImageTest-1875562462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:30:22 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-7942a01c-3636-47a8-9a04-1b33535333d7 tempest-VolumeAndVolumeTypeFromImageTest-1875562462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:30:22 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-7942a01c-3636-47a8-9a04-1b33535333d7 tempest-VolumeAndVolumeTypeFromImageTest-1875562462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:30:22 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-7942a01c-3636-47a8-9a04-1b33535333d7 tempest-VolumeAndVolumeTypeFromImageTest-1875562462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:30:22 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-7942a01c-3636-47a8-9a04-1b33535333d7 tempest-VolumeAndVolumeTypeFromImageTest-1875562462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:30:22 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-7942a01c-3636-47a8-9a04-1b33535333d7 tempest-VolumeAndVolumeTypeFromImageTest-1875562462 None] Selected osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:30:22 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-7942a01c-3636-47a8-9a04-1b33535333d7 tempest-VolumeAndVolumeTypeFromImageTest-1875562462 None] casted to osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 Nov 04 10:30:22 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7942a01c-3636-47a8-9a04-1b33535333d7 tempest-VolumeAndVolumeTypeFromImageTest-1875562462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-bbd55b2a-d0a1-4726-ae3a-e7163764b17d 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:30:22 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-9348af68-7037-4a6d-88e5-bde81c866401 tempest-CinderUnicodeTest-1040606135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7bfb450-c842-46f7-97a3-828d9e5440b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-409b0aa5-7e47-4141-9795-0fe590993207', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:30:22 devstack sudo[104485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-bbd55b2a-d0a1-4726-ae3a-e7163764b17d 1073741824 Nov 04 10:30:22 devstack sudo[104485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:30:22 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-9348af68-7037-4a6d-88e5-bde81c866401 tempest-CinderUnicodeTest-1040606135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c55ee7a-5c73-46bd-9ad1-55d0546a5bd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:30:22 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-9348af68-7037-4a6d-88e5-bde81c866401 tempest-CinderUnicodeTest-1040606135 None] Volume volume-409b0aa5-7e47-4141-9795-0fe590993207 (409b0aa5-7e47-4141-9795-0fe590993207): created successfully Nov 04 10:30:22 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-9348af68-7037-4a6d-88e5-bde81c866401 tempest-CinderUnicodeTest-1040606135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c55ee7a-5c73-46bd-9ad1-55d0546a5bd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:30:22 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-9348af68-7037-4a6d-88e5-bde81c866401 tempest-CinderUnicodeTest-1040606135 None] Flow 'volume_create_manager' (f56ea045-fa27-48fd-98ea-3a2a6fb05f0b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:30:22 devstack sudo[104484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-36ad933e-f173-4bd4-b277-9e543999a979 Nov 04 10:30:22 devstack sudo[104484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:30:22 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-9348af68-7037-4a6d-88e5-bde81c866401 tempest-CinderUnicodeTest-1040606135 None] Created volume successfully. Nov 04 10:30:23 devstack sudo[104484]: pam_unix(sudo:session): session closed for user root Nov 04 10:30:23 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-a9456cff-7d19-424a-bcc7-0916e09c290e tempest-CreateVolumesFromImageTest-1351866360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-36ad933e-f173-4bd4-b277-9e543999a979" returned: 0 in 0.399s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:30:23 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-a9456cff-7d19-424a-bcc7-0916e09c290e tempest-CreateVolumesFromImageTest-1351866360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-36ad933e-f173-4bd4-b277-9e543999a979 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:30:23 devstack sudo[104495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-36ad933e-f173-4bd4-b277-9e543999a979 Nov 04 10:30:23 devstack sudo[104495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:30:23 devstack sudo[104485]: pam_unix(sudo:session): session closed for user root Nov 04 10:30:23 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7942a01c-3636-47a8-9a04-1b33535333d7 tempest-VolumeAndVolumeTypeFromImageTest-1875562462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-bbd55b2a-d0a1-4726-ae3a-e7163764b17d 1073741824" returned: 0 in 0.559s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:30:23 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7942a01c-3636-47a8-9a04-1b33535333d7 tempest-VolumeAndVolumeTypeFromImageTest-1875562462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-bbd55b2a-d0a1-4726-ae3a-e7163764b17d {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:30:23 devstack sudo[104495]: pam_unix(sudo:session): session closed for user root Nov 04 10:30:23 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8b1a2a4-2458-4ed4-b3e5-7573655bcacd tempest-CreateVolumesFromSnapshotTest-517992082 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:30:23 devstack sudo[104499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-bbd55b2a-d0a1-4726-ae3a-e7163764b17d Nov 04 10:30:23 devstack sudo[104499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:30:23 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c8b1a2a4-2458-4ed4-b3e5-7573655bcacd tempest-CreateVolumesFromSnapshotTest-517992082 None] Flow 'volume_create_manager' (77ae1699-83a6-451e-a59e-609745656872) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:30:23 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c8b1a2a4-2458-4ed4-b3e5-7573655bcacd tempest-CreateVolumesFromSnapshotTest-517992082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d796f930-8869-4bc9-b1b2-731c9ea9ae9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:30:23 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-a9456cff-7d19-424a-bcc7-0916e09c290e tempest-CreateVolumesFromImageTest-1351866360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-36ad933e-f173-4bd4-b277-9e543999a979" returned: 0 in 0.327s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:30:23 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-a9456cff-7d19-424a-bcc7-0916e09c290e tempest-CreateVolumesFromImageTest-1351866360 None] Lock "cinder-quobyte-36ad933e-f173-4bd4-b277-9e543999a979" released by "delete_volume" :: held 0.785s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:30:23 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c8b1a2a4-2458-4ed4-b3e5-7573655bcacd tempest-CreateVolumesFromSnapshotTest-517992082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d796f930-8869-4bc9-b1b2-731c9ea9ae9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:30:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1927807073',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04d9e646-36e0-4f6e-a9b4-0e7cb5e2b991,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5941a1c11d24eceb16585ffd817bf0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:30:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:30:23Z,use_quota=True,user_id='4d75921ff5fb466e8d542434b8a4125b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:30:23 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c8b1a2a4-2458-4ed4-b3e5-7573655bcacd tempest-CreateVolumesFromSnapshotTest-517992082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42fcd5cb-7b8c-4a1e-9c6b-f91438ac3d4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:30:23 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c8b1a2a4-2458-4ed4-b3e5-7573655bcacd tempest-CreateVolumesFromSnapshotTest-517992082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42fcd5cb-7b8c-4a1e-9c6b-f91438ac3d4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:30:23 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c8b1a2a4-2458-4ed4-b3e5-7573655bcacd tempest-CreateVolumesFromSnapshotTest-517992082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9117bc12-cb24-476b-89ab-00d29aea1b7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:30:23 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c8b1a2a4-2458-4ed4-b3e5-7573655bcacd tempest-CreateVolumesFromSnapshotTest-517992082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9117bc12-cb24-476b-89ab-00d29aea1b7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04d9e646-36e0-4f6e-a9b4-0e7cb5e2b991', 'volume_name': 'volume-04d9e646-36e0-4f6e-a9b4-0e7cb5e2b991', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:30:23 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c8b1a2a4-2458-4ed4-b3e5-7573655bcacd tempest-CreateVolumesFromSnapshotTest-517992082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d74f397-7e54-445d-be2f-34710f0cb55e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:30:23 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c8b1a2a4-2458-4ed4-b3e5-7573655bcacd tempest-CreateVolumesFromSnapshotTest-517992082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d74f397-7e54-445d-be2f-34710f0cb55e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:30:23 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c8b1a2a4-2458-4ed4-b3e5-7573655bcacd tempest-CreateVolumesFromSnapshotTest-517992082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81a154fa-bb65-4e69-aa43-e181a4f54e9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:30:23 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-c8b1a2a4-2458-4ed4-b3e5-7573655bcacd tempest-CreateVolumesFromSnapshotTest-517992082 None] Volume 04d9e646-36e0-4f6e-a9b4-0e7cb5e2b991: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04d9e646-36e0-4f6e-a9b4-0e7cb5e2b991', 'volume_size': 1} Nov 04 10:30:23 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-c8b1a2a4-2458-4ed4-b3e5-7573655bcacd tempest-CreateVolumesFromSnapshotTest-517992082 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:30:23 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-a9456cff-7d19-424a-bcc7-0916e09c290e tempest-CreateVolumesFromImageTest-1351866360 None] Created reservations ['3e11d3b2-e9fd-4b95-aede-06be3a6d8f54', '5d4734e3-5119-4862-8d55-c2bc76ae71c1', 'df1da34d-9e89-4cb7-9e91-df6e4c9914ed', 'a5870fc1-855c-469b-9fe8-c1ad68b68d01'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:30:23 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-a9456cff-7d19-424a-bcc7-0916e09c290e tempest-CreateVolumesFromImageTest-1351866360 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:30:23 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-a9456cff-7d19-424a-bcc7-0916e09c290e tempest-CreateVolumesFromImageTest-1351866360 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:30:23 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-a9456cff-7d19-424a-bcc7-0916e09c290e tempest-CreateVolumesFromImageTest-1351866360 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:30:23 devstack sudo[104499]: pam_unix(sudo:session): session closed for user root Nov 04 10:30:23 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-a9456cff-7d19-424a-bcc7-0916e09c290e tempest-CreateVolumesFromImageTest-1351866360 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:30:23 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-a9456cff-7d19-424a-bcc7-0916e09c290e tempest-CreateVolumesFromImageTest-1351866360 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:30:23 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-a9456cff-7d19-424a-bcc7-0916e09c290e tempest-CreateVolumesFromImageTest-1351866360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:30:23 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7942a01c-3636-47a8-9a04-1b33535333d7 tempest-VolumeAndVolumeTypeFromImageTest-1875562462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-bbd55b2a-d0a1-4726-ae3a-e7163764b17d" returned: 0 in 0.346s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:30:23 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-7942a01c-3636-47a8-9a04-1b33535333d7 tempest-VolumeAndVolumeTypeFromImageTest-1875562462 None] <== create_volume: return (984ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 10:30:23 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-7942a01c-3636-47a8-9a04-1b33535333d7 tempest-VolumeAndVolumeTypeFromImageTest-1875562462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.991s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:30:23 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-c8b1a2a4-2458-4ed4-b3e5-7573655bcacd tempest-CreateVolumesFromSnapshotTest-517992082 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.236s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:30:23 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-c8b1a2a4-2458-4ed4-b3e5-7573655bcacd tempest-CreateVolumesFromSnapshotTest-517992082 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:30:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1927807073',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04d9e646-36e0-4f6e-a9b4-0e7cb5e2b991,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5941a1c11d24eceb16585ffd817bf0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:30:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:30:23Z,use_quota=True,user_id='4d75921ff5fb466e8d542434b8a4125b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 10:30:23 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-c8b1a2a4-2458-4ed4-b3e5-7573655bcacd tempest-CreateVolumesFromSnapshotTest-517992082 None] Creating volume 04d9e646-36e0-4f6e-a9b4-0e7cb5e2b991 {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:30:23 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-c8b1a2a4-2458-4ed4-b3e5-7573655bcacd tempest-CreateVolumesFromSnapshotTest-517992082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:30:23 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-c8b1a2a4-2458-4ed4-b3e5-7573655bcacd tempest-CreateVolumesFromSnapshotTest-517992082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:30:23 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-c8b1a2a4-2458-4ed4-b3e5-7573655bcacd tempest-CreateVolumesFromSnapshotTest-517992082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:30:23 devstack sudo[104502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:30:23 devstack sudo[104502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:30:23 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-c8b1a2a4-2458-4ed4-b3e5-7573655bcacd tempest-CreateVolumesFromSnapshotTest-517992082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:30:23 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-c8b1a2a4-2458-4ed4-b3e5-7573655bcacd tempest-CreateVolumesFromSnapshotTest-517992082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:30:23 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-c8b1a2a4-2458-4ed4-b3e5-7573655bcacd tempest-CreateVolumesFromSnapshotTest-517992082 None] Selected osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:30:23 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-c8b1a2a4-2458-4ed4-b3e5-7573655bcacd tempest-CreateVolumesFromSnapshotTest-517992082 None] casted to osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 Nov 04 10:30:23 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c8b1a2a4-2458-4ed4-b3e5-7573655bcacd tempest-CreateVolumesFromSnapshotTest-517992082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-04d9e646-36e0-4f6e-a9b4-0e7cb5e2b991 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:30:23 devstack sudo[104504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-04d9e646-36e0-4f6e-a9b4-0e7cb5e2b991 1073741824 Nov 04 10:30:23 devstack sudo[104504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:30:23 devstack cinder-volume[87068]: DEBUG cinder.volume.volume_utils [None req-7942a01c-3636-47a8-9a04-1b33535333d7 tempest-VolumeAndVolumeTypeFromImageTest-1875562462 None] Attempting download of 297e3214-fd85-4792-9370-3b6e49ceb78a ((None, [{'url': 'file:///opt/stack/data/glance/images/297e3214-fd85-4792-9370-3b6e49ceb78a', 'metadata': {}}])) to volume bbd55b2a-d0a1-4726-ae3a-e7163764b17d. {{(pid=87068) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 04 10:30:23 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-b0d21721-b074-414a-b5d8-699808da0143 tempest-CreateVolumesFromImageTest-1351866360 None] Acquiring lock "cinder-526b760f-2c05-4f80-8669-ea33a69d0a05-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:30:23 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-5caf126e-0e76-452e-b100-cc9e24cbe279 tempest-CreateVolumesFromSnapshotTest-517992082 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:30:23 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-5caf126e-0e76-452e-b100-cc9e24cbe279 tempest-CreateVolumesFromSnapshotTest-517992082 None] Flow 'volume_create_manager' (88aa9b57-273d-4cc2-95f4-03c48750720a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:30:23 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-5caf126e-0e76-452e-b100-cc9e24cbe279 tempest-CreateVolumesFromSnapshotTest-517992082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (689a8291-e26f-41a1-a368-3ed17c399b1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:30:24 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-b0d21721-b074-414a-b5d8-699808da0143 tempest-CreateVolumesFromImageTest-1351866360 None] Lock "cinder-526b760f-2c05-4f80-8669-ea33a69d0a05-delete_volume" acquired by "delete_volume" :: waited 0.204s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:30:24 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e1a42b4-9384-4af8-a7af-81363fca7f55]: (4, 'raw') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:30:24 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7942a01c-3636-47a8-9a04-1b33535333d7 tempest-VolumeAndVolumeTypeFromImageTest-1875562462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_297e3214-fd85-4792-9370-3b6e49ceb78a_iifiy2jr {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:30:24 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-5caf126e-0e76-452e-b100-cc9e24cbe279 tempest-CreateVolumesFromSnapshotTest-517992082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (689a8291-e26f-41a1-a368-3ed17c399b1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:30:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1783506766',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55acf56f-bf3f-4e60-af9f-8256135e33b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5941a1c11d24eceb16585ffd817bf0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:30:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:30:24Z,use_quota=True,user_id='4d75921ff5fb466e8d542434b8a4125b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:30:24 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-5caf126e-0e76-452e-b100-cc9e24cbe279 tempest-CreateVolumesFromSnapshotTest-517992082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (374554ea-9623-4e48-af39-283579979f39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:30:24 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-5caf126e-0e76-452e-b100-cc9e24cbe279 tempest-CreateVolumesFromSnapshotTest-517992082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (374554ea-9623-4e48-af39-283579979f39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:30:24 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-5caf126e-0e76-452e-b100-cc9e24cbe279 tempest-CreateVolumesFromSnapshotTest-517992082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18604982-2127-4a9d-a27d-b6699cb04c97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:30:24 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-5caf126e-0e76-452e-b100-cc9e24cbe279 tempest-CreateVolumesFromSnapshotTest-517992082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18604982-2127-4a9d-a27d-b6699cb04c97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '55acf56f-bf3f-4e60-af9f-8256135e33b0', 'volume_name': 'volume-55acf56f-bf3f-4e60-af9f-8256135e33b0', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:30:24 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-5caf126e-0e76-452e-b100-cc9e24cbe279 tempest-CreateVolumesFromSnapshotTest-517992082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40333b26-26b7-43bf-9db5-98c6bcb1b175) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:30:24 devstack sudo[104509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_297e3214-fd85-4792-9370-3b6e49ceb78a_iifiy2jr Nov 04 10:30:24 devstack sudo[104509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:30:24 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-5caf126e-0e76-452e-b100-cc9e24cbe279 tempest-CreateVolumesFromSnapshotTest-517992082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40333b26-26b7-43bf-9db5-98c6bcb1b175) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:30:24 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-5caf126e-0e76-452e-b100-cc9e24cbe279 tempest-CreateVolumesFromSnapshotTest-517992082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5a9890f-a7bc-40c0-bd70-a7303e236117) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:30:24 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-5caf126e-0e76-452e-b100-cc9e24cbe279 tempest-CreateVolumesFromSnapshotTest-517992082 None] Volume 55acf56f-bf3f-4e60-af9f-8256135e33b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-55acf56f-bf3f-4e60-af9f-8256135e33b0', 'volume_size': 1} Nov 04 10:30:24 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-5caf126e-0e76-452e-b100-cc9e24cbe279 tempest-CreateVolumesFromSnapshotTest-517992082 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:30:24 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-b0d21721-b074-414a-b5d8-699808da0143 tempest-CreateVolumesFromImageTest-1351866360 None] Acquiring lock "cinder-quobyte-526b760f-2c05-4f80-8669-ea33a69d0a05" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:30:24 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-b0d21721-b074-414a-b5d8-699808da0143 tempest-CreateVolumesFromImageTest-1351866360 None] Lock "cinder-quobyte-526b760f-2c05-4f80-8669-ea33a69d0a05" acquired by "delete_volume" :: waited 0.025s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:30:24 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e7cc4bf-afa2-431e-9ec4-b4fa77da484c]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:30:24 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-b0d21721-b074-414a-b5d8-699808da0143 tempest-CreateVolumesFromImageTest-1351866360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-526b760f-2c05-4f80-8669-ea33a69d0a05 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:30:24 devstack sudo[104502]: pam_unix(sudo:session): session closed for user root Nov 04 10:30:24 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-a9456cff-7d19-424a-bcc7-0916e09c290e tempest-CreateVolumesFromImageTest-1351866360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.726s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:30:24 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-a9456cff-7d19-424a-bcc7-0916e09c290e tempest-CreateVolumesFromImageTest-1351866360 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:30:24 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-a9456cff-7d19-424a-bcc7-0916e09c290e tempest-CreateVolumesFromImageTest-1351866360 None] Deleted volume successfully. Nov 04 10:30:24 devstack sudo[104504]: pam_unix(sudo:session): session closed for user root Nov 04 10:30:24 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-a9456cff-7d19-424a-bcc7-0916e09c290e tempest-CreateVolumesFromImageTest-1351866360 None] Lock "cinder-36ad933e-f173-4bd4-b277-9e543999a979-delete_volume" released by "delete_volume" :: held 1.879s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:30:24 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c8b1a2a4-2458-4ed4-b3e5-7573655bcacd tempest-CreateVolumesFromSnapshotTest-517992082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-04d9e646-36e0-4f6e-a9b4-0e7cb5e2b991 1073741824" returned: 0 in 0.711s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:30:24 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-b44d9bec-0499-4289-b670-17d3a2389fc8 tempest-CreateVolumesFromSnapshotTest-517992082 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:30:24 devstack sudo[104513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-526b760f-2c05-4f80-8669-ea33a69d0a05 Nov 04 10:30:24 devstack sudo[104513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:30:24 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-b44d9bec-0499-4289-b670-17d3a2389fc8 tempest-CreateVolumesFromSnapshotTest-517992082 None] Flow 'volume_create_manager' (7f80439d-bf4c-4296-ba2d-a984cc6d213c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:30:24 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-b44d9bec-0499-4289-b670-17d3a2389fc8 tempest-CreateVolumesFromSnapshotTest-517992082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd64b900-29ee-4687-bbc8-a270125b2b70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:30:24 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c8b1a2a4-2458-4ed4-b3e5-7573655bcacd tempest-CreateVolumesFromSnapshotTest-517992082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-04d9e646-36e0-4f6e-a9b4-0e7cb5e2b991 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:30:24 devstack sudo[104509]: pam_unix(sudo:session): session closed for user root Nov 04 10:30:24 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-7cacd9c4-7c03-4c96-851d-a6c0c8908d60 tempest-CinderUnicodeTest-1040606135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:30:24 devstack sudo[104517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-04d9e646-36e0-4f6e-a9b4-0e7cb5e2b991 Nov 04 10:30:24 devstack sudo[104517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:30:24 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7942a01c-3636-47a8-9a04-1b33535333d7 tempest-VolumeAndVolumeTypeFromImageTest-1875562462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_297e3214-fd85-4792-9370-3b6e49ceb78a_iifiy2jr" returned: 0 in 0.580s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:30:24 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7942a01c-3636-47a8-9a04-1b33535333d7 tempest-VolumeAndVolumeTypeFromImageTest-1875562462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_297e3214-fd85-4792-9370-3b6e49ceb78a_iifiy2jr {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:30:24 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-b44d9bec-0499-4289-b670-17d3a2389fc8 tempest-CreateVolumesFromSnapshotTest-517992082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd64b900-29ee-4687-bbc8-a270125b2b70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:30:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-715923467',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f531445-c0ad-452d-a0aa-5bcd5ed7ebad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5941a1c11d24eceb16585ffd817bf0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:30:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:30:24Z,use_quota=True,user_id='4d75921ff5fb466e8d542434b8a4125b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:30:24 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-b44d9bec-0499-4289-b670-17d3a2389fc8 tempest-CreateVolumesFromSnapshotTest-517992082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fd31a5c-f159-4981-b097-9acceef96c07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:30:24 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-b44d9bec-0499-4289-b670-17d3a2389fc8 tempest-CreateVolumesFromSnapshotTest-517992082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fd31a5c-f159-4981-b097-9acceef96c07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:30:24 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-b44d9bec-0499-4289-b670-17d3a2389fc8 tempest-CreateVolumesFromSnapshotTest-517992082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04cc8efc-20be-48fc-a941-5f22c8015a14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:30:24 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-b44d9bec-0499-4289-b670-17d3a2389fc8 tempest-CreateVolumesFromSnapshotTest-517992082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04cc8efc-20be-48fc-a941-5f22c8015a14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f531445-c0ad-452d-a0aa-5bcd5ed7ebad', 'volume_name': 'volume-9f531445-c0ad-452d-a0aa-5bcd5ed7ebad', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:30:24 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-b44d9bec-0499-4289-b670-17d3a2389fc8 tempest-CreateVolumesFromSnapshotTest-517992082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9ea56dd-5753-42ab-9051-fa591fb03d62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:30:24 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-b44d9bec-0499-4289-b670-17d3a2389fc8 tempest-CreateVolumesFromSnapshotTest-517992082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9ea56dd-5753-42ab-9051-fa591fb03d62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:30:24 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-b44d9bec-0499-4289-b670-17d3a2389fc8 tempest-CreateVolumesFromSnapshotTest-517992082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c72787d4-eb9e-42f1-ace0-9e3e6fa0e0e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:30:24 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-b44d9bec-0499-4289-b670-17d3a2389fc8 tempest-CreateVolumesFromSnapshotTest-517992082 None] Volume 9f531445-c0ad-452d-a0aa-5bcd5ed7ebad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f531445-c0ad-452d-a0aa-5bcd5ed7ebad', 'volume_size': 1} Nov 04 10:30:24 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-b44d9bec-0499-4289-b670-17d3a2389fc8 tempest-CreateVolumesFromSnapshotTest-517992082 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:30:24 devstack sudo[104519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_297e3214-fd85-4792-9370-3b6e49ceb78a_iifiy2jr Nov 04 10:30:24 devstack sudo[104519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:30:24 devstack sudo[104517]: pam_unix(sudo:session): session closed for user root Nov 04 10:30:24 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c8b1a2a4-2458-4ed4-b3e5-7573655bcacd tempest-CreateVolumesFromSnapshotTest-517992082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-04d9e646-36e0-4f6e-a9b4-0e7cb5e2b991" returned: 0 in 0.298s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:30:24 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-c8b1a2a4-2458-4ed4-b3e5-7573655bcacd tempest-CreateVolumesFromSnapshotTest-517992082 None] <== create_volume: return (1175ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 10:30:24 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-c8b1a2a4-2458-4ed4-b3e5-7573655bcacd tempest-CreateVolumesFromSnapshotTest-517992082 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.180s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:30:24 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-5caf126e-0e76-452e-b100-cc9e24cbe279 tempest-CreateVolumesFromSnapshotTest-517992082 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.656s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:30:24 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-5caf126e-0e76-452e-b100-cc9e24cbe279 tempest-CreateVolumesFromSnapshotTest-517992082 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:30:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1783506766',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55acf56f-bf3f-4e60-af9f-8256135e33b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5941a1c11d24eceb16585ffd817bf0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:30:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:30:24Z,use_quota=True,user_id='4d75921ff5fb466e8d542434b8a4125b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 10:30:24 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-5caf126e-0e76-452e-b100-cc9e24cbe279 tempest-CreateVolumesFromSnapshotTest-517992082 None] Creating volume 55acf56f-bf3f-4e60-af9f-8256135e33b0 {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:30:24 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-5caf126e-0e76-452e-b100-cc9e24cbe279 tempest-CreateVolumesFromSnapshotTest-517992082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:30:24 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-5caf126e-0e76-452e-b100-cc9e24cbe279 tempest-CreateVolumesFromSnapshotTest-517992082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:30:24 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-5caf126e-0e76-452e-b100-cc9e24cbe279 tempest-CreateVolumesFromSnapshotTest-517992082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:30:24 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-5caf126e-0e76-452e-b100-cc9e24cbe279 tempest-CreateVolumesFromSnapshotTest-517992082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:30:24 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-5caf126e-0e76-452e-b100-cc9e24cbe279 tempest-CreateVolumesFromSnapshotTest-517992082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:30:24 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-5caf126e-0e76-452e-b100-cc9e24cbe279 tempest-CreateVolumesFromSnapshotTest-517992082 None] Selected osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:30:24 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-5caf126e-0e76-452e-b100-cc9e24cbe279 tempest-CreateVolumesFromSnapshotTest-517992082 None] casted to osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 Nov 04 10:30:24 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-5caf126e-0e76-452e-b100-cc9e24cbe279 tempest-CreateVolumesFromSnapshotTest-517992082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-55acf56f-bf3f-4e60-af9f-8256135e33b0 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:30:24 devstack sudo[104524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-55acf56f-bf3f-4e60-af9f-8256135e33b0 1073741824 Nov 04 10:30:24 devstack sudo[104524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:30:24 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c8b1a2a4-2458-4ed4-b3e5-7573655bcacd tempest-CreateVolumesFromSnapshotTest-517992082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81a154fa-bb65-4e69-aa43-e181a4f54e9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04d9e646-36e0-4f6e-a9b4-0e7cb5e2b991', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:30:24 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c8b1a2a4-2458-4ed4-b3e5-7573655bcacd tempest-CreateVolumesFromSnapshotTest-517992082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa80af65-e61a-4d27-bda4-c9c80de317c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:30:24 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc7e4b29-e584-41a0-b29e-b87a0cf36dc3 tempest-CreateVolumesFromSnapshotTest-517992082 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:30:25 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-fc7e4b29-e584-41a0-b29e-b87a0cf36dc3 tempest-CreateVolumesFromSnapshotTest-517992082 None] Flow 'volume_create_manager' (6926c85f-cdd2-4415-a0dc-a20df3bc6559) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:30:25 devstack sudo[104513]: pam_unix(sudo:session): session closed for user root Nov 04 10:30:25 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-fc7e4b29-e584-41a0-b29e-b87a0cf36dc3 tempest-CreateVolumesFromSnapshotTest-517992082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (819b0e4f-aab7-4fb4-89df-bdf4f87c3e1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:30:25 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-c8b1a2a4-2458-4ed4-b3e5-7573655bcacd tempest-CreateVolumesFromSnapshotTest-517992082 None] Volume volume-04d9e646-36e0-4f6e-a9b4-0e7cb5e2b991 (04d9e646-36e0-4f6e-a9b4-0e7cb5e2b991): created successfully Nov 04 10:30:25 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c8b1a2a4-2458-4ed4-b3e5-7573655bcacd tempest-CreateVolumesFromSnapshotTest-517992082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa80af65-e61a-4d27-bda4-c9c80de317c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:30:25 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c8b1a2a4-2458-4ed4-b3e5-7573655bcacd tempest-CreateVolumesFromSnapshotTest-517992082 None] Flow 'volume_create_manager' (77ae1699-83a6-451e-a59e-609745656872) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:30:25 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-b0d21721-b074-414a-b5d8-699808da0143 tempest-CreateVolumesFromImageTest-1351866360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-526b760f-2c05-4f80-8669-ea33a69d0a05" returned: 0 in 0.761s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:30:25 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-b0d21721-b074-414a-b5d8-699808da0143 tempest-CreateVolumesFromImageTest-1351866360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-526b760f-2c05-4f80-8669-ea33a69d0a05 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:30:25 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-fc7e4b29-e584-41a0-b29e-b87a0cf36dc3 tempest-CreateVolumesFromSnapshotTest-517992082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (819b0e4f-aab7-4fb4-89df-bdf4f87c3e1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:30:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-157005514',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc8662b0-81d6-44fc-9e8c-65201c7e5324,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5941a1c11d24eceb16585ffd817bf0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:30:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:30:25Z,use_quota=True,user_id='4d75921ff5fb466e8d542434b8a4125b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:30:25 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-fc7e4b29-e584-41a0-b29e-b87a0cf36dc3 tempest-CreateVolumesFromSnapshotTest-517992082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c453506a-cd24-4347-a1b9-33959864c7e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:30:25 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-fc7e4b29-e584-41a0-b29e-b87a0cf36dc3 tempest-CreateVolumesFromSnapshotTest-517992082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c453506a-cd24-4347-a1b9-33959864c7e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:30:25 devstack sudo[104528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-526b760f-2c05-4f80-8669-ea33a69d0a05 Nov 04 10:30:25 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-fc7e4b29-e584-41a0-b29e-b87a0cf36dc3 tempest-CreateVolumesFromSnapshotTest-517992082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2240f023-fcc0-4baa-9f68-a8cdff280665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:30:25 devstack sudo[104528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:30:25 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-fc7e4b29-e584-41a0-b29e-b87a0cf36dc3 tempest-CreateVolumesFromSnapshotTest-517992082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2240f023-fcc0-4baa-9f68-a8cdff280665) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc8662b0-81d6-44fc-9e8c-65201c7e5324', 'volume_name': 'volume-bc8662b0-81d6-44fc-9e8c-65201c7e5324', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:30:25 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-fc7e4b29-e584-41a0-b29e-b87a0cf36dc3 tempest-CreateVolumesFromSnapshotTest-517992082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b6c313f-f6b3-437a-844e-ad855cff8653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:30:25 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-fc7e4b29-e584-41a0-b29e-b87a0cf36dc3 tempest-CreateVolumesFromSnapshotTest-517992082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b6c313f-f6b3-437a-844e-ad855cff8653) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:30:25 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-fc7e4b29-e584-41a0-b29e-b87a0cf36dc3 tempest-CreateVolumesFromSnapshotTest-517992082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1957fc4d-f11e-4c01-9ca6-9c5736126ec6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:30:25 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-fc7e4b29-e584-41a0-b29e-b87a0cf36dc3 tempest-CreateVolumesFromSnapshotTest-517992082 None] Volume bc8662b0-81d6-44fc-9e8c-65201c7e5324: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc8662b0-81d6-44fc-9e8c-65201c7e5324', 'volume_size': 1} Nov 04 10:30:25 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-fc7e4b29-e584-41a0-b29e-b87a0cf36dc3 tempest-CreateVolumesFromSnapshotTest-517992082 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:30:25 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-c8b1a2a4-2458-4ed4-b3e5-7573655bcacd tempest-CreateVolumesFromSnapshotTest-517992082 None] Created volume successfully. Nov 04 10:30:25 devstack sudo[104519]: pam_unix(sudo:session): session closed for user root Nov 04 10:30:25 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7942a01c-3636-47a8-9a04-1b33535333d7 tempest-VolumeAndVolumeTypeFromImageTest-1875562462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_297e3214-fd85-4792-9370-3b6e49ceb78a_iifiy2jr" returned: 1 in 0.631s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:30:25 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7942a01c-3636-47a8-9a04-1b33535333d7 tempest-VolumeAndVolumeTypeFromImageTest-1875562462 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_297e3214-fd85-4792-9370-3b6e49ceb78a_iifiy2jr' failed. Not Retrying. {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 04 10:30:25 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a9ffdb3-c70f-41b8-896d-774d1ef13e11]: (4, 'raw') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:30:25 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7942a01c-3636-47a8-9a04-1b33535333d7 tempest-VolumeAndVolumeTypeFromImageTest-1875562462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_297e3214-fd85-4792-9370-3b6e49ceb78a_zv6gtawjdevstack@QuobyteHD {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:30:25 devstack sudo[104535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_297e3214-fd85-4792-9370-3b6e49ceb78a_zv6gtawjdevstack@QuobyteHD Nov 04 10:30:25 devstack sudo[104535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:30:25 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-1139dd86-e47e-4f15-ad59-f2bb1f183983 tempest-CreateVolumesFromSnapshotTest-517992082 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:30:25 devstack sudo[104528]: pam_unix(sudo:session): session closed for user root Nov 04 10:30:25 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1139dd86-e47e-4f15-ad59-f2bb1f183983 tempest-CreateVolumesFromSnapshotTest-517992082 None] Flow 'volume_create_manager' (1469370e-a200-4d0c-9c8a-1e5578f1bcd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:30:25 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1139dd86-e47e-4f15-ad59-f2bb1f183983 tempest-CreateVolumesFromSnapshotTest-517992082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f568857-7ad1-4fbe-b61d-567e4a96f0fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:30:25 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-b0d21721-b074-414a-b5d8-699808da0143 tempest-CreateVolumesFromImageTest-1351866360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-526b760f-2c05-4f80-8669-ea33a69d0a05" returned: 0 in 0.373s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:30:25 devstack sudo[104524]: pam_unix(sudo:session): session closed for user root Nov 04 10:30:25 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-5caf126e-0e76-452e-b100-cc9e24cbe279 tempest-CreateVolumesFromSnapshotTest-517992082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-55acf56f-bf3f-4e60-af9f-8256135e33b0 1073741824" returned: 0 in 0.611s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:30:25 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-b0d21721-b074-414a-b5d8-699808da0143 tempest-CreateVolumesFromImageTest-1351866360 None] Lock "cinder-quobyte-526b760f-2c05-4f80-8669-ea33a69d0a05" released by "delete_volume" :: held 1.211s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:30:25 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1139dd86-e47e-4f15-ad59-f2bb1f183983 tempest-CreateVolumesFromSnapshotTest-517992082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f568857-7ad1-4fbe-b61d-567e4a96f0fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:30:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1439799632',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cf24df4-4fdc-4de0-9dad-07944ff49549,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5941a1c11d24eceb16585ffd817bf0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:30:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:30:25Z,use_quota=True,user_id='4d75921ff5fb466e8d542434b8a4125b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:30:25 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1139dd86-e47e-4f15-ad59-f2bb1f183983 tempest-CreateVolumesFromSnapshotTest-517992082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5c06cb7-e52d-49fc-af59-766f11f59150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:30:25 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1139dd86-e47e-4f15-ad59-f2bb1f183983 tempest-CreateVolumesFromSnapshotTest-517992082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5c06cb7-e52d-49fc-af59-766f11f59150) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:30:25 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1139dd86-e47e-4f15-ad59-f2bb1f183983 tempest-CreateVolumesFromSnapshotTest-517992082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95c88088-86f7-474b-9d0b-be3a3834928f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:30:25 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1139dd86-e47e-4f15-ad59-f2bb1f183983 tempest-CreateVolumesFromSnapshotTest-517992082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95c88088-86f7-474b-9d0b-be3a3834928f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0cf24df4-4fdc-4de0-9dad-07944ff49549', 'volume_name': 'volume-0cf24df4-4fdc-4de0-9dad-07944ff49549', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:30:25 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1139dd86-e47e-4f15-ad59-f2bb1f183983 tempest-CreateVolumesFromSnapshotTest-517992082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d7a871b-a46f-4854-b276-7e074c040991) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:30:25 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1139dd86-e47e-4f15-ad59-f2bb1f183983 tempest-CreateVolumesFromSnapshotTest-517992082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d7a871b-a46f-4854-b276-7e074c040991) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:30:25 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1139dd86-e47e-4f15-ad59-f2bb1f183983 tempest-CreateVolumesFromSnapshotTest-517992082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b82571d2-f984-4d7e-a619-3afe42046686) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:30:25 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-1139dd86-e47e-4f15-ad59-f2bb1f183983 tempest-CreateVolumesFromSnapshotTest-517992082 None] Volume 0cf24df4-4fdc-4de0-9dad-07944ff49549: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0cf24df4-4fdc-4de0-9dad-07944ff49549', 'volume_size': 1} Nov 04 10:30:25 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-1139dd86-e47e-4f15-ad59-f2bb1f183983 tempest-CreateVolumesFromSnapshotTest-517992082 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:30:25 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-5caf126e-0e76-452e-b100-cc9e24cbe279 tempest-CreateVolumesFromSnapshotTest-517992082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-55acf56f-bf3f-4e60-af9f-8256135e33b0 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:30:25 devstack sudo[104539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-55acf56f-bf3f-4e60-af9f-8256135e33b0 Nov 04 10:30:25 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-b0d21721-b074-414a-b5d8-699808da0143 tempest-CreateVolumesFromImageTest-1351866360 None] Created reservations ['24426f40-3485-4af1-9aa8-d7bd1948ba26', '8fd2e31a-27ac-4064-a01c-e1554813b448', '5a37e6ee-bc62-4de4-b4e6-e36ecee397b3', 'd0960de1-323f-4c84-8feb-792759ae8cfd'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:30:25 devstack sudo[104539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:30:25 devstack sudo[104535]: pam_unix(sudo:session): session closed for user root Nov 04 10:30:25 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7942a01c-3636-47a8-9a04-1b33535333d7 tempest-VolumeAndVolumeTypeFromImageTest-1875562462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_297e3214-fd85-4792-9370-3b6e49ceb78a_zv6gtawjdevstack@QuobyteHD" returned: 0 in 0.376s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:30:25 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7942a01c-3636-47a8-9a04-1b33535333d7 tempest-VolumeAndVolumeTypeFromImageTest-1875562462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_297e3214-fd85-4792-9370-3b6e49ceb78a_zv6gtawjdevstack@QuobyteHD {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:30:25 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-b0d21721-b074-414a-b5d8-699808da0143 tempest-CreateVolumesFromImageTest-1351866360 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:30:25 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-b0d21721-b074-414a-b5d8-699808da0143 tempest-CreateVolumesFromImageTest-1351866360 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:30:25 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-b0d21721-b074-414a-b5d8-699808da0143 tempest-CreateVolumesFromImageTest-1351866360 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:30:25 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-b0d21721-b074-414a-b5d8-699808da0143 tempest-CreateVolumesFromImageTest-1351866360 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:30:25 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-b0d21721-b074-414a-b5d8-699808da0143 tempest-CreateVolumesFromImageTest-1351866360 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:30:25 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-b0d21721-b074-414a-b5d8-699808da0143 tempest-CreateVolumesFromImageTest-1351866360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:30:25 devstack sudo[104544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:30:25 devstack sudo[104544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:30:25 devstack sudo[104543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_297e3214-fd85-4792-9370-3b6e49ceb78a_zv6gtawjdevstack@QuobyteHD Nov 04 10:30:25 devstack sudo[104543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:30:25 devstack sudo[104539]: pam_unix(sudo:session): session closed for user root Nov 04 10:30:25 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-5caf126e-0e76-452e-b100-cc9e24cbe279 tempest-CreateVolumesFromSnapshotTest-517992082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-55acf56f-bf3f-4e60-af9f-8256135e33b0" returned: 0 in 0.267s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:30:25 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-5caf126e-0e76-452e-b100-cc9e24cbe279 tempest-CreateVolumesFromSnapshotTest-517992082 None] <== create_volume: return (973ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 10:30:25 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-5caf126e-0e76-452e-b100-cc9e24cbe279 tempest-CreateVolumesFromSnapshotTest-517992082 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.975s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:30:25 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-7cacd9c4-7c03-4c96-851d-a6c0c8908d60 tempest-CinderUnicodeTest-1040606135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.249s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:30:25 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-5caf126e-0e76-452e-b100-cc9e24cbe279 tempest-CreateVolumesFromSnapshotTest-517992082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5a9890f-a7bc-40c0-bd70-a7303e236117) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55acf56f-bf3f-4e60-af9f-8256135e33b0', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:30:25 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-5caf126e-0e76-452e-b100-cc9e24cbe279 tempest-CreateVolumesFromSnapshotTest-517992082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44838c38-7313-469e-a2bb-f998ee227475) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:30:25 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-7cacd9c4-7c03-4c96-851d-a6c0c8908d60 tempest-CinderUnicodeTest-1040606135 None] Creating offline snapshot 9fb046a6-9927-4bad-8a0c-d8bb4fad8940 of volume 409b0aa5-7e47-4141-9795-0fe590993207 {{(pid=87068) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 10:30:25 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-5caf126e-0e76-452e-b100-cc9e24cbe279 tempest-CreateVolumesFromSnapshotTest-517992082 None] Volume volume-55acf56f-bf3f-4e60-af9f-8256135e33b0 (55acf56f-bf3f-4e60-af9f-8256135e33b0): created successfully Nov 04 10:30:25 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-5caf126e-0e76-452e-b100-cc9e24cbe279 tempest-CreateVolumesFromSnapshotTest-517992082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44838c38-7313-469e-a2bb-f998ee227475) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:30:25 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-5caf126e-0e76-452e-b100-cc9e24cbe279 tempest-CreateVolumesFromSnapshotTest-517992082 None] Flow 'volume_create_manager' (88aa9b57-273d-4cc2-95f4-03c48750720a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:30:25 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[92051a94-eae6-44a5-84a1-57901c9c5af7]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:30:25 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7cacd9c4-7c03-4c96-851d-a6c0c8908d60 tempest-CinderUnicodeTest-1040606135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-409b0aa5-7e47-4141-9795-0fe590993207 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:30:25 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-5caf126e-0e76-452e-b100-cc9e24cbe279 tempest-CreateVolumesFromSnapshotTest-517992082 None] Created volume successfully. Nov 04 10:30:25 devstack sudo[104544]: pam_unix(sudo:session): session closed for user root Nov 04 10:30:25 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-b0d21721-b074-414a-b5d8-699808da0143 tempest-CreateVolumesFromImageTest-1351866360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.263s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:30:25 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-b0d21721-b074-414a-b5d8-699808da0143 tempest-CreateVolumesFromImageTest-1351866360 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:30:25 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-b0d21721-b074-414a-b5d8-699808da0143 tempest-CreateVolumesFromImageTest-1351866360 None] Deleted volume successfully. Nov 04 10:30:26 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-b0d21721-b074-414a-b5d8-699808da0143 tempest-CreateVolumesFromImageTest-1351866360 None] Lock "cinder-526b760f-2c05-4f80-8669-ea33a69d0a05-delete_volume" released by "delete_volume" :: held 1.950s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:30:26 devstack sudo[104543]: pam_unix(sudo:session): session closed for user root Nov 04 10:30:26 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7942a01c-3636-47a8-9a04-1b33535333d7 tempest-VolumeAndVolumeTypeFromImageTest-1875562462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_297e3214-fd85-4792-9370-3b6e49ceb78a_zv6gtawjdevstack@QuobyteHD" returned: 1 in 0.374s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:30:26 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7942a01c-3636-47a8-9a04-1b33535333d7 tempest-VolumeAndVolumeTypeFromImageTest-1875562462 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_297e3214-fd85-4792-9370-3b6e49ceb78a_zv6gtawjdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 04 10:30:26 devstack cinder-volume[87068]: DEBUG cinder.image.image_utils [None req-7942a01c-3636-47a8-9a04-1b33535333d7 tempest-VolumeAndVolumeTypeFromImageTest-1875562462 None] 297e3214-fd85-4792-9370-3b6e49ceb78a was raw, converting to qcow2 {{(pid=87068) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 04 10:30:26 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7942a01c-3636-47a8-9a04-1b33535333d7 tempest-VolumeAndVolumeTypeFromImageTest-1875562462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_297e3214-fd85-4792-9370-3b6e49ceb78a_zv6gtawjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-bbd55b2a-d0a1-4726-ae3a-e7163764b17d {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:30:26 devstack sudo[104550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-409b0aa5-7e47-4141-9795-0fe590993207 Nov 04 10:30:26 devstack sudo[104550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:30:26 devstack sudo[104554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_297e3214-fd85-4792-9370-3b6e49ceb78a_zv6gtawjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-bbd55b2a-d0a1-4726-ae3a-e7163764b17d Nov 04 10:30:26 devstack sudo[104554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:30:26 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-6e141c7a-29b9-43fb-b75c-54ab1c1b9429 tempest-CreateVolumesFromImageTest-1351866360 None] Acquiring lock "cinder-6e7f6275-2d94-48bc-a780-a2773cbe3a2c-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:30:26 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-6e141c7a-29b9-43fb-b75c-54ab1c1b9429 tempest-CreateVolumesFromImageTest-1351866360 None] Lock "cinder-6e7f6275-2d94-48bc-a780-a2773cbe3a2c-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:30:26 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-6e141c7a-29b9-43fb-b75c-54ab1c1b9429 tempest-CreateVolumesFromImageTest-1351866360 None] Acquiring lock "cinder-quobyte-6e7f6275-2d94-48bc-a780-a2773cbe3a2c" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:30:26 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-6e141c7a-29b9-43fb-b75c-54ab1c1b9429 tempest-CreateVolumesFromImageTest-1351866360 None] Lock "cinder-quobyte-6e7f6275-2d94-48bc-a780-a2773cbe3a2c" acquired by "delete_volume" :: waited 0.021s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:30:26 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[b39eaa09-841b-40ef-97cf-207bb0e0b3a8]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:30:26 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6e141c7a-29b9-43fb-b75c-54ab1c1b9429 tempest-CreateVolumesFromImageTest-1351866360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6e7f6275-2d94-48bc-a780-a2773cbe3a2c {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:30:26 devstack sudo[104550]: pam_unix(sudo:session): session closed for user root Nov 04 10:30:26 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7cacd9c4-7c03-4c96-851d-a6c0c8908d60 tempest-CinderUnicodeTest-1040606135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-409b0aa5-7e47-4141-9795-0fe590993207" returned: 0 in 0.437s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:30:26 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7cacd9c4-7c03-4c96-851d-a6c0c8908d60 tempest-CinderUnicodeTest-1040606135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-409b0aa5-7e47-4141-9795-0fe590993207,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-409b0aa5-7e47-4141-9795-0fe590993207.9fb046a6-9927-4bad-8a0c-d8bb4fad8940 1G {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:30:26 devstack sudo[104564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-409b0aa5-7e47-4141-9795-0fe590993207,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-409b0aa5-7e47-4141-9795-0fe590993207.9fb046a6-9927-4bad-8a0c-d8bb4fad8940 1G Nov 04 10:30:26 devstack sudo[104564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:30:26 devstack sudo[104563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6e7f6275-2d94-48bc-a780-a2773cbe3a2c Nov 04 10:30:26 devstack sudo[104563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:30:26 devstack sudo[104554]: pam_unix(sudo:session): session closed for user root Nov 04 10:30:26 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7942a01c-3636-47a8-9a04-1b33535333d7 tempest-VolumeAndVolumeTypeFromImageTest-1875562462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_297e3214-fd85-4792-9370-3b6e49ceb78a_zv6gtawjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-bbd55b2a-d0a1-4726-ae3a-e7163764b17d" returned: 0 in 0.573s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:30:26 devstack cinder-volume[87068]: DEBUG cinder.image.image_utils [None req-7942a01c-3636-47a8-9a04-1b33535333d7 tempest-VolumeAndVolumeTypeFromImageTest-1875562462 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_297e3214-fd85-4792-9370-3b6e49ceb78a_zv6gtawjdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-bbd55b2a-d0a1-4726-ae3a-e7163764b17d {{(pid=87068) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 04 10:30:26 devstack cinder-volume[87068]: INFO cinder.image.image_utils [None req-7942a01c-3636-47a8-9a04-1b33535333d7 tempest-VolumeAndVolumeTypeFromImageTest-1875562462 None] Converted 0.00 MB image at 0.00 MB/s Nov 04 10:30:26 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7942a01c-3636-47a8-9a04-1b33535333d7 tempest-VolumeAndVolumeTypeFromImageTest-1875562462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-bbd55b2a-d0a1-4726-ae3a-e7163764b17d 1G {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:30:26 devstack sudo[104567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-bbd55b2a-d0a1-4726-ae3a-e7163764b17d 1G Nov 04 10:30:26 devstack sudo[104567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:30:26 devstack sudo[104563]: pam_unix(sudo:session): session closed for user root Nov 04 10:30:26 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6e141c7a-29b9-43fb-b75c-54ab1c1b9429 tempest-CreateVolumesFromImageTest-1351866360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6e7f6275-2d94-48bc-a780-a2773cbe3a2c" returned: 0 in 0.418s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:30:26 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6e141c7a-29b9-43fb-b75c-54ab1c1b9429 tempest-CreateVolumesFromImageTest-1351866360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6e7f6275-2d94-48bc-a780-a2773cbe3a2c {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:30:26 devstack sudo[104575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6e7f6275-2d94-48bc-a780-a2773cbe3a2c Nov 04 10:30:26 devstack sudo[104575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:30:26 devstack sudo[104564]: pam_unix(sudo:session): session closed for user root Nov 04 10:30:26 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7cacd9c4-7c03-4c96-851d-a6c0c8908d60 tempest-CinderUnicodeTest-1040606135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-409b0aa5-7e47-4141-9795-0fe590993207,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-409b0aa5-7e47-4141-9795-0fe590993207.9fb046a6-9927-4bad-8a0c-d8bb4fad8940 1G" returned: 0 in 0.489s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:30:26 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7cacd9c4-7c03-4c96-851d-a6c0c8908d60 tempest-CinderUnicodeTest-1040606135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-409b0aa5-7e47-4141-9795-0fe590993207 -F qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-409b0aa5-7e47-4141-9795-0fe590993207.9fb046a6-9927-4bad-8a0c-d8bb4fad8940 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:30:26 devstack sudo[104579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-409b0aa5-7e47-4141-9795-0fe590993207 -F qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-409b0aa5-7e47-4141-9795-0fe590993207.9fb046a6-9927-4bad-8a0c-d8bb4fad8940 Nov 04 10:30:26 devstack sudo[104579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:30:26 devstack sudo[104567]: pam_unix(sudo:session): session closed for user root Nov 04 10:30:26 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7942a01c-3636-47a8-9a04-1b33535333d7 tempest-VolumeAndVolumeTypeFromImageTest-1875562462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-bbd55b2a-d0a1-4726-ae3a-e7163764b17d 1G" returned: 0 in 0.371s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:30:26 devstack cinder-volume[87068]: DEBUG cinder.volume.volume_utils [None req-7942a01c-3636-47a8-9a04-1b33535333d7 tempest-VolumeAndVolumeTypeFromImageTest-1875562462 None] Downloaded image 297e3214-fd85-4792-9370-3b6e49ceb78a ((None, [{'url': 'file:///opt/stack/data/glance/images/297e3214-fd85-4792-9370-3b6e49ceb78a', 'metadata': {}}])) to volume bbd55b2a-d0a1-4726-ae3a-e7163764b17d successfully. {{(pid=87068) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 04 10:30:26 devstack cinder-volume[87068]: DEBUG cinder.image.image_utils [None req-7942a01c-3636-47a8-9a04-1b33535333d7 tempest-VolumeAndVolumeTypeFromImageTest-1875562462 None] Temporary image 297e3214-fd85-4792-9370-3b6e49ceb78a for user c82f3efa970c4650a8b7bd1743cad070 is deleted. {{(pid=87068) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 04 10:30:26 devstack cinder-volume[87068]: DEBUG cinder.volume.volume_utils [None req-7942a01c-3636-47a8-9a04-1b33535333d7 tempest-VolumeAndVolumeTypeFromImageTest-1875562462 None] Marking volume bbd55b2a-d0a1-4726-ae3a-e7163764b17d as bootable. {{(pid=87068) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 04 10:30:27 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-7942a01c-3636-47a8-9a04-1b33535333d7 tempest-VolumeAndVolumeTypeFromImageTest-1875562462 None] Copying metadata from image 297e3214-fd85-4792-9370-3b6e49ceb78a to bbd55b2a-d0a1-4726-ae3a-e7163764b17d. {{(pid=87068) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 04 10:30:27 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-7942a01c-3636-47a8-9a04-1b33535333d7 tempest-VolumeAndVolumeTypeFromImageTest-1875562462 None] Creating volume glance metadata for volume bbd55b2a-d0a1-4726-ae3a-e7163764b17d backed by image 297e3214-fd85-4792-9370-3b6e49ceb78a with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '297e3214-fd85-4792-9370-3b6e49ceb78a', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'e615c1d8df7e79decaf8ec53d19cf45f', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87068) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 04 10:30:27 devstack sudo[104575]: pam_unix(sudo:session): session closed for user root Nov 04 10:30:27 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6e141c7a-29b9-43fb-b75c-54ab1c1b9429 tempest-CreateVolumesFromImageTest-1351866360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6e7f6275-2d94-48bc-a780-a2773cbe3a2c" returned: 0 in 0.293s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:30:27 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-6e141c7a-29b9-43fb-b75c-54ab1c1b9429 tempest-CreateVolumesFromImageTest-1351866360 None] Lock "cinder-quobyte-6e7f6275-2d94-48bc-a780-a2773cbe3a2c" released by "delete_volume" :: held 0.764s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:30:27 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7942a01c-3636-47a8-9a04-1b33535333d7 tempest-VolumeAndVolumeTypeFromImageTest-1875562462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f20ea9df-84f6-4bf7-8261-3f3e55a2c748) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bbd55b2a-d0a1-4726-ae3a-e7163764b17d', 'volume_size': 1, 'image_id': '297e3214-fd85-4792-9370-3b6e49ceb78a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/297e3214-fd85-4792-9370-3b6e49ceb78a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e615c1d8df7e79decaf8ec53d19cf45f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '6b62e885cb344834b13fddb74340c843', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '14dd830cb87a8cebdaeb3e91c12d8d2db5f57b16c2c56b9664e874543ce7ddf33fd87e4bd6afb93323e2033c0005148de6464c36dba02f6117d9ff4e66960800', 'id': '297e3214-fd85-4792-9370-3b6e49ceb78a', 'created_at': datetime.datetime(2026, 11, 4, 9, 30, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 9, 30, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/297e3214-fd85-4792-9370-3b6e49ceb78a/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:30:27 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7942a01c-3636-47a8-9a04-1b33535333d7 tempest-VolumeAndVolumeTypeFromImageTest-1875562462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f86b5b55-5a55-49c5-8d12-45d8a37f3248) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:30:27 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-7942a01c-3636-47a8-9a04-1b33535333d7 tempest-VolumeAndVolumeTypeFromImageTest-1875562462 None] Volume volume-bbd55b2a-d0a1-4726-ae3a-e7163764b17d (bbd55b2a-d0a1-4726-ae3a-e7163764b17d): created successfully Nov 04 10:30:27 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7942a01c-3636-47a8-9a04-1b33535333d7 tempest-VolumeAndVolumeTypeFromImageTest-1875562462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f86b5b55-5a55-49c5-8d12-45d8a37f3248) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:30:27 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7942a01c-3636-47a8-9a04-1b33535333d7 tempest-VolumeAndVolumeTypeFromImageTest-1875562462 None] Flow 'volume_create_manager' (ac3cbc53-80b1-4f58-8edd-dfc5bde17d27) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:30:27 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-7942a01c-3636-47a8-9a04-1b33535333d7 tempest-VolumeAndVolumeTypeFromImageTest-1875562462 None] Created volume successfully. Nov 04 10:30:27 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-6e141c7a-29b9-43fb-b75c-54ab1c1b9429 tempest-CreateVolumesFromImageTest-1351866360 None] Created reservations ['d946a18d-e632-4515-ac6d-0330c404d652', '5129f234-b1e8-4788-89f5-401cd8b95baa', 'c0245a6c-a0d0-4809-ac79-26bd5577813f', '8f6b5680-3d86-42bf-bef6-aa110da1aec6'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:30:27 devstack sudo[104579]: pam_unix(sudo:session): session closed for user root Nov 04 10:30:27 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7cacd9c4-7c03-4c96-851d-a6c0c8908d60 tempest-CinderUnicodeTest-1040606135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-409b0aa5-7e47-4141-9795-0fe590993207 -F qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-409b0aa5-7e47-4141-9795-0fe590993207.9fb046a6-9927-4bad-8a0c-d8bb4fad8940" returned: 0 in 0.321s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:30:27 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-7cacd9c4-7c03-4c96-851d-a6c0c8908d60 tempest-CinderUnicodeTest-1040606135 None] /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-409b0aa5-7e47-4141-9795-0fe590993207.9fb046a6-9927-4bad-8a0c-d8bb4fad8940 is being set with open permissions: ugo+rw Nov 04 10:30:27 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7cacd9c4-7c03-4c96-851d-a6c0c8908d60 tempest-CinderUnicodeTest-1040606135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-409b0aa5-7e47-4141-9795-0fe590993207.9fb046a6-9927-4bad-8a0c-d8bb4fad8940 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:30:27 devstack sudo[104586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-409b0aa5-7e47-4141-9795-0fe590993207.9fb046a6-9927-4bad-8a0c-d8bb4fad8940 Nov 04 10:30:27 devstack sudo[104586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:30:27 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-6e141c7a-29b9-43fb-b75c-54ab1c1b9429 tempest-CreateVolumesFromImageTest-1351866360 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:30:27 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-6e141c7a-29b9-43fb-b75c-54ab1c1b9429 tempest-CreateVolumesFromImageTest-1351866360 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:30:27 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-6e141c7a-29b9-43fb-b75c-54ab1c1b9429 tempest-CreateVolumesFromImageTest-1351866360 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:30:27 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-6e141c7a-29b9-43fb-b75c-54ab1c1b9429 tempest-CreateVolumesFromImageTest-1351866360 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:30:27 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-6e141c7a-29b9-43fb-b75c-54ab1c1b9429 tempest-CreateVolumesFromImageTest-1351866360 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:30:27 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6e141c7a-29b9-43fb-b75c-54ab1c1b9429 tempest-CreateVolumesFromImageTest-1351866360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:30:27 devstack sudo[104588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:30:27 devstack sudo[104588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:30:27 devstack sudo[104586]: pam_unix(sudo:session): session closed for user root Nov 04 10:30:27 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7cacd9c4-7c03-4c96-851d-a6c0c8908d60 tempest-CinderUnicodeTest-1040606135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-409b0aa5-7e47-4141-9795-0fe590993207.9fb046a6-9927-4bad-8a0c-d8bb4fad8940" returned: 0 in 0.257s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:30:27 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7cacd9c4-7c03-4c96-851d-a6c0c8908d60 tempest-CinderUnicodeTest-1040606135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-409b0aa5-7e47-4141-9795-0fe590993207.info {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:30:27 devstack sudo[104592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-409b0aa5-7e47-4141-9795-0fe590993207.info Nov 04 10:30:27 devstack sudo[104592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:30:27 devstack sudo[104588]: pam_unix(sudo:session): session closed for user root Nov 04 10:30:27 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6e141c7a-29b9-43fb-b75c-54ab1c1b9429 tempest-CreateVolumesFromImageTest-1351866360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.285s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:30:27 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-6e141c7a-29b9-43fb-b75c-54ab1c1b9429 tempest-CreateVolumesFromImageTest-1351866360 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:30:27 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-6e141c7a-29b9-43fb-b75c-54ab1c1b9429 tempest-CreateVolumesFromImageTest-1351866360 None] Deleted volume successfully. Nov 04 10:30:27 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-6e141c7a-29b9-43fb-b75c-54ab1c1b9429 tempest-CreateVolumesFromImageTest-1351866360 None] Lock "cinder-6e7f6275-2d94-48bc-a780-a2773cbe3a2c-delete_volume" released by "delete_volume" :: held 1.349s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:30:27 devstack sudo[104592]: pam_unix(sudo:session): session closed for user root Nov 04 10:30:27 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7cacd9c4-7c03-4c96-851d-a6c0c8908d60 tempest-CinderUnicodeTest-1040606135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-409b0aa5-7e47-4141-9795-0fe590993207.info" returned: 0 in 0.285s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:30:27 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-7cacd9c4-7c03-4c96-851d-a6c0c8908d60 tempest-CinderUnicodeTest-1040606135 None] /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-409b0aa5-7e47-4141-9795-0fe590993207.info is being set with open permissions: ugo+rw Nov 04 10:30:27 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7cacd9c4-7c03-4c96-851d-a6c0c8908d60 tempest-CinderUnicodeTest-1040606135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-409b0aa5-7e47-4141-9795-0fe590993207.info {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:30:27 devstack sudo[104595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-409b0aa5-7e47-4141-9795-0fe590993207.info Nov 04 10:30:27 devstack sudo[104595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:30:28 devstack sudo[104595]: pam_unix(sudo:session): session closed for user root Nov 04 10:30:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7cacd9c4-7c03-4c96-851d-a6c0c8908d60 tempest-CinderUnicodeTest-1040606135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-409b0aa5-7e47-4141-9795-0fe590993207.info" returned: 0 in 0.262s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:30:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-7cacd9c4-7c03-4c96-851d-a6c0c8908d60 tempest-CinderUnicodeTest-1040606135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.192s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:30:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-b44d9bec-0499-4289-b670-17d3a2389fc8 tempest-CreateVolumesFromSnapshotTest-517992082 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.273s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:30:28 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-b44d9bec-0499-4289-b670-17d3a2389fc8 tempest-CreateVolumesFromSnapshotTest-517992082 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:30:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-715923467',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f531445-c0ad-452d-a0aa-5bcd5ed7ebad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5941a1c11d24eceb16585ffd817bf0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:30:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:30:24Z,use_quota=True,user_id='4d75921ff5fb466e8d542434b8a4125b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 10:30:28 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-b44d9bec-0499-4289-b670-17d3a2389fc8 tempest-CreateVolumesFromSnapshotTest-517992082 None] Creating volume 9f531445-c0ad-452d-a0aa-5bcd5ed7ebad {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:30:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-b44d9bec-0499-4289-b670-17d3a2389fc8 tempest-CreateVolumesFromSnapshotTest-517992082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:30:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-b44d9bec-0499-4289-b670-17d3a2389fc8 tempest-CreateVolumesFromSnapshotTest-517992082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:30:28 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-b44d9bec-0499-4289-b670-17d3a2389fc8 tempest-CreateVolumesFromSnapshotTest-517992082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:30:28 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-b44d9bec-0499-4289-b670-17d3a2389fc8 tempest-CreateVolumesFromSnapshotTest-517992082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:30:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-b44d9bec-0499-4289-b670-17d3a2389fc8 tempest-CreateVolumesFromSnapshotTest-517992082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:30:28 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-b44d9bec-0499-4289-b670-17d3a2389fc8 tempest-CreateVolumesFromSnapshotTest-517992082 None] Selected osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:30:28 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-b44d9bec-0499-4289-b670-17d3a2389fc8 tempest-CreateVolumesFromSnapshotTest-517992082 None] casted to osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 Nov 04 10:30:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-b44d9bec-0499-4289-b670-17d3a2389fc8 tempest-CreateVolumesFromSnapshotTest-517992082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-9f531445-c0ad-452d-a0aa-5bcd5ed7ebad 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:30:28 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-a9acb432-7589-4c58-9404-3bbaf01b4c7f tempest-VolumeAndVolumeTypeFromImageTest-1875562462 None] Acquiring lock "cinder-bbd55b2a-d0a1-4726-ae3a-e7163764b17d-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:30:28 devstack sudo[104598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-9f531445-c0ad-452d-a0aa-5bcd5ed7ebad 1073741824 Nov 04 10:30:28 devstack sudo[104598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:30:28 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-a9acb432-7589-4c58-9404-3bbaf01b4c7f tempest-VolumeAndVolumeTypeFromImageTest-1875562462 None] Lock "cinder-bbd55b2a-d0a1-4726-ae3a-e7163764b17d-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:30:28 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-7cacd9c4-7c03-4c96-851d-a6c0c8908d60 tempest-CinderUnicodeTest-1040606135 None] Create snapshot completed successfully Nov 04 10:30:28 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-a9acb432-7589-4c58-9404-3bbaf01b4c7f tempest-VolumeAndVolumeTypeFromImageTest-1875562462 None] Acquiring lock "cinder-quobyte-bbd55b2a-d0a1-4726-ae3a-e7163764b17d" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:30:28 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-a9acb432-7589-4c58-9404-3bbaf01b4c7f tempest-VolumeAndVolumeTypeFromImageTest-1875562462 None] Lock "cinder-quobyte-bbd55b2a-d0a1-4726-ae3a-e7163764b17d" acquired by "delete_volume" :: waited 0.021s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:30:28 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[df043a6d-352b-4629-a1e8-ffe287254773]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:30:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-a9acb432-7589-4c58-9404-3bbaf01b4c7f tempest-VolumeAndVolumeTypeFromImageTest-1875562462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-bbd55b2a-d0a1-4726-ae3a-e7163764b17d {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:30:28 devstack sudo[104600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-bbd55b2a-d0a1-4726-ae3a-e7163764b17d Nov 04 10:30:28 devstack sudo[104600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:30:28 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-2b169bcf-63da-4423-b029-edcf0a40d540 tempest-CinderUnicodeTest-1040606135 None] Acquiring lock "cinder-9fb046a6-9927-4bad-8a0c-d8bb4fad8940-delete_snapshot" by "delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:30:28 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-2b169bcf-63da-4423-b029-edcf0a40d540 tempest-CinderUnicodeTest-1040606135 None] Lock "cinder-9fb046a6-9927-4bad-8a0c-d8bb4fad8940-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:30:28 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-2b169bcf-63da-4423-b029-edcf0a40d540 tempest-CinderUnicodeTest-1040606135 None] Acquiring lock "cinder-quobyte-409b0aa5-7e47-4141-9795-0fe590993207" by "delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:30:28 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-2b169bcf-63da-4423-b029-edcf0a40d540 tempest-CinderUnicodeTest-1040606135 None] Lock "cinder-quobyte-409b0aa5-7e47-4141-9795-0fe590993207" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:30:28 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-2b169bcf-63da-4423-b029-edcf0a40d540 tempest-CinderUnicodeTest-1040606135 None] Acquiring lock "cinder-quobyte-9fb046a6-9927-4bad-8a0c-d8bb4fad8940" by "_delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:30:28 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-2b169bcf-63da-4423-b029-edcf0a40d540 tempest-CinderUnicodeTest-1040606135 None] Lock "cinder-quobyte-9fb046a6-9927-4bad-8a0c-d8bb4fad8940" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:30:28 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-2b169bcf-63da-4423-b029-edcf0a40d540 tempest-CinderUnicodeTest-1040606135 None] Deleting offline snapshot 9fb046a6-9927-4bad-8a0c-d8bb4fad8940 of volume 409b0aa5-7e47-4141-9795-0fe590993207 {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 10:30:28 devstack sudo[104598]: pam_unix(sudo:session): session closed for user root Nov 04 10:30:28 devstack sudo[104600]: pam_unix(sudo:session): session closed for user root Nov 04 10:30:28 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-2b169bcf-63da-4423-b029-edcf0a40d540 tempest-CinderUnicodeTest-1040606135 None] snapshot_file for this snap is: volume-409b0aa5-7e47-4141-9795-0fe590993207.9fb046a6-9927-4bad-8a0c-d8bb4fad8940 {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 10:30:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-b44d9bec-0499-4289-b670-17d3a2389fc8 tempest-CreateVolumesFromSnapshotTest-517992082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-9f531445-c0ad-452d-a0aa-5bcd5ed7ebad 1073741824" returned: 0 in 0.682s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:30:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-a9acb432-7589-4c58-9404-3bbaf01b4c7f tempest-VolumeAndVolumeTypeFromImageTest-1875562462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-bbd55b2a-d0a1-4726-ae3a-e7163764b17d" returned: 0 in 0.531s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:30:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-a9acb432-7589-4c58-9404-3bbaf01b4c7f tempest-VolumeAndVolumeTypeFromImageTest-1875562462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-bbd55b2a-d0a1-4726-ae3a-e7163764b17d {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:30:28 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[27107f74-a592-4f73-8a16-a5d221c0ef8d]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:30:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-2b169bcf-63da-4423-b029-edcf0a40d540 tempest-CinderUnicodeTest-1040606135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-409b0aa5-7e47-4141-9795-0fe590993207.9fb046a6-9927-4bad-8a0c-d8bb4fad8940 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:30:28 devstack sudo[104609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-bbd55b2a-d0a1-4726-ae3a-e7163764b17d Nov 04 10:30:28 devstack sudo[104609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:30:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-b44d9bec-0499-4289-b670-17d3a2389fc8 tempest-CreateVolumesFromSnapshotTest-517992082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-9f531445-c0ad-452d-a0aa-5bcd5ed7ebad {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:30:28 devstack sudo[104614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-9f531445-c0ad-452d-a0aa-5bcd5ed7ebad Nov 04 10:30:28 devstack sudo[104614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:30:28 devstack sudo[104610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-409b0aa5-7e47-4141-9795-0fe590993207.9fb046a6-9927-4bad-8a0c-d8bb4fad8940 Nov 04 10:30:28 devstack sudo[104610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:30:29 devstack sudo[104609]: pam_unix(sudo:session): session closed for user root Nov 04 10:30:29 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-a9acb432-7589-4c58-9404-3bbaf01b4c7f tempest-VolumeAndVolumeTypeFromImageTest-1875562462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-bbd55b2a-d0a1-4726-ae3a-e7163764b17d" returned: 0 in 0.299s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:30:29 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-a9acb432-7589-4c58-9404-3bbaf01b4c7f tempest-VolumeAndVolumeTypeFromImageTest-1875562462 None] Lock "cinder-quobyte-bbd55b2a-d0a1-4726-ae3a-e7163764b17d" released by "delete_volume" :: held 0.896s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:30:29 devstack sudo[104614]: pam_unix(sudo:session): session closed for user root Nov 04 10:30:29 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-b44d9bec-0499-4289-b670-17d3a2389fc8 tempest-CreateVolumesFromSnapshotTest-517992082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-9f531445-c0ad-452d-a0aa-5bcd5ed7ebad" returned: 0 in 0.323s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:30:29 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-b44d9bec-0499-4289-b670-17d3a2389fc8 tempest-CreateVolumesFromSnapshotTest-517992082 None] <== create_volume: return (1103ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 10:30:29 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-b44d9bec-0499-4289-b670-17d3a2389fc8 tempest-CreateVolumesFromSnapshotTest-517992082 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.108s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:30:29 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-fc7e4b29-e584-41a0-b29e-b87a0cf36dc3 tempest-CreateVolumesFromSnapshotTest-517992082 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.991s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:30:29 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-fc7e4b29-e584-41a0-b29e-b87a0cf36dc3 tempest-CreateVolumesFromSnapshotTest-517992082 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:30:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-157005514',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc8662b0-81d6-44fc-9e8c-65201c7e5324,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5941a1c11d24eceb16585ffd817bf0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:30:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:30:25Z,use_quota=True,user_id='4d75921ff5fb466e8d542434b8a4125b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 10:30:29 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-fc7e4b29-e584-41a0-b29e-b87a0cf36dc3 tempest-CreateVolumesFromSnapshotTest-517992082 None] Creating volume bc8662b0-81d6-44fc-9e8c-65201c7e5324 {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:30:29 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-fc7e4b29-e584-41a0-b29e-b87a0cf36dc3 tempest-CreateVolumesFromSnapshotTest-517992082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:30:29 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-fc7e4b29-e584-41a0-b29e-b87a0cf36dc3 tempest-CreateVolumesFromSnapshotTest-517992082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:30:29 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-fc7e4b29-e584-41a0-b29e-b87a0cf36dc3 tempest-CreateVolumesFromSnapshotTest-517992082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:30:29 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-fc7e4b29-e584-41a0-b29e-b87a0cf36dc3 tempest-CreateVolumesFromSnapshotTest-517992082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:30:29 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-fc7e4b29-e584-41a0-b29e-b87a0cf36dc3 tempest-CreateVolumesFromSnapshotTest-517992082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:30:29 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-fc7e4b29-e584-41a0-b29e-b87a0cf36dc3 tempest-CreateVolumesFromSnapshotTest-517992082 None] Selected osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:30:29 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-fc7e4b29-e584-41a0-b29e-b87a0cf36dc3 tempest-CreateVolumesFromSnapshotTest-517992082 None] casted to osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 Nov 04 10:30:29 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-fc7e4b29-e584-41a0-b29e-b87a0cf36dc3 tempest-CreateVolumesFromSnapshotTest-517992082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-bc8662b0-81d6-44fc-9e8c-65201c7e5324 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:30:29 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-a9acb432-7589-4c58-9404-3bbaf01b4c7f tempest-VolumeAndVolumeTypeFromImageTest-1875562462 None] Created reservations ['85177c45-9e27-4f01-ae04-23052d5bcd2e', 'd7c503d6-b2b2-46a8-8e4a-e47306c5db22', '803b7dac-278a-4290-ba46-a6b43a33aee3', '7c9953aa-7ba9-4a96-b68f-cb1553e8e0b3'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:30:29 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-b44d9bec-0499-4289-b670-17d3a2389fc8 tempest-CreateVolumesFromSnapshotTest-517992082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c72787d4-eb9e-42f1-ace0-9e3e6fa0e0e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f531445-c0ad-452d-a0aa-5bcd5ed7ebad', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:30:29 devstack sudo[104622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-bc8662b0-81d6-44fc-9e8c-65201c7e5324 1073741824 Nov 04 10:30:29 devstack sudo[104622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:30:29 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-b44d9bec-0499-4289-b670-17d3a2389fc8 tempest-CreateVolumesFromSnapshotTest-517992082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98e32930-46a6-476f-9309-0a32fdd39cb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:30:29 devstack sudo[104610]: pam_unix(sudo:session): session closed for user root Nov 04 10:30:29 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-2b169bcf-63da-4423-b029-edcf0a40d540 tempest-CinderUnicodeTest-1040606135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-409b0aa5-7e47-4141-9795-0fe590993207.9fb046a6-9927-4bad-8a0c-d8bb4fad8940" returned: 0 in 0.473s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:30:29 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-2b169bcf-63da-4423-b029-edcf0a40d540 tempest-CinderUnicodeTest-1040606135 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-409b0aa5-7e47-4141-9795-0fe590993207(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87068) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 10:30:29 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-b44d9bec-0499-4289-b670-17d3a2389fc8 tempest-CreateVolumesFromSnapshotTest-517992082 None] Volume volume-9f531445-c0ad-452d-a0aa-5bcd5ed7ebad (9f531445-c0ad-452d-a0aa-5bcd5ed7ebad): created successfully Nov 04 10:30:29 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-b44d9bec-0499-4289-b670-17d3a2389fc8 tempest-CreateVolumesFromSnapshotTest-517992082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98e32930-46a6-476f-9309-0a32fdd39cb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:30:29 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-b44d9bec-0499-4289-b670-17d3a2389fc8 tempest-CreateVolumesFromSnapshotTest-517992082 None] Flow 'volume_create_manager' (7f80439d-bf4c-4296-ba2d-a984cc6d213c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:30:29 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[04fe6dca-2467-46ee-9451-203d82c980a3]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:30:29 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-2b169bcf-63da-4423-b029-edcf0a40d540 tempest-CinderUnicodeTest-1040606135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-409b0aa5-7e47-4141-9795-0fe590993207 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:30:29 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-b44d9bec-0499-4289-b670-17d3a2389fc8 tempest-CreateVolumesFromSnapshotTest-517992082 None] Created volume successfully. Nov 04 10:30:29 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-a9acb432-7589-4c58-9404-3bbaf01b4c7f tempest-VolumeAndVolumeTypeFromImageTest-1875562462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:30:29 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-a9acb432-7589-4c58-9404-3bbaf01b4c7f tempest-VolumeAndVolumeTypeFromImageTest-1875562462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:30:29 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-a9acb432-7589-4c58-9404-3bbaf01b4c7f tempest-VolumeAndVolumeTypeFromImageTest-1875562462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:30:29 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-a9acb432-7589-4c58-9404-3bbaf01b4c7f tempest-VolumeAndVolumeTypeFromImageTest-1875562462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:30:29 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-a9acb432-7589-4c58-9404-3bbaf01b4c7f tempest-VolumeAndVolumeTypeFromImageTest-1875562462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:30:29 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-a9acb432-7589-4c58-9404-3bbaf01b4c7f tempest-VolumeAndVolumeTypeFromImageTest-1875562462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:30:29 devstack sudo[104624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-409b0aa5-7e47-4141-9795-0fe590993207 Nov 04 10:30:29 devstack sudo[104624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:30:29 devstack sudo[104625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:30:29 devstack sudo[104625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:30:29 devstack sudo[104625]: pam_unix(sudo:session): session closed for user root Nov 04 10:30:29 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-a9acb432-7589-4c58-9404-3bbaf01b4c7f tempest-VolumeAndVolumeTypeFromImageTest-1875562462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.329s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:30:29 devstack sudo[104624]: pam_unix(sudo:session): session closed for user root Nov 04 10:30:29 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-a9acb432-7589-4c58-9404-3bbaf01b4c7f tempest-VolumeAndVolumeTypeFromImageTest-1875562462 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:30:29 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-2b169bcf-63da-4423-b029-edcf0a40d540 tempest-CinderUnicodeTest-1040606135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-409b0aa5-7e47-4141-9795-0fe590993207" returned: 0 in 0.428s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:30:29 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-2b169bcf-63da-4423-b029-edcf0a40d540 tempest-CinderUnicodeTest-1040606135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-409b0aa5-7e47-4141-9795-0fe590993207.9fb046a6-9927-4bad-8a0c-d8bb4fad8940 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:30:29 devstack sudo[104622]: pam_unix(sudo:session): session closed for user root Nov 04 10:30:29 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-a9acb432-7589-4c58-9404-3bbaf01b4c7f tempest-VolumeAndVolumeTypeFromImageTest-1875562462 None] Deleted volume successfully. Nov 04 10:30:29 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-fc7e4b29-e584-41a0-b29e-b87a0cf36dc3 tempest-CreateVolumesFromSnapshotTest-517992082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-bc8662b0-81d6-44fc-9e8c-65201c7e5324 1073741824" returned: 0 in 0.569s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:30:29 devstack sudo[104636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-409b0aa5-7e47-4141-9795-0fe590993207.9fb046a6-9927-4bad-8a0c-d8bb4fad8940 Nov 04 10:30:29 devstack sudo[104636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:30:29 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-a9acb432-7589-4c58-9404-3bbaf01b4c7f tempest-VolumeAndVolumeTypeFromImageTest-1875562462 None] Lock "cinder-bbd55b2a-d0a1-4726-ae3a-e7163764b17d-delete_volume" released by "delete_volume" :: held 1.659s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:30:29 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-fc7e4b29-e584-41a0-b29e-b87a0cf36dc3 tempest-CreateVolumesFromSnapshotTest-517992082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-bc8662b0-81d6-44fc-9e8c-65201c7e5324 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:30:29 devstack sudo[104638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-bc8662b0-81d6-44fc-9e8c-65201c7e5324 Nov 04 10:30:29 devstack sudo[104638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:30:30 devstack sudo[104638]: pam_unix(sudo:session): session closed for user root Nov 04 10:30:30 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-fc7e4b29-e584-41a0-b29e-b87a0cf36dc3 tempest-CreateVolumesFromSnapshotTest-517992082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-bc8662b0-81d6-44fc-9e8c-65201c7e5324" returned: 0 in 0.298s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:30:30 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-fc7e4b29-e584-41a0-b29e-b87a0cf36dc3 tempest-CreateVolumesFromSnapshotTest-517992082 None] <== create_volume: return (934ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 10:30:30 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-fc7e4b29-e584-41a0-b29e-b87a0cf36dc3 tempest-CreateVolumesFromSnapshotTest-517992082 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.937s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:30:30 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-1139dd86-e47e-4f15-ad59-f2bb1f183983 tempest-CreateVolumesFromSnapshotTest-517992082 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.561s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:30:30 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-1139dd86-e47e-4f15-ad59-f2bb1f183983 tempest-CreateVolumesFromSnapshotTest-517992082 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:30:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1439799632',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cf24df4-4fdc-4de0-9dad-07944ff49549,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5941a1c11d24eceb16585ffd817bf0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:30:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:30:25Z,use_quota=True,user_id='4d75921ff5fb466e8d542434b8a4125b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 10:30:30 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-1139dd86-e47e-4f15-ad59-f2bb1f183983 tempest-CreateVolumesFromSnapshotTest-517992082 None] Creating volume 0cf24df4-4fdc-4de0-9dad-07944ff49549 {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:30:30 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-1139dd86-e47e-4f15-ad59-f2bb1f183983 tempest-CreateVolumesFromSnapshotTest-517992082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:30:30 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-1139dd86-e47e-4f15-ad59-f2bb1f183983 tempest-CreateVolumesFromSnapshotTest-517992082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:30:30 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-1139dd86-e47e-4f15-ad59-f2bb1f183983 tempest-CreateVolumesFromSnapshotTest-517992082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:30:30 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-1139dd86-e47e-4f15-ad59-f2bb1f183983 tempest-CreateVolumesFromSnapshotTest-517992082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:30:30 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-1139dd86-e47e-4f15-ad59-f2bb1f183983 tempest-CreateVolumesFromSnapshotTest-517992082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:30:30 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-1139dd86-e47e-4f15-ad59-f2bb1f183983 tempest-CreateVolumesFromSnapshotTest-517992082 None] Selected osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:30:30 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-1139dd86-e47e-4f15-ad59-f2bb1f183983 tempest-CreateVolumesFromSnapshotTest-517992082 None] casted to osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 Nov 04 10:30:30 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-1139dd86-e47e-4f15-ad59-f2bb1f183983 tempest-CreateVolumesFromSnapshotTest-517992082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-0cf24df4-4fdc-4de0-9dad-07944ff49549 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:30:30 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-fc7e4b29-e584-41a0-b29e-b87a0cf36dc3 tempest-CreateVolumesFromSnapshotTest-517992082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1957fc4d-f11e-4c01-9ca6-9c5736126ec6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc8662b0-81d6-44fc-9e8c-65201c7e5324', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:30:30 devstack sudo[104645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-0cf24df4-4fdc-4de0-9dad-07944ff49549 1073741824 Nov 04 10:30:30 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-fc7e4b29-e584-41a0-b29e-b87a0cf36dc3 tempest-CreateVolumesFromSnapshotTest-517992082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ab5591a-4dd9-449a-982e-f131f96d64cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:30:30 devstack sudo[104645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:30:30 devstack sudo[104636]: pam_unix(sudo:session): session closed for user root Nov 04 10:30:30 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-2b169bcf-63da-4423-b029-edcf0a40d540 tempest-CinderUnicodeTest-1040606135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-409b0aa5-7e47-4141-9795-0fe590993207.9fb046a6-9927-4bad-8a0c-d8bb4fad8940" returned: 0 in 0.478s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:30:30 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-2b169bcf-63da-4423-b029-edcf0a40d540 tempest-CinderUnicodeTest-1040606135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-409b0aa5-7e47-4141-9795-0fe590993207.9fb046a6-9927-4bad-8a0c-d8bb4fad8940 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:30:30 devstack sudo[104647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-409b0aa5-7e47-4141-9795-0fe590993207.9fb046a6-9927-4bad-8a0c-d8bb4fad8940 Nov 04 10:30:30 devstack sudo[104647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:30:30 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-fc7e4b29-e584-41a0-b29e-b87a0cf36dc3 tempest-CreateVolumesFromSnapshotTest-517992082 None] Volume volume-bc8662b0-81d6-44fc-9e8c-65201c7e5324 (bc8662b0-81d6-44fc-9e8c-65201c7e5324): created successfully Nov 04 10:30:30 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-fc7e4b29-e584-41a0-b29e-b87a0cf36dc3 tempest-CreateVolumesFromSnapshotTest-517992082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ab5591a-4dd9-449a-982e-f131f96d64cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:30:30 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-fc7e4b29-e584-41a0-b29e-b87a0cf36dc3 tempest-CreateVolumesFromSnapshotTest-517992082 None] Flow 'volume_create_manager' (6926c85f-cdd2-4415-a0dc-a20df3bc6559) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:30:30 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-fc7e4b29-e584-41a0-b29e-b87a0cf36dc3 tempest-CreateVolumesFromSnapshotTest-517992082 None] Created volume successfully. Nov 04 10:30:30 devstack sudo[104647]: pam_unix(sudo:session): session closed for user root Nov 04 10:30:30 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-2b169bcf-63da-4423-b029-edcf0a40d540 tempest-CinderUnicodeTest-1040606135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-409b0aa5-7e47-4141-9795-0fe590993207.9fb046a6-9927-4bad-8a0c-d8bb4fad8940" returned: 0 in 0.335s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:30:30 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-2b169bcf-63da-4423-b029-edcf0a40d540 tempest-CinderUnicodeTest-1040606135 None] Lock "cinder-quobyte-9fb046a6-9927-4bad-8a0c-d8bb4fad8940" released by "_delete_snapshot" :: held 1.874s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:30:30 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-2b169bcf-63da-4423-b029-edcf0a40d540 tempest-CinderUnicodeTest-1040606135 None] Lock "cinder-quobyte-409b0aa5-7e47-4141-9795-0fe590993207" released by "delete_snapshot" :: held 1.922s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:30:30 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-2b169bcf-63da-4423-b029-edcf0a40d540 tempest-CinderUnicodeTest-1040606135 None] Created reservations ['dcdd081a-18a6-4579-af7f-10342f71e951', 'faa5550e-2a77-4876-b15f-ee7a2357a63a', '304fe7f1-7cb0-4523-b59f-bb45a6495089', '84307a9e-e92f-4496-96e0-53acc18d7a57'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:30:30 devstack sudo[104645]: pam_unix(sudo:session): session closed for user root Nov 04 10:30:30 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-1139dd86-e47e-4f15-ad59-f2bb1f183983 tempest-CreateVolumesFromSnapshotTest-517992082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-0cf24df4-4fdc-4de0-9dad-07944ff49549 1073741824" returned: 0 in 0.607s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:30:30 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-2b169bcf-63da-4423-b029-edcf0a40d540 tempest-CinderUnicodeTest-1040606135 None] Delete snapshot completed successfully. Nov 04 10:30:30 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-2b169bcf-63da-4423-b029-edcf0a40d540 tempest-CinderUnicodeTest-1040606135 None] Lock "cinder-9fb046a6-9927-4bad-8a0c-d8bb4fad8940-delete_snapshot" released by "delete_snapshot" :: held 2.116s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:30:30 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-1139dd86-e47e-4f15-ad59-f2bb1f183983 tempest-CreateVolumesFromSnapshotTest-517992082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-0cf24df4-4fdc-4de0-9dad-07944ff49549 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:30:30 devstack sudo[104654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-0cf24df4-4fdc-4de0-9dad-07944ff49549 Nov 04 10:30:30 devstack sudo[104654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:30:30 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-e756856d-ffb1-4998-910e-6a81de4a53ed tempest-CinderUnicodeTest-1040606135 None] Acquiring lock "cinder-409b0aa5-7e47-4141-9795-0fe590993207-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:30:30 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-e756856d-ffb1-4998-910e-6a81de4a53ed tempest-CinderUnicodeTest-1040606135 None] Lock "cinder-409b0aa5-7e47-4141-9795-0fe590993207-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:30:31 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-e756856d-ffb1-4998-910e-6a81de4a53ed tempest-CinderUnicodeTest-1040606135 None] Acquiring lock "cinder-quobyte-409b0aa5-7e47-4141-9795-0fe590993207" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:30:31 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-e756856d-ffb1-4998-910e-6a81de4a53ed tempest-CinderUnicodeTest-1040606135 None] Lock "cinder-quobyte-409b0aa5-7e47-4141-9795-0fe590993207" acquired by "delete_volume" :: waited 0.029s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:30:31 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e3be7ac-d355-4fa3-a539-759772af1b6f]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:30:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-e756856d-ffb1-4998-910e-6a81de4a53ed tempest-CinderUnicodeTest-1040606135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-409b0aa5-7e47-4141-9795-0fe590993207 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:30:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-1139dd86-e47e-4f15-ad59-f2bb1f183983 tempest-CreateVolumesFromSnapshotTest-517992082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-0cf24df4-4fdc-4de0-9dad-07944ff49549" returned: 0 in 0.374s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:30:31 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-1139dd86-e47e-4f15-ad59-f2bb1f183983 tempest-CreateVolumesFromSnapshotTest-517992082 None] <== create_volume: return (1041ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 10:30:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-1139dd86-e47e-4f15-ad59-f2bb1f183983 tempest-CreateVolumesFromSnapshotTest-517992082 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.044s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:30:31 devstack sudo[104654]: pam_unix(sudo:session): session closed for user root Nov 04 10:30:31 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1139dd86-e47e-4f15-ad59-f2bb1f183983 tempest-CreateVolumesFromSnapshotTest-517992082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b82571d2-f984-4d7e-a619-3afe42046686) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0cf24df4-4fdc-4de0-9dad-07944ff49549', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:30:31 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1139dd86-e47e-4f15-ad59-f2bb1f183983 tempest-CreateVolumesFromSnapshotTest-517992082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5cd2a10-9812-406c-a111-ad5fa174f863) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:30:31 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-1139dd86-e47e-4f15-ad59-f2bb1f183983 tempest-CreateVolumesFromSnapshotTest-517992082 None] Volume volume-0cf24df4-4fdc-4de0-9dad-07944ff49549 (0cf24df4-4fdc-4de0-9dad-07944ff49549): created successfully Nov 04 10:30:31 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1139dd86-e47e-4f15-ad59-f2bb1f183983 tempest-CreateVolumesFromSnapshotTest-517992082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5cd2a10-9812-406c-a111-ad5fa174f863) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:30:31 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1139dd86-e47e-4f15-ad59-f2bb1f183983 tempest-CreateVolumesFromSnapshotTest-517992082 None] Flow 'volume_create_manager' (1469370e-a200-4d0c-9c8a-1e5578f1bcd2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:30:31 devstack sudo[104658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-409b0aa5-7e47-4141-9795-0fe590993207 Nov 04 10:30:31 devstack sudo[104658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:30:31 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-1139dd86-e47e-4f15-ad59-f2bb1f183983 tempest-CreateVolumesFromSnapshotTest-517992082 None] Created volume successfully. Nov 04 10:30:31 devstack sudo[104658]: pam_unix(sudo:session): session closed for user root Nov 04 10:30:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-e756856d-ffb1-4998-910e-6a81de4a53ed tempest-CinderUnicodeTest-1040606135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-409b0aa5-7e47-4141-9795-0fe590993207" returned: 0 in 0.471s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:30:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-e756856d-ffb1-4998-910e-6a81de4a53ed tempest-CinderUnicodeTest-1040606135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-409b0aa5-7e47-4141-9795-0fe590993207 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:30:31 devstack sudo[104664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-409b0aa5-7e47-4141-9795-0fe590993207 Nov 04 10:30:31 devstack sudo[104664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:30:31 devstack sudo[104664]: pam_unix(sudo:session): session closed for user root Nov 04 10:30:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-e756856d-ffb1-4998-910e-6a81de4a53ed tempest-CinderUnicodeTest-1040606135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-409b0aa5-7e47-4141-9795-0fe590993207" returned: 0 in 0.260s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:30:31 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-e756856d-ffb1-4998-910e-6a81de4a53ed tempest-CinderUnicodeTest-1040606135 None] Lock "cinder-quobyte-409b0aa5-7e47-4141-9795-0fe590993207" released by "delete_volume" :: held 0.848s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:30:31 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-e756856d-ffb1-4998-910e-6a81de4a53ed tempest-CinderUnicodeTest-1040606135 None] Created reservations ['e266310b-9693-4c84-ba7e-00c8fb665ea6', '894c9f83-3b5c-415a-b90d-6db65f4394f2', '1251e332-f661-413d-bf46-0b15c43ba44b', '9b34df67-0765-4107-a880-9f3e3ebf7c93'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:30:32 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-e756856d-ffb1-4998-910e-6a81de4a53ed tempest-CinderUnicodeTest-1040606135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:30:32 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-e756856d-ffb1-4998-910e-6a81de4a53ed tempest-CinderUnicodeTest-1040606135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:30:32 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-e756856d-ffb1-4998-910e-6a81de4a53ed tempest-CinderUnicodeTest-1040606135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:30:32 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-e756856d-ffb1-4998-910e-6a81de4a53ed tempest-CinderUnicodeTest-1040606135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:30:32 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-e756856d-ffb1-4998-910e-6a81de4a53ed tempest-CinderUnicodeTest-1040606135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:30:32 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-e756856d-ffb1-4998-910e-6a81de4a53ed tempest-CinderUnicodeTest-1040606135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:30:32 devstack sudo[104667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:30:32 devstack sudo[104667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:30:32 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-ba5eb7db-3fb9-4b11-b2d9-29a970d704d8 tempest-CinderUnicodeTest-1040606135 None] Acquiring lock "cinder-0d49599b-6de8-4aa7-88ea-d29030b36dac-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:30:32 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-ba5eb7db-3fb9-4b11-b2d9-29a970d704d8 tempest-CinderUnicodeTest-1040606135 None] Lock "cinder-0d49599b-6de8-4aa7-88ea-d29030b36dac-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:30:32 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-ba5eb7db-3fb9-4b11-b2d9-29a970d704d8 tempest-CinderUnicodeTest-1040606135 None] Acquiring lock "cinder-quobyte-0d49599b-6de8-4aa7-88ea-d29030b36dac" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:30:32 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-ba5eb7db-3fb9-4b11-b2d9-29a970d704d8 tempest-CinderUnicodeTest-1040606135 None] Lock "cinder-quobyte-0d49599b-6de8-4aa7-88ea-d29030b36dac" acquired by "delete_volume" :: waited 0.026s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:30:32 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf2489b1-6351-4221-aafd-94e2c0052790]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:30:32 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ba5eb7db-3fb9-4b11-b2d9-29a970d704d8 tempest-CinderUnicodeTest-1040606135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-0d49599b-6de8-4aa7-88ea-d29030b36dac {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:30:32 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-2684b536-6f7d-4146-9d25-0b6af2614e7b tempest-CreateVolumesFromSnapshotTest-517992082 None] Acquiring lock "cinder-0cf24df4-4fdc-4de0-9dad-07944ff49549-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:30:32 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-2684b536-6f7d-4146-9d25-0b6af2614e7b tempest-CreateVolumesFromSnapshotTest-517992082 None] Lock "cinder-0cf24df4-4fdc-4de0-9dad-07944ff49549-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:30:32 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-2684b536-6f7d-4146-9d25-0b6af2614e7b tempest-CreateVolumesFromSnapshotTest-517992082 None] Acquiring lock "cinder-quobyte-0cf24df4-4fdc-4de0-9dad-07944ff49549" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:30:32 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-2684b536-6f7d-4146-9d25-0b6af2614e7b tempest-CreateVolumesFromSnapshotTest-517992082 None] Lock "cinder-quobyte-0cf24df4-4fdc-4de0-9dad-07944ff49549" acquired by "delete_volume" :: waited 0.020s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:30:32 devstack sudo[104669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-0d49599b-6de8-4aa7-88ea-d29030b36dac Nov 04 10:30:32 devstack sudo[104669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:30:32 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[57d821c2-0a75-4480-b7ad-03ee33a413f5]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:30:32 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-2684b536-6f7d-4146-9d25-0b6af2614e7b tempest-CreateVolumesFromSnapshotTest-517992082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-0cf24df4-4fdc-4de0-9dad-07944ff49549 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:30:32 devstack sudo[104667]: pam_unix(sudo:session): session closed for user root Nov 04 10:30:32 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-e756856d-ffb1-4998-910e-6a81de4a53ed tempest-CinderUnicodeTest-1040606135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.517s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:30:32 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-e756856d-ffb1-4998-910e-6a81de4a53ed tempest-CinderUnicodeTest-1040606135 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:30:32 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-e756856d-ffb1-4998-910e-6a81de4a53ed tempest-CinderUnicodeTest-1040606135 None] Deleted volume successfully. Nov 04 10:30:32 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-e756856d-ffb1-4998-910e-6a81de4a53ed tempest-CinderUnicodeTest-1040606135 None] Lock "cinder-409b0aa5-7e47-4141-9795-0fe590993207-delete_volume" released by "delete_volume" :: held 1.721s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:30:32 devstack sudo[104672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-0cf24df4-4fdc-4de0-9dad-07944ff49549 Nov 04 10:30:32 devstack sudo[104672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:30:32 devstack sudo[104669]: pam_unix(sudo:session): session closed for user root Nov 04 10:30:32 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ba5eb7db-3fb9-4b11-b2d9-29a970d704d8 tempest-CinderUnicodeTest-1040606135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-0d49599b-6de8-4aa7-88ea-d29030b36dac" returned: 0 in 0.517s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:30:32 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ba5eb7db-3fb9-4b11-b2d9-29a970d704d8 tempest-CinderUnicodeTest-1040606135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-0d49599b-6de8-4aa7-88ea-d29030b36dac {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:30:32 devstack sudo[104679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-0d49599b-6de8-4aa7-88ea-d29030b36dac Nov 04 10:30:32 devstack sudo[104679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:30:33 devstack sudo[104672]: pam_unix(sudo:session): session closed for user root Nov 04 10:30:33 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-2684b536-6f7d-4146-9d25-0b6af2614e7b tempest-CreateVolumesFromSnapshotTest-517992082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-0cf24df4-4fdc-4de0-9dad-07944ff49549" returned: 0 in 0.562s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:30:33 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-2684b536-6f7d-4146-9d25-0b6af2614e7b tempest-CreateVolumesFromSnapshotTest-517992082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-0cf24df4-4fdc-4de0-9dad-07944ff49549 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:30:33 devstack sudo[104686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-0cf24df4-4fdc-4de0-9dad-07944ff49549 Nov 04 10:30:33 devstack sudo[104686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:30:33 devstack sudo[104679]: pam_unix(sudo:session): session closed for user root Nov 04 10:30:33 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ba5eb7db-3fb9-4b11-b2d9-29a970d704d8 tempest-CinderUnicodeTest-1040606135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-0d49599b-6de8-4aa7-88ea-d29030b36dac" returned: 0 in 0.320s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:30:33 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-ba5eb7db-3fb9-4b11-b2d9-29a970d704d8 tempest-CinderUnicodeTest-1040606135 None] Lock "cinder-quobyte-0d49599b-6de8-4aa7-88ea-d29030b36dac" released by "delete_volume" :: held 0.916s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:30:33 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-ba5eb7db-3fb9-4b11-b2d9-29a970d704d8 tempest-CinderUnicodeTest-1040606135 None] Created reservations ['38cce8ac-415c-433c-b17d-df905f0cfb07', '6c863763-8b73-4d84-81de-36bee1bd98d2', 'd74ca1ba-a05f-4ef0-9461-4b8e804a233a', '42f1538f-dd39-467e-954a-9d43c39aad18'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:30:33 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-ba5eb7db-3fb9-4b11-b2d9-29a970d704d8 tempest-CinderUnicodeTest-1040606135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:30:33 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-ba5eb7db-3fb9-4b11-b2d9-29a970d704d8 tempest-CinderUnicodeTest-1040606135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:30:33 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-ba5eb7db-3fb9-4b11-b2d9-29a970d704d8 tempest-CinderUnicodeTest-1040606135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:30:33 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-ba5eb7db-3fb9-4b11-b2d9-29a970d704d8 tempest-CinderUnicodeTest-1040606135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:30:33 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-ba5eb7db-3fb9-4b11-b2d9-29a970d704d8 tempest-CinderUnicodeTest-1040606135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:30:33 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ba5eb7db-3fb9-4b11-b2d9-29a970d704d8 tempest-CinderUnicodeTest-1040606135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:30:33 devstack sudo[104688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:30:33 devstack sudo[104688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:30:33 devstack sudo[104686]: pam_unix(sudo:session): session closed for user root Nov 04 10:30:33 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-2684b536-6f7d-4146-9d25-0b6af2614e7b tempest-CreateVolumesFromSnapshotTest-517992082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-0cf24df4-4fdc-4de0-9dad-07944ff49549" returned: 0 in 0.419s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:30:33 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-2684b536-6f7d-4146-9d25-0b6af2614e7b tempest-CreateVolumesFromSnapshotTest-517992082 None] Lock "cinder-quobyte-0cf24df4-4fdc-4de0-9dad-07944ff49549" released by "delete_volume" :: held 1.060s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:30:33 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-2684b536-6f7d-4146-9d25-0b6af2614e7b tempest-CreateVolumesFromSnapshotTest-517992082 None] Created reservations ['7cfd28a8-2a36-4056-8a74-0ce0c04e87bd', 'eb316d7e-5d8b-42fc-a09d-b8a6c45ac7d8', 'cc3822b3-7b80-4379-a9e2-d18a93a28937', 'e794cfcd-463a-48b9-820f-866a9095b788'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:30:33 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-2684b536-6f7d-4146-9d25-0b6af2614e7b tempest-CreateVolumesFromSnapshotTest-517992082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:30:33 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-2684b536-6f7d-4146-9d25-0b6af2614e7b tempest-CreateVolumesFromSnapshotTest-517992082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:30:33 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-2684b536-6f7d-4146-9d25-0b6af2614e7b tempest-CreateVolumesFromSnapshotTest-517992082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:30:33 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-2684b536-6f7d-4146-9d25-0b6af2614e7b tempest-CreateVolumesFromSnapshotTest-517992082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:30:33 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-2684b536-6f7d-4146-9d25-0b6af2614e7b tempest-CreateVolumesFromSnapshotTest-517992082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:30:33 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-2684b536-6f7d-4146-9d25-0b6af2614e7b tempest-CreateVolumesFromSnapshotTest-517992082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:30:33 devstack sudo[104688]: pam_unix(sudo:session): session closed for user root Nov 04 10:30:33 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ba5eb7db-3fb9-4b11-b2d9-29a970d704d8 tempest-CinderUnicodeTest-1040606135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.373s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:30:33 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-ba5eb7db-3fb9-4b11-b2d9-29a970d704d8 tempest-CinderUnicodeTest-1040606135 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:30:33 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-ba5eb7db-3fb9-4b11-b2d9-29a970d704d8 tempest-CinderUnicodeTest-1040606135 None] Deleted volume successfully. Nov 04 10:30:33 devstack sudo[104692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:30:33 devstack sudo[104692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:30:33 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-ba5eb7db-3fb9-4b11-b2d9-29a970d704d8 tempest-CinderUnicodeTest-1040606135 None] Lock "cinder-0d49599b-6de8-4aa7-88ea-d29030b36dac-delete_volume" released by "delete_volume" :: held 1.633s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:30:34 devstack sudo[104692]: pam_unix(sudo:session): session closed for user root Nov 04 10:30:34 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-2684b536-6f7d-4146-9d25-0b6af2614e7b tempest-CreateVolumesFromSnapshotTest-517992082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.328s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:30:34 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-2684b536-6f7d-4146-9d25-0b6af2614e7b tempest-CreateVolumesFromSnapshotTest-517992082 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:30:34 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-2684b536-6f7d-4146-9d25-0b6af2614e7b tempest-CreateVolumesFromSnapshotTest-517992082 None] Deleted volume successfully. Nov 04 10:30:34 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-2684b536-6f7d-4146-9d25-0b6af2614e7b tempest-CreateVolumesFromSnapshotTest-517992082 None] Lock "cinder-0cf24df4-4fdc-4de0-9dad-07944ff49549-delete_volume" released by "delete_volume" :: held 1.695s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:30:34 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-96ee2a5b-a141-4a23-8c59-0c91291ed583 tempest-CreateVolumesFromSnapshotTest-517992082 None] Acquiring lock "cinder-bc8662b0-81d6-44fc-9e8c-65201c7e5324-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:30:34 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-96ee2a5b-a141-4a23-8c59-0c91291ed583 tempest-CreateVolumesFromSnapshotTest-517992082 None] Lock "cinder-bc8662b0-81d6-44fc-9e8c-65201c7e5324-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:30:34 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-96ee2a5b-a141-4a23-8c59-0c91291ed583 tempest-CreateVolumesFromSnapshotTest-517992082 None] Acquiring lock "cinder-quobyte-bc8662b0-81d6-44fc-9e8c-65201c7e5324" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:30:34 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-96ee2a5b-a141-4a23-8c59-0c91291ed583 tempest-CreateVolumesFromSnapshotTest-517992082 None] Lock "cinder-quobyte-bc8662b0-81d6-44fc-9e8c-65201c7e5324" acquired by "delete_volume" :: waited 0.019s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:30:34 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[75d81bfb-972d-4938-b5bb-7df7fd2487d7]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:30:34 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-96ee2a5b-a141-4a23-8c59-0c91291ed583 tempest-CreateVolumesFromSnapshotTest-517992082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-bc8662b0-81d6-44fc-9e8c-65201c7e5324 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:30:34 devstack sudo[104695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-bc8662b0-81d6-44fc-9e8c-65201c7e5324 Nov 04 10:30:34 devstack sudo[104695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:30:35 devstack sudo[104695]: pam_unix(sudo:session): session closed for user root Nov 04 10:30:35 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-96ee2a5b-a141-4a23-8c59-0c91291ed583 tempest-CreateVolumesFromSnapshotTest-517992082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-bc8662b0-81d6-44fc-9e8c-65201c7e5324" returned: 0 in 0.555s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:30:35 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-96ee2a5b-a141-4a23-8c59-0c91291ed583 tempest-CreateVolumesFromSnapshotTest-517992082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-bc8662b0-81d6-44fc-9e8c-65201c7e5324 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:30:35 devstack sudo[104700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-bc8662b0-81d6-44fc-9e8c-65201c7e5324 Nov 04 10:30:35 devstack sudo[104700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:30:35 devstack sudo[104700]: pam_unix(sudo:session): session closed for user root Nov 04 10:30:35 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-96ee2a5b-a141-4a23-8c59-0c91291ed583 tempest-CreateVolumesFromSnapshotTest-517992082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-bc8662b0-81d6-44fc-9e8c-65201c7e5324" returned: 0 in 0.276s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:30:35 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-96ee2a5b-a141-4a23-8c59-0c91291ed583 tempest-CreateVolumesFromSnapshotTest-517992082 None] Lock "cinder-quobyte-bc8662b0-81d6-44fc-9e8c-65201c7e5324" released by "delete_volume" :: held 0.898s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:30:35 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-96ee2a5b-a141-4a23-8c59-0c91291ed583 tempest-CreateVolumesFromSnapshotTest-517992082 None] Created reservations ['2cc89b21-cb3b-4ddb-9ca2-1fa3fe0a89c6', '923bd117-1c44-4514-82b8-bdf52993e250', '6f5a4723-b26e-4a1e-8da1-a588b8fe0cb7', 'e6acb4b5-beb2-4151-911c-5c55a9bc930d'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:30:35 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-96ee2a5b-a141-4a23-8c59-0c91291ed583 tempest-CreateVolumesFromSnapshotTest-517992082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:30:35 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-96ee2a5b-a141-4a23-8c59-0c91291ed583 tempest-CreateVolumesFromSnapshotTest-517992082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:30:35 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-96ee2a5b-a141-4a23-8c59-0c91291ed583 tempest-CreateVolumesFromSnapshotTest-517992082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:30:35 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-96ee2a5b-a141-4a23-8c59-0c91291ed583 tempest-CreateVolumesFromSnapshotTest-517992082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:30:35 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-96ee2a5b-a141-4a23-8c59-0c91291ed583 tempest-CreateVolumesFromSnapshotTest-517992082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:30:35 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-96ee2a5b-a141-4a23-8c59-0c91291ed583 tempest-CreateVolumesFromSnapshotTest-517992082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:30:35 devstack sudo[104703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:30:35 devstack sudo[104703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:30:35 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-9d6886a4-da56-4777-b89e-7c4c756db70d tempest-CreateVolumesFromSnapshotTest-517992082 None] Acquiring lock "cinder-9f531445-c0ad-452d-a0aa-5bcd5ed7ebad-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:30:35 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-9d6886a4-da56-4777-b89e-7c4c756db70d tempest-CreateVolumesFromSnapshotTest-517992082 None] Lock "cinder-9f531445-c0ad-452d-a0aa-5bcd5ed7ebad-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:30:36 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-9d6886a4-da56-4777-b89e-7c4c756db70d tempest-CreateVolumesFromSnapshotTest-517992082 None] Acquiring lock "cinder-quobyte-9f531445-c0ad-452d-a0aa-5bcd5ed7ebad" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:30:36 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-9d6886a4-da56-4777-b89e-7c4c756db70d tempest-CreateVolumesFromSnapshotTest-517992082 None] Lock "cinder-quobyte-9f531445-c0ad-452d-a0aa-5bcd5ed7ebad" acquired by "delete_volume" :: waited 0.032s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:30:36 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[529bd22e-10ae-46a5-9891-32e9879ea946]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:30:36 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-9d6886a4-da56-4777-b89e-7c4c756db70d tempest-CreateVolumesFromSnapshotTest-517992082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-9f531445-c0ad-452d-a0aa-5bcd5ed7ebad {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:30:36 devstack sudo[104703]: pam_unix(sudo:session): session closed for user root Nov 04 10:30:36 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-96ee2a5b-a141-4a23-8c59-0c91291ed583 tempest-CreateVolumesFromSnapshotTest-517992082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.324s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:30:36 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-96ee2a5b-a141-4a23-8c59-0c91291ed583 tempest-CreateVolumesFromSnapshotTest-517992082 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:30:36 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-96ee2a5b-a141-4a23-8c59-0c91291ed583 tempest-CreateVolumesFromSnapshotTest-517992082 None] Deleted volume successfully. Nov 04 10:30:36 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-96ee2a5b-a141-4a23-8c59-0c91291ed583 tempest-CreateVolumesFromSnapshotTest-517992082 None] Lock "cinder-bc8662b0-81d6-44fc-9e8c-65201c7e5324-delete_volume" released by "delete_volume" :: held 1.535s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:30:36 devstack sudo[104705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-9f531445-c0ad-452d-a0aa-5bcd5ed7ebad Nov 04 10:30:36 devstack sudo[104705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:30:36 devstack sudo[104705]: pam_unix(sudo:session): session closed for user root Nov 04 10:30:36 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-9d6886a4-da56-4777-b89e-7c4c756db70d tempest-CreateVolumesFromSnapshotTest-517992082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-9f531445-c0ad-452d-a0aa-5bcd5ed7ebad" returned: 0 in 0.535s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:30:36 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-9d6886a4-da56-4777-b89e-7c4c756db70d tempest-CreateVolumesFromSnapshotTest-517992082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-9f531445-c0ad-452d-a0aa-5bcd5ed7ebad {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:30:36 devstack sudo[104712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-9f531445-c0ad-452d-a0aa-5bcd5ed7ebad Nov 04 10:30:36 devstack sudo[104712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:30:36 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-46d3704c-9991-4e5b-8dca-e287ed673bc6 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:30:36 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-46d3704c-9991-4e5b-8dca-e287ed673bc6 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Flow 'volume_create_manager' (d7cfd5ce-fb1d-4650-86f7-4ff4d828005c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:30:36 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-46d3704c-9991-4e5b-8dca-e287ed673bc6 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b70bfec-b0dc-44e1-b8b0-e5b76f0cabd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:30:36 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-46d3704c-9991-4e5b-8dca-e287ed673bc6 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b70bfec-b0dc-44e1-b8b0-e5b76f0cabd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:30:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-35966234',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4de85265-35b3-417b-b070-8b54045efc18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5c02bf7833f4b91847a255f765e88bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:30:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:30:37Z,use_quota=True,user_id='98962634ce7444d982243799290fcd0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:30:36 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-46d3704c-9991-4e5b-8dca-e287ed673bc6 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a22e1ecb-e9c2-4de5-938c-3607b4403c58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:30:36 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-46d3704c-9991-4e5b-8dca-e287ed673bc6 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a22e1ecb-e9c2-4de5-938c-3607b4403c58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:30:36 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-46d3704c-9991-4e5b-8dca-e287ed673bc6 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4e7c96a-0490-47b8-a0a9-bfe49a2a2317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:30:36 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-46d3704c-9991-4e5b-8dca-e287ed673bc6 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4e7c96a-0490-47b8-a0a9-bfe49a2a2317) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4de85265-35b3-417b-b070-8b54045efc18', 'volume_name': 'volume-4de85265-35b3-417b-b070-8b54045efc18', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:30:36 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-46d3704c-9991-4e5b-8dca-e287ed673bc6 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf6bf7e3-6b49-46ce-aa10-a9f0509655b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:30:36 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-46d3704c-9991-4e5b-8dca-e287ed673bc6 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf6bf7e3-6b49-46ce-aa10-a9f0509655b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:30:36 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-46d3704c-9991-4e5b-8dca-e287ed673bc6 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1837b30-6bb9-447a-81c6-07e8525372b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:30:36 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-46d3704c-9991-4e5b-8dca-e287ed673bc6 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Volume 4de85265-35b3-417b-b070-8b54045efc18: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4de85265-35b3-417b-b070-8b54045efc18', 'volume_size': 1} Nov 04 10:30:36 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-46d3704c-9991-4e5b-8dca-e287ed673bc6 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:30:36 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-46d3704c-9991-4e5b-8dca-e287ed673bc6 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:30:36 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-46d3704c-9991-4e5b-8dca-e287ed673bc6 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:30:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-35966234',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4de85265-35b3-417b-b070-8b54045efc18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5c02bf7833f4b91847a255f765e88bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:30:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:30:37Z,use_quota=True,user_id='98962634ce7444d982243799290fcd0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 10:30:36 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-46d3704c-9991-4e5b-8dca-e287ed673bc6 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Creating volume 4de85265-35b3-417b-b070-8b54045efc18 {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:30:36 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-46d3704c-9991-4e5b-8dca-e287ed673bc6 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:30:36 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-46d3704c-9991-4e5b-8dca-e287ed673bc6 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:30:36 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-46d3704c-9991-4e5b-8dca-e287ed673bc6 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:30:36 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-46d3704c-9991-4e5b-8dca-e287ed673bc6 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:30:36 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-46d3704c-9991-4e5b-8dca-e287ed673bc6 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:30:36 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-46d3704c-9991-4e5b-8dca-e287ed673bc6 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Selected osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:30:36 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-46d3704c-9991-4e5b-8dca-e287ed673bc6 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] casted to osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 Nov 04 10:30:36 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-46d3704c-9991-4e5b-8dca-e287ed673bc6 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-4de85265-35b3-417b-b070-8b54045efc18 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:30:36 devstack sudo[104714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-4de85265-35b3-417b-b070-8b54045efc18 1073741824 Nov 04 10:30:36 devstack sudo[104714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:30:36 devstack sudo[104712]: pam_unix(sudo:session): session closed for user root Nov 04 10:30:36 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-9d6886a4-da56-4777-b89e-7c4c756db70d tempest-CreateVolumesFromSnapshotTest-517992082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-9f531445-c0ad-452d-a0aa-5bcd5ed7ebad" returned: 0 in 0.295s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:30:36 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-9d6886a4-da56-4777-b89e-7c4c756db70d tempest-CreateVolumesFromSnapshotTest-517992082 None] Lock "cinder-quobyte-9f531445-c0ad-452d-a0aa-5bcd5ed7ebad" released by "delete_volume" :: held 0.902s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:30:37 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-9d6886a4-da56-4777-b89e-7c4c756db70d tempest-CreateVolumesFromSnapshotTest-517992082 None] Created reservations ['62bd208e-56ff-4197-aa22-f3d8fa3f81ae', '41df6da5-97ff-4c20-b906-5738833fb9b6', '0bd9d49d-f9fc-4398-8ad6-2e4e9ddde2f5', 'bd113f1b-2592-46a7-852d-9482a4c9eda7'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:30:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-9d6886a4-da56-4777-b89e-7c4c756db70d tempest-CreateVolumesFromSnapshotTest-517992082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:30:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-9d6886a4-da56-4777-b89e-7c4c756db70d tempest-CreateVolumesFromSnapshotTest-517992082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:30:37 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-9d6886a4-da56-4777-b89e-7c4c756db70d tempest-CreateVolumesFromSnapshotTest-517992082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:30:37 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-9d6886a4-da56-4777-b89e-7c4c756db70d tempest-CreateVolumesFromSnapshotTest-517992082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:30:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-9d6886a4-da56-4777-b89e-7c4c756db70d tempest-CreateVolumesFromSnapshotTest-517992082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:30:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-9d6886a4-da56-4777-b89e-7c4c756db70d tempest-CreateVolumesFromSnapshotTest-517992082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:30:37 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-bf72bcfa-cfc1-427d-9a1d-caadaed04917 tempest-CreateVolumesFromSnapshotTest-517992082 None] Acquiring lock "cinder-55acf56f-bf3f-4e60-af9f-8256135e33b0-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:30:37 devstack sudo[104720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:30:37 devstack sudo[104720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:30:37 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-bf72bcfa-cfc1-427d-9a1d-caadaed04917 tempest-CreateVolumesFromSnapshotTest-517992082 None] Lock "cinder-55acf56f-bf3f-4e60-af9f-8256135e33b0-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:30:37 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-bf72bcfa-cfc1-427d-9a1d-caadaed04917 tempest-CreateVolumesFromSnapshotTest-517992082 None] Acquiring lock "cinder-quobyte-55acf56f-bf3f-4e60-af9f-8256135e33b0" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:30:37 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-bf72bcfa-cfc1-427d-9a1d-caadaed04917 tempest-CreateVolumesFromSnapshotTest-517992082 None] Lock "cinder-quobyte-55acf56f-bf3f-4e60-af9f-8256135e33b0" acquired by "delete_volume" :: waited 0.023s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:30:37 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[786d544e-d63a-4c87-a5f7-8a98389039e6]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:30:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-bf72bcfa-cfc1-427d-9a1d-caadaed04917 tempest-CreateVolumesFromSnapshotTest-517992082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-55acf56f-bf3f-4e60-af9f-8256135e33b0 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:30:37 devstack sudo[104714]: pam_unix(sudo:session): session closed for user root Nov 04 10:30:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-46d3704c-9991-4e5b-8dca-e287ed673bc6 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-4de85265-35b3-417b-b070-8b54045efc18 1073741824" returned: 0 in 0.612s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:30:37 devstack sudo[104722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-55acf56f-bf3f-4e60-af9f-8256135e33b0 Nov 04 10:30:37 devstack sudo[104722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:30:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-46d3704c-9991-4e5b-8dca-e287ed673bc6 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-4de85265-35b3-417b-b070-8b54045efc18 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:30:37 devstack sudo[104724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-4de85265-35b3-417b-b070-8b54045efc18 Nov 04 10:30:37 devstack sudo[104724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:30:37 devstack sudo[104720]: pam_unix(sudo:session): session closed for user root Nov 04 10:30:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-9d6886a4-da56-4777-b89e-7c4c756db70d tempest-CreateVolumesFromSnapshotTest-517992082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.553s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:30:37 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-9d6886a4-da56-4777-b89e-7c4c756db70d tempest-CreateVolumesFromSnapshotTest-517992082 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:30:37 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-9d6886a4-da56-4777-b89e-7c4c756db70d tempest-CreateVolumesFromSnapshotTest-517992082 None] Deleted volume successfully. Nov 04 10:30:37 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-9d6886a4-da56-4777-b89e-7c4c756db70d tempest-CreateVolumesFromSnapshotTest-517992082 None] Lock "cinder-9f531445-c0ad-452d-a0aa-5bcd5ed7ebad-delete_volume" released by "delete_volume" :: held 1.786s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:30:37 devstack sudo[104724]: pam_unix(sudo:session): session closed for user root Nov 04 10:30:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-46d3704c-9991-4e5b-8dca-e287ed673bc6 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-4de85265-35b3-417b-b070-8b54045efc18" returned: 0 in 0.301s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:30:37 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-46d3704c-9991-4e5b-8dca-e287ed673bc6 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] <== create_volume: return (1013ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 10:30:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-46d3704c-9991-4e5b-8dca-e287ed673bc6 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.017s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:30:37 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-46d3704c-9991-4e5b-8dca-e287ed673bc6 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1837b30-6bb9-447a-81c6-07e8525372b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4de85265-35b3-417b-b070-8b54045efc18', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:30:37 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-46d3704c-9991-4e5b-8dca-e287ed673bc6 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db782b36-2724-4bbd-8f38-188a71265566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:30:37 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-46d3704c-9991-4e5b-8dca-e287ed673bc6 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Volume volume-4de85265-35b3-417b-b070-8b54045efc18 (4de85265-35b3-417b-b070-8b54045efc18): created successfully Nov 04 10:30:37 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-46d3704c-9991-4e5b-8dca-e287ed673bc6 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db782b36-2724-4bbd-8f38-188a71265566) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:30:37 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-46d3704c-9991-4e5b-8dca-e287ed673bc6 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Flow 'volume_create_manager' (d7cfd5ce-fb1d-4650-86f7-4ff4d828005c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:30:37 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-46d3704c-9991-4e5b-8dca-e287ed673bc6 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Created volume successfully. Nov 04 10:30:37 devstack sudo[104722]: pam_unix(sudo:session): session closed for user root Nov 04 10:30:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-bf72bcfa-cfc1-427d-9a1d-caadaed04917 tempest-CreateVolumesFromSnapshotTest-517992082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-55acf56f-bf3f-4e60-af9f-8256135e33b0" returned: 0 in 0.567s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:30:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-bf72bcfa-cfc1-427d-9a1d-caadaed04917 tempest-CreateVolumesFromSnapshotTest-517992082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-55acf56f-bf3f-4e60-af9f-8256135e33b0 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:30:37 devstack sudo[104731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-55acf56f-bf3f-4e60-af9f-8256135e33b0 Nov 04 10:30:37 devstack sudo[104731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:30:38 devstack sudo[104731]: pam_unix(sudo:session): session closed for user root Nov 04 10:30:38 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-bf72bcfa-cfc1-427d-9a1d-caadaed04917 tempest-CreateVolumesFromSnapshotTest-517992082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-55acf56f-bf3f-4e60-af9f-8256135e33b0" returned: 0 in 0.279s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:30:38 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-bf72bcfa-cfc1-427d-9a1d-caadaed04917 tempest-CreateVolumesFromSnapshotTest-517992082 None] Lock "cinder-quobyte-55acf56f-bf3f-4e60-af9f-8256135e33b0" released by "delete_volume" :: held 0.919s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:30:38 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-bf72bcfa-cfc1-427d-9a1d-caadaed04917 tempest-CreateVolumesFromSnapshotTest-517992082 None] Created reservations ['b34f9c3c-9eb0-42a0-9fc6-4ecefb51521f', '0d3c92fe-abc7-4e87-a747-16080051f3b4', '8af2b692-fd65-4d73-85e5-2230c933b11d', '220ff6ea-c48f-44ad-b5eb-97583c5df788'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:30:38 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-bf72bcfa-cfc1-427d-9a1d-caadaed04917 tempest-CreateVolumesFromSnapshotTest-517992082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:30:38 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-bf72bcfa-cfc1-427d-9a1d-caadaed04917 tempest-CreateVolumesFromSnapshotTest-517992082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:30:38 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-bf72bcfa-cfc1-427d-9a1d-caadaed04917 tempest-CreateVolumesFromSnapshotTest-517992082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:30:38 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-bf72bcfa-cfc1-427d-9a1d-caadaed04917 tempest-CreateVolumesFromSnapshotTest-517992082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:30:38 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-bf72bcfa-cfc1-427d-9a1d-caadaed04917 tempest-CreateVolumesFromSnapshotTest-517992082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:30:38 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-bf72bcfa-cfc1-427d-9a1d-caadaed04917 tempest-CreateVolumesFromSnapshotTest-517992082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:30:38 devstack sudo[104734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:30:38 devstack sudo[104734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:30:38 devstack sudo[104734]: pam_unix(sudo:session): session closed for user root Nov 04 10:30:38 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-bf72bcfa-cfc1-427d-9a1d-caadaed04917 tempest-CreateVolumesFromSnapshotTest-517992082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.243s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:30:38 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-bf72bcfa-cfc1-427d-9a1d-caadaed04917 tempest-CreateVolumesFromSnapshotTest-517992082 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:30:38 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-bf72bcfa-cfc1-427d-9a1d-caadaed04917 tempest-CreateVolumesFromSnapshotTest-517992082 None] Deleted volume successfully. Nov 04 10:30:38 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-bf72bcfa-cfc1-427d-9a1d-caadaed04917 tempest-CreateVolumesFromSnapshotTest-517992082 None] Lock "cinder-55acf56f-bf3f-4e60-af9f-8256135e33b0-delete_volume" released by "delete_volume" :: held 1.443s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:30:39 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f1b2b08-f89b-49f8-9e32-4c5560befef9 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:30:39 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-2f1b2b08-f89b-49f8-9e32-4c5560befef9 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Flow 'volume_create_manager' (e7534978-b23f-4563-8d1e-a13efae3fc42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:30:39 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-2f1b2b08-f89b-49f8-9e32-4c5560befef9 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (512d0a45-57f7-4232-a106-c27e276b8f91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:30:39 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-2f1b2b08-f89b-49f8-9e32-4c5560befef9 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (512d0a45-57f7-4232-a106-c27e276b8f91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:30:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1303695046',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=062023ed-ca0c-4192-bfe1-1d2b5b2da3da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5c02bf7833f4b91847a255f765e88bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:30:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:30:39Z,use_quota=True,user_id='98962634ce7444d982243799290fcd0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:30:39 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-2f1b2b08-f89b-49f8-9e32-4c5560befef9 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fb8deeb-132e-4031-8f79-661940fafc5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:30:39 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-2f1b2b08-f89b-49f8-9e32-4c5560befef9 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fb8deeb-132e-4031-8f79-661940fafc5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:30:39 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-2f1b2b08-f89b-49f8-9e32-4c5560befef9 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35cb043b-27fe-4049-882b-1334f4472eca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:30:39 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-2f1b2b08-f89b-49f8-9e32-4c5560befef9 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35cb043b-27fe-4049-882b-1334f4472eca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '062023ed-ca0c-4192-bfe1-1d2b5b2da3da', 'volume_name': 'volume-062023ed-ca0c-4192-bfe1-1d2b5b2da3da', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:30:39 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-2f1b2b08-f89b-49f8-9e32-4c5560befef9 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5bee931-552f-4598-9544-c742d87f8ba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:30:39 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-2f1b2b08-f89b-49f8-9e32-4c5560befef9 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5bee931-552f-4598-9544-c742d87f8ba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:30:39 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-2f1b2b08-f89b-49f8-9e32-4c5560befef9 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb40a5d4-359b-4fdc-b87d-64a27ca55c3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:30:39 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-2f1b2b08-f89b-49f8-9e32-4c5560befef9 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Volume 062023ed-ca0c-4192-bfe1-1d2b5b2da3da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-062023ed-ca0c-4192-bfe1-1d2b5b2da3da', 'volume_size': 1} Nov 04 10:30:39 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-2f1b2b08-f89b-49f8-9e32-4c5560befef9 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:30:39 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-2f1b2b08-f89b-49f8-9e32-4c5560befef9 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:30:39 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-2f1b2b08-f89b-49f8-9e32-4c5560befef9 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:30:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1303695046',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=062023ed-ca0c-4192-bfe1-1d2b5b2da3da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5c02bf7833f4b91847a255f765e88bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:30:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:30:39Z,use_quota=True,user_id='98962634ce7444d982243799290fcd0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 10:30:39 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-2f1b2b08-f89b-49f8-9e32-4c5560befef9 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Creating volume 062023ed-ca0c-4192-bfe1-1d2b5b2da3da {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:30:39 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-2f1b2b08-f89b-49f8-9e32-4c5560befef9 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:30:39 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-2f1b2b08-f89b-49f8-9e32-4c5560befef9 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:30:39 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-2f1b2b08-f89b-49f8-9e32-4c5560befef9 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:30:39 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-2f1b2b08-f89b-49f8-9e32-4c5560befef9 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:30:39 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-2f1b2b08-f89b-49f8-9e32-4c5560befef9 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:30:39 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-2f1b2b08-f89b-49f8-9e32-4c5560befef9 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Selected osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:30:39 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-2f1b2b08-f89b-49f8-9e32-4c5560befef9 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] casted to osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 Nov 04 10:30:39 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-2f1b2b08-f89b-49f8-9e32-4c5560befef9 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-062023ed-ca0c-4192-bfe1-1d2b5b2da3da 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:30:39 devstack sudo[104737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-062023ed-ca0c-4192-bfe1-1d2b5b2da3da 1073741824 Nov 04 10:30:39 devstack sudo[104737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:30:39 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-99b6ab2d-f5a0-4e78-b1fb-16bc682533a7 tempest-CreateVolumesFromSnapshotTest-517992082 None] Acquiring lock "cinder-04d9e646-36e0-4f6e-a9b4-0e7cb5e2b991-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:30:39 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-99b6ab2d-f5a0-4e78-b1fb-16bc682533a7 tempest-CreateVolumesFromSnapshotTest-517992082 None] Lock "cinder-04d9e646-36e0-4f6e-a9b4-0e7cb5e2b991-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:30:39 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-99b6ab2d-f5a0-4e78-b1fb-16bc682533a7 tempest-CreateVolumesFromSnapshotTest-517992082 None] Acquiring lock "cinder-quobyte-04d9e646-36e0-4f6e-a9b4-0e7cb5e2b991" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:30:39 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-99b6ab2d-f5a0-4e78-b1fb-16bc682533a7 tempest-CreateVolumesFromSnapshotTest-517992082 None] Lock "cinder-quobyte-04d9e646-36e0-4f6e-a9b4-0e7cb5e2b991" acquired by "delete_volume" :: waited 0.030s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:30:39 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-7398c0d5-776a-4bbb-a846-5f45579232f4 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:30:39 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7398c0d5-776a-4bbb-a846-5f45579232f4 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Flow 'volume_create_manager' (284ad0f4-5415-41de-b836-fb42ea526109) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:30:39 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7398c0d5-776a-4bbb-a846-5f45579232f4 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed40b968-4ea4-4794-887a-0454398ee959) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:30:39 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9d6ed33-4562-4875-8f82-6a9c638c8400]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:30:39 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-99b6ab2d-f5a0-4e78-b1fb-16bc682533a7 tempest-CreateVolumesFromSnapshotTest-517992082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-04d9e646-36e0-4f6e-a9b4-0e7cb5e2b991 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:30:39 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7398c0d5-776a-4bbb-a846-5f45579232f4 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed40b968-4ea4-4794-887a-0454398ee959) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:30:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-411903469',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=849a54e4-ec92-4a0d-8e2f-cacd81b33a9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5c02bf7833f4b91847a255f765e88bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:30:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:30:40Z,use_quota=True,user_id='98962634ce7444d982243799290fcd0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:30:39 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7398c0d5-776a-4bbb-a846-5f45579232f4 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (532f67ce-28fa-4f8e-849e-310167c01781) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:30:39 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7398c0d5-776a-4bbb-a846-5f45579232f4 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (532f67ce-28fa-4f8e-849e-310167c01781) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:30:39 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7398c0d5-776a-4bbb-a846-5f45579232f4 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11f575d3-422a-4db9-b8fd-64645f0b31e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:30:39 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7398c0d5-776a-4bbb-a846-5f45579232f4 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11f575d3-422a-4db9-b8fd-64645f0b31e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '849a54e4-ec92-4a0d-8e2f-cacd81b33a9e', 'volume_name': 'volume-849a54e4-ec92-4a0d-8e2f-cacd81b33a9e', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:30:39 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7398c0d5-776a-4bbb-a846-5f45579232f4 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f153fbfa-4840-428b-ace2-a19135d479d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:30:39 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7398c0d5-776a-4bbb-a846-5f45579232f4 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f153fbfa-4840-428b-ace2-a19135d479d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:30:39 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7398c0d5-776a-4bbb-a846-5f45579232f4 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4e8f1db-aa49-4cb2-9504-a7c2a8dc4fe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:30:39 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-7398c0d5-776a-4bbb-a846-5f45579232f4 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Volume 849a54e4-ec92-4a0d-8e2f-cacd81b33a9e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-849a54e4-ec92-4a0d-8e2f-cacd81b33a9e', 'volume_size': 1} Nov 04 10:30:39 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-7398c0d5-776a-4bbb-a846-5f45579232f4 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:30:39 devstack sudo[104742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-04d9e646-36e0-4f6e-a9b4-0e7cb5e2b991 Nov 04 10:30:39 devstack sudo[104742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:30:40 devstack sudo[104737]: pam_unix(sudo:session): session closed for user root Nov 04 10:30:40 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-2f1b2b08-f89b-49f8-9e32-4c5560befef9 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-062023ed-ca0c-4192-bfe1-1d2b5b2da3da 1073741824" returned: 0 in 0.675s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:30:40 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-2f1b2b08-f89b-49f8-9e32-4c5560befef9 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-062023ed-ca0c-4192-bfe1-1d2b5b2da3da {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:30:40 devstack sudo[104745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-062023ed-ca0c-4192-bfe1-1d2b5b2da3da Nov 04 10:30:40 devstack sudo[104745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:30:40 devstack sudo[104745]: pam_unix(sudo:session): session closed for user root Nov 04 10:30:40 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-2f1b2b08-f89b-49f8-9e32-4c5560befef9 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-062023ed-ca0c-4192-bfe1-1d2b5b2da3da" returned: 0 in 0.347s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:30:40 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-2f1b2b08-f89b-49f8-9e32-4c5560befef9 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] <== create_volume: return (1075ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 10:30:40 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-2f1b2b08-f89b-49f8-9e32-4c5560befef9 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.078s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:30:40 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-7398c0d5-776a-4bbb-a846-5f45579232f4 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.499s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:30:40 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-7398c0d5-776a-4bbb-a846-5f45579232f4 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:30:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-411903469',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=849a54e4-ec92-4a0d-8e2f-cacd81b33a9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5c02bf7833f4b91847a255f765e88bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:30:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:30:40Z,use_quota=True,user_id='98962634ce7444d982243799290fcd0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 10:30:40 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-7398c0d5-776a-4bbb-a846-5f45579232f4 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Creating volume 849a54e4-ec92-4a0d-8e2f-cacd81b33a9e {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:30:40 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-7398c0d5-776a-4bbb-a846-5f45579232f4 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:30:40 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-7398c0d5-776a-4bbb-a846-5f45579232f4 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:30:40 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-7398c0d5-776a-4bbb-a846-5f45579232f4 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:30:40 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-7398c0d5-776a-4bbb-a846-5f45579232f4 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:30:40 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-7398c0d5-776a-4bbb-a846-5f45579232f4 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:30:40 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-7398c0d5-776a-4bbb-a846-5f45579232f4 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Selected osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:30:40 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-7398c0d5-776a-4bbb-a846-5f45579232f4 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] casted to osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 Nov 04 10:30:40 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7398c0d5-776a-4bbb-a846-5f45579232f4 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-849a54e4-ec92-4a0d-8e2f-cacd81b33a9e 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:30:40 devstack sudo[104742]: pam_unix(sudo:session): session closed for user root Nov 04 10:30:40 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-99b6ab2d-f5a0-4e78-b1fb-16bc682533a7 tempest-CreateVolumesFromSnapshotTest-517992082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-04d9e646-36e0-4f6e-a9b4-0e7cb5e2b991" returned: 0 in 0.713s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:30:40 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-99b6ab2d-f5a0-4e78-b1fb-16bc682533a7 tempest-CreateVolumesFromSnapshotTest-517992082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-04d9e646-36e0-4f6e-a9b4-0e7cb5e2b991 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:30:40 devstack sudo[104751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-849a54e4-ec92-4a0d-8e2f-cacd81b33a9e 1073741824 Nov 04 10:30:40 devstack sudo[104751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:30:40 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-2f1b2b08-f89b-49f8-9e32-4c5560befef9 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb40a5d4-359b-4fdc-b87d-64a27ca55c3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-062023ed-ca0c-4192-bfe1-1d2b5b2da3da', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:30:40 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-2f1b2b08-f89b-49f8-9e32-4c5560befef9 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1be121bd-ff5f-4c12-98f2-81d6700645d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:30:40 devstack sudo[104752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-04d9e646-36e0-4f6e-a9b4-0e7cb5e2b991 Nov 04 10:30:40 devstack sudo[104752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:30:40 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb97ab08-f9c9-4da7-b7e6-63ebd69f562f tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:30:40 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-bb97ab08-f9c9-4da7-b7e6-63ebd69f562f tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Flow 'volume_create_manager' (98ba556b-c785-4222-90ed-e10817d4adac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:30:40 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-bb97ab08-f9c9-4da7-b7e6-63ebd69f562f tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9267c5b7-986b-4fb5-a2b7-537c1fe7a0a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:30:40 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-2f1b2b08-f89b-49f8-9e32-4c5560befef9 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Volume volume-062023ed-ca0c-4192-bfe1-1d2b5b2da3da (062023ed-ca0c-4192-bfe1-1d2b5b2da3da): created successfully Nov 04 10:30:40 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-2f1b2b08-f89b-49f8-9e32-4c5560befef9 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1be121bd-ff5f-4c12-98f2-81d6700645d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:30:40 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-2f1b2b08-f89b-49f8-9e32-4c5560befef9 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Flow 'volume_create_manager' (e7534978-b23f-4563-8d1e-a13efae3fc42) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:30:40 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-bb97ab08-f9c9-4da7-b7e6-63ebd69f562f tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9267c5b7-986b-4fb5-a2b7-537c1fe7a0a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:30:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-194514262',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6929a189-9d62-480b-af5e-1d435e0515f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5c02bf7833f4b91847a255f765e88bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:30:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:30:40Z,use_quota=True,user_id='98962634ce7444d982243799290fcd0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:30:40 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-bb97ab08-f9c9-4da7-b7e6-63ebd69f562f tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fe7ab15-9776-4dc5-a62c-f21a0d95dc65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:30:40 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-bb97ab08-f9c9-4da7-b7e6-63ebd69f562f tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fe7ab15-9776-4dc5-a62c-f21a0d95dc65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:30:40 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-bb97ab08-f9c9-4da7-b7e6-63ebd69f562f tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77eb1648-b219-4f1a-af98-c18941b8354a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:30:40 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-bb97ab08-f9c9-4da7-b7e6-63ebd69f562f tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77eb1648-b219-4f1a-af98-c18941b8354a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6929a189-9d62-480b-af5e-1d435e0515f6', 'volume_name': 'volume-6929a189-9d62-480b-af5e-1d435e0515f6', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:30:40 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-bb97ab08-f9c9-4da7-b7e6-63ebd69f562f tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72155b4c-098b-4eac-8548-b515e54f435c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:30:40 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-bb97ab08-f9c9-4da7-b7e6-63ebd69f562f tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72155b4c-098b-4eac-8548-b515e54f435c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:30:40 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-bb97ab08-f9c9-4da7-b7e6-63ebd69f562f tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b4399fa-be47-4546-b327-9c9326f7fa51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:30:40 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-bb97ab08-f9c9-4da7-b7e6-63ebd69f562f tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Volume 6929a189-9d62-480b-af5e-1d435e0515f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6929a189-9d62-480b-af5e-1d435e0515f6', 'volume_size': 1} Nov 04 10:30:40 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-bb97ab08-f9c9-4da7-b7e6-63ebd69f562f tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:30:40 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-2f1b2b08-f89b-49f8-9e32-4c5560befef9 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Created volume successfully. Nov 04 10:30:41 devstack sudo[104752]: pam_unix(sudo:session): session closed for user root Nov 04 10:30:41 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-99b6ab2d-f5a0-4e78-b1fb-16bc682533a7 tempest-CreateVolumesFromSnapshotTest-517992082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-04d9e646-36e0-4f6e-a9b4-0e7cb5e2b991" returned: 0 in 0.549s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:30:41 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-99b6ab2d-f5a0-4e78-b1fb-16bc682533a7 tempest-CreateVolumesFromSnapshotTest-517992082 None] Lock "cinder-quobyte-04d9e646-36e0-4f6e-a9b4-0e7cb5e2b991" released by "delete_volume" :: held 1.356s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:30:41 devstack sudo[104751]: pam_unix(sudo:session): session closed for user root Nov 04 10:30:41 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-99b6ab2d-f5a0-4e78-b1fb-16bc682533a7 tempest-CreateVolumesFromSnapshotTest-517992082 None] Created reservations ['d50768f7-86da-4559-a46b-7c0e0d430aea', 'aac97983-6078-4b1b-b66c-4671a69b65c7', '9a2d0bf9-4488-4854-91d1-1ebf39d40135', '140e16da-7453-47cc-8dc7-5bdcb8d3d72d'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:30:41 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7398c0d5-776a-4bbb-a846-5f45579232f4 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-849a54e4-ec92-4a0d-8e2f-cacd81b33a9e 1073741824" returned: 0 in 0.702s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:30:41 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7398c0d5-776a-4bbb-a846-5f45579232f4 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-849a54e4-ec92-4a0d-8e2f-cacd81b33a9e {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:30:41 devstack sudo[104760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-849a54e4-ec92-4a0d-8e2f-cacd81b33a9e Nov 04 10:30:41 devstack sudo[104760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:30:41 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-99b6ab2d-f5a0-4e78-b1fb-16bc682533a7 tempest-CreateVolumesFromSnapshotTest-517992082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:30:41 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-99b6ab2d-f5a0-4e78-b1fb-16bc682533a7 tempest-CreateVolumesFromSnapshotTest-517992082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:30:41 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-99b6ab2d-f5a0-4e78-b1fb-16bc682533a7 tempest-CreateVolumesFromSnapshotTest-517992082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:30:41 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-99b6ab2d-f5a0-4e78-b1fb-16bc682533a7 tempest-CreateVolumesFromSnapshotTest-517992082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:30:41 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-99b6ab2d-f5a0-4e78-b1fb-16bc682533a7 tempest-CreateVolumesFromSnapshotTest-517992082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:30:41 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-99b6ab2d-f5a0-4e78-b1fb-16bc682533a7 tempest-CreateVolumesFromSnapshotTest-517992082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:30:41 devstack sudo[104762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:30:41 devstack sudo[104762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:30:41 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8363f36-fefd-43d3-ab8d-39822d7ccc53 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:30:41 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-f8363f36-fefd-43d3-ab8d-39822d7ccc53 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Flow 'volume_create_manager' (9eb171b1-7bd5-4200-9686-5f925bae26bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:30:41 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-f8363f36-fefd-43d3-ab8d-39822d7ccc53 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (653d03f0-d657-493e-8e2b-118285103916) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:30:41 devstack sudo[104760]: pam_unix(sudo:session): session closed for user root Nov 04 10:30:41 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-f8363f36-fefd-43d3-ab8d-39822d7ccc53 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (653d03f0-d657-493e-8e2b-118285103916) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:30:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1516313697',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3dc2b897-5664-47f7-9073-1849ab11518f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5c02bf7833f4b91847a255f765e88bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:30:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:30:41Z,use_quota=True,user_id='98962634ce7444d982243799290fcd0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:30:41 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-f8363f36-fefd-43d3-ab8d-39822d7ccc53 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efb76193-9535-4df9-9b6a-e751a7f66d27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:30:41 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-f8363f36-fefd-43d3-ab8d-39822d7ccc53 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efb76193-9535-4df9-9b6a-e751a7f66d27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:30:41 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-f8363f36-fefd-43d3-ab8d-39822d7ccc53 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7cdd5a7-f246-4f6f-9b48-6b02d0f882ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:30:41 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-f8363f36-fefd-43d3-ab8d-39822d7ccc53 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7cdd5a7-f246-4f6f-9b48-6b02d0f882ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3dc2b897-5664-47f7-9073-1849ab11518f', 'volume_name': 'volume-3dc2b897-5664-47f7-9073-1849ab11518f', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:30:41 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-f8363f36-fefd-43d3-ab8d-39822d7ccc53 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f59b3b4-bb67-44e8-a761-56d0eb09eab2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:30:41 devstack sudo[104762]: pam_unix(sudo:session): session closed for user root Nov 04 10:30:41 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-f8363f36-fefd-43d3-ab8d-39822d7ccc53 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f59b3b4-bb67-44e8-a761-56d0eb09eab2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:30:41 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-f8363f36-fefd-43d3-ab8d-39822d7ccc53 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (475937d1-4ad8-47b6-b264-d32cddd7f5e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:30:41 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-f8363f36-fefd-43d3-ab8d-39822d7ccc53 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Volume 3dc2b897-5664-47f7-9073-1849ab11518f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3dc2b897-5664-47f7-9073-1849ab11518f', 'volume_size': 1} Nov 04 10:30:41 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-f8363f36-fefd-43d3-ab8d-39822d7ccc53 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:30:41 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7398c0d5-776a-4bbb-a846-5f45579232f4 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-849a54e4-ec92-4a0d-8e2f-cacd81b33a9e" returned: 0 in 0.505s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:30:41 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-7398c0d5-776a-4bbb-a846-5f45579232f4 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] <== create_volume: return (1276ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 10:30:41 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-7398c0d5-776a-4bbb-a846-5f45579232f4 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.281s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:30:41 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-bb97ab08-f9c9-4da7-b7e6-63ebd69f562f tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.979s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:30:41 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-bb97ab08-f9c9-4da7-b7e6-63ebd69f562f tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:30:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-194514262',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6929a189-9d62-480b-af5e-1d435e0515f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5c02bf7833f4b91847a255f765e88bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:30:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:30:40Z,use_quota=True,user_id='98962634ce7444d982243799290fcd0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 10:30:41 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-bb97ab08-f9c9-4da7-b7e6-63ebd69f562f tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Creating volume 6929a189-9d62-480b-af5e-1d435e0515f6 {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:30:41 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-bb97ab08-f9c9-4da7-b7e6-63ebd69f562f tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:30:41 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-bb97ab08-f9c9-4da7-b7e6-63ebd69f562f tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:30:41 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-bb97ab08-f9c9-4da7-b7e6-63ebd69f562f tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:30:41 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-bb97ab08-f9c9-4da7-b7e6-63ebd69f562f tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:30:41 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-bb97ab08-f9c9-4da7-b7e6-63ebd69f562f tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:30:41 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-bb97ab08-f9c9-4da7-b7e6-63ebd69f562f tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Selected osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:30:41 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-bb97ab08-f9c9-4da7-b7e6-63ebd69f562f tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] casted to osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 Nov 04 10:30:41 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-bb97ab08-f9c9-4da7-b7e6-63ebd69f562f tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6929a189-9d62-480b-af5e-1d435e0515f6 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:30:41 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-99b6ab2d-f5a0-4e78-b1fb-16bc682533a7 tempest-CreateVolumesFromSnapshotTest-517992082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.466s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:30:41 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-99b6ab2d-f5a0-4e78-b1fb-16bc682533a7 tempest-CreateVolumesFromSnapshotTest-517992082 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:30:41 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-99b6ab2d-f5a0-4e78-b1fb-16bc682533a7 tempest-CreateVolumesFromSnapshotTest-517992082 None] Deleted volume successfully. Nov 04 10:30:41 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7398c0d5-776a-4bbb-a846-5f45579232f4 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4e8f1db-aa49-4cb2-9504-a7c2a8dc4fe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-849a54e4-ec92-4a0d-8e2f-cacd81b33a9e', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:30:41 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7398c0d5-776a-4bbb-a846-5f45579232f4 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbcacda9-83b9-477a-86e7-7744c3d2130c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:30:41 devstack sudo[104766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6929a189-9d62-480b-af5e-1d435e0515f6 1073741824 Nov 04 10:30:41 devstack sudo[104766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:30:41 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-7398c0d5-776a-4bbb-a846-5f45579232f4 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Volume volume-849a54e4-ec92-4a0d-8e2f-cacd81b33a9e (849a54e4-ec92-4a0d-8e2f-cacd81b33a9e): created successfully Nov 04 10:30:41 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7398c0d5-776a-4bbb-a846-5f45579232f4 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbcacda9-83b9-477a-86e7-7744c3d2130c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:30:41 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-7398c0d5-776a-4bbb-a846-5f45579232f4 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Flow 'volume_create_manager' (284ad0f4-5415-41de-b836-fb42ea526109) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:30:41 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-99b6ab2d-f5a0-4e78-b1fb-16bc682533a7 tempest-CreateVolumesFromSnapshotTest-517992082 None] Lock "cinder-04d9e646-36e0-4f6e-a9b4-0e7cb5e2b991-delete_volume" released by "delete_volume" :: held 2.218s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:30:41 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-7398c0d5-776a-4bbb-a846-5f45579232f4 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Created volume successfully. Nov 04 10:30:41 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae55e9a9-0a88-4673-9678-ec214b0cac54 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:30:42 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-ae55e9a9-0a88-4673-9678-ec214b0cac54 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Flow 'volume_create_manager' (03d07b57-1b32-45fc-8f74-c2bf6d644364) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:30:42 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-ae55e9a9-0a88-4673-9678-ec214b0cac54 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec79efd5-dc10-42b7-8b20-4797a57ee7b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:30:42 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-ae55e9a9-0a88-4673-9678-ec214b0cac54 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec79efd5-dc10-42b7-8b20-4797a57ee7b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:30:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-467835831',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d396912-65eb-4188-82a6-f2a051838439,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5c02bf7833f4b91847a255f765e88bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:30:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:30:42Z,use_quota=True,user_id='98962634ce7444d982243799290fcd0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:30:42 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-ae55e9a9-0a88-4673-9678-ec214b0cac54 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (662c9198-40c9-49de-a78e-56776747cf55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:30:42 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-ae55e9a9-0a88-4673-9678-ec214b0cac54 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (662c9198-40c9-49de-a78e-56776747cf55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:30:42 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-ae55e9a9-0a88-4673-9678-ec214b0cac54 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35c7c0dd-c327-498f-9672-632b247e544f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:30:42 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-ae55e9a9-0a88-4673-9678-ec214b0cac54 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35c7c0dd-c327-498f-9672-632b247e544f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d396912-65eb-4188-82a6-f2a051838439', 'volume_name': 'volume-7d396912-65eb-4188-82a6-f2a051838439', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:30:42 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-ae55e9a9-0a88-4673-9678-ec214b0cac54 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f91271d-42d7-45c2-b041-5b072c893189) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:30:42 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-ae55e9a9-0a88-4673-9678-ec214b0cac54 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f91271d-42d7-45c2-b041-5b072c893189) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:30:42 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-ae55e9a9-0a88-4673-9678-ec214b0cac54 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0b1dbea-bde2-4802-a651-afc9a67d6318) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:30:42 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-ae55e9a9-0a88-4673-9678-ec214b0cac54 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Volume 7d396912-65eb-4188-82a6-f2a051838439: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d396912-65eb-4188-82a6-f2a051838439', 'volume_size': 1} Nov 04 10:30:42 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-ae55e9a9-0a88-4673-9678-ec214b0cac54 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:30:42 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-cc19784e-0134-45f8-8c25-6f3ed05aee3a tempest-CreateVolumesFromSnapshotTest-517992082 None] Acquiring lock "cinder-5deb6274-4543-46d7-a157-ea40935512ea-delete_snapshot" by "delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:30:42 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-cc19784e-0134-45f8-8c25-6f3ed05aee3a tempest-CreateVolumesFromSnapshotTest-517992082 None] Lock "cinder-5deb6274-4543-46d7-a157-ea40935512ea-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:30:42 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-cc19784e-0134-45f8-8c25-6f3ed05aee3a tempest-CreateVolumesFromSnapshotTest-517992082 None] Acquiring lock "cinder-quobyte-57c7cbf6-588a-4ef6-b974-ae90bbd9ed87" by "delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:30:42 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-cc19784e-0134-45f8-8c25-6f3ed05aee3a tempest-CreateVolumesFromSnapshotTest-517992082 None] Lock "cinder-quobyte-57c7cbf6-588a-4ef6-b974-ae90bbd9ed87" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:30:42 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-cc19784e-0134-45f8-8c25-6f3ed05aee3a tempest-CreateVolumesFromSnapshotTest-517992082 None] Acquiring lock "cinder-quobyte-5deb6274-4543-46d7-a157-ea40935512ea" by "_delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:30:42 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-cc19784e-0134-45f8-8c25-6f3ed05aee3a tempest-CreateVolumesFromSnapshotTest-517992082 None] Lock "cinder-quobyte-5deb6274-4543-46d7-a157-ea40935512ea" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:30:42 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-cc19784e-0134-45f8-8c25-6f3ed05aee3a tempest-CreateVolumesFromSnapshotTest-517992082 None] Deleting offline snapshot 5deb6274-4543-46d7-a157-ea40935512ea of volume 57c7cbf6-588a-4ef6-b974-ae90bbd9ed87 {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 10:30:42 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-cc19784e-0134-45f8-8c25-6f3ed05aee3a tempest-CreateVolumesFromSnapshotTest-517992082 None] snapshot_file for this snap is: volume-57c7cbf6-588a-4ef6-b974-ae90bbd9ed87.5deb6274-4543-46d7-a157-ea40935512ea {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 10:30:42 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[64367c3e-5edb-4b2d-bb32-6edb939e41a6]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:30:42 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-cc19784e-0134-45f8-8c25-6f3ed05aee3a tempest-CreateVolumesFromSnapshotTest-517992082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-57c7cbf6-588a-4ef6-b974-ae90bbd9ed87.5deb6274-4543-46d7-a157-ea40935512ea {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:30:42 devstack sudo[104772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-57c7cbf6-588a-4ef6-b974-ae90bbd9ed87.5deb6274-4543-46d7-a157-ea40935512ea Nov 04 10:30:42 devstack sudo[104772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:30:42 devstack sudo[104766]: pam_unix(sudo:session): session closed for user root Nov 04 10:30:42 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-bb97ab08-f9c9-4da7-b7e6-63ebd69f562f tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6929a189-9d62-480b-af5e-1d435e0515f6 1073741824" returned: 0 in 0.670s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:30:42 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-bb97ab08-f9c9-4da7-b7e6-63ebd69f562f tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6929a189-9d62-480b-af5e-1d435e0515f6 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:30:42 devstack sudo[104774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6929a189-9d62-480b-af5e-1d435e0515f6 Nov 04 10:30:42 devstack sudo[104774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:30:42 devstack sudo[104772]: pam_unix(sudo:session): session closed for user root Nov 04 10:30:42 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-cc19784e-0134-45f8-8c25-6f3ed05aee3a tempest-CreateVolumesFromSnapshotTest-517992082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-57c7cbf6-588a-4ef6-b974-ae90bbd9ed87.5deb6274-4543-46d7-a157-ea40935512ea" returned: 0 in 0.465s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:30:42 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-cc19784e-0134-45f8-8c25-6f3ed05aee3a tempest-CreateVolumesFromSnapshotTest-517992082 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-57c7cbf6-588a-4ef6-b974-ae90bbd9ed87(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87068) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 10:30:42 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[63493960-ab71-4553-898e-9e41d329e2a3]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:30:42 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-cc19784e-0134-45f8-8c25-6f3ed05aee3a tempest-CreateVolumesFromSnapshotTest-517992082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-57c7cbf6-588a-4ef6-b974-ae90bbd9ed87 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:30:42 devstack sudo[104774]: pam_unix(sudo:session): session closed for user root Nov 04 10:30:42 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-bb97ab08-f9c9-4da7-b7e6-63ebd69f562f tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6929a189-9d62-480b-af5e-1d435e0515f6" returned: 0 in 0.358s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:30:42 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-bb97ab08-f9c9-4da7-b7e6-63ebd69f562f tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] <== create_volume: return (1097ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 10:30:42 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-bb97ab08-f9c9-4da7-b7e6-63ebd69f562f tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.101s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:30:42 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-f8363f36-fefd-43d3-ab8d-39822d7ccc53 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.113s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:30:42 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-f8363f36-fefd-43d3-ab8d-39822d7ccc53 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:30:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1516313697',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3dc2b897-5664-47f7-9073-1849ab11518f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5c02bf7833f4b91847a255f765e88bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:30:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:30:41Z,use_quota=True,user_id='98962634ce7444d982243799290fcd0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 10:30:42 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-f8363f36-fefd-43d3-ab8d-39822d7ccc53 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Creating volume 3dc2b897-5664-47f7-9073-1849ab11518f {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:30:42 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-f8363f36-fefd-43d3-ab8d-39822d7ccc53 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:30:42 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-f8363f36-fefd-43d3-ab8d-39822d7ccc53 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:30:42 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-f8363f36-fefd-43d3-ab8d-39822d7ccc53 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:30:42 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-f8363f36-fefd-43d3-ab8d-39822d7ccc53 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:30:42 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-f8363f36-fefd-43d3-ab8d-39822d7ccc53 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:30:42 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-f8363f36-fefd-43d3-ab8d-39822d7ccc53 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Selected osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:30:42 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-f8363f36-fefd-43d3-ab8d-39822d7ccc53 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] casted to osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 Nov 04 10:30:42 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f8363f36-fefd-43d3-ab8d-39822d7ccc53 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-3dc2b897-5664-47f7-9073-1849ab11518f 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:30:42 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-bb97ab08-f9c9-4da7-b7e6-63ebd69f562f tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b4399fa-be47-4546-b327-9c9326f7fa51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6929a189-9d62-480b-af5e-1d435e0515f6', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:30:42 devstack sudo[104782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-3dc2b897-5664-47f7-9073-1849ab11518f 1073741824 Nov 04 10:30:42 devstack sudo[104782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:30:42 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-bb97ab08-f9c9-4da7-b7e6-63ebd69f562f tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6838a2fc-5562-475d-a2e7-a4d58eaa16eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:30:42 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-bb97ab08-f9c9-4da7-b7e6-63ebd69f562f tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Volume volume-6929a189-9d62-480b-af5e-1d435e0515f6 (6929a189-9d62-480b-af5e-1d435e0515f6): created successfully Nov 04 10:30:42 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-bb97ab08-f9c9-4da7-b7e6-63ebd69f562f tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6838a2fc-5562-475d-a2e7-a4d58eaa16eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:30:42 devstack sudo[104781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-57c7cbf6-588a-4ef6-b974-ae90bbd9ed87 Nov 04 10:30:42 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-bb97ab08-f9c9-4da7-b7e6-63ebd69f562f tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Flow 'volume_create_manager' (98ba556b-c785-4222-90ed-e10817d4adac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:30:42 devstack sudo[104781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:30:42 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-bb97ab08-f9c9-4da7-b7e6-63ebd69f562f tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Created volume successfully. Nov 04 10:30:43 devstack sudo[104781]: pam_unix(sudo:session): session closed for user root Nov 04 10:30:43 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-cc19784e-0134-45f8-8c25-6f3ed05aee3a tempest-CreateVolumesFromSnapshotTest-517992082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-57c7cbf6-588a-4ef6-b974-ae90bbd9ed87" returned: 0 in 0.518s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:30:43 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-cc19784e-0134-45f8-8c25-6f3ed05aee3a tempest-CreateVolumesFromSnapshotTest-517992082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-57c7cbf6-588a-4ef6-b974-ae90bbd9ed87.5deb6274-4543-46d7-a157-ea40935512ea {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:30:43 devstack sudo[104793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-57c7cbf6-588a-4ef6-b974-ae90bbd9ed87.5deb6274-4543-46d7-a157-ea40935512ea Nov 04 10:30:43 devstack sudo[104793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:30:43 devstack sudo[104782]: pam_unix(sudo:session): session closed for user root Nov 04 10:30:43 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f8363f36-fefd-43d3-ab8d-39822d7ccc53 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-3dc2b897-5664-47f7-9073-1849ab11518f 1073741824" returned: 0 in 0.709s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:30:43 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f8363f36-fefd-43d3-ab8d-39822d7ccc53 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-3dc2b897-5664-47f7-9073-1849ab11518f {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:30:43 devstack sudo[104799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-3dc2b897-5664-47f7-9073-1849ab11518f Nov 04 10:30:43 devstack sudo[104799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:30:43 devstack sudo[104793]: pam_unix(sudo:session): session closed for user root Nov 04 10:30:43 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-cc19784e-0134-45f8-8c25-6f3ed05aee3a tempest-CreateVolumesFromSnapshotTest-517992082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-57c7cbf6-588a-4ef6-b974-ae90bbd9ed87.5deb6274-4543-46d7-a157-ea40935512ea" returned: 0 in 0.415s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:30:43 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-cc19784e-0134-45f8-8c25-6f3ed05aee3a tempest-CreateVolumesFromSnapshotTest-517992082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-57c7cbf6-588a-4ef6-b974-ae90bbd9ed87.5deb6274-4543-46d7-a157-ea40935512ea {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:30:43 devstack sudo[104801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-57c7cbf6-588a-4ef6-b974-ae90bbd9ed87.5deb6274-4543-46d7-a157-ea40935512ea Nov 04 10:30:43 devstack sudo[104801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:30:43 devstack sudo[104799]: pam_unix(sudo:session): session closed for user root Nov 04 10:30:43 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f8363f36-fefd-43d3-ab8d-39822d7ccc53 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-3dc2b897-5664-47f7-9073-1849ab11518f" returned: 0 in 0.256s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:30:43 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-f8363f36-fefd-43d3-ab8d-39822d7ccc53 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] <== create_volume: return (1015ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 10:30:43 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-f8363f36-fefd-43d3-ab8d-39822d7ccc53 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.020s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:30:43 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-ae55e9a9-0a88-4673-9678-ec214b0cac54 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.720s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:30:43 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-ae55e9a9-0a88-4673-9678-ec214b0cac54 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:30:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-467835831',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d396912-65eb-4188-82a6-f2a051838439,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5c02bf7833f4b91847a255f765e88bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:30:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:30:42Z,use_quota=True,user_id='98962634ce7444d982243799290fcd0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 10:30:43 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-ae55e9a9-0a88-4673-9678-ec214b0cac54 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Creating volume 7d396912-65eb-4188-82a6-f2a051838439 {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:30:43 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-ae55e9a9-0a88-4673-9678-ec214b0cac54 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:30:43 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-ae55e9a9-0a88-4673-9678-ec214b0cac54 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:30:43 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-ae55e9a9-0a88-4673-9678-ec214b0cac54 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:30:43 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-ae55e9a9-0a88-4673-9678-ec214b0cac54 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:30:43 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-ae55e9a9-0a88-4673-9678-ec214b0cac54 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:30:43 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-ae55e9a9-0a88-4673-9678-ec214b0cac54 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Selected osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:30:43 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-ae55e9a9-0a88-4673-9678-ec214b0cac54 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] casted to osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 Nov 04 10:30:43 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ae55e9a9-0a88-4673-9678-ec214b0cac54 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-7d396912-65eb-4188-82a6-f2a051838439 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:30:43 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-f8363f36-fefd-43d3-ab8d-39822d7ccc53 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (475937d1-4ad8-47b6-b264-d32cddd7f5e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3dc2b897-5664-47f7-9073-1849ab11518f', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:30:43 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-f8363f36-fefd-43d3-ab8d-39822d7ccc53 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f89902d-4106-4817-bfa8-72d5ca8ee43b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:30:43 devstack sudo[104804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-7d396912-65eb-4188-82a6-f2a051838439 1073741824 Nov 04 10:30:43 devstack sudo[104804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:30:43 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-f8363f36-fefd-43d3-ab8d-39822d7ccc53 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Volume volume-3dc2b897-5664-47f7-9073-1849ab11518f (3dc2b897-5664-47f7-9073-1849ab11518f): created successfully Nov 04 10:30:43 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-f8363f36-fefd-43d3-ab8d-39822d7ccc53 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f89902d-4106-4817-bfa8-72d5ca8ee43b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:30:43 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-f8363f36-fefd-43d3-ab8d-39822d7ccc53 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Flow 'volume_create_manager' (9eb171b1-7bd5-4200-9686-5f925bae26bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:30:43 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-f8363f36-fefd-43d3-ab8d-39822d7ccc53 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Created volume successfully. Nov 04 10:30:43 devstack sudo[104801]: pam_unix(sudo:session): session closed for user root Nov 04 10:30:43 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-cc19784e-0134-45f8-8c25-6f3ed05aee3a tempest-CreateVolumesFromSnapshotTest-517992082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-57c7cbf6-588a-4ef6-b974-ae90bbd9ed87.5deb6274-4543-46d7-a157-ea40935512ea" returned: 0 in 0.279s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:30:44 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-cc19784e-0134-45f8-8c25-6f3ed05aee3a tempest-CreateVolumesFromSnapshotTest-517992082 None] Lock "cinder-quobyte-5deb6274-4543-46d7-a157-ea40935512ea" released by "_delete_snapshot" :: held 1.828s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:30:44 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-cc19784e-0134-45f8-8c25-6f3ed05aee3a tempest-CreateVolumesFromSnapshotTest-517992082 None] Lock "cinder-quobyte-57c7cbf6-588a-4ef6-b974-ae90bbd9ed87" released by "delete_snapshot" :: held 1.853s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:30:44 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-cc19784e-0134-45f8-8c25-6f3ed05aee3a tempest-CreateVolumesFromSnapshotTest-517992082 None] Created reservations ['f4e1db3a-8e72-4fb7-a53d-26b721b44b00', '09c27d71-b2cb-4c4b-820c-6d7dfcf5a880', '215343cf-21e3-49c8-81e6-8a267b6b2e98', '37618aa5-e650-4613-90ae-849879d27638'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:30:44 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-cc19784e-0134-45f8-8c25-6f3ed05aee3a tempest-CreateVolumesFromSnapshotTest-517992082 None] Delete snapshot completed successfully. Nov 04 10:30:44 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-cc19784e-0134-45f8-8c25-6f3ed05aee3a tempest-CreateVolumesFromSnapshotTest-517992082 None] Lock "cinder-5deb6274-4543-46d7-a157-ea40935512ea-delete_snapshot" released by "delete_snapshot" :: held 2.023s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:30:44 devstack sudo[104804]: pam_unix(sudo:session): session closed for user root Nov 04 10:30:44 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ae55e9a9-0a88-4673-9678-ec214b0cac54 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-7d396912-65eb-4188-82a6-f2a051838439 1073741824" returned: 0 in 0.550s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:30:44 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ae55e9a9-0a88-4673-9678-ec214b0cac54 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-7d396912-65eb-4188-82a6-f2a051838439 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:30:44 devstack sudo[104811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-7d396912-65eb-4188-82a6-f2a051838439 Nov 04 10:30:44 devstack sudo[104811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:30:44 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-f2626816-a9b3-4b1f-866b-2554da72e687 tempest-CreateVolumesFromSnapshotTest-517992082 None] Acquiring lock "cinder-57c7cbf6-588a-4ef6-b974-ae90bbd9ed87-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:30:44 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-f2626816-a9b3-4b1f-866b-2554da72e687 tempest-CreateVolumesFromSnapshotTest-517992082 None] Lock "cinder-57c7cbf6-588a-4ef6-b974-ae90bbd9ed87-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:30:44 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-f2626816-a9b3-4b1f-866b-2554da72e687 tempest-CreateVolumesFromSnapshotTest-517992082 None] Acquiring lock "cinder-quobyte-57c7cbf6-588a-4ef6-b974-ae90bbd9ed87" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:30:44 devstack sudo[104811]: pam_unix(sudo:session): session closed for user root Nov 04 10:30:44 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-f2626816-a9b3-4b1f-866b-2554da72e687 tempest-CreateVolumesFromSnapshotTest-517992082 None] Lock "cinder-quobyte-57c7cbf6-588a-4ef6-b974-ae90bbd9ed87" acquired by "delete_volume" :: waited 0.026s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:30:44 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ae55e9a9-0a88-4673-9678-ec214b0cac54 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-7d396912-65eb-4188-82a6-f2a051838439" returned: 0 in 0.382s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:30:44 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-ae55e9a9-0a88-4673-9678-ec214b0cac54 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] <== create_volume: return (991ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 10:30:44 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-ae55e9a9-0a88-4673-9678-ec214b0cac54 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.994s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:30:44 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[adf926be-a748-4600-923e-8d5f1f9ca3ac]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:30:44 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f2626816-a9b3-4b1f-866b-2554da72e687 tempest-CreateVolumesFromSnapshotTest-517992082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-57c7cbf6-588a-4ef6-b974-ae90bbd9ed87 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:30:44 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-529f8f8b-4406-4e66-a8a4-ce4ab7d5be01 tempest-ProjectReaderTests-888867065 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:30:44 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-529f8f8b-4406-4e66-a8a4-ce4ab7d5be01 tempest-ProjectReaderTests-888867065 None] Flow 'volume_create_manager' (5fb1746c-bc11-4539-ab3e-20e0a9c43397) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:30:44 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-529f8f8b-4406-4e66-a8a4-ce4ab7d5be01 tempest-ProjectReaderTests-888867065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd87766e-5f46-4812-9bea-40e780b43cd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:30:44 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-ae55e9a9-0a88-4673-9678-ec214b0cac54 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0b1dbea-bde2-4802-a651-afc9a67d6318) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d396912-65eb-4188-82a6-f2a051838439', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:30:44 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-ae55e9a9-0a88-4673-9678-ec214b0cac54 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36826ff4-e111-4021-8557-5690aef19096) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:30:44 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-529f8f8b-4406-4e66-a8a4-ce4ab7d5be01 tempest-ProjectReaderTests-888867065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd87766e-5f46-4812-9bea-40e780b43cd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:30:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1608413987',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7cb5285-4f07-4a3c-9399-b98e0f90a31f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ceada5c21c0840989abb5a48b7006da6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:30:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:30:45Z,use_quota=True,user_id='8e11bec0815c4b9e994b7a51e248abd4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:30:44 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-529f8f8b-4406-4e66-a8a4-ce4ab7d5be01 tempest-ProjectReaderTests-888867065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee34f904-f373-4ce1-be81-2acfc2c5e426) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:30:44 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-529f8f8b-4406-4e66-a8a4-ce4ab7d5be01 tempest-ProjectReaderTests-888867065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee34f904-f373-4ce1-be81-2acfc2c5e426) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:30:44 devstack sudo[104814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-57c7cbf6-588a-4ef6-b974-ae90bbd9ed87 Nov 04 10:30:44 devstack sudo[104814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:30:44 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-529f8f8b-4406-4e66-a8a4-ce4ab7d5be01 tempest-ProjectReaderTests-888867065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6842067d-05c3-4fd8-b687-1a1b53e19bab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:30:44 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-529f8f8b-4406-4e66-a8a4-ce4ab7d5be01 tempest-ProjectReaderTests-888867065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6842067d-05c3-4fd8-b687-1a1b53e19bab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7cb5285-4f07-4a3c-9399-b98e0f90a31f', 'volume_name': 'volume-c7cb5285-4f07-4a3c-9399-b98e0f90a31f', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:30:44 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-529f8f8b-4406-4e66-a8a4-ce4ab7d5be01 tempest-ProjectReaderTests-888867065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fed00e3-3cb4-4ce8-acb0-756393870cd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:30:44 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-529f8f8b-4406-4e66-a8a4-ce4ab7d5be01 tempest-ProjectReaderTests-888867065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fed00e3-3cb4-4ce8-acb0-756393870cd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:30:44 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-529f8f8b-4406-4e66-a8a4-ce4ab7d5be01 tempest-ProjectReaderTests-888867065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32d00688-fafd-4697-9b12-127a66ba3180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:30:44 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-529f8f8b-4406-4e66-a8a4-ce4ab7d5be01 tempest-ProjectReaderTests-888867065 None] Volume c7cb5285-4f07-4a3c-9399-b98e0f90a31f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7cb5285-4f07-4a3c-9399-b98e0f90a31f', 'volume_size': 1} Nov 04 10:30:44 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-529f8f8b-4406-4e66-a8a4-ce4ab7d5be01 tempest-ProjectReaderTests-888867065 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:30:44 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-529f8f8b-4406-4e66-a8a4-ce4ab7d5be01 tempest-ProjectReaderTests-888867065 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:30:44 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-529f8f8b-4406-4e66-a8a4-ce4ab7d5be01 tempest-ProjectReaderTests-888867065 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:30:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1608413987',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7cb5285-4f07-4a3c-9399-b98e0f90a31f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ceada5c21c0840989abb5a48b7006da6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:30:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:30:45Z,use_quota=True,user_id='8e11bec0815c4b9e994b7a51e248abd4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 10:30:44 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-529f8f8b-4406-4e66-a8a4-ce4ab7d5be01 tempest-ProjectReaderTests-888867065 None] Creating volume c7cb5285-4f07-4a3c-9399-b98e0f90a31f {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:30:44 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-529f8f8b-4406-4e66-a8a4-ce4ab7d5be01 tempest-ProjectReaderTests-888867065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:30:44 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-529f8f8b-4406-4e66-a8a4-ce4ab7d5be01 tempest-ProjectReaderTests-888867065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:30:44 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-529f8f8b-4406-4e66-a8a4-ce4ab7d5be01 tempest-ProjectReaderTests-888867065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:30:44 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-529f8f8b-4406-4e66-a8a4-ce4ab7d5be01 tempest-ProjectReaderTests-888867065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:30:44 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-529f8f8b-4406-4e66-a8a4-ce4ab7d5be01 tempest-ProjectReaderTests-888867065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:30:44 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-529f8f8b-4406-4e66-a8a4-ce4ab7d5be01 tempest-ProjectReaderTests-888867065 None] Selected osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:30:44 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-529f8f8b-4406-4e66-a8a4-ce4ab7d5be01 tempest-ProjectReaderTests-888867065 None] casted to osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 Nov 04 10:30:44 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-529f8f8b-4406-4e66-a8a4-ce4ab7d5be01 tempest-ProjectReaderTests-888867065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-c7cb5285-4f07-4a3c-9399-b98e0f90a31f 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:30:44 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-ae55e9a9-0a88-4673-9678-ec214b0cac54 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Volume volume-7d396912-65eb-4188-82a6-f2a051838439 (7d396912-65eb-4188-82a6-f2a051838439): created successfully Nov 04 10:30:45 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-ae55e9a9-0a88-4673-9678-ec214b0cac54 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36826ff4-e111-4021-8557-5690aef19096) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:30:45 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-ae55e9a9-0a88-4673-9678-ec214b0cac54 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Flow 'volume_create_manager' (03d07b57-1b32-45fc-8f74-c2bf6d644364) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:30:45 devstack sudo[104816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-c7cb5285-4f07-4a3c-9399-b98e0f90a31f 1073741824 Nov 04 10:30:45 devstack sudo[104816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:30:45 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-ae55e9a9-0a88-4673-9678-ec214b0cac54 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Created volume successfully. Nov 04 10:30:45 devstack sudo[104814]: pam_unix(sudo:session): session closed for user root Nov 04 10:30:45 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f2626816-a9b3-4b1f-866b-2554da72e687 tempest-CreateVolumesFromSnapshotTest-517992082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-57c7cbf6-588a-4ef6-b974-ae90bbd9ed87" returned: 0 in 0.415s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:30:45 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f2626816-a9b3-4b1f-866b-2554da72e687 tempest-CreateVolumesFromSnapshotTest-517992082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-57c7cbf6-588a-4ef6-b974-ae90bbd9ed87 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:30:45 devstack sudo[104823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-57c7cbf6-588a-4ef6-b974-ae90bbd9ed87 Nov 04 10:30:45 devstack sudo[104823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:30:45 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-60a304a4-29cd-461f-a674-6ea174b1ebd7 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Acquiring lock "cinder-7d396912-65eb-4188-82a6-f2a051838439-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:30:45 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-60a304a4-29cd-461f-a674-6ea174b1ebd7 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Lock "cinder-7d396912-65eb-4188-82a6-f2a051838439-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:30:45 devstack sudo[104816]: pam_unix(sudo:session): session closed for user root Nov 04 10:30:45 devstack sudo[104823]: pam_unix(sudo:session): session closed for user root Nov 04 10:30:45 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-529f8f8b-4406-4e66-a8a4-ce4ab7d5be01 tempest-ProjectReaderTests-888867065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-c7cb5285-4f07-4a3c-9399-b98e0f90a31f 1073741824" returned: 0 in 0.637s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:30:45 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f2626816-a9b3-4b1f-866b-2554da72e687 tempest-CreateVolumesFromSnapshotTest-517992082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-57c7cbf6-588a-4ef6-b974-ae90bbd9ed87" returned: 0 in 0.380s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:30:45 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-f2626816-a9b3-4b1f-866b-2554da72e687 tempest-CreateVolumesFromSnapshotTest-517992082 None] Lock "cinder-quobyte-57c7cbf6-588a-4ef6-b974-ae90bbd9ed87" released by "delete_volume" :: held 0.882s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:30:45 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-60a304a4-29cd-461f-a674-6ea174b1ebd7 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Acquiring lock "cinder-quobyte-7d396912-65eb-4188-82a6-f2a051838439" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:30:45 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-529f8f8b-4406-4e66-a8a4-ce4ab7d5be01 tempest-ProjectReaderTests-888867065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-c7cb5285-4f07-4a3c-9399-b98e0f90a31f {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:30:45 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-60a304a4-29cd-461f-a674-6ea174b1ebd7 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Lock "cinder-quobyte-7d396912-65eb-4188-82a6-f2a051838439" acquired by "delete_volume" :: waited 0.030s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:30:45 devstack sudo[104828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-c7cb5285-4f07-4a3c-9399-b98e0f90a31f Nov 04 10:30:45 devstack sudo[104828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:30:45 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[d36e3123-2ca8-4693-b927-586204186519]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:30:45 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-60a304a4-29cd-461f-a674-6ea174b1ebd7 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-7d396912-65eb-4188-82a6-f2a051838439 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:30:45 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-f2626816-a9b3-4b1f-866b-2554da72e687 tempest-CreateVolumesFromSnapshotTest-517992082 None] Created reservations ['e1db5db5-9ad4-4e97-8e41-ea82ed3e2975', '461c8879-5071-473d-9478-1aec328bba3a', 'd00eb066-3046-4238-be7c-f7f9b0e04c25', 'a92c2a5d-f399-4a97-a464-d994c6feac33'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:30:45 devstack sudo[104830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-7d396912-65eb-4188-82a6-f2a051838439 Nov 04 10:30:45 devstack sudo[104830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:30:45 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-f2626816-a9b3-4b1f-866b-2554da72e687 tempest-CreateVolumesFromSnapshotTest-517992082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:30:45 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-f2626816-a9b3-4b1f-866b-2554da72e687 tempest-CreateVolumesFromSnapshotTest-517992082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:30:45 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-f2626816-a9b3-4b1f-866b-2554da72e687 tempest-CreateVolumesFromSnapshotTest-517992082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:30:45 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-f2626816-a9b3-4b1f-866b-2554da72e687 tempest-CreateVolumesFromSnapshotTest-517992082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:30:45 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-f2626816-a9b3-4b1f-866b-2554da72e687 tempest-CreateVolumesFromSnapshotTest-517992082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:30:45 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f2626816-a9b3-4b1f-866b-2554da72e687 tempest-CreateVolumesFromSnapshotTest-517992082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:30:45 devstack sudo[104832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:30:45 devstack sudo[104832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:30:46 devstack sudo[104828]: pam_unix(sudo:session): session closed for user root Nov 04 10:30:46 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-529f8f8b-4406-4e66-a8a4-ce4ab7d5be01 tempest-ProjectReaderTests-888867065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-c7cb5285-4f07-4a3c-9399-b98e0f90a31f" returned: 0 in 0.353s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:30:46 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-529f8f8b-4406-4e66-a8a4-ce4ab7d5be01 tempest-ProjectReaderTests-888867065 None] <== create_volume: return (1056ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 10:30:46 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-529f8f8b-4406-4e66-a8a4-ce4ab7d5be01 tempest-ProjectReaderTests-888867065 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.060s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:30:46 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-529f8f8b-4406-4e66-a8a4-ce4ab7d5be01 tempest-ProjectReaderTests-888867065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32d00688-fafd-4697-9b12-127a66ba3180) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7cb5285-4f07-4a3c-9399-b98e0f90a31f', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:30:46 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-529f8f8b-4406-4e66-a8a4-ce4ab7d5be01 tempest-ProjectReaderTests-888867065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d69e31b0-892b-4d22-bdc2-1d9538eabf82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:30:46 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-529f8f8b-4406-4e66-a8a4-ce4ab7d5be01 tempest-ProjectReaderTests-888867065 None] Volume volume-c7cb5285-4f07-4a3c-9399-b98e0f90a31f (c7cb5285-4f07-4a3c-9399-b98e0f90a31f): created successfully Nov 04 10:30:46 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-529f8f8b-4406-4e66-a8a4-ce4ab7d5be01 tempest-ProjectReaderTests-888867065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d69e31b0-892b-4d22-bdc2-1d9538eabf82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:30:46 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-529f8f8b-4406-4e66-a8a4-ce4ab7d5be01 tempest-ProjectReaderTests-888867065 None] Flow 'volume_create_manager' (5fb1746c-bc11-4539-ab3e-20e0a9c43397) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:30:46 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-529f8f8b-4406-4e66-a8a4-ce4ab7d5be01 tempest-ProjectReaderTests-888867065 None] Created volume successfully. Nov 04 10:30:46 devstack sudo[104830]: pam_unix(sudo:session): session closed for user root Nov 04 10:30:46 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-60a304a4-29cd-461f-a674-6ea174b1ebd7 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-7d396912-65eb-4188-82a6-f2a051838439" returned: 0 in 0.429s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:30:46 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-60a304a4-29cd-461f-a674-6ea174b1ebd7 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-7d396912-65eb-4188-82a6-f2a051838439 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:30:46 devstack sudo[104840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-7d396912-65eb-4188-82a6-f2a051838439 Nov 04 10:30:46 devstack sudo[104840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:30:46 devstack sudo[104832]: pam_unix(sudo:session): session closed for user root Nov 04 10:30:46 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f2626816-a9b3-4b1f-866b-2554da72e687 tempest-CreateVolumesFromSnapshotTest-517992082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.308s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:30:46 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-f2626816-a9b3-4b1f-866b-2554da72e687 tempest-CreateVolumesFromSnapshotTest-517992082 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:30:46 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-f2626816-a9b3-4b1f-866b-2554da72e687 tempest-CreateVolumesFromSnapshotTest-517992082 None] Deleted volume successfully. Nov 04 10:30:46 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-f2626816-a9b3-4b1f-866b-2554da72e687 tempest-CreateVolumesFromSnapshotTest-517992082 None] Lock "cinder-57c7cbf6-588a-4ef6-b974-ae90bbd9ed87-delete_volume" released by "delete_volume" :: held 1.578s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:30:46 devstack sudo[104840]: pam_unix(sudo:session): session closed for user root Nov 04 10:30:46 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-60a304a4-29cd-461f-a674-6ea174b1ebd7 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-7d396912-65eb-4188-82a6-f2a051838439" returned: 0 in 0.251s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:30:46 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-60a304a4-29cd-461f-a674-6ea174b1ebd7 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Lock "cinder-quobyte-7d396912-65eb-4188-82a6-f2a051838439" released by "delete_volume" :: held 0.760s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:30:46 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-60a304a4-29cd-461f-a674-6ea174b1ebd7 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Created reservations ['5dc6db6e-6087-4df4-9a62-acec0bf3ffe1', '89f809d7-7ba6-42e6-8540-100c8bc96840', '9f76cb43-50d4-4794-8179-2f02a3e7cbd9', '62ff7701-ed17-46f7-93c1-55dba3e1ebe5'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:30:46 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-60a304a4-29cd-461f-a674-6ea174b1ebd7 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:30:46 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-60a304a4-29cd-461f-a674-6ea174b1ebd7 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:30:46 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-60a304a4-29cd-461f-a674-6ea174b1ebd7 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:30:46 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-60a304a4-29cd-461f-a674-6ea174b1ebd7 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:30:46 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-60a304a4-29cd-461f-a674-6ea174b1ebd7 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:30:46 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-60a304a4-29cd-461f-a674-6ea174b1ebd7 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:30:46 devstack sudo[104843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:30:46 devstack sudo[104843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:30:46 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-5b707feb-e470-4a38-b671-cbf13ee1aced tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Acquiring lock "cinder-3dc2b897-5664-47f7-9073-1849ab11518f-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:30:46 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-5b707feb-e470-4a38-b671-cbf13ee1aced tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Lock "cinder-3dc2b897-5664-47f7-9073-1849ab11518f-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:30:46 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-5b707feb-e470-4a38-b671-cbf13ee1aced tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Acquiring lock "cinder-quobyte-3dc2b897-5664-47f7-9073-1849ab11518f" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:30:46 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-5b707feb-e470-4a38-b671-cbf13ee1aced tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Lock "cinder-quobyte-3dc2b897-5664-47f7-9073-1849ab11518f" acquired by "delete_volume" :: waited 0.023s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:30:46 devstack sudo[104843]: pam_unix(sudo:session): session closed for user root Nov 04 10:30:46 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f4d8bed-d1d3-4c2f-8beb-d59b56d9f09d]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:30:46 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-5b707feb-e470-4a38-b671-cbf13ee1aced tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-3dc2b897-5664-47f7-9073-1849ab11518f {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:30:46 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-60a304a4-29cd-461f-a674-6ea174b1ebd7 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.279s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:30:46 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-60a304a4-29cd-461f-a674-6ea174b1ebd7 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:30:46 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-60a304a4-29cd-461f-a674-6ea174b1ebd7 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Deleted volume successfully. Nov 04 10:30:46 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-60a304a4-29cd-461f-a674-6ea174b1ebd7 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Lock "cinder-7d396912-65eb-4188-82a6-f2a051838439-delete_volume" released by "delete_volume" :: held 1.351s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:30:47 devstack sudo[104846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-3dc2b897-5664-47f7-9073-1849ab11518f Nov 04 10:30:47 devstack sudo[104846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:30:47 devstack sudo[104846]: pam_unix(sudo:session): session closed for user root Nov 04 10:30:47 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-5b707feb-e470-4a38-b671-cbf13ee1aced tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-3dc2b897-5664-47f7-9073-1849ab11518f" returned: 0 in 0.437s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:30:47 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-5b707feb-e470-4a38-b671-cbf13ee1aced tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-3dc2b897-5664-47f7-9073-1849ab11518f {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:30:47 devstack sudo[104854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-3dc2b897-5664-47f7-9073-1849ab11518f Nov 04 10:30:47 devstack sudo[104854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:30:47 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-ac202dec-87a0-4697-8e6a-eb6310f6f45e tempest-ProjectReaderTests-888867065 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:30:47 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-ac202dec-87a0-4697-8e6a-eb6310f6f45e tempest-ProjectReaderTests-888867065 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:30:47 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-ac202dec-87a0-4697-8e6a-eb6310f6f45e tempest-ProjectReaderTests-888867065 None] Creating offline snapshot 791b5eff-4a38-48bb-b63e-70cff6394d56 of volume c7cb5285-4f07-4a3c-9399-b98e0f90a31f {{(pid=87068) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 10:30:47 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[6efa3bf4-1059-4802-aa51-1820222020b3]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:30:47 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ac202dec-87a0-4697-8e6a-eb6310f6f45e tempest-ProjectReaderTests-888867065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-c7cb5285-4f07-4a3c-9399-b98e0f90a31f {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:30:47 devstack sudo[104893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-c7cb5285-4f07-4a3c-9399-b98e0f90a31f Nov 04 10:30:47 devstack sudo[104893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:30:47 devstack sudo[104854]: pam_unix(sudo:session): session closed for user root Nov 04 10:30:47 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-5b707feb-e470-4a38-b671-cbf13ee1aced tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-3dc2b897-5664-47f7-9073-1849ab11518f" returned: 0 in 0.419s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:30:47 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-5b707feb-e470-4a38-b671-cbf13ee1aced tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Lock "cinder-quobyte-3dc2b897-5664-47f7-9073-1849ab11518f" released by "delete_volume" :: held 0.920s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:30:47 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-5b707feb-e470-4a38-b671-cbf13ee1aced tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Created reservations ['44dc5dc5-70a9-4bfa-b0f5-19e215fda9ef', '5820499c-3436-41e2-b1fd-a170b19a556c', '1d820761-1b5a-418f-b390-5ce25cc8e0f9', 'fe97f522-ecef-4e00-9c02-43d7b6706bc6'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:30:47 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-5b707feb-e470-4a38-b671-cbf13ee1aced tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:30:47 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-5b707feb-e470-4a38-b671-cbf13ee1aced tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:30:47 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-5b707feb-e470-4a38-b671-cbf13ee1aced tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:30:47 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-5b707feb-e470-4a38-b671-cbf13ee1aced tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:30:47 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-5b707feb-e470-4a38-b671-cbf13ee1aced tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:30:47 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-5b707feb-e470-4a38-b671-cbf13ee1aced tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:30:47 devstack sudo[104898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:30:47 devstack sudo[104898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:30:48 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-684cbef6-92a2-42a8-a8ec-10bfead14619 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Acquiring lock "cinder-6929a189-9d62-480b-af5e-1d435e0515f6-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:30:48 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-684cbef6-92a2-42a8-a8ec-10bfead14619 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Lock "cinder-6929a189-9d62-480b-af5e-1d435e0515f6-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:30:48 devstack sudo[104893]: pam_unix(sudo:session): session closed for user root Nov 04 10:30:48 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ac202dec-87a0-4697-8e6a-eb6310f6f45e tempest-ProjectReaderTests-888867065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-c7cb5285-4f07-4a3c-9399-b98e0f90a31f" returned: 0 in 0.598s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:30:48 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ac202dec-87a0-4697-8e6a-eb6310f6f45e tempest-ProjectReaderTests-888867065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-c7cb5285-4f07-4a3c-9399-b98e0f90a31f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-c7cb5285-4f07-4a3c-9399-b98e0f90a31f.791b5eff-4a38-48bb-b63e-70cff6394d56 1G {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:30:48 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-684cbef6-92a2-42a8-a8ec-10bfead14619 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Acquiring lock "cinder-quobyte-6929a189-9d62-480b-af5e-1d435e0515f6" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:30:48 devstack sudo[104903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-c7cb5285-4f07-4a3c-9399-b98e0f90a31f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-c7cb5285-4f07-4a3c-9399-b98e0f90a31f.791b5eff-4a38-48bb-b63e-70cff6394d56 1G Nov 04 10:30:48 devstack sudo[104903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:30:48 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-684cbef6-92a2-42a8-a8ec-10bfead14619 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Lock "cinder-quobyte-6929a189-9d62-480b-af5e-1d435e0515f6" acquired by "delete_volume" :: waited 0.025s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:30:48 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[e159c185-cef3-40f5-b43c-8f544e721892]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:30:48 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-684cbef6-92a2-42a8-a8ec-10bfead14619 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6929a189-9d62-480b-af5e-1d435e0515f6 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:30:48 devstack sudo[104898]: pam_unix(sudo:session): session closed for user root Nov 04 10:30:48 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-5b707feb-e470-4a38-b671-cbf13ee1aced tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.352s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:30:48 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-5b707feb-e470-4a38-b671-cbf13ee1aced tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:30:48 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-5b707feb-e470-4a38-b671-cbf13ee1aced tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Deleted volume successfully. Nov 04 10:30:48 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-5b707feb-e470-4a38-b671-cbf13ee1aced tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Lock "cinder-3dc2b897-5664-47f7-9073-1849ab11518f-delete_volume" released by "delete_volume" :: held 1.628s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:30:48 devstack sudo[104906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6929a189-9d62-480b-af5e-1d435e0515f6 Nov 04 10:30:48 devstack sudo[104906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:30:48 devstack sudo[104906]: pam_unix(sudo:session): session closed for user root Nov 04 10:30:48 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-684cbef6-92a2-42a8-a8ec-10bfead14619 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6929a189-9d62-480b-af5e-1d435e0515f6" returned: 0 in 0.520s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:30:48 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-684cbef6-92a2-42a8-a8ec-10bfead14619 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6929a189-9d62-480b-af5e-1d435e0515f6 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:30:48 devstack sudo[104903]: pam_unix(sudo:session): session closed for user root Nov 04 10:30:48 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ac202dec-87a0-4697-8e6a-eb6310f6f45e tempest-ProjectReaderTests-888867065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-c7cb5285-4f07-4a3c-9399-b98e0f90a31f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-c7cb5285-4f07-4a3c-9399-b98e0f90a31f.791b5eff-4a38-48bb-b63e-70cff6394d56 1G" returned: 0 in 0.668s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:30:48 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ac202dec-87a0-4697-8e6a-eb6310f6f45e tempest-ProjectReaderTests-888867065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7cb5285-4f07-4a3c-9399-b98e0f90a31f -F qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-c7cb5285-4f07-4a3c-9399-b98e0f90a31f.791b5eff-4a38-48bb-b63e-70cff6394d56 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:30:48 devstack sudo[104915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6929a189-9d62-480b-af5e-1d435e0515f6 Nov 04 10:30:48 devstack sudo[104915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:30:48 devstack sudo[104916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7cb5285-4f07-4a3c-9399-b98e0f90a31f -F qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-c7cb5285-4f07-4a3c-9399-b98e0f90a31f.791b5eff-4a38-48bb-b63e-70cff6394d56 Nov 04 10:30:48 devstack sudo[104916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:30:49 devstack sudo[104915]: pam_unix(sudo:session): session closed for user root Nov 04 10:30:49 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-684cbef6-92a2-42a8-a8ec-10bfead14619 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6929a189-9d62-480b-af5e-1d435e0515f6" returned: 0 in 0.308s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:30:49 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-684cbef6-92a2-42a8-a8ec-10bfead14619 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Lock "cinder-quobyte-6929a189-9d62-480b-af5e-1d435e0515f6" released by "delete_volume" :: held 0.894s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:30:49 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-684cbef6-92a2-42a8-a8ec-10bfead14619 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Created reservations ['35c19b00-e19f-4484-b980-b8356f715553', '1f726569-140c-4bfb-9b80-b4e84b89f88d', '80c1f91c-3ecb-4b42-95e8-33d9dba69540', 'd0294069-96ca-44f0-b05a-0c1f384054df'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:30:49 devstack sudo[104916]: pam_unix(sudo:session): session closed for user root Nov 04 10:30:49 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ac202dec-87a0-4697-8e6a-eb6310f6f45e tempest-ProjectReaderTests-888867065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7cb5285-4f07-4a3c-9399-b98e0f90a31f -F qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-c7cb5285-4f07-4a3c-9399-b98e0f90a31f.791b5eff-4a38-48bb-b63e-70cff6394d56" returned: 0 in 0.443s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:30:49 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-ac202dec-87a0-4697-8e6a-eb6310f6f45e tempest-ProjectReaderTests-888867065 None] /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-c7cb5285-4f07-4a3c-9399-b98e0f90a31f.791b5eff-4a38-48bb-b63e-70cff6394d56 is being set with open permissions: ugo+rw Nov 04 10:30:49 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ac202dec-87a0-4697-8e6a-eb6310f6f45e tempest-ProjectReaderTests-888867065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-c7cb5285-4f07-4a3c-9399-b98e0f90a31f.791b5eff-4a38-48bb-b63e-70cff6394d56 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:30:49 devstack sudo[104924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-c7cb5285-4f07-4a3c-9399-b98e0f90a31f.791b5eff-4a38-48bb-b63e-70cff6394d56 Nov 04 10:30:49 devstack sudo[104924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:30:49 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-684cbef6-92a2-42a8-a8ec-10bfead14619 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:30:49 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-684cbef6-92a2-42a8-a8ec-10bfead14619 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:30:49 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-684cbef6-92a2-42a8-a8ec-10bfead14619 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:30:49 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-684cbef6-92a2-42a8-a8ec-10bfead14619 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:30:49 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-684cbef6-92a2-42a8-a8ec-10bfead14619 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:30:49 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-684cbef6-92a2-42a8-a8ec-10bfead14619 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:30:49 devstack sudo[104926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:30:49 devstack sudo[104926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:30:49 devstack sudo[104924]: pam_unix(sudo:session): session closed for user root Nov 04 10:30:49 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ac202dec-87a0-4697-8e6a-eb6310f6f45e tempest-ProjectReaderTests-888867065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-c7cb5285-4f07-4a3c-9399-b98e0f90a31f.791b5eff-4a38-48bb-b63e-70cff6394d56" returned: 0 in 0.356s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:30:49 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ac202dec-87a0-4697-8e6a-eb6310f6f45e tempest-ProjectReaderTests-888867065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-c7cb5285-4f07-4a3c-9399-b98e0f90a31f.info {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:30:49 devstack sudo[104926]: pam_unix(sudo:session): session closed for user root Nov 04 10:30:49 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-684cbef6-92a2-42a8-a8ec-10bfead14619 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.295s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:30:49 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-684cbef6-92a2-42a8-a8ec-10bfead14619 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:30:49 devstack sudo[104930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-c7cb5285-4f07-4a3c-9399-b98e0f90a31f.info Nov 04 10:30:49 devstack sudo[104930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:30:49 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-684cbef6-92a2-42a8-a8ec-10bfead14619 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Deleted volume successfully. Nov 04 10:30:49 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-684cbef6-92a2-42a8-a8ec-10bfead14619 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Lock "cinder-6929a189-9d62-480b-af5e-1d435e0515f6-delete_volume" released by "delete_volume" :: held 1.646s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:30:49 devstack sudo[104930]: pam_unix(sudo:session): session closed for user root Nov 04 10:30:49 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ac202dec-87a0-4697-8e6a-eb6310f6f45e tempest-ProjectReaderTests-888867065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-c7cb5285-4f07-4a3c-9399-b98e0f90a31f.info" returned: 0 in 0.309s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:30:49 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-ac202dec-87a0-4697-8e6a-eb6310f6f45e tempest-ProjectReaderTests-888867065 None] /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-c7cb5285-4f07-4a3c-9399-b98e0f90a31f.info is being set with open permissions: ugo+rw Nov 04 10:30:49 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ac202dec-87a0-4697-8e6a-eb6310f6f45e tempest-ProjectReaderTests-888867065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-c7cb5285-4f07-4a3c-9399-b98e0f90a31f.info {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:30:50 devstack sudo[104933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-c7cb5285-4f07-4a3c-9399-b98e0f90a31f.info Nov 04 10:30:50 devstack sudo[104933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:30:50 devstack sudo[104933]: pam_unix(sudo:session): session closed for user root Nov 04 10:30:50 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ac202dec-87a0-4697-8e6a-eb6310f6f45e tempest-ProjectReaderTests-888867065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-c7cb5285-4f07-4a3c-9399-b98e0f90a31f.info" returned: 0 in 0.302s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:30:50 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-ac202dec-87a0-4697-8e6a-eb6310f6f45e tempest-ProjectReaderTests-888867065 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.834s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:30:50 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-ac202dec-87a0-4697-8e6a-eb6310f6f45e tempest-ProjectReaderTests-888867065 None] Create snapshot completed successfully Nov 04 10:30:50 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-06954e93-2a7a-459c-97fb-24caa456694d tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Acquiring lock "cinder-849a54e4-ec92-4a0d-8e2f-cacd81b33a9e-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:30:50 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-06954e93-2a7a-459c-97fb-24caa456694d tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Lock "cinder-849a54e4-ec92-4a0d-8e2f-cacd81b33a9e-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:30:50 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-06954e93-2a7a-459c-97fb-24caa456694d tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Acquiring lock "cinder-quobyte-849a54e4-ec92-4a0d-8e2f-cacd81b33a9e" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:30:50 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-06954e93-2a7a-459c-97fb-24caa456694d tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Lock "cinder-quobyte-849a54e4-ec92-4a0d-8e2f-cacd81b33a9e" acquired by "delete_volume" :: waited 0.021s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:30:50 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2fa600a-c769-43e9-bc2c-c5edb3ad2b8f]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:30:50 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-06954e93-2a7a-459c-97fb-24caa456694d tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-849a54e4-ec92-4a0d-8e2f-cacd81b33a9e {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:30:50 devstack sudo[104936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-849a54e4-ec92-4a0d-8e2f-cacd81b33a9e Nov 04 10:30:50 devstack sudo[104936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:30:50 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-d99f3455-fdde-4660-a464-887a7bf44d18 tempest-ProjectReaderTests-888867065 None] Acquiring lock "cinder-791b5eff-4a38-48bb-b63e-70cff6394d56-delete_snapshot" by "delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:30:50 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-d99f3455-fdde-4660-a464-887a7bf44d18 tempest-ProjectReaderTests-888867065 None] Lock "cinder-791b5eff-4a38-48bb-b63e-70cff6394d56-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:30:50 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-d99f3455-fdde-4660-a464-887a7bf44d18 tempest-ProjectReaderTests-888867065 None] Acquiring lock "cinder-quobyte-c7cb5285-4f07-4a3c-9399-b98e0f90a31f" by "delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:30:50 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-d99f3455-fdde-4660-a464-887a7bf44d18 tempest-ProjectReaderTests-888867065 None] Lock "cinder-quobyte-c7cb5285-4f07-4a3c-9399-b98e0f90a31f" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:30:50 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-d99f3455-fdde-4660-a464-887a7bf44d18 tempest-ProjectReaderTests-888867065 None] Acquiring lock "cinder-quobyte-791b5eff-4a38-48bb-b63e-70cff6394d56" by "_delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:30:50 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-d99f3455-fdde-4660-a464-887a7bf44d18 tempest-ProjectReaderTests-888867065 None] Lock "cinder-quobyte-791b5eff-4a38-48bb-b63e-70cff6394d56" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:30:50 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-d99f3455-fdde-4660-a464-887a7bf44d18 tempest-ProjectReaderTests-888867065 None] Deleting offline snapshot 791b5eff-4a38-48bb-b63e-70cff6394d56 of volume c7cb5285-4f07-4a3c-9399-b98e0f90a31f {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 10:30:50 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-d99f3455-fdde-4660-a464-887a7bf44d18 tempest-ProjectReaderTests-888867065 None] snapshot_file for this snap is: volume-c7cb5285-4f07-4a3c-9399-b98e0f90a31f.791b5eff-4a38-48bb-b63e-70cff6394d56 {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 10:30:50 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba62c9f4-b318-448d-a151-ca01e10da753]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:30:50 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d99f3455-fdde-4660-a464-887a7bf44d18 tempest-ProjectReaderTests-888867065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-c7cb5285-4f07-4a3c-9399-b98e0f90a31f.791b5eff-4a38-48bb-b63e-70cff6394d56 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:30:50 devstack sudo[104936]: pam_unix(sudo:session): session closed for user root Nov 04 10:30:50 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-06954e93-2a7a-459c-97fb-24caa456694d tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-849a54e4-ec92-4a0d-8e2f-cacd81b33a9e" returned: 0 in 0.456s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:30:50 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-06954e93-2a7a-459c-97fb-24caa456694d tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-849a54e4-ec92-4a0d-8e2f-cacd81b33a9e {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:30:51 devstack sudo[104942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-849a54e4-ec92-4a0d-8e2f-cacd81b33a9e Nov 04 10:30:51 devstack sudo[104942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:30:51 devstack sudo[104941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-c7cb5285-4f07-4a3c-9399-b98e0f90a31f.791b5eff-4a38-48bb-b63e-70cff6394d56 Nov 04 10:30:51 devstack sudo[104941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:30:51 devstack sudo[104942]: pam_unix(sudo:session): session closed for user root Nov 04 10:30:51 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-06954e93-2a7a-459c-97fb-24caa456694d tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-849a54e4-ec92-4a0d-8e2f-cacd81b33a9e" returned: 0 in 0.271s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:30:51 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-06954e93-2a7a-459c-97fb-24caa456694d tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Lock "cinder-quobyte-849a54e4-ec92-4a0d-8e2f-cacd81b33a9e" released by "delete_volume" :: held 0.804s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:30:51 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-06954e93-2a7a-459c-97fb-24caa456694d tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Created reservations ['af6ee7c6-98c5-486f-95e6-14eea340f5ee', '671cf7de-97a6-40c5-af42-b5e9172196db', '4cfe8e34-6e9a-4afe-b2b2-27e558fb16f2', '3651a45b-1208-43f2-acef-8c4d1971c727'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:30:51 devstack sudo[104941]: pam_unix(sudo:session): session closed for user root Nov 04 10:30:51 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d99f3455-fdde-4660-a464-887a7bf44d18 tempest-ProjectReaderTests-888867065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-c7cb5285-4f07-4a3c-9399-b98e0f90a31f.791b5eff-4a38-48bb-b63e-70cff6394d56" returned: 0 in 0.451s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:30:51 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-d99f3455-fdde-4660-a464-887a7bf44d18 tempest-ProjectReaderTests-888867065 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c7cb5285-4f07-4a3c-9399-b98e0f90a31f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87068) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 10:30:51 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[01b04a1d-ff83-437f-8104-94f2b55c3cc4]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:30:51 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d99f3455-fdde-4660-a464-887a7bf44d18 tempest-ProjectReaderTests-888867065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-c7cb5285-4f07-4a3c-9399-b98e0f90a31f {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:30:51 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-06954e93-2a7a-459c-97fb-24caa456694d tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:30:51 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-06954e93-2a7a-459c-97fb-24caa456694d tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:30:51 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-06954e93-2a7a-459c-97fb-24caa456694d tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:30:51 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-06954e93-2a7a-459c-97fb-24caa456694d tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:30:51 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-06954e93-2a7a-459c-97fb-24caa456694d tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:30:51 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-06954e93-2a7a-459c-97fb-24caa456694d tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:30:51 devstack sudo[104950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:30:51 devstack sudo[104950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:30:51 devstack sudo[104949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-c7cb5285-4f07-4a3c-9399-b98e0f90a31f Nov 04 10:30:51 devstack sudo[104949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:30:51 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-15320b5c-4621-4447-b50d-78fb8beed86d tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Acquiring lock "cinder-062023ed-ca0c-4192-bfe1-1d2b5b2da3da-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:30:51 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-15320b5c-4621-4447-b50d-78fb8beed86d tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Lock "cinder-062023ed-ca0c-4192-bfe1-1d2b5b2da3da-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:30:51 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-15320b5c-4621-4447-b50d-78fb8beed86d tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Acquiring lock "cinder-quobyte-062023ed-ca0c-4192-bfe1-1d2b5b2da3da" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:30:51 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-15320b5c-4621-4447-b50d-78fb8beed86d tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Lock "cinder-quobyte-062023ed-ca0c-4192-bfe1-1d2b5b2da3da" acquired by "delete_volume" :: waited 0.030s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:30:51 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0692702-7f26-4c54-b109-c97bbe2d361a]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:30:51 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-15320b5c-4621-4447-b50d-78fb8beed86d tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-062023ed-ca0c-4192-bfe1-1d2b5b2da3da {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:30:51 devstack sudo[104954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-062023ed-ca0c-4192-bfe1-1d2b5b2da3da Nov 04 10:30:51 devstack sudo[104954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:30:51 devstack sudo[104949]: pam_unix(sudo:session): session closed for user root Nov 04 10:30:51 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d99f3455-fdde-4660-a464-887a7bf44d18 tempest-ProjectReaderTests-888867065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-c7cb5285-4f07-4a3c-9399-b98e0f90a31f" returned: 0 in 0.520s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:30:51 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d99f3455-fdde-4660-a464-887a7bf44d18 tempest-ProjectReaderTests-888867065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-c7cb5285-4f07-4a3c-9399-b98e0f90a31f.791b5eff-4a38-48bb-b63e-70cff6394d56 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:30:51 devstack sudo[104950]: pam_unix(sudo:session): session closed for user root Nov 04 10:30:52 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-06954e93-2a7a-459c-97fb-24caa456694d tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.512s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:30:52 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-06954e93-2a7a-459c-97fb-24caa456694d tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:30:52 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-06954e93-2a7a-459c-97fb-24caa456694d tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Deleted volume successfully. Nov 04 10:30:52 devstack sudo[104959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-c7cb5285-4f07-4a3c-9399-b98e0f90a31f.791b5eff-4a38-48bb-b63e-70cff6394d56 Nov 04 10:30:52 devstack sudo[104959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:30:52 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-06954e93-2a7a-459c-97fb-24caa456694d tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Lock "cinder-849a54e4-ec92-4a0d-8e2f-cacd81b33a9e-delete_volume" released by "delete_volume" :: held 1.636s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:30:52 devstack sudo[104954]: pam_unix(sudo:session): session closed for user root Nov 04 10:30:52 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-15320b5c-4621-4447-b50d-78fb8beed86d tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-062023ed-ca0c-4192-bfe1-1d2b5b2da3da" returned: 0 in 0.472s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:30:52 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-15320b5c-4621-4447-b50d-78fb8beed86d tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-062023ed-ca0c-4192-bfe1-1d2b5b2da3da {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:30:52 devstack sudo[104967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-062023ed-ca0c-4192-bfe1-1d2b5b2da3da Nov 04 10:30:52 devstack sudo[104967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:30:52 devstack sudo[104959]: pam_unix(sudo:session): session closed for user root Nov 04 10:30:52 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d99f3455-fdde-4660-a464-887a7bf44d18 tempest-ProjectReaderTests-888867065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-c7cb5285-4f07-4a3c-9399-b98e0f90a31f.791b5eff-4a38-48bb-b63e-70cff6394d56" returned: 0 in 0.473s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:30:52 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d99f3455-fdde-4660-a464-887a7bf44d18 tempest-ProjectReaderTests-888867065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-c7cb5285-4f07-4a3c-9399-b98e0f90a31f.791b5eff-4a38-48bb-b63e-70cff6394d56 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:30:52 devstack sudo[104969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-c7cb5285-4f07-4a3c-9399-b98e0f90a31f.791b5eff-4a38-48bb-b63e-70cff6394d56 Nov 04 10:30:52 devstack sudo[104969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:30:52 devstack sudo[104967]: pam_unix(sudo:session): session closed for user root Nov 04 10:30:52 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-15320b5c-4621-4447-b50d-78fb8beed86d tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-062023ed-ca0c-4192-bfe1-1d2b5b2da3da" returned: 0 in 0.310s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:30:52 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-15320b5c-4621-4447-b50d-78fb8beed86d tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Lock "cinder-quobyte-062023ed-ca0c-4192-bfe1-1d2b5b2da3da" released by "delete_volume" :: held 0.847s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:30:52 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-15320b5c-4621-4447-b50d-78fb8beed86d tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Created reservations ['eaafaa9f-925a-43a3-b29b-d2f87f28533b', 'a6e3c7a8-2c17-47a6-85a0-f6bd4f324521', '17553903-ca1d-4f95-8195-7ff92c69c778', '6f536346-2da0-427b-9d7a-3c9927659a74'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:30:52 devstack sudo[104969]: pam_unix(sudo:session): session closed for user root Nov 04 10:30:52 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d99f3455-fdde-4660-a464-887a7bf44d18 tempest-ProjectReaderTests-888867065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-c7cb5285-4f07-4a3c-9399-b98e0f90a31f.791b5eff-4a38-48bb-b63e-70cff6394d56" returned: 0 in 0.286s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:30:52 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-d99f3455-fdde-4660-a464-887a7bf44d18 tempest-ProjectReaderTests-888867065 None] Lock "cinder-quobyte-791b5eff-4a38-48bb-b63e-70cff6394d56" released by "_delete_snapshot" :: held 1.856s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:30:52 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-15320b5c-4621-4447-b50d-78fb8beed86d tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:30:52 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-15320b5c-4621-4447-b50d-78fb8beed86d tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:30:52 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-15320b5c-4621-4447-b50d-78fb8beed86d tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:30:52 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-15320b5c-4621-4447-b50d-78fb8beed86d tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:30:52 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-15320b5c-4621-4447-b50d-78fb8beed86d tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:30:52 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-15320b5c-4621-4447-b50d-78fb8beed86d tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:30:52 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-d99f3455-fdde-4660-a464-887a7bf44d18 tempest-ProjectReaderTests-888867065 None] Lock "cinder-quobyte-c7cb5285-4f07-4a3c-9399-b98e0f90a31f" released by "delete_snapshot" :: held 1.907s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:30:52 devstack sudo[104973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:30:52 devstack sudo[104973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:30:52 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-aa943a5d-8fda-4a10-a104-066e90c79208 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Acquiring lock "cinder-4de85265-35b3-417b-b070-8b54045efc18-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:30:52 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-aa943a5d-8fda-4a10-a104-066e90c79208 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Lock "cinder-4de85265-35b3-417b-b070-8b54045efc18-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:30:52 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-aa943a5d-8fda-4a10-a104-066e90c79208 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Acquiring lock "cinder-quobyte-4de85265-35b3-417b-b070-8b54045efc18" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:30:52 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-d99f3455-fdde-4660-a464-887a7bf44d18 tempest-ProjectReaderTests-888867065 None] Created reservations ['69dff19c-9246-4806-a462-517f0a038fe7', '929db219-d618-4c71-971e-7cbb8cf96144', 'aeee7b7b-9a56-4cd3-8b0b-828564fd6877', 'c1b8ee0b-04c1-4277-ab06-c00026b648af'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:30:52 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-aa943a5d-8fda-4a10-a104-066e90c79208 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Lock "cinder-quobyte-4de85265-35b3-417b-b070-8b54045efc18" acquired by "delete_volume" :: waited 0.029s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:30:53 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[7045ad93-a561-40bd-ac59-c0d1befba151]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:30:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-aa943a5d-8fda-4a10-a104-066e90c79208 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-4de85265-35b3-417b-b070-8b54045efc18 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:30:53 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-d99f3455-fdde-4660-a464-887a7bf44d18 tempest-ProjectReaderTests-888867065 None] Delete snapshot completed successfully. Nov 04 10:30:53 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-d99f3455-fdde-4660-a464-887a7bf44d18 tempest-ProjectReaderTests-888867065 None] Lock "cinder-791b5eff-4a38-48bb-b63e-70cff6394d56-delete_snapshot" released by "delete_snapshot" :: held 2.190s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:30:53 devstack sudo[104973]: pam_unix(sudo:session): session closed for user root Nov 04 10:30:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-15320b5c-4621-4447-b50d-78fb8beed86d tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.322s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:30:53 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-15320b5c-4621-4447-b50d-78fb8beed86d tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:30:53 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-15320b5c-4621-4447-b50d-78fb8beed86d tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Deleted volume successfully. Nov 04 10:30:53 devstack sudo[104976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-4de85265-35b3-417b-b070-8b54045efc18 Nov 04 10:30:53 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-15320b5c-4621-4447-b50d-78fb8beed86d tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Lock "cinder-062023ed-ca0c-4192-bfe1-1d2b5b2da3da-delete_volume" released by "delete_volume" :: held 1.500s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:30:53 devstack sudo[104976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:30:53 devstack sudo[104976]: pam_unix(sudo:session): session closed for user root Nov 04 10:30:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-aa943a5d-8fda-4a10-a104-066e90c79208 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-4de85265-35b3-417b-b070-8b54045efc18" returned: 0 in 0.404s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:30:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-aa943a5d-8fda-4a10-a104-066e90c79208 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-4de85265-35b3-417b-b070-8b54045efc18 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:30:53 devstack sudo[104982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-4de85265-35b3-417b-b070-8b54045efc18 Nov 04 10:30:53 devstack sudo[104982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:30:53 devstack sudo[104982]: pam_unix(sudo:session): session closed for user root Nov 04 10:30:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-aa943a5d-8fda-4a10-a104-066e90c79208 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-4de85265-35b3-417b-b070-8b54045efc18" returned: 0 in 0.262s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:30:53 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-aa943a5d-8fda-4a10-a104-066e90c79208 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Lock "cinder-quobyte-4de85265-35b3-417b-b070-8b54045efc18" released by "delete_volume" :: held 0.729s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:30:53 devstack cinder-volume[87068]: DEBUG oslo_service.periodic_task [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87068) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 10:30:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:30:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:30:53 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:30:53 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:30:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:30:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:30:53 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-aa943a5d-8fda-4a10-a104-066e90c79208 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Created reservations ['2ccee76f-7d2c-4c41-a054-91f4e5854a40', 'f38faec2-fd27-4d9c-8486-86656fbe5feb', '26a267fe-3cdf-4dfc-b133-f8b170f12bc4', 'ed9e8502-cc9c-493f-bf30-1bdeec736aa3'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:30:53 devstack sudo[104985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:30:53 devstack sudo[104985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:30:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-aa943a5d-8fda-4a10-a104-066e90c79208 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:30:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-aa943a5d-8fda-4a10-a104-066e90c79208 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:30:53 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-aa943a5d-8fda-4a10-a104-066e90c79208 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:30:53 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-aa943a5d-8fda-4a10-a104-066e90c79208 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:30:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-aa943a5d-8fda-4a10-a104-066e90c79208 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:30:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-aa943a5d-8fda-4a10-a104-066e90c79208 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:30:53 devstack sudo[104987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:30:53 devstack sudo[104987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:30:53 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d9a9cfd-99f9-4310-b195-9f3238f0cd8f tempest-VolumeImageDependencyTests-1606162103 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:30:54 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-0d9a9cfd-99f9-4310-b195-9f3238f0cd8f tempest-VolumeImageDependencyTests-1606162103 None] Flow 'volume_create_manager' (e75b4e6b-1750-4624-8115-a42c0d1e4bbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:30:54 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-0d9a9cfd-99f9-4310-b195-9f3238f0cd8f tempest-VolumeImageDependencyTests-1606162103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e56b9ac2-0275-4209-b39a-7ddc4e40ec3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:30:54 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-0d9a9cfd-99f9-4310-b195-9f3238f0cd8f tempest-VolumeImageDependencyTests-1606162103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e56b9ac2-0275-4209-b39a-7ddc4e40ec3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:30:54Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79bf3147-d35e-4a1e-873c-bf4fa64d4888,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5ed3796dcb243cbb968c4ded7244840',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:30:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:30:54Z,use_quota=True,user_id='8f8b8c2cc80141628ad52da331e19880',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:30:54 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-0d9a9cfd-99f9-4310-b195-9f3238f0cd8f tempest-VolumeImageDependencyTests-1606162103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (140e9943-228d-49c7-aed7-e34141c14045) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:30:54 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-0d9a9cfd-99f9-4310-b195-9f3238f0cd8f tempest-VolumeImageDependencyTests-1606162103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (140e9943-228d-49c7-aed7-e34141c14045) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:30:54 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-0d9a9cfd-99f9-4310-b195-9f3238f0cd8f tempest-VolumeImageDependencyTests-1606162103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e453fbc-499b-4f73-9041-2270789400ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:30:54 devstack cinder-volume[87068]: DEBUG cinder.image.glance [None req-0d9a9cfd-99f9-4310-b195-9f3238f0cd8f tempest-VolumeImageDependencyTests-1606162103 None] Creating Keystone auth plugin from conf {{(pid=87068) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 04 10:30:54 devstack sudo[104985]: pam_unix(sudo:session): session closed for user root Nov 04 10:30:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.343s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:30:54 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:30:54 devstack cinder-volume[87068]: DEBUG oslo_service.periodic_task [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Running periodic task VolumeManager._thread_info {{(pid=87068) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 10:30:54 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] thread count: 28 {{(pid=87068) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 04 10:30:54 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] thread info: [<_MainThread(MainThread, started 126275656192128)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87068) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 04 10:30:54 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-f08cb6ac-deaa-41bd-bed2-496a8c80188e tempest-ProjectReaderTests-888867065 None] Acquiring lock "cinder-c7cb5285-4f07-4a3c-9399-b98e0f90a31f-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:30:54 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-f08cb6ac-deaa-41bd-bed2-496a8c80188e tempest-ProjectReaderTests-888867065 None] Lock "cinder-c7cb5285-4f07-4a3c-9399-b98e0f90a31f-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:30:54 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-f08cb6ac-deaa-41bd-bed2-496a8c80188e tempest-ProjectReaderTests-888867065 None] Acquiring lock "cinder-quobyte-c7cb5285-4f07-4a3c-9399-b98e0f90a31f" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:30:54 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-f08cb6ac-deaa-41bd-bed2-496a8c80188e tempest-ProjectReaderTests-888867065 None] Lock "cinder-quobyte-c7cb5285-4f07-4a3c-9399-b98e0f90a31f" acquired by "delete_volume" :: waited 0.023s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:30:54 devstack sudo[104987]: pam_unix(sudo:session): session closed for user root Nov 04 10:30:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-aa943a5d-8fda-4a10-a104-066e90c79208 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.399s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:30:54 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-aa943a5d-8fda-4a10-a104-066e90c79208 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:30:54 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-aa943a5d-8fda-4a10-a104-066e90c79208 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Deleted volume successfully. Nov 04 10:30:54 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[6de2925b-deed-4029-9ef0-6dc0e4a78cff]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:30:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f08cb6ac-deaa-41bd-bed2-496a8c80188e tempest-ProjectReaderTests-888867065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-c7cb5285-4f07-4a3c-9399-b98e0f90a31f {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:30:54 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-aa943a5d-8fda-4a10-a104-066e90c79208 tempest-CreateVolumesFromSourceVolumeTest-1121306153 None] Lock "cinder-4de85265-35b3-417b-b070-8b54045efc18-delete_volume" released by "delete_volume" :: held 1.477s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:30:54 devstack sudo[104991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-c7cb5285-4f07-4a3c-9399-b98e0f90a31f Nov 04 10:30:54 devstack sudo[104991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:30:54 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-0d9a9cfd-99f9-4310-b195-9f3238f0cd8f tempest-VolumeImageDependencyTests-1606162103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e453fbc-499b-4f73-9041-2270789400ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '79bf3147-d35e-4a1e-873c-bf4fa64d4888', 'volume_name': 'volume-79bf3147-d35e-4a1e-873c-bf4fa64d4888', 'volume_size': 1, 'image_id': '5e2451fa-8177-4d0e-aafa-55f777b30d70', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5e2451fa-8177-4d0e-aafa-55f777b30d70', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '17ae638aece94aa3bee715bb46e72371', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a5ed3796dcb243cbb968c4ded7244840', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2954c23a8f91092333a93e564f36b4db11053ba4e52158bbe0f4df329567a5ad465967c8426a6de774980cee277b1e55a193c31721729d55fac07c77dbcf38a3', 'id': '5e2451fa-8177-4d0e-aafa-55f777b30d70', 'created_at': datetime.datetime(2026, 11, 4, 9, 30, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 9, 30, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5e2451fa-8177-4d0e-aafa-55f777b30d70/file', 'properties': {}}, 'image_service': }' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:30:54 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-0d9a9cfd-99f9-4310-b195-9f3238f0cd8f tempest-VolumeImageDependencyTests-1606162103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce5afa1e-6a3c-423e-bb46-9abfa0cf09a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:30:54 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-0d9a9cfd-99f9-4310-b195-9f3238f0cd8f tempest-VolumeImageDependencyTests-1606162103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce5afa1e-6a3c-423e-bb46-9abfa0cf09a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:30:54 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-0d9a9cfd-99f9-4310-b195-9f3238f0cd8f tempest-VolumeImageDependencyTests-1606162103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bac475a-7db5-4a7e-aa06-cc425dbe2a64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:30:54 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-0d9a9cfd-99f9-4310-b195-9f3238f0cd8f tempest-VolumeImageDependencyTests-1606162103 None] Volume 79bf3147-d35e-4a1e-873c-bf4fa64d4888: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-79bf3147-d35e-4a1e-873c-bf4fa64d4888', 'volume_size': 1, 'image_id': '5e2451fa-8177-4d0e-aafa-55f777b30d70', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5e2451fa-8177-4d0e-aafa-55f777b30d70', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '17ae638aece94aa3bee715bb46e72371', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a5ed3796dcb243cbb968c4ded7244840', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2954c23a8f91092333a93e564f36b4db11053ba4e52158bbe0f4df329567a5ad465967c8426a6de774980cee277b1e55a193c31721729d55fac07c77dbcf38a3', 'id': '5e2451fa-8177-4d0e-aafa-55f777b30d70', 'created_at': datetime.datetime(2026, 11, 4, 9, 30, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 9, 30, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5e2451fa-8177-4d0e-aafa-55f777b30d70/file', 'properties': {}}, 'image_service': } Nov 04 10:30:54 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d9a9cfd-99f9-4310-b195-9f3238f0cd8f tempest-VolumeImageDependencyTests-1606162103 None] Trying to clone 79bf3147-d35e-4a1e-873c-bf4fa64d4888 from image 5e2451fa-8177-4d0e-aafa-55f777b30d70 at location (None, [{'url': 'file:///opt/stack/data/glance/images/5e2451fa-8177-4d0e-aafa-55f777b30d70', 'metadata': {}}]). {{(pid=87068) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 04 10:30:54 devstack sudo[104991]: pam_unix(sudo:session): session closed for user root Nov 04 10:30:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f08cb6ac-deaa-41bd-bed2-496a8c80188e tempest-ProjectReaderTests-888867065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-c7cb5285-4f07-4a3c-9399-b98e0f90a31f" returned: 0 in 0.457s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:30:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f08cb6ac-deaa-41bd-bed2-496a8c80188e tempest-ProjectReaderTests-888867065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-c7cb5285-4f07-4a3c-9399-b98e0f90a31f {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:30:54 devstack cinder-volume[87068]: DEBUG cinder.image.image_utils [None req-0d9a9cfd-99f9-4310-b195-9f3238f0cd8f tempest-VolumeImageDependencyTests-1606162103 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_5e2451fa-8177-4d0e-aafa-55f777b30d70_zt3qe68rdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87068) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 04 10:30:54 devstack cinder-volume[87068]: INFO cinder.image.image_utils [None req-0d9a9cfd-99f9-4310-b195-9f3238f0cd8f tempest-VolumeImageDependencyTests-1606162103 None] Image download 0.00 MB at 0.00 MB/s Nov 04 10:30:54 devstack sudo[104996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-c7cb5285-4f07-4a3c-9399-b98e0f90a31f Nov 04 10:30:54 devstack sudo[104996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:30:54 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b219fec-e2f0-42cb-a8e8-343de28249ef]: (4, 'raw') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:30:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-0d9a9cfd-99f9-4310-b195-9f3238f0cd8f tempest-VolumeImageDependencyTests-1606162103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5e2451fa-8177-4d0e-aafa-55f777b30d70_zt3qe68rdevstack@QuobyteHD {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:30:55 devstack sudo[104998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5e2451fa-8177-4d0e-aafa-55f777b30d70_zt3qe68rdevstack@QuobyteHD Nov 04 10:30:55 devstack sudo[104998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:30:55 devstack sudo[104996]: pam_unix(sudo:session): session closed for user root Nov 04 10:30:55 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f08cb6ac-deaa-41bd-bed2-496a8c80188e tempest-ProjectReaderTests-888867065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-c7cb5285-4f07-4a3c-9399-b98e0f90a31f" returned: 0 in 0.366s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:30:55 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-f08cb6ac-deaa-41bd-bed2-496a8c80188e tempest-ProjectReaderTests-888867065 None] Lock "cinder-quobyte-c7cb5285-4f07-4a3c-9399-b98e0f90a31f" released by "delete_volume" :: held 0.940s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:30:55 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-f08cb6ac-deaa-41bd-bed2-496a8c80188e tempest-ProjectReaderTests-888867065 None] Created reservations ['4b2b2d33-b674-4a4d-8770-777d57e421ed', '60c9cc53-56d2-4cab-bb96-ba8ad3e66f48', '1b051925-aa65-4dc5-a28d-4860855a9d47', 'e79d70ab-998a-46aa-a667-5c0d1b062697'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:30:55 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-f08cb6ac-deaa-41bd-bed2-496a8c80188e tempest-ProjectReaderTests-888867065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:30:55 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-f08cb6ac-deaa-41bd-bed2-496a8c80188e tempest-ProjectReaderTests-888867065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:30:55 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-f08cb6ac-deaa-41bd-bed2-496a8c80188e tempest-ProjectReaderTests-888867065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:30:55 devstack sudo[104998]: pam_unix(sudo:session): session closed for user root Nov 04 10:30:55 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-f08cb6ac-deaa-41bd-bed2-496a8c80188e tempest-ProjectReaderTests-888867065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:30:55 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-f08cb6ac-deaa-41bd-bed2-496a8c80188e tempest-ProjectReaderTests-888867065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:30:55 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f08cb6ac-deaa-41bd-bed2-496a8c80188e tempest-ProjectReaderTests-888867065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:30:55 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-0d9a9cfd-99f9-4310-b195-9f3238f0cd8f tempest-VolumeImageDependencyTests-1606162103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5e2451fa-8177-4d0e-aafa-55f777b30d70_zt3qe68rdevstack@QuobyteHD" returned: 0 in 0.494s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:30:55 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-0d9a9cfd-99f9-4310-b195-9f3238f0cd8f tempest-VolumeImageDependencyTests-1606162103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5e2451fa-8177-4d0e-aafa-55f777b30d70_zt3qe68rdevstack@QuobyteHD {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:30:55 devstack sudo[105003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:30:55 devstack sudo[105003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:30:55 devstack sudo[105004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5e2451fa-8177-4d0e-aafa-55f777b30d70_zt3qe68rdevstack@QuobyteHD Nov 04 10:30:55 devstack sudo[105004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:30:55 devstack sudo[105003]: pam_unix(sudo:session): session closed for user root Nov 04 10:30:55 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f08cb6ac-deaa-41bd-bed2-496a8c80188e tempest-ProjectReaderTests-888867065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.411s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:30:55 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-f08cb6ac-deaa-41bd-bed2-496a8c80188e tempest-ProjectReaderTests-888867065 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:30:55 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-f08cb6ac-deaa-41bd-bed2-496a8c80188e tempest-ProjectReaderTests-888867065 None] Deleted volume successfully. Nov 04 10:30:55 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-f08cb6ac-deaa-41bd-bed2-496a8c80188e tempest-ProjectReaderTests-888867065 None] Lock "cinder-c7cb5285-4f07-4a3c-9399-b98e0f90a31f-delete_volume" released by "delete_volume" :: held 1.675s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:30:55 devstack sudo[105004]: pam_unix(sudo:session): session closed for user root Nov 04 10:30:55 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-0d9a9cfd-99f9-4310-b195-9f3238f0cd8f tempest-VolumeImageDependencyTests-1606162103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5e2451fa-8177-4d0e-aafa-55f777b30d70_zt3qe68rdevstack@QuobyteHD" returned: 1 in 0.528s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:30:55 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-0d9a9cfd-99f9-4310-b195-9f3238f0cd8f tempest-VolumeImageDependencyTests-1606162103 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5e2451fa-8177-4d0e-aafa-55f777b30d70_zt3qe68rdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 04 10:30:55 devstack cinder-volume[87068]: DEBUG cinder.image.image_utils [None req-0d9a9cfd-99f9-4310-b195-9f3238f0cd8f tempest-VolumeImageDependencyTests-1606162103 None] Temporary image 5e2451fa-8177-4d0e-aafa-55f777b30d70 is fetched for user 8f8b8c2cc80141628ad52da331e19880. {{(pid=87068) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 04 10:30:56 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[a09e35d1-fcfb-4583-aee9-b4b5e6f5668a]: (4, 'raw') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:30:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-0d9a9cfd-99f9-4310-b195-9f3238f0cd8f tempest-VolumeImageDependencyTests-1606162103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5e2451fa-8177-4d0e-aafa-55f777b30d70_zt3qe68rdevstack@QuobyteHD {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:30:56 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac3b4b36-4a4d-4ea6-a3eb-48f86bed4f46 tempest-ProjectReaderTests-888867065 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:30:56 devstack sudo[105011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5e2451fa-8177-4d0e-aafa-55f777b30d70_zt3qe68rdevstack@QuobyteHD Nov 04 10:30:56 devstack sudo[105011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:30:56 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-ac3b4b36-4a4d-4ea6-a3eb-48f86bed4f46 tempest-ProjectReaderTests-888867065 None] Flow 'volume_create_manager' (d61cf78c-4a0c-4505-a3a2-15b87c847820) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:30:56 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-ac3b4b36-4a4d-4ea6-a3eb-48f86bed4f46 tempest-ProjectReaderTests-888867065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f238810b-b28e-44b7-8353-77361f85053d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:30:56 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-ac3b4b36-4a4d-4ea6-a3eb-48f86bed4f46 tempest-ProjectReaderTests-888867065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f238810b-b28e-44b7-8353-77361f85053d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:30:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-907851831',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de47a656-f2a9-4f2c-80c9-af0608556b34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ceada5c21c0840989abb5a48b7006da6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:30:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:30:56Z,use_quota=True,user_id='8e11bec0815c4b9e994b7a51e248abd4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:30:56 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-ac3b4b36-4a4d-4ea6-a3eb-48f86bed4f46 tempest-ProjectReaderTests-888867065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb7d1dfe-bf2d-4b8d-97c4-f879c04b5a8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:30:56 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-ac3b4b36-4a4d-4ea6-a3eb-48f86bed4f46 tempest-ProjectReaderTests-888867065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb7d1dfe-bf2d-4b8d-97c4-f879c04b5a8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:30:56 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-ac3b4b36-4a4d-4ea6-a3eb-48f86bed4f46 tempest-ProjectReaderTests-888867065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbbb5b1e-e148-404a-b4c7-9f5308709cbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:30:56 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-ac3b4b36-4a4d-4ea6-a3eb-48f86bed4f46 tempest-ProjectReaderTests-888867065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbbb5b1e-e148-404a-b4c7-9f5308709cbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de47a656-f2a9-4f2c-80c9-af0608556b34', 'volume_name': 'volume-de47a656-f2a9-4f2c-80c9-af0608556b34', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:30:56 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-ac3b4b36-4a4d-4ea6-a3eb-48f86bed4f46 tempest-ProjectReaderTests-888867065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (592ba144-35cf-42cc-a186-50c0dc583601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:30:56 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-ac3b4b36-4a4d-4ea6-a3eb-48f86bed4f46 tempest-ProjectReaderTests-888867065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (592ba144-35cf-42cc-a186-50c0dc583601) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:30:56 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-ac3b4b36-4a4d-4ea6-a3eb-48f86bed4f46 tempest-ProjectReaderTests-888867065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c3885d2-e993-4be7-a514-0e0488639b4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:30:56 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-ac3b4b36-4a4d-4ea6-a3eb-48f86bed4f46 tempest-ProjectReaderTests-888867065 None] Volume de47a656-f2a9-4f2c-80c9-af0608556b34: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de47a656-f2a9-4f2c-80c9-af0608556b34', 'volume_size': 1} Nov 04 10:30:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-ac3b4b36-4a4d-4ea6-a3eb-48f86bed4f46 tempest-ProjectReaderTests-888867065 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:30:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-ac3b4b36-4a4d-4ea6-a3eb-48f86bed4f46 tempest-ProjectReaderTests-888867065 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:30:56 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-ac3b4b36-4a4d-4ea6-a3eb-48f86bed4f46 tempest-ProjectReaderTests-888867065 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:30:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-907851831',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de47a656-f2a9-4f2c-80c9-af0608556b34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ceada5c21c0840989abb5a48b7006da6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:30:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:30:56Z,use_quota=True,user_id='8e11bec0815c4b9e994b7a51e248abd4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 10:30:56 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-ac3b4b36-4a4d-4ea6-a3eb-48f86bed4f46 tempest-ProjectReaderTests-888867065 None] Creating volume de47a656-f2a9-4f2c-80c9-af0608556b34 {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:30:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-ac3b4b36-4a4d-4ea6-a3eb-48f86bed4f46 tempest-ProjectReaderTests-888867065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:30:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-ac3b4b36-4a4d-4ea6-a3eb-48f86bed4f46 tempest-ProjectReaderTests-888867065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:30:56 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-ac3b4b36-4a4d-4ea6-a3eb-48f86bed4f46 tempest-ProjectReaderTests-888867065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:30:56 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-ac3b4b36-4a4d-4ea6-a3eb-48f86bed4f46 tempest-ProjectReaderTests-888867065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:30:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-ac3b4b36-4a4d-4ea6-a3eb-48f86bed4f46 tempest-ProjectReaderTests-888867065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:30:56 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-ac3b4b36-4a4d-4ea6-a3eb-48f86bed4f46 tempest-ProjectReaderTests-888867065 None] Selected osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:30:56 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-ac3b4b36-4a4d-4ea6-a3eb-48f86bed4f46 tempest-ProjectReaderTests-888867065 None] casted to osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 Nov 04 10:30:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ac3b4b36-4a4d-4ea6-a3eb-48f86bed4f46 tempest-ProjectReaderTests-888867065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-de47a656-f2a9-4f2c-80c9-af0608556b34 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:30:56 devstack sudo[105013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-de47a656-f2a9-4f2c-80c9-af0608556b34 1073741824 Nov 04 10:30:56 devstack sudo[105013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:30:56 devstack sudo[105011]: pam_unix(sudo:session): session closed for user root Nov 04 10:30:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-0d9a9cfd-99f9-4310-b195-9f3238f0cd8f tempest-VolumeImageDependencyTests-1606162103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5e2451fa-8177-4d0e-aafa-55f777b30d70_zt3qe68rdevstack@QuobyteHD" returned: 0 in 0.456s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:30:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-0d9a9cfd-99f9-4310-b195-9f3238f0cd8f tempest-VolumeImageDependencyTests-1606162103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5e2451fa-8177-4d0e-aafa-55f777b30d70_zt3qe68rdevstack@QuobyteHD {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:30:56 devstack sudo[105017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5e2451fa-8177-4d0e-aafa-55f777b30d70_zt3qe68rdevstack@QuobyteHD Nov 04 10:30:56 devstack sudo[105017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:30:56 devstack sudo[105017]: pam_unix(sudo:session): session closed for user root Nov 04 10:30:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-0d9a9cfd-99f9-4310-b195-9f3238f0cd8f tempest-VolumeImageDependencyTests-1606162103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5e2451fa-8177-4d0e-aafa-55f777b30d70_zt3qe68rdevstack@QuobyteHD" returned: 1 in 0.394s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:30:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-0d9a9cfd-99f9-4310-b195-9f3238f0cd8f tempest-VolumeImageDependencyTests-1606162103 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5e2451fa-8177-4d0e-aafa-55f777b30d70_zt3qe68rdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 04 10:30:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-0d9a9cfd-99f9-4310-b195-9f3238f0cd8f tempest-VolumeImageDependencyTests-1606162103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:30:56 devstack sudo[105013]: pam_unix(sudo:session): session closed for user root Nov 04 10:30:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ac3b4b36-4a4d-4ea6-a3eb-48f86bed4f46 tempest-ProjectReaderTests-888867065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-de47a656-f2a9-4f2c-80c9-af0608556b34 1073741824" returned: 0 in 0.558s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:30:57 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ac3b4b36-4a4d-4ea6-a3eb-48f86bed4f46 tempest-ProjectReaderTests-888867065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-de47a656-f2a9-4f2c-80c9-af0608556b34 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:30:57 devstack sudo[105026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-de47a656-f2a9-4f2c-80c9-af0608556b34 Nov 04 10:30:57 devstack sudo[105026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:30:57 devstack sudo[105026]: pam_unix(sudo:session): session closed for user root Nov 04 10:30:57 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ac3b4b36-4a4d-4ea6-a3eb-48f86bed4f46 tempest-ProjectReaderTests-888867065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-de47a656-f2a9-4f2c-80c9-af0608556b34" returned: 0 in 0.300s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:30:57 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-ac3b4b36-4a4d-4ea6-a3eb-48f86bed4f46 tempest-ProjectReaderTests-888867065 None] <== create_volume: return (928ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 10:30:57 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-ac3b4b36-4a4d-4ea6-a3eb-48f86bed4f46 tempest-ProjectReaderTests-888867065 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.936s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:30:57 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-0d9a9cfd-99f9-4310-b195-9f3238f0cd8f tempest-VolumeImageDependencyTests-1606162103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.385s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:30:57 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-0d9a9cfd-99f9-4310-b195-9f3238f0cd8f tempest-VolumeImageDependencyTests-1606162103 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:30:54Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79bf3147-d35e-4a1e-873c-bf4fa64d4888,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5ed3796dcb243cbb968c4ded7244840',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:30:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:30:54Z,use_quota=True,user_id='8f8b8c2cc80141628ad52da331e19880',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 10:30:57 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-0d9a9cfd-99f9-4310-b195-9f3238f0cd8f tempest-VolumeImageDependencyTests-1606162103 None] Creating volume 79bf3147-d35e-4a1e-873c-bf4fa64d4888 {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:30:57 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-0d9a9cfd-99f9-4310-b195-9f3238f0cd8f tempest-VolumeImageDependencyTests-1606162103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:30:57 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-0d9a9cfd-99f9-4310-b195-9f3238f0cd8f tempest-VolumeImageDependencyTests-1606162103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:30:57 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-0d9a9cfd-99f9-4310-b195-9f3238f0cd8f tempest-VolumeImageDependencyTests-1606162103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:30:57 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-0d9a9cfd-99f9-4310-b195-9f3238f0cd8f tempest-VolumeImageDependencyTests-1606162103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:30:57 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-0d9a9cfd-99f9-4310-b195-9f3238f0cd8f tempest-VolumeImageDependencyTests-1606162103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:30:57 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-0d9a9cfd-99f9-4310-b195-9f3238f0cd8f tempest-VolumeImageDependencyTests-1606162103 None] Selected osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:30:57 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-0d9a9cfd-99f9-4310-b195-9f3238f0cd8f tempest-VolumeImageDependencyTests-1606162103 None] casted to osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 Nov 04 10:30:57 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-0d9a9cfd-99f9-4310-b195-9f3238f0cd8f tempest-VolumeImageDependencyTests-1606162103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-79bf3147-d35e-4a1e-873c-bf4fa64d4888 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:30:57 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-ac3b4b36-4a4d-4ea6-a3eb-48f86bed4f46 tempest-ProjectReaderTests-888867065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c3885d2-e993-4be7-a514-0e0488639b4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de47a656-f2a9-4f2c-80c9-af0608556b34', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:30:57 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-ac3b4b36-4a4d-4ea6-a3eb-48f86bed4f46 tempest-ProjectReaderTests-888867065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1d8af46-4feb-4d78-929e-920db69c5325) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:30:57 devstack sudo[105029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-79bf3147-d35e-4a1e-873c-bf4fa64d4888 1073741824 Nov 04 10:30:57 devstack sudo[105029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:30:57 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-ac3b4b36-4a4d-4ea6-a3eb-48f86bed4f46 tempest-ProjectReaderTests-888867065 None] Volume volume-de47a656-f2a9-4f2c-80c9-af0608556b34 (de47a656-f2a9-4f2c-80c9-af0608556b34): created successfully Nov 04 10:30:57 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-ac3b4b36-4a4d-4ea6-a3eb-48f86bed4f46 tempest-ProjectReaderTests-888867065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1d8af46-4feb-4d78-929e-920db69c5325) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:30:57 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-ac3b4b36-4a4d-4ea6-a3eb-48f86bed4f46 tempest-ProjectReaderTests-888867065 None] Flow 'volume_create_manager' (d61cf78c-4a0c-4505-a3a2-15b87c847820) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:30:57 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-ac3b4b36-4a4d-4ea6-a3eb-48f86bed4f46 tempest-ProjectReaderTests-888867065 None] Created volume successfully. Nov 04 10:30:57 devstack sudo[105029]: pam_unix(sudo:session): session closed for user root Nov 04 10:30:57 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-0d9a9cfd-99f9-4310-b195-9f3238f0cd8f tempest-VolumeImageDependencyTests-1606162103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-79bf3147-d35e-4a1e-873c-bf4fa64d4888 1073741824" returned: 0 in 0.503s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:30:57 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-0d9a9cfd-99f9-4310-b195-9f3238f0cd8f tempest-VolumeImageDependencyTests-1606162103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-79bf3147-d35e-4a1e-873c-bf4fa64d4888 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:30:57 devstack sudo[105036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-79bf3147-d35e-4a1e-873c-bf4fa64d4888 Nov 04 10:30:57 devstack sudo[105036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:30:58 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-775a97c9-2889-4d80-adad-ad479e172cac tempest-VolumeDependencyTests-268296630 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:30:58 devstack sudo[105036]: pam_unix(sudo:session): session closed for user root Nov 04 10:30:58 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-775a97c9-2889-4d80-adad-ad479e172cac tempest-VolumeDependencyTests-268296630 None] Flow 'volume_create_manager' (9aa57288-4127-4101-a905-a968ba51b311) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:30:58 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-775a97c9-2889-4d80-adad-ad479e172cac tempest-VolumeDependencyTests-268296630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54a70427-c684-407b-a13d-db85638851b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:30:58 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-0d9a9cfd-99f9-4310-b195-9f3238f0cd8f tempest-VolumeImageDependencyTests-1606162103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-79bf3147-d35e-4a1e-873c-bf4fa64d4888" returned: 0 in 0.331s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:30:58 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-0d9a9cfd-99f9-4310-b195-9f3238f0cd8f tempest-VolumeImageDependencyTests-1606162103 None] <== create_volume: return (890ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 10:30:58 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-0d9a9cfd-99f9-4310-b195-9f3238f0cd8f tempest-VolumeImageDependencyTests-1606162103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.892s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:30:58 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-775a97c9-2889-4d80-adad-ad479e172cac tempest-VolumeDependencyTests-268296630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54a70427-c684-407b-a13d-db85638851b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:30:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-841530078',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89a35098-136f-4c6f-978a-dff445a37b20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='076179b95334487ab9b5efd07166eb55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:30:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:30:58Z,use_quota=True,user_id='8886f96787794bd398d700a309a53c92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:30:58 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-775a97c9-2889-4d80-adad-ad479e172cac tempest-VolumeDependencyTests-268296630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6187e045-2f2f-4f7f-a56e-cf7aaf963a0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:30:58 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-775a97c9-2889-4d80-adad-ad479e172cac tempest-VolumeDependencyTests-268296630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6187e045-2f2f-4f7f-a56e-cf7aaf963a0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:30:58 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-775a97c9-2889-4d80-adad-ad479e172cac tempest-VolumeDependencyTests-268296630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (774486a8-192d-4651-84bc-51919e8bfe91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:30:58 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-775a97c9-2889-4d80-adad-ad479e172cac tempest-VolumeDependencyTests-268296630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (774486a8-192d-4651-84bc-51919e8bfe91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89a35098-136f-4c6f-978a-dff445a37b20', 'volume_name': 'volume-89a35098-136f-4c6f-978a-dff445a37b20', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:30:58 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-775a97c9-2889-4d80-adad-ad479e172cac tempest-VolumeDependencyTests-268296630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87a2eb8c-585b-4039-a9e6-9136f52077a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:30:58 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-775a97c9-2889-4d80-adad-ad479e172cac tempest-VolumeDependencyTests-268296630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87a2eb8c-585b-4039-a9e6-9136f52077a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:30:58 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-775a97c9-2889-4d80-adad-ad479e172cac tempest-VolumeDependencyTests-268296630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f8ed081-267a-4902-b873-1a1259a2fecd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:30:58 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-775a97c9-2889-4d80-adad-ad479e172cac tempest-VolumeDependencyTests-268296630 None] Volume 89a35098-136f-4c6f-978a-dff445a37b20: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89a35098-136f-4c6f-978a-dff445a37b20', 'volume_size': 1} Nov 04 10:30:58 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-775a97c9-2889-4d80-adad-ad479e172cac tempest-VolumeDependencyTests-268296630 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:30:58 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-775a97c9-2889-4d80-adad-ad479e172cac tempest-VolumeDependencyTests-268296630 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:30:58 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-775a97c9-2889-4d80-adad-ad479e172cac tempest-VolumeDependencyTests-268296630 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:30:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-841530078',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89a35098-136f-4c6f-978a-dff445a37b20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='076179b95334487ab9b5efd07166eb55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:30:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:30:58Z,use_quota=True,user_id='8886f96787794bd398d700a309a53c92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 10:30:58 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-775a97c9-2889-4d80-adad-ad479e172cac tempest-VolumeDependencyTests-268296630 None] Creating volume 89a35098-136f-4c6f-978a-dff445a37b20 {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:30:58 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-775a97c9-2889-4d80-adad-ad479e172cac tempest-VolumeDependencyTests-268296630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:30:58 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-775a97c9-2889-4d80-adad-ad479e172cac tempest-VolumeDependencyTests-268296630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:30:58 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-775a97c9-2889-4d80-adad-ad479e172cac tempest-VolumeDependencyTests-268296630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:30:58 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-775a97c9-2889-4d80-adad-ad479e172cac tempest-VolumeDependencyTests-268296630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:30:58 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-775a97c9-2889-4d80-adad-ad479e172cac tempest-VolumeDependencyTests-268296630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:30:58 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-775a97c9-2889-4d80-adad-ad479e172cac tempest-VolumeDependencyTests-268296630 None] Selected osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:30:58 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-775a97c9-2889-4d80-adad-ad479e172cac tempest-VolumeDependencyTests-268296630 None] casted to osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 Nov 04 10:30:58 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-775a97c9-2889-4d80-adad-ad479e172cac tempest-VolumeDependencyTests-268296630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-89a35098-136f-4c6f-978a-dff445a37b20 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:30:58 devstack cinder-volume[87068]: DEBUG cinder.volume.volume_utils [None req-0d9a9cfd-99f9-4310-b195-9f3238f0cd8f tempest-VolumeImageDependencyTests-1606162103 None] Attempting download of 5e2451fa-8177-4d0e-aafa-55f777b30d70 ((None, [{'url': 'file:///opt/stack/data/glance/images/5e2451fa-8177-4d0e-aafa-55f777b30d70', 'metadata': {}}])) to volume 79bf3147-d35e-4a1e-873c-bf4fa64d4888. {{(pid=87068) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 04 10:30:58 devstack sudo[105039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-89a35098-136f-4c6f-978a-dff445a37b20 1073741824 Nov 04 10:30:58 devstack sudo[105039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:30:58 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[696fffe6-3466-4cda-8cda-c73d57e5abb5]: (4, 'raw') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:30:58 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-0d9a9cfd-99f9-4310-b195-9f3238f0cd8f tempest-VolumeImageDependencyTests-1606162103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5e2451fa-8177-4d0e-aafa-55f777b30d70_l52nlilo {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:30:58 devstack sudo[105041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5e2451fa-8177-4d0e-aafa-55f777b30d70_l52nlilo Nov 04 10:30:58 devstack sudo[105041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:30:58 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-52ab2f12-1cea-40ab-aa12-c76c890dfe58 tempest-ProjectReaderTests-888867065 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:30:58 devstack sudo[105041]: pam_unix(sudo:session): session closed for user root Nov 04 10:30:58 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-0d9a9cfd-99f9-4310-b195-9f3238f0cd8f tempest-VolumeImageDependencyTests-1606162103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5e2451fa-8177-4d0e-aafa-55f777b30d70_l52nlilo" returned: 0 in 0.406s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:30:58 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-0d9a9cfd-99f9-4310-b195-9f3238f0cd8f tempest-VolumeImageDependencyTests-1606162103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5e2451fa-8177-4d0e-aafa-55f777b30d70_l52nlilo {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:30:58 devstack sudo[105039]: pam_unix(sudo:session): session closed for user root Nov 04 10:30:58 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-775a97c9-2889-4d80-adad-ad479e172cac tempest-VolumeDependencyTests-268296630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-89a35098-136f-4c6f-978a-dff445a37b20 1073741824" returned: 0 in 0.572s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:30:58 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-775a97c9-2889-4d80-adad-ad479e172cac tempest-VolumeDependencyTests-268296630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-89a35098-136f-4c6f-978a-dff445a37b20 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:30:58 devstack sudo[105049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5e2451fa-8177-4d0e-aafa-55f777b30d70_l52nlilo Nov 04 10:30:58 devstack sudo[105049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:30:58 devstack sudo[105050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-89a35098-136f-4c6f-978a-dff445a37b20 Nov 04 10:30:58 devstack sudo[105050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:30:59 devstack sudo[105049]: pam_unix(sudo:session): session closed for user root Nov 04 10:30:59 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-0d9a9cfd-99f9-4310-b195-9f3238f0cd8f tempest-VolumeImageDependencyTests-1606162103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5e2451fa-8177-4d0e-aafa-55f777b30d70_l52nlilo" returned: 1 in 0.340s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:30:59 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-0d9a9cfd-99f9-4310-b195-9f3238f0cd8f tempest-VolumeImageDependencyTests-1606162103 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5e2451fa-8177-4d0e-aafa-55f777b30d70_l52nlilo' failed. Not Retrying. {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 04 10:30:59 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e424edb-3085-46e0-8b39-cdde77f130f9]: (4, 'raw') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:30:59 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-0d9a9cfd-99f9-4310-b195-9f3238f0cd8f tempest-VolumeImageDependencyTests-1606162103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5e2451fa-8177-4d0e-aafa-55f777b30d70_zt3qe68rdevstack@QuobyteHD {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:30:59 devstack sudo[105050]: pam_unix(sudo:session): session closed for user root Nov 04 10:30:59 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-775a97c9-2889-4d80-adad-ad479e172cac tempest-VolumeDependencyTests-268296630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-89a35098-136f-4c6f-978a-dff445a37b20" returned: 0 in 0.287s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:30:59 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-775a97c9-2889-4d80-adad-ad479e172cac tempest-VolumeDependencyTests-268296630 None] <== create_volume: return (901ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 10:30:59 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-775a97c9-2889-4d80-adad-ad479e172cac tempest-VolumeDependencyTests-268296630 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.903s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:30:59 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-52ab2f12-1cea-40ab-aa12-c76c890dfe58 tempest-ProjectReaderTests-888867065 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.586s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:30:59 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-52ab2f12-1cea-40ab-aa12-c76c890dfe58 tempest-ProjectReaderTests-888867065 None] Creating offline snapshot ee5c75a5-da56-44e9-bef9-bb9cc1750594 of volume de47a656-f2a9-4f2c-80c9-af0608556b34 {{(pid=87068) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 10:30:59 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-775a97c9-2889-4d80-adad-ad479e172cac tempest-VolumeDependencyTests-268296630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f8ed081-267a-4902-b873-1a1259a2fecd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89a35098-136f-4c6f-978a-dff445a37b20', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:30:59 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-775a97c9-2889-4d80-adad-ad479e172cac tempest-VolumeDependencyTests-268296630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b09ffe3b-6c4f-4316-ab0d-220df7617e27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:30:59 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[6682dbc4-486a-4322-99e7-0c3d8a4bc3da]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:30:59 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-52ab2f12-1cea-40ab-aa12-c76c890dfe58 tempest-ProjectReaderTests-888867065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-de47a656-f2a9-4f2c-80c9-af0608556b34 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:30:59 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-775a97c9-2889-4d80-adad-ad479e172cac tempest-VolumeDependencyTests-268296630 None] Volume volume-89a35098-136f-4c6f-978a-dff445a37b20 (89a35098-136f-4c6f-978a-dff445a37b20): created successfully Nov 04 10:30:59 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-775a97c9-2889-4d80-adad-ad479e172cac tempest-VolumeDependencyTests-268296630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b09ffe3b-6c4f-4316-ab0d-220df7617e27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:30:59 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-775a97c9-2889-4d80-adad-ad479e172cac tempest-VolumeDependencyTests-268296630 None] Flow 'volume_create_manager' (9aa57288-4127-4101-a905-a968ba51b311) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:30:59 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-775a97c9-2889-4d80-adad-ad479e172cac tempest-VolumeDependencyTests-268296630 None] Created volume successfully. Nov 04 10:30:59 devstack sudo[105056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5e2451fa-8177-4d0e-aafa-55f777b30d70_zt3qe68rdevstack@QuobyteHD Nov 04 10:30:59 devstack sudo[105056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:30:59 devstack sudo[105057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-de47a656-f2a9-4f2c-80c9-af0608556b34 Nov 04 10:30:59 devstack sudo[105057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:30:59 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9ea08f8-7b81-4e17-bf48-5e37023374e1 tempest-ProjectReaderTests-869798815 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:30:59 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c9ea08f8-7b81-4e17-bf48-5e37023374e1 tempest-ProjectReaderTests-869798815 None] Flow 'volume_create_manager' (b9e1d212-176b-4d04-bf45-b2cd4c16b572) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:30:59 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c9ea08f8-7b81-4e17-bf48-5e37023374e1 tempest-ProjectReaderTests-869798815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc7985cd-6a94-48f7-8b82-f93a3d27eef7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:30:59 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c9ea08f8-7b81-4e17-bf48-5e37023374e1 tempest-ProjectReaderTests-869798815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc7985cd-6a94-48f7-8b82-f93a3d27eef7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:30:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1191335621',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95cb6c19-2566-4219-a807-df9da3facbb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f08593383b464bc1a3773c0a7b12ddf1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:30:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:30:59Z,use_quota=True,user_id='53d28dfee9454957b6fb2f5c08df4ddd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:30:59 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c9ea08f8-7b81-4e17-bf48-5e37023374e1 tempest-ProjectReaderTests-869798815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73ac106c-9486-48b9-97bd-4742e087c430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:30:59 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c9ea08f8-7b81-4e17-bf48-5e37023374e1 tempest-ProjectReaderTests-869798815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73ac106c-9486-48b9-97bd-4742e087c430) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:30:59 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c9ea08f8-7b81-4e17-bf48-5e37023374e1 tempest-ProjectReaderTests-869798815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (066e09ec-45d1-4099-b0fd-65639711ddb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:30:59 devstack sudo[105056]: pam_unix(sudo:session): session closed for user root Nov 04 10:30:59 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c9ea08f8-7b81-4e17-bf48-5e37023374e1 tempest-ProjectReaderTests-869798815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (066e09ec-45d1-4099-b0fd-65639711ddb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95cb6c19-2566-4219-a807-df9da3facbb5', 'volume_name': 'volume-95cb6c19-2566-4219-a807-df9da3facbb5', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:30:59 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c9ea08f8-7b81-4e17-bf48-5e37023374e1 tempest-ProjectReaderTests-869798815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7da2493-4de6-4d2b-aa8e-180acfa6e4ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:30:59 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c9ea08f8-7b81-4e17-bf48-5e37023374e1 tempest-ProjectReaderTests-869798815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7da2493-4de6-4d2b-aa8e-180acfa6e4ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:30:59 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c9ea08f8-7b81-4e17-bf48-5e37023374e1 tempest-ProjectReaderTests-869798815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67b17d59-624d-48b4-b3b7-b05fd9fe04b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:30:59 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-c9ea08f8-7b81-4e17-bf48-5e37023374e1 tempest-ProjectReaderTests-869798815 None] Volume 95cb6c19-2566-4219-a807-df9da3facbb5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95cb6c19-2566-4219-a807-df9da3facbb5', 'volume_size': 1} Nov 04 10:30:59 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-c9ea08f8-7b81-4e17-bf48-5e37023374e1 tempest-ProjectReaderTests-869798815 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:30:59 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-0d9a9cfd-99f9-4310-b195-9f3238f0cd8f tempest-VolumeImageDependencyTests-1606162103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5e2451fa-8177-4d0e-aafa-55f777b30d70_zt3qe68rdevstack@QuobyteHD" returned: 0 in 0.404s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:30:59 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-0d9a9cfd-99f9-4310-b195-9f3238f0cd8f tempest-VolumeImageDependencyTests-1606162103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5e2451fa-8177-4d0e-aafa-55f777b30d70_zt3qe68rdevstack@QuobyteHD {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:30:59 devstack sudo[105057]: pam_unix(sudo:session): session closed for user root Nov 04 10:30:59 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-52ab2f12-1cea-40ab-aa12-c76c890dfe58 tempest-ProjectReaderTests-888867065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-de47a656-f2a9-4f2c-80c9-af0608556b34" returned: 0 in 0.392s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:30:59 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-52ab2f12-1cea-40ab-aa12-c76c890dfe58 tempest-ProjectReaderTests-888867065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-de47a656-f2a9-4f2c-80c9-af0608556b34,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-de47a656-f2a9-4f2c-80c9-af0608556b34.ee5c75a5-da56-44e9-bef9-bb9cc1750594 1G {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:30:59 devstack sudo[105062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5e2451fa-8177-4d0e-aafa-55f777b30d70_zt3qe68rdevstack@QuobyteHD Nov 04 10:30:59 devstack sudo[105062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:30:59 devstack sudo[105066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-de47a656-f2a9-4f2c-80c9-af0608556b34,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-de47a656-f2a9-4f2c-80c9-af0608556b34.ee5c75a5-da56-44e9-bef9-bb9cc1750594 1G Nov 04 10:30:59 devstack sudo[105066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:30:59 devstack sudo[105062]: pam_unix(sudo:session): session closed for user root Nov 04 10:30:59 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-0d9a9cfd-99f9-4310-b195-9f3238f0cd8f tempest-VolumeImageDependencyTests-1606162103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5e2451fa-8177-4d0e-aafa-55f777b30d70_zt3qe68rdevstack@QuobyteHD" returned: 1 in 0.335s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:30:59 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-0d9a9cfd-99f9-4310-b195-9f3238f0cd8f tempest-VolumeImageDependencyTests-1606162103 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5e2451fa-8177-4d0e-aafa-55f777b30d70_zt3qe68rdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 04 10:30:59 devstack cinder-volume[87068]: DEBUG cinder.image.image_utils [None req-0d9a9cfd-99f9-4310-b195-9f3238f0cd8f tempest-VolumeImageDependencyTests-1606162103 None] 5e2451fa-8177-4d0e-aafa-55f777b30d70 was raw, converting to qcow2 {{(pid=87068) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 04 10:30:59 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-0d9a9cfd-99f9-4310-b195-9f3238f0cd8f tempest-VolumeImageDependencyTests-1606162103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_5e2451fa-8177-4d0e-aafa-55f777b30d70_zt3qe68rdevstack@QuobyteHD /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-79bf3147-d35e-4a1e-873c-bf4fa64d4888 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:30:59 devstack sudo[105075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_5e2451fa-8177-4d0e-aafa-55f777b30d70_zt3qe68rdevstack@QuobyteHD /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-79bf3147-d35e-4a1e-873c-bf4fa64d4888 Nov 04 10:30:59 devstack sudo[105075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:31:00 devstack sudo[105066]: pam_unix(sudo:session): session closed for user root Nov 04 10:31:00 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-52ab2f12-1cea-40ab-aa12-c76c890dfe58 tempest-ProjectReaderTests-888867065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-de47a656-f2a9-4f2c-80c9-af0608556b34,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-de47a656-f2a9-4f2c-80c9-af0608556b34.ee5c75a5-da56-44e9-bef9-bb9cc1750594 1G" returned: 0 in 0.406s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:31:00 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-52ab2f12-1cea-40ab-aa12-c76c890dfe58 tempest-ProjectReaderTests-888867065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de47a656-f2a9-4f2c-80c9-af0608556b34 -F qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-de47a656-f2a9-4f2c-80c9-af0608556b34.ee5c75a5-da56-44e9-bef9-bb9cc1750594 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:31:00 devstack sudo[105078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de47a656-f2a9-4f2c-80c9-af0608556b34 -F qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-de47a656-f2a9-4f2c-80c9-af0608556b34.ee5c75a5-da56-44e9-bef9-bb9cc1750594 Nov 04 10:31:00 devstack sudo[105078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:31:00 devstack sudo[105078]: pam_unix(sudo:session): session closed for user root Nov 04 10:31:00 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-52ab2f12-1cea-40ab-aa12-c76c890dfe58 tempest-ProjectReaderTests-888867065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de47a656-f2a9-4f2c-80c9-af0608556b34 -F qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-de47a656-f2a9-4f2c-80c9-af0608556b34.ee5c75a5-da56-44e9-bef9-bb9cc1750594" returned: 0 in 0.366s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:31:00 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-52ab2f12-1cea-40ab-aa12-c76c890dfe58 tempest-ProjectReaderTests-888867065 None] /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-de47a656-f2a9-4f2c-80c9-af0608556b34.ee5c75a5-da56-44e9-bef9-bb9cc1750594 is being set with open permissions: ugo+rw Nov 04 10:31:00 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-52ab2f12-1cea-40ab-aa12-c76c890dfe58 tempest-ProjectReaderTests-888867065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-de47a656-f2a9-4f2c-80c9-af0608556b34.ee5c75a5-da56-44e9-bef9-bb9cc1750594 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:31:00 devstack sudo[105087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-de47a656-f2a9-4f2c-80c9-af0608556b34.ee5c75a5-da56-44e9-bef9-bb9cc1750594 Nov 04 10:31:00 devstack sudo[105087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:31:00 devstack sudo[105075]: pam_unix(sudo:session): session closed for user root Nov 04 10:31:00 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-45c55576-2e3f-44e1-915d-9cb6f822ee3e tempest-VolumeDependencyTests-268296630 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:31:00 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-0d9a9cfd-99f9-4310-b195-9f3238f0cd8f tempest-VolumeImageDependencyTests-1606162103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_5e2451fa-8177-4d0e-aafa-55f777b30d70_zt3qe68rdevstack@QuobyteHD /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-79bf3147-d35e-4a1e-873c-bf4fa64d4888" returned: 0 in 0.578s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:31:00 devstack cinder-volume[87068]: DEBUG cinder.image.image_utils [None req-0d9a9cfd-99f9-4310-b195-9f3238f0cd8f tempest-VolumeImageDependencyTests-1606162103 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_5e2451fa-8177-4d0e-aafa-55f777b30d70_zt3qe68rdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-79bf3147-d35e-4a1e-873c-bf4fa64d4888 {{(pid=87068) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 04 10:31:00 devstack cinder-volume[87068]: INFO cinder.image.image_utils [None req-0d9a9cfd-99f9-4310-b195-9f3238f0cd8f tempest-VolumeImageDependencyTests-1606162103 None] Converted 0.00 MB image at 0.00 MB/s Nov 04 10:31:00 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-0d9a9cfd-99f9-4310-b195-9f3238f0cd8f tempest-VolumeImageDependencyTests-1606162103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-79bf3147-d35e-4a1e-873c-bf4fa64d4888 1G {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:31:00 devstack sudo[105089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-79bf3147-d35e-4a1e-873c-bf4fa64d4888 1G Nov 04 10:31:00 devstack sudo[105089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:31:00 devstack sudo[105087]: pam_unix(sudo:session): session closed for user root Nov 04 10:31:00 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-52ab2f12-1cea-40ab-aa12-c76c890dfe58 tempest-ProjectReaderTests-888867065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-de47a656-f2a9-4f2c-80c9-af0608556b34.ee5c75a5-da56-44e9-bef9-bb9cc1750594" returned: 0 in 0.251s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:31:00 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-52ab2f12-1cea-40ab-aa12-c76c890dfe58 tempest-ProjectReaderTests-888867065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-de47a656-f2a9-4f2c-80c9-af0608556b34.info {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:31:00 devstack sudo[105094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-de47a656-f2a9-4f2c-80c9-af0608556b34.info Nov 04 10:31:00 devstack sudo[105094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:31:00 devstack sudo[105089]: pam_unix(sudo:session): session closed for user root Nov 04 10:31:00 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-0d9a9cfd-99f9-4310-b195-9f3238f0cd8f tempest-VolumeImageDependencyTests-1606162103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-79bf3147-d35e-4a1e-873c-bf4fa64d4888 1G" returned: 0 in 0.324s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:31:00 devstack cinder-volume[87068]: DEBUG cinder.volume.volume_utils [None req-0d9a9cfd-99f9-4310-b195-9f3238f0cd8f tempest-VolumeImageDependencyTests-1606162103 None] Downloaded image 5e2451fa-8177-4d0e-aafa-55f777b30d70 ((None, [{'url': 'file:///opt/stack/data/glance/images/5e2451fa-8177-4d0e-aafa-55f777b30d70', 'metadata': {}}])) to volume 79bf3147-d35e-4a1e-873c-bf4fa64d4888 successfully. {{(pid=87068) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 04 10:31:00 devstack cinder-volume[87068]: DEBUG cinder.image.image_utils [None req-0d9a9cfd-99f9-4310-b195-9f3238f0cd8f tempest-VolumeImageDependencyTests-1606162103 None] Temporary image 5e2451fa-8177-4d0e-aafa-55f777b30d70 for user 8f8b8c2cc80141628ad52da331e19880 is deleted. {{(pid=87068) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 04 10:31:00 devstack cinder-volume[87068]: DEBUG cinder.volume.volume_utils [None req-0d9a9cfd-99f9-4310-b195-9f3238f0cd8f tempest-VolumeImageDependencyTests-1606162103 None] Marking volume 79bf3147-d35e-4a1e-873c-bf4fa64d4888 as bootable. {{(pid=87068) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 04 10:31:00 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d9a9cfd-99f9-4310-b195-9f3238f0cd8f tempest-VolumeImageDependencyTests-1606162103 None] Copying metadata from image 5e2451fa-8177-4d0e-aafa-55f777b30d70 to 79bf3147-d35e-4a1e-873c-bf4fa64d4888. {{(pid=87068) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 04 10:31:00 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d9a9cfd-99f9-4310-b195-9f3238f0cd8f tempest-VolumeImageDependencyTests-1606162103 None] Creating volume glance metadata for volume 79bf3147-d35e-4a1e-873c-bf4fa64d4888 backed by image 5e2451fa-8177-4d0e-aafa-55f777b30d70 with: {'image_id': '5e2451fa-8177-4d0e-aafa-55f777b30d70', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '17ae638aece94aa3bee715bb46e72371', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87068) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 04 10:31:00 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-0d9a9cfd-99f9-4310-b195-9f3238f0cd8f tempest-VolumeImageDependencyTests-1606162103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bac475a-7db5-4a7e-aa06-cc425dbe2a64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79bf3147-d35e-4a1e-873c-bf4fa64d4888', 'volume_size': 1, 'image_id': '5e2451fa-8177-4d0e-aafa-55f777b30d70', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5e2451fa-8177-4d0e-aafa-55f777b30d70', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '17ae638aece94aa3bee715bb46e72371', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a5ed3796dcb243cbb968c4ded7244840', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2954c23a8f91092333a93e564f36b4db11053ba4e52158bbe0f4df329567a5ad465967c8426a6de774980cee277b1e55a193c31721729d55fac07c77dbcf38a3', 'id': '5e2451fa-8177-4d0e-aafa-55f777b30d70', 'created_at': datetime.datetime(2026, 11, 4, 9, 30, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 9, 30, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5e2451fa-8177-4d0e-aafa-55f777b30d70/file', 'properties': {}}, 'image_service': }' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:31:00 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-0d9a9cfd-99f9-4310-b195-9f3238f0cd8f tempest-VolumeImageDependencyTests-1606162103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ed970e7-b6b4-4fed-826a-4bb2a00c31cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:31:00 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-0d9a9cfd-99f9-4310-b195-9f3238f0cd8f tempest-VolumeImageDependencyTests-1606162103 None] Volume volume-79bf3147-d35e-4a1e-873c-bf4fa64d4888 (79bf3147-d35e-4a1e-873c-bf4fa64d4888): created successfully Nov 04 10:31:00 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-0d9a9cfd-99f9-4310-b195-9f3238f0cd8f tempest-VolumeImageDependencyTests-1606162103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ed970e7-b6b4-4fed-826a-4bb2a00c31cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:31:00 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-0d9a9cfd-99f9-4310-b195-9f3238f0cd8f tempest-VolumeImageDependencyTests-1606162103 None] Flow 'volume_create_manager' (e75b4e6b-1750-4624-8115-a42c0d1e4bbc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:31:00 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-0d9a9cfd-99f9-4310-b195-9f3238f0cd8f tempest-VolumeImageDependencyTests-1606162103 None] Created volume successfully. Nov 04 10:31:00 devstack sudo[105094]: pam_unix(sudo:session): session closed for user root Nov 04 10:31:00 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-52ab2f12-1cea-40ab-aa12-c76c890dfe58 tempest-ProjectReaderTests-888867065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-de47a656-f2a9-4f2c-80c9-af0608556b34.info" returned: 0 in 0.260s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:31:00 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-52ab2f12-1cea-40ab-aa12-c76c890dfe58 tempest-ProjectReaderTests-888867065 None] /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-de47a656-f2a9-4f2c-80c9-af0608556b34.info is being set with open permissions: ugo+rw Nov 04 10:31:00 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-52ab2f12-1cea-40ab-aa12-c76c890dfe58 tempest-ProjectReaderTests-888867065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-de47a656-f2a9-4f2c-80c9-af0608556b34.info {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:31:00 devstack sudo[105098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-de47a656-f2a9-4f2c-80c9-af0608556b34.info Nov 04 10:31:00 devstack sudo[105098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:31:01 devstack sudo[105098]: pam_unix(sudo:session): session closed for user root Nov 04 10:31:01 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-52ab2f12-1cea-40ab-aa12-c76c890dfe58 tempest-ProjectReaderTests-888867065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-de47a656-f2a9-4f2c-80c9-af0608556b34.info" returned: 0 in 0.231s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:31:01 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-52ab2f12-1cea-40ab-aa12-c76c890dfe58 tempest-ProjectReaderTests-888867065 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.032s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:31:01 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-c9ea08f8-7b81-4e17-bf48-5e37023374e1 tempest-ProjectReaderTests-869798815 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.665s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:31:01 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-c9ea08f8-7b81-4e17-bf48-5e37023374e1 tempest-ProjectReaderTests-869798815 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:30:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1191335621',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95cb6c19-2566-4219-a807-df9da3facbb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f08593383b464bc1a3773c0a7b12ddf1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:30:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:30:59Z,use_quota=True,user_id='53d28dfee9454957b6fb2f5c08df4ddd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 10:31:01 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-c9ea08f8-7b81-4e17-bf48-5e37023374e1 tempest-ProjectReaderTests-869798815 None] Creating volume 95cb6c19-2566-4219-a807-df9da3facbb5 {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:31:01 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-c9ea08f8-7b81-4e17-bf48-5e37023374e1 tempest-ProjectReaderTests-869798815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:31:01 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-c9ea08f8-7b81-4e17-bf48-5e37023374e1 tempest-ProjectReaderTests-869798815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:31:01 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-c9ea08f8-7b81-4e17-bf48-5e37023374e1 tempest-ProjectReaderTests-869798815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:31:01 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-c9ea08f8-7b81-4e17-bf48-5e37023374e1 tempest-ProjectReaderTests-869798815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:31:01 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-c9ea08f8-7b81-4e17-bf48-5e37023374e1 tempest-ProjectReaderTests-869798815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:31:01 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-c9ea08f8-7b81-4e17-bf48-5e37023374e1 tempest-ProjectReaderTests-869798815 None] Selected osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:31:01 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-c9ea08f8-7b81-4e17-bf48-5e37023374e1 tempest-ProjectReaderTests-869798815 None] casted to osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 Nov 04 10:31:01 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c9ea08f8-7b81-4e17-bf48-5e37023374e1 tempest-ProjectReaderTests-869798815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-95cb6c19-2566-4219-a807-df9da3facbb5 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:31:01 devstack sudo[105101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-95cb6c19-2566-4219-a807-df9da3facbb5 1073741824 Nov 04 10:31:01 devstack sudo[105101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:31:01 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-52ab2f12-1cea-40ab-aa12-c76c890dfe58 tempest-ProjectReaderTests-888867065 None] Create snapshot completed successfully Nov 04 10:31:01 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-b7926dc2-7e04-40ad-a704-969187ab57e3 tempest-VolumeImageDependencyTests-1606162103 None] Acquiring lock "cinder-79bf3147-d35e-4a1e-873c-bf4fa64d4888-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:31:01 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-b7926dc2-7e04-40ad-a704-969187ab57e3 tempest-VolumeImageDependencyTests-1606162103 None] Lock "cinder-79bf3147-d35e-4a1e-873c-bf4fa64d4888-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:31:01 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-b7926dc2-7e04-40ad-a704-969187ab57e3 tempest-VolumeImageDependencyTests-1606162103 None] Acquiring lock "cinder-quobyte-79bf3147-d35e-4a1e-873c-bf4fa64d4888" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:31:01 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-b7926dc2-7e04-40ad-a704-969187ab57e3 tempest-VolumeImageDependencyTests-1606162103 None] Lock "cinder-quobyte-79bf3147-d35e-4a1e-873c-bf4fa64d4888" acquired by "delete_volume" :: waited 0.016s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:31:01 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb9deb1f-ad83-455c-a033-c321cc29abd7]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:31:01 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-b7926dc2-7e04-40ad-a704-969187ab57e3 tempest-VolumeImageDependencyTests-1606162103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-79bf3147-d35e-4a1e-873c-bf4fa64d4888 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:31:01 devstack sudo[105101]: pam_unix(sudo:session): session closed for user root Nov 04 10:31:01 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c9ea08f8-7b81-4e17-bf48-5e37023374e1 tempest-ProjectReaderTests-869798815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-95cb6c19-2566-4219-a807-df9da3facbb5 1073741824" returned: 0 in 0.543s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:31:01 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-9c6eacad-fadd-4ee7-85c7-322038fc873c tempest-ProjectReaderTests-888867065 None] Acquiring lock "cinder-ee5c75a5-da56-44e9-bef9-bb9cc1750594-delete_snapshot" by "delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:31:01 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-9c6eacad-fadd-4ee7-85c7-322038fc873c tempest-ProjectReaderTests-888867065 None] Lock "cinder-ee5c75a5-da56-44e9-bef9-bb9cc1750594-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:31:01 devstack sudo[105107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-79bf3147-d35e-4a1e-873c-bf4fa64d4888 Nov 04 10:31:01 devstack sudo[105107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:31:01 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-9c6eacad-fadd-4ee7-85c7-322038fc873c tempest-ProjectReaderTests-888867065 None] Acquiring lock "cinder-quobyte-de47a656-f2a9-4f2c-80c9-af0608556b34" by "delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:31:01 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-9c6eacad-fadd-4ee7-85c7-322038fc873c tempest-ProjectReaderTests-888867065 None] Lock "cinder-quobyte-de47a656-f2a9-4f2c-80c9-af0608556b34" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:31:01 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-9c6eacad-fadd-4ee7-85c7-322038fc873c tempest-ProjectReaderTests-888867065 None] Acquiring lock "cinder-quobyte-ee5c75a5-da56-44e9-bef9-bb9cc1750594" by "_delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:31:01 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c9ea08f8-7b81-4e17-bf48-5e37023374e1 tempest-ProjectReaderTests-869798815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-95cb6c19-2566-4219-a807-df9da3facbb5 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:31:01 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-9c6eacad-fadd-4ee7-85c7-322038fc873c tempest-ProjectReaderTests-888867065 None] Lock "cinder-quobyte-ee5c75a5-da56-44e9-bef9-bb9cc1750594" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:31:01 devstack sudo[105109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-95cb6c19-2566-4219-a807-df9da3facbb5 Nov 04 10:31:01 devstack sudo[105109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:31:01 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-9c6eacad-fadd-4ee7-85c7-322038fc873c tempest-ProjectReaderTests-888867065 None] Deleting offline snapshot ee5c75a5-da56-44e9-bef9-bb9cc1750594 of volume de47a656-f2a9-4f2c-80c9-af0608556b34 {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 10:31:01 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-9c6eacad-fadd-4ee7-85c7-322038fc873c tempest-ProjectReaderTests-888867065 None] snapshot_file for this snap is: volume-de47a656-f2a9-4f2c-80c9-af0608556b34.ee5c75a5-da56-44e9-bef9-bb9cc1750594 {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 10:31:01 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[03f57561-48d7-4341-b671-b249b4f00a2d]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:31:01 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-9c6eacad-fadd-4ee7-85c7-322038fc873c tempest-ProjectReaderTests-888867065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-de47a656-f2a9-4f2c-80c9-af0608556b34.ee5c75a5-da56-44e9-bef9-bb9cc1750594 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:31:02 devstack sudo[105111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-de47a656-f2a9-4f2c-80c9-af0608556b34.ee5c75a5-da56-44e9-bef9-bb9cc1750594 Nov 04 10:31:02 devstack sudo[105111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:31:02 devstack sudo[105107]: pam_unix(sudo:session): session closed for user root Nov 04 10:31:02 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-b7926dc2-7e04-40ad-a704-969187ab57e3 tempest-VolumeImageDependencyTests-1606162103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-79bf3147-d35e-4a1e-873c-bf4fa64d4888" returned: 0 in 0.418s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:31:02 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-b7926dc2-7e04-40ad-a704-969187ab57e3 tempest-VolumeImageDependencyTests-1606162103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-79bf3147-d35e-4a1e-873c-bf4fa64d4888 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:31:02 devstack sudo[105109]: pam_unix(sudo:session): session closed for user root Nov 04 10:31:02 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-c9ea08f8-7b81-4e17-bf48-5e37023374e1 tempest-ProjectReaderTests-869798815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-95cb6c19-2566-4219-a807-df9da3facbb5" returned: 0 in 0.263s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:31:02 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-c9ea08f8-7b81-4e17-bf48-5e37023374e1 tempest-ProjectReaderTests-869798815 None] <== create_volume: return (897ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 10:31:02 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-c9ea08f8-7b81-4e17-bf48-5e37023374e1 tempest-ProjectReaderTests-869798815 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.904s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:31:02 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-45c55576-2e3f-44e1-915d-9cb6f822ee3e tempest-VolumeDependencyTests-268296630 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.654s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:31:02 devstack sudo[105117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-79bf3147-d35e-4a1e-873c-bf4fa64d4888 Nov 04 10:31:02 devstack sudo[105117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:31:02 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c9ea08f8-7b81-4e17-bf48-5e37023374e1 tempest-ProjectReaderTests-869798815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67b17d59-624d-48b4-b3b7-b05fd9fe04b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95cb6c19-2566-4219-a807-df9da3facbb5', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:31:02 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c9ea08f8-7b81-4e17-bf48-5e37023374e1 tempest-ProjectReaderTests-869798815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f09b0121-0997-4387-a10c-d7425e8cd4c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:31:02 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-45c55576-2e3f-44e1-915d-9cb6f822ee3e tempest-VolumeDependencyTests-268296630 None] Creating offline snapshot d0134cda-5688-4138-b33f-8f095bdb9be2 of volume 89a35098-136f-4c6f-978a-dff445a37b20 {{(pid=87068) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 10:31:02 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-c9ea08f8-7b81-4e17-bf48-5e37023374e1 tempest-ProjectReaderTests-869798815 None] Volume volume-95cb6c19-2566-4219-a807-df9da3facbb5 (95cb6c19-2566-4219-a807-df9da3facbb5): created successfully Nov 04 10:31:02 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c9ea08f8-7b81-4e17-bf48-5e37023374e1 tempest-ProjectReaderTests-869798815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f09b0121-0997-4387-a10c-d7425e8cd4c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:31:02 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-c9ea08f8-7b81-4e17-bf48-5e37023374e1 tempest-ProjectReaderTests-869798815 None] Flow 'volume_create_manager' (b9e1d212-176b-4d04-bf45-b2cd4c16b572) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:31:02 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[f15d866e-6617-494f-ae2c-38ade8588e5e]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:31:02 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-45c55576-2e3f-44e1-915d-9cb6f822ee3e tempest-VolumeDependencyTests-268296630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-89a35098-136f-4c6f-978a-dff445a37b20 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:31:02 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-c9ea08f8-7b81-4e17-bf48-5e37023374e1 tempest-ProjectReaderTests-869798815 None] Created volume successfully. Nov 04 10:31:02 devstack sudo[105119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-89a35098-136f-4c6f-978a-dff445a37b20 Nov 04 10:31:02 devstack sudo[105119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:31:02 devstack sudo[105111]: pam_unix(sudo:session): session closed for user root Nov 04 10:31:02 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-9c6eacad-fadd-4ee7-85c7-322038fc873c tempest-ProjectReaderTests-888867065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-de47a656-f2a9-4f2c-80c9-af0608556b34.ee5c75a5-da56-44e9-bef9-bb9cc1750594" returned: 0 in 0.407s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:31:02 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-9c6eacad-fadd-4ee7-85c7-322038fc873c tempest-ProjectReaderTests-888867065 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-de47a656-f2a9-4f2c-80c9-af0608556b34(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87068) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 10:31:02 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e8faa8a-3b2c-4e12-8369-cf5f4bf17e95]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:31:02 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-9c6eacad-fadd-4ee7-85c7-322038fc873c tempest-ProjectReaderTests-888867065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-de47a656-f2a9-4f2c-80c9-af0608556b34 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:31:02 devstack sudo[105117]: pam_unix(sudo:session): session closed for user root Nov 04 10:31:02 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-b7926dc2-7e04-40ad-a704-969187ab57e3 tempest-VolumeImageDependencyTests-1606162103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-79bf3147-d35e-4a1e-873c-bf4fa64d4888" returned: 0 in 0.270s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:31:02 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-b7926dc2-7e04-40ad-a704-969187ab57e3 tempest-VolumeImageDependencyTests-1606162103 None] Lock "cinder-quobyte-79bf3147-d35e-4a1e-873c-bf4fa64d4888" released by "delete_volume" :: held 0.744s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:31:02 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-b7926dc2-7e04-40ad-a704-969187ab57e3 tempest-VolumeImageDependencyTests-1606162103 None] Created reservations ['9a04dea9-133d-4a1a-a7d0-4ce5c259c9e2', '416f4492-b179-48fd-a2e2-de9541de2eec', 'b85027d0-0945-45e1-960f-0f2f5e4c55e6', '29f2227d-7432-415a-a89f-df60d879aad6'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:31:02 devstack sudo[105125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-de47a656-f2a9-4f2c-80c9-af0608556b34 Nov 04 10:31:02 devstack sudo[105125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:31:02 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-b7926dc2-7e04-40ad-a704-969187ab57e3 tempest-VolumeImageDependencyTests-1606162103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:31:02 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-b7926dc2-7e04-40ad-a704-969187ab57e3 tempest-VolumeImageDependencyTests-1606162103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:31:02 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-b7926dc2-7e04-40ad-a704-969187ab57e3 tempest-VolumeImageDependencyTests-1606162103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:31:02 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-b7926dc2-7e04-40ad-a704-969187ab57e3 tempest-VolumeImageDependencyTests-1606162103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:31:02 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-b7926dc2-7e04-40ad-a704-969187ab57e3 tempest-VolumeImageDependencyTests-1606162103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:31:02 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-b7926dc2-7e04-40ad-a704-969187ab57e3 tempest-VolumeImageDependencyTests-1606162103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:31:02 devstack sudo[105129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:31:02 devstack sudo[105129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:31:02 devstack sudo[105119]: pam_unix(sudo:session): session closed for user root Nov 04 10:31:02 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-45c55576-2e3f-44e1-915d-9cb6f822ee3e tempest-VolumeDependencyTests-268296630 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-89a35098-136f-4c6f-978a-dff445a37b20" returned: 0 in 0.445s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:31:02 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-45c55576-2e3f-44e1-915d-9cb6f822ee3e tempest-VolumeDependencyTests-268296630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-89a35098-136f-4c6f-978a-dff445a37b20,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-89a35098-136f-4c6f-978a-dff445a37b20.d0134cda-5688-4138-b33f-8f095bdb9be2 1G {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:31:02 devstack sudo[105132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-89a35098-136f-4c6f-978a-dff445a37b20,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-89a35098-136f-4c6f-978a-dff445a37b20.d0134cda-5688-4138-b33f-8f095bdb9be2 1G Nov 04 10:31:02 devstack sudo[105132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:31:02 devstack sudo[105125]: pam_unix(sudo:session): session closed for user root Nov 04 10:31:02 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-9c6eacad-fadd-4ee7-85c7-322038fc873c tempest-ProjectReaderTests-888867065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-de47a656-f2a9-4f2c-80c9-af0608556b34" returned: 0 in 0.462s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:31:02 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-9c6eacad-fadd-4ee7-85c7-322038fc873c tempest-ProjectReaderTests-888867065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-de47a656-f2a9-4f2c-80c9-af0608556b34.ee5c75a5-da56-44e9-bef9-bb9cc1750594 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:31:02 devstack sudo[105138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-de47a656-f2a9-4f2c-80c9-af0608556b34.ee5c75a5-da56-44e9-bef9-bb9cc1750594 Nov 04 10:31:02 devstack sudo[105138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:31:02 devstack sudo[105129]: pam_unix(sudo:session): session closed for user root Nov 04 10:31:02 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-b7926dc2-7e04-40ad-a704-969187ab57e3 tempest-VolumeImageDependencyTests-1606162103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.373s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:31:02 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-b7926dc2-7e04-40ad-a704-969187ab57e3 tempest-VolumeImageDependencyTests-1606162103 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:31:02 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-b7926dc2-7e04-40ad-a704-969187ab57e3 tempest-VolumeImageDependencyTests-1606162103 None] Deleted volume successfully. Nov 04 10:31:02 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-90f0d107-f564-4e6e-9002-cfb879e5f77c tempest-ProjectReaderTests-869798815 None] Acquiring lock "cinder-95cb6c19-2566-4219-a807-df9da3facbb5-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:31:02 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-90f0d107-f564-4e6e-9002-cfb879e5f77c tempest-ProjectReaderTests-869798815 None] Lock "cinder-95cb6c19-2566-4219-a807-df9da3facbb5-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:31:02 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-b7926dc2-7e04-40ad-a704-969187ab57e3 tempest-VolumeImageDependencyTests-1606162103 None] Lock "cinder-79bf3147-d35e-4a1e-873c-bf4fa64d4888-delete_volume" released by "delete_volume" :: held 1.392s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:31:03 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-90f0d107-f564-4e6e-9002-cfb879e5f77c tempest-ProjectReaderTests-869798815 None] Acquiring lock "cinder-quobyte-95cb6c19-2566-4219-a807-df9da3facbb5" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:31:03 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-90f0d107-f564-4e6e-9002-cfb879e5f77c tempest-ProjectReaderTests-869798815 None] Lock "cinder-quobyte-95cb6c19-2566-4219-a807-df9da3facbb5" acquired by "delete_volume" :: waited 0.023s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:31:03 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1b30915-2580-4bcb-b514-356d042e9fb3]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:31:03 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-90f0d107-f564-4e6e-9002-cfb879e5f77c tempest-ProjectReaderTests-869798815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-95cb6c19-2566-4219-a807-df9da3facbb5 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:31:03 devstack sudo[105144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-95cb6c19-2566-4219-a807-df9da3facbb5 Nov 04 10:31:03 devstack sudo[105144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:31:03 devstack sudo[105132]: pam_unix(sudo:session): session closed for user root Nov 04 10:31:03 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-45c55576-2e3f-44e1-915d-9cb6f822ee3e tempest-VolumeDependencyTests-268296630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-89a35098-136f-4c6f-978a-dff445a37b20,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-89a35098-136f-4c6f-978a-dff445a37b20.d0134cda-5688-4138-b33f-8f095bdb9be2 1G" returned: 0 in 0.613s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:31:03 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-45c55576-2e3f-44e1-915d-9cb6f822ee3e tempest-VolumeDependencyTests-268296630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-89a35098-136f-4c6f-978a-dff445a37b20 -F qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-89a35098-136f-4c6f-978a-dff445a37b20.d0134cda-5688-4138-b33f-8f095bdb9be2 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:31:03 devstack sudo[105151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-89a35098-136f-4c6f-978a-dff445a37b20 -F qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-89a35098-136f-4c6f-978a-dff445a37b20.d0134cda-5688-4138-b33f-8f095bdb9be2 Nov 04 10:31:03 devstack sudo[105151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:31:03 devstack sudo[105138]: pam_unix(sudo:session): session closed for user root Nov 04 10:31:03 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-9c6eacad-fadd-4ee7-85c7-322038fc873c tempest-ProjectReaderTests-888867065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-de47a656-f2a9-4f2c-80c9-af0608556b34.ee5c75a5-da56-44e9-bef9-bb9cc1750594" returned: 0 in 0.544s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:31:03 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-9c6eacad-fadd-4ee7-85c7-322038fc873c tempest-ProjectReaderTests-888867065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-de47a656-f2a9-4f2c-80c9-af0608556b34.ee5c75a5-da56-44e9-bef9-bb9cc1750594 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:31:03 devstack sudo[105153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-de47a656-f2a9-4f2c-80c9-af0608556b34.ee5c75a5-da56-44e9-bef9-bb9cc1750594 Nov 04 10:31:03 devstack sudo[105153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:31:03 devstack sudo[105144]: pam_unix(sudo:session): session closed for user root Nov 04 10:31:03 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-90f0d107-f564-4e6e-9002-cfb879e5f77c tempest-ProjectReaderTests-869798815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-95cb6c19-2566-4219-a807-df9da3facbb5" returned: 0 in 0.443s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:31:03 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-90f0d107-f564-4e6e-9002-cfb879e5f77c tempest-ProjectReaderTests-869798815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-95cb6c19-2566-4219-a807-df9da3facbb5 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:31:03 devstack sudo[105161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-95cb6c19-2566-4219-a807-df9da3facbb5 Nov 04 10:31:03 devstack sudo[105161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:31:03 devstack sudo[105151]: pam_unix(sudo:session): session closed for user root Nov 04 10:31:03 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-45c55576-2e3f-44e1-915d-9cb6f822ee3e tempest-VolumeDependencyTests-268296630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-89a35098-136f-4c6f-978a-dff445a37b20 -F qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-89a35098-136f-4c6f-978a-dff445a37b20.d0134cda-5688-4138-b33f-8f095bdb9be2" returned: 0 in 0.364s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:31:03 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-45c55576-2e3f-44e1-915d-9cb6f822ee3e tempest-VolumeDependencyTests-268296630 None] /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-89a35098-136f-4c6f-978a-dff445a37b20.d0134cda-5688-4138-b33f-8f095bdb9be2 is being set with open permissions: ugo+rw Nov 04 10:31:03 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-45c55576-2e3f-44e1-915d-9cb6f822ee3e tempest-VolumeDependencyTests-268296630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-89a35098-136f-4c6f-978a-dff445a37b20.d0134cda-5688-4138-b33f-8f095bdb9be2 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:31:03 devstack sudo[105165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-89a35098-136f-4c6f-978a-dff445a37b20.d0134cda-5688-4138-b33f-8f095bdb9be2 Nov 04 10:31:03 devstack sudo[105165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:31:03 devstack sudo[105153]: pam_unix(sudo:session): session closed for user root Nov 04 10:31:03 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-9c6eacad-fadd-4ee7-85c7-322038fc873c tempest-ProjectReaderTests-888867065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-de47a656-f2a9-4f2c-80c9-af0608556b34.ee5c75a5-da56-44e9-bef9-bb9cc1750594" returned: 0 in 0.328s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:31:03 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-9c6eacad-fadd-4ee7-85c7-322038fc873c tempest-ProjectReaderTests-888867065 None] Lock "cinder-quobyte-ee5c75a5-da56-44e9-bef9-bb9cc1750594" released by "_delete_snapshot" :: held 1.860s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:31:03 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-9c6eacad-fadd-4ee7-85c7-322038fc873c tempest-ProjectReaderTests-888867065 None] Lock "cinder-quobyte-de47a656-f2a9-4f2c-80c9-af0608556b34" released by "delete_snapshot" :: held 1.895s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:31:03 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-9c6eacad-fadd-4ee7-85c7-322038fc873c tempest-ProjectReaderTests-888867065 None] Created reservations ['6234c9b5-ec1d-480d-9c0d-a69ec9a9033e', '1075d71c-b570-41e1-9b16-db696fa3cd49', 'c0e6aa0a-b0f4-41b9-b8cf-e4719ca3a009', '609c546e-cb55-4f5f-8886-9c587f97ebd1'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:31:03 devstack sudo[105161]: pam_unix(sudo:session): session closed for user root Nov 04 10:31:03 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-90f0d107-f564-4e6e-9002-cfb879e5f77c tempest-ProjectReaderTests-869798815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-95cb6c19-2566-4219-a807-df9da3facbb5" returned: 0 in 0.290s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:31:03 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-90f0d107-f564-4e6e-9002-cfb879e5f77c tempest-ProjectReaderTests-869798815 None] Lock "cinder-quobyte-95cb6c19-2566-4219-a807-df9da3facbb5" released by "delete_volume" :: held 0.792s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:31:03 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-9c6eacad-fadd-4ee7-85c7-322038fc873c tempest-ProjectReaderTests-888867065 None] Delete snapshot completed successfully. Nov 04 10:31:03 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-9c6eacad-fadd-4ee7-85c7-322038fc873c tempest-ProjectReaderTests-888867065 None] Lock "cinder-ee5c75a5-da56-44e9-bef9-bb9cc1750594-delete_snapshot" released by "delete_snapshot" :: held 2.111s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:31:03 devstack sudo[105165]: pam_unix(sudo:session): session closed for user root Nov 04 10:31:03 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-45c55576-2e3f-44e1-915d-9cb6f822ee3e tempest-VolumeDependencyTests-268296630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-89a35098-136f-4c6f-978a-dff445a37b20.d0134cda-5688-4138-b33f-8f095bdb9be2" returned: 0 in 0.311s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:31:03 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-90f0d107-f564-4e6e-9002-cfb879e5f77c tempest-ProjectReaderTests-869798815 None] Created reservations ['a441acb5-93f8-4824-94ce-1dfd326152a1', 'd42d676f-80e3-491c-b184-006167e74774', 'a1148f06-e2b2-40d4-96d6-0af4bc5ef286', 'ebece2a4-1692-4ad7-9bfd-8a6d37d18424'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:31:03 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-45c55576-2e3f-44e1-915d-9cb6f822ee3e tempest-VolumeDependencyTests-268296630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-89a35098-136f-4c6f-978a-dff445a37b20.info {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:31:03 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-8af3bf31-a54b-4a37-84ce-58432a294698 tempest-ProjectReaderTests-888867065 None] Acquiring lock "cinder-de47a656-f2a9-4f2c-80c9-af0608556b34-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:31:04 devstack sudo[105169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-89a35098-136f-4c6f-978a-dff445a37b20.info Nov 04 10:31:04 devstack sudo[105169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:31:04 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-8af3bf31-a54b-4a37-84ce-58432a294698 tempest-ProjectReaderTests-888867065 None] Lock "cinder-de47a656-f2a9-4f2c-80c9-af0608556b34-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:31:04 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-90f0d107-f564-4e6e-9002-cfb879e5f77c tempest-ProjectReaderTests-869798815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:31:04 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-90f0d107-f564-4e6e-9002-cfb879e5f77c tempest-ProjectReaderTests-869798815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:31:04 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-90f0d107-f564-4e6e-9002-cfb879e5f77c tempest-ProjectReaderTests-869798815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:31:04 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-90f0d107-f564-4e6e-9002-cfb879e5f77c tempest-ProjectReaderTests-869798815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:31:04 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-90f0d107-f564-4e6e-9002-cfb879e5f77c tempest-ProjectReaderTests-869798815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:31:04 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-90f0d107-f564-4e6e-9002-cfb879e5f77c tempest-ProjectReaderTests-869798815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:31:04 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-8af3bf31-a54b-4a37-84ce-58432a294698 tempest-ProjectReaderTests-888867065 None] Acquiring lock "cinder-quobyte-de47a656-f2a9-4f2c-80c9-af0608556b34" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:31:04 devstack sudo[105171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:31:04 devstack sudo[105171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:31:04 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-8af3bf31-a54b-4a37-84ce-58432a294698 tempest-ProjectReaderTests-888867065 None] Lock "cinder-quobyte-de47a656-f2a9-4f2c-80c9-af0608556b34" acquired by "delete_volume" :: waited 0.028s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:31:04 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad8b5c8d-2720-4205-837b-856383aabebb]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:31:04 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-8af3bf31-a54b-4a37-84ce-58432a294698 tempest-ProjectReaderTests-888867065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-de47a656-f2a9-4f2c-80c9-af0608556b34 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:31:04 devstack sudo[105169]: pam_unix(sudo:session): session closed for user root Nov 04 10:31:04 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-45c55576-2e3f-44e1-915d-9cb6f822ee3e tempest-VolumeDependencyTests-268296630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-89a35098-136f-4c6f-978a-dff445a37b20.info" returned: 0 in 0.333s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:31:04 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-45c55576-2e3f-44e1-915d-9cb6f822ee3e tempest-VolumeDependencyTests-268296630 None] /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-89a35098-136f-4c6f-978a-dff445a37b20.info is being set with open permissions: ugo+rw Nov 04 10:31:04 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-45c55576-2e3f-44e1-915d-9cb6f822ee3e tempest-VolumeDependencyTests-268296630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-89a35098-136f-4c6f-978a-dff445a37b20.info {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:31:04 devstack sudo[105175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-89a35098-136f-4c6f-978a-dff445a37b20.info Nov 04 10:31:04 devstack sudo[105175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:31:04 devstack sudo[105174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-de47a656-f2a9-4f2c-80c9-af0608556b34 Nov 04 10:31:04 devstack sudo[105174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:31:04 devstack sudo[105171]: pam_unix(sudo:session): session closed for user root Nov 04 10:31:04 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-90f0d107-f564-4e6e-9002-cfb879e5f77c tempest-ProjectReaderTests-869798815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.384s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:31:04 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-90f0d107-f564-4e6e-9002-cfb879e5f77c tempest-ProjectReaderTests-869798815 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:31:04 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-90f0d107-f564-4e6e-9002-cfb879e5f77c tempest-ProjectReaderTests-869798815 None] Deleted volume successfully. Nov 04 10:31:04 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-90f0d107-f564-4e6e-9002-cfb879e5f77c tempest-ProjectReaderTests-869798815 None] Lock "cinder-95cb6c19-2566-4219-a807-df9da3facbb5-delete_volume" released by "delete_volume" :: held 1.593s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:31:04 devstack sudo[105175]: pam_unix(sudo:session): session closed for user root Nov 04 10:31:04 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-45c55576-2e3f-44e1-915d-9cb6f822ee3e tempest-VolumeDependencyTests-268296630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-89a35098-136f-4c6f-978a-dff445a37b20.info" returned: 0 in 0.383s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:31:04 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-45c55576-2e3f-44e1-915d-9cb6f822ee3e tempest-VolumeDependencyTests-268296630 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.607s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:31:04 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-45c55576-2e3f-44e1-915d-9cb6f822ee3e tempest-VolumeDependencyTests-268296630 None] Create snapshot completed successfully Nov 04 10:31:04 devstack sudo[105174]: pam_unix(sudo:session): session closed for user root Nov 04 10:31:04 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-8af3bf31-a54b-4a37-84ce-58432a294698 tempest-ProjectReaderTests-888867065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-de47a656-f2a9-4f2c-80c9-af0608556b34" returned: 0 in 0.558s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:31:04 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-8af3bf31-a54b-4a37-84ce-58432a294698 tempest-ProjectReaderTests-888867065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-de47a656-f2a9-4f2c-80c9-af0608556b34 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:31:04 devstack sudo[105183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-de47a656-f2a9-4f2c-80c9-af0608556b34 Nov 04 10:31:04 devstack sudo[105183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:31:04 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9823603-9497-483c-b4df-84fd78981ad6 tempest-ProjectReaderTests-869798815 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:31:04 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-a9823603-9497-483c-b4df-84fd78981ad6 tempest-ProjectReaderTests-869798815 None] Flow 'volume_create_manager' (4ded008a-2984-426b-9b77-d7a4d7b9481b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:31:04 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-a9823603-9497-483c-b4df-84fd78981ad6 tempest-ProjectReaderTests-869798815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (704033b1-5596-4ba2-b05b-7e4f0d936198) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:31:04 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-a9823603-9497-483c-b4df-84fd78981ad6 tempest-ProjectReaderTests-869798815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (704033b1-5596-4ba2-b05b-7e4f0d936198) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:31:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-964499858',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bfaa668-6c43-4335-9fb3-470ac8f0765b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f08593383b464bc1a3773c0a7b12ddf1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:31:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:31:05Z,use_quota=True,user_id='53d28dfee9454957b6fb2f5c08df4ddd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:31:04 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-a9823603-9497-483c-b4df-84fd78981ad6 tempest-ProjectReaderTests-869798815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (191d0b5f-37dd-4911-b9c2-791a7c0f5c6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:31:04 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-a9823603-9497-483c-b4df-84fd78981ad6 tempest-ProjectReaderTests-869798815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (191d0b5f-37dd-4911-b9c2-791a7c0f5c6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:31:04 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-a9823603-9497-483c-b4df-84fd78981ad6 tempest-ProjectReaderTests-869798815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91f7ebf8-0130-44b5-aa30-b2158d1451d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:31:04 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-a9823603-9497-483c-b4df-84fd78981ad6 tempest-ProjectReaderTests-869798815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91f7ebf8-0130-44b5-aa30-b2158d1451d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8bfaa668-6c43-4335-9fb3-470ac8f0765b', 'volume_name': 'volume-8bfaa668-6c43-4335-9fb3-470ac8f0765b', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:31:04 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-a9823603-9497-483c-b4df-84fd78981ad6 tempest-ProjectReaderTests-869798815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37b261bc-f511-49a4-977f-0a92ee0140ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:31:04 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-a9823603-9497-483c-b4df-84fd78981ad6 tempest-ProjectReaderTests-869798815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37b261bc-f511-49a4-977f-0a92ee0140ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:31:04 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-a9823603-9497-483c-b4df-84fd78981ad6 tempest-ProjectReaderTests-869798815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (492ce146-b84b-4ac7-b875-dbf72cf8de23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:31:04 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-a9823603-9497-483c-b4df-84fd78981ad6 tempest-ProjectReaderTests-869798815 None] Volume 8bfaa668-6c43-4335-9fb3-470ac8f0765b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8bfaa668-6c43-4335-9fb3-470ac8f0765b', 'volume_size': 1} Nov 04 10:31:04 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-a9823603-9497-483c-b4df-84fd78981ad6 tempest-ProjectReaderTests-869798815 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:31:04 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-a9823603-9497-483c-b4df-84fd78981ad6 tempest-ProjectReaderTests-869798815 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:31:04 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-a9823603-9497-483c-b4df-84fd78981ad6 tempest-ProjectReaderTests-869798815 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:31:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-964499858',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bfaa668-6c43-4335-9fb3-470ac8f0765b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f08593383b464bc1a3773c0a7b12ddf1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:31:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:31:05Z,use_quota=True,user_id='53d28dfee9454957b6fb2f5c08df4ddd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 10:31:04 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-a9823603-9497-483c-b4df-84fd78981ad6 tempest-ProjectReaderTests-869798815 None] Creating volume 8bfaa668-6c43-4335-9fb3-470ac8f0765b {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:31:04 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-a9823603-9497-483c-b4df-84fd78981ad6 tempest-ProjectReaderTests-869798815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:31:04 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-a9823603-9497-483c-b4df-84fd78981ad6 tempest-ProjectReaderTests-869798815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:31:04 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-a9823603-9497-483c-b4df-84fd78981ad6 tempest-ProjectReaderTests-869798815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:31:04 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-a9823603-9497-483c-b4df-84fd78981ad6 tempest-ProjectReaderTests-869798815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:31:04 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-a9823603-9497-483c-b4df-84fd78981ad6 tempest-ProjectReaderTests-869798815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:31:04 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-a9823603-9497-483c-b4df-84fd78981ad6 tempest-ProjectReaderTests-869798815 None] Selected osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:31:04 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-a9823603-9497-483c-b4df-84fd78981ad6 tempest-ProjectReaderTests-869798815 None] casted to osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 Nov 04 10:31:04 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-a9823603-9497-483c-b4df-84fd78981ad6 tempest-ProjectReaderTests-869798815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-8bfaa668-6c43-4335-9fb3-470ac8f0765b 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:31:05 devstack sudo[105185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-8bfaa668-6c43-4335-9fb3-470ac8f0765b 1073741824 Nov 04 10:31:05 devstack sudo[105185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:31:05 devstack sudo[105183]: pam_unix(sudo:session): session closed for user root Nov 04 10:31:05 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-8af3bf31-a54b-4a37-84ce-58432a294698 tempest-ProjectReaderTests-888867065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-de47a656-f2a9-4f2c-80c9-af0608556b34" returned: 0 in 0.300s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:31:05 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-8af3bf31-a54b-4a37-84ce-58432a294698 tempest-ProjectReaderTests-888867065 None] Lock "cinder-quobyte-de47a656-f2a9-4f2c-80c9-af0608556b34" released by "delete_volume" :: held 0.966s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:31:05 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-8af3bf31-a54b-4a37-84ce-58432a294698 tempest-ProjectReaderTests-888867065 None] Created reservations ['c90e3846-57fa-40db-85bc-7fde402e7754', '82b01b8f-2e24-432d-8ae0-4ad427059511', '63e830f0-2b4a-4fd4-9857-74304738d4c8', '31e99135-2a26-4571-b312-a07a23f9dc01'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:31:05 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-8af3bf31-a54b-4a37-84ce-58432a294698 tempest-ProjectReaderTests-888867065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:31:05 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-8af3bf31-a54b-4a37-84ce-58432a294698 tempest-ProjectReaderTests-888867065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:31:05 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-8af3bf31-a54b-4a37-84ce-58432a294698 tempest-ProjectReaderTests-888867065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:31:05 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-8af3bf31-a54b-4a37-84ce-58432a294698 tempest-ProjectReaderTests-888867065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:31:05 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-8af3bf31-a54b-4a37-84ce-58432a294698 tempest-ProjectReaderTests-888867065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:31:05 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-8af3bf31-a54b-4a37-84ce-58432a294698 tempest-ProjectReaderTests-888867065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:31:05 devstack sudo[105191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:31:05 devstack sudo[105191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:31:05 devstack sudo[105185]: pam_unix(sudo:session): session closed for user root Nov 04 10:31:05 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-a9823603-9497-483c-b4df-84fd78981ad6 tempest-ProjectReaderTests-869798815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-8bfaa668-6c43-4335-9fb3-470ac8f0765b 1073741824" returned: 0 in 0.509s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:31:05 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-a9823603-9497-483c-b4df-84fd78981ad6 tempest-ProjectReaderTests-869798815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-8bfaa668-6c43-4335-9fb3-470ac8f0765b {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:31:05 devstack sudo[105191]: pam_unix(sudo:session): session closed for user root Nov 04 10:31:05 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-8af3bf31-a54b-4a37-84ce-58432a294698 tempest-ProjectReaderTests-888867065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.273s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:31:05 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-8af3bf31-a54b-4a37-84ce-58432a294698 tempest-ProjectReaderTests-888867065 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:31:05 devstack sudo[105195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-8bfaa668-6c43-4335-9fb3-470ac8f0765b Nov 04 10:31:05 devstack sudo[105195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:31:05 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-8af3bf31-a54b-4a37-84ce-58432a294698 tempest-ProjectReaderTests-888867065 None] Deleted volume successfully. Nov 04 10:31:05 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-8af3bf31-a54b-4a37-84ce-58432a294698 tempest-ProjectReaderTests-888867065 None] Lock "cinder-de47a656-f2a9-4f2c-80c9-af0608556b34-delete_volume" released by "delete_volume" :: held 1.565s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:31:05 devstack sudo[105195]: pam_unix(sudo:session): session closed for user root Nov 04 10:31:05 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-a9823603-9497-483c-b4df-84fd78981ad6 tempest-ProjectReaderTests-869798815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-8bfaa668-6c43-4335-9fb3-470ac8f0765b" returned: 0 in 0.304s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:31:05 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-a9823603-9497-483c-b4df-84fd78981ad6 tempest-ProjectReaderTests-869798815 None] <== create_volume: return (859ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 10:31:05 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-a9823603-9497-483c-b4df-84fd78981ad6 tempest-ProjectReaderTests-869798815 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.862s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:31:05 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-a9823603-9497-483c-b4df-84fd78981ad6 tempest-ProjectReaderTests-869798815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (492ce146-b84b-4ac7-b875-dbf72cf8de23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8bfaa668-6c43-4335-9fb3-470ac8f0765b', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:31:05 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-a9823603-9497-483c-b4df-84fd78981ad6 tempest-ProjectReaderTests-869798815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (444e0118-d608-4869-b50f-5da86a0e5cf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:31:05 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-a9823603-9497-483c-b4df-84fd78981ad6 tempest-ProjectReaderTests-869798815 None] Volume volume-8bfaa668-6c43-4335-9fb3-470ac8f0765b (8bfaa668-6c43-4335-9fb3-470ac8f0765b): created successfully Nov 04 10:31:05 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-a9823603-9497-483c-b4df-84fd78981ad6 tempest-ProjectReaderTests-869798815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (444e0118-d608-4869-b50f-5da86a0e5cf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:31:05 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-a9823603-9497-483c-b4df-84fd78981ad6 tempest-ProjectReaderTests-869798815 None] Flow 'volume_create_manager' (4ded008a-2984-426b-9b77-d7a4d7b9481b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:31:05 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-a9823603-9497-483c-b4df-84fd78981ad6 tempest-ProjectReaderTests-869798815 None] Created volume successfully. Nov 04 10:31:06 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-87076265-3309-46bd-ba0e-9ca82623c88d tempest-VolumeDependencyTests-268296630 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:31:06 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-87076265-3309-46bd-ba0e-9ca82623c88d tempest-VolumeDependencyTests-268296630 None] Flow 'volume_create_manager' (56fb65f4-180d-41a3-a1ca-ad6b43df54fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:31:06 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-87076265-3309-46bd-ba0e-9ca82623c88d tempest-VolumeDependencyTests-268296630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37ff5c93-f1ce-490c-a116-b4b32ebd024c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:31:06 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-87076265-3309-46bd-ba0e-9ca82623c88d tempest-VolumeDependencyTests-268296630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37ff5c93-f1ce-490c-a116-b4b32ebd024c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:31:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1133033388',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=754b1b88-840d-493f-ad5e-eb14197ea285,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='076179b95334487ab9b5efd07166eb55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:31:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d0134cda-5688-4138-b33f-8f095bdb9be2,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:31:06Z,use_quota=True,user_id='8886f96787794bd398d700a309a53c92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:31:06 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-87076265-3309-46bd-ba0e-9ca82623c88d tempest-VolumeDependencyTests-268296630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fa16259-b813-4586-bedd-f78b95c461ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:31:06 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-87076265-3309-46bd-ba0e-9ca82623c88d tempest-VolumeDependencyTests-268296630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fa16259-b813-4586-bedd-f78b95c461ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:31:06 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-87076265-3309-46bd-ba0e-9ca82623c88d tempest-VolumeDependencyTests-268296630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5281677d-b585-4780-b06e-2ac8eec67432) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:31:06 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-87076265-3309-46bd-ba0e-9ca82623c88d tempest-VolumeDependencyTests-268296630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5281677d-b585-4780-b06e-2ac8eec67432) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '754b1b88-840d-493f-ad5e-eb14197ea285', 'volume_name': 'volume-754b1b88-840d-493f-ad5e-eb14197ea285', 'volume_size': 1, 'snapshot_id': 'd0134cda-5688-4138-b33f-8f095bdb9be2'}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:31:06 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-87076265-3309-46bd-ba0e-9ca82623c88d tempest-VolumeDependencyTests-268296630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b663c23-63b4-4ac0-b733-38e2680298f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:31:06 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-87076265-3309-46bd-ba0e-9ca82623c88d tempest-VolumeDependencyTests-268296630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b663c23-63b4-4ac0-b733-38e2680298f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:31:06 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-87076265-3309-46bd-ba0e-9ca82623c88d tempest-VolumeDependencyTests-268296630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6adc9855-aa41-401a-af2e-3fa437ea79ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:31:06 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-87076265-3309-46bd-ba0e-9ca82623c88d tempest-VolumeDependencyTests-268296630 None] Volume 754b1b88-840d-493f-ad5e-eb14197ea285: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-754b1b88-840d-493f-ad5e-eb14197ea285', 'volume_size': 1, 'snapshot_id': 'd0134cda-5688-4138-b33f-8f095bdb9be2'} Nov 04 10:31:06 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-87076265-3309-46bd-ba0e-9ca82623c88d tempest-VolumeDependencyTests-268296630 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:31:06 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-87076265-3309-46bd-ba0e-9ca82623c88d tempest-VolumeDependencyTests-268296630 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:31:06 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-87076265-3309-46bd-ba0e-9ca82623c88d tempest-VolumeDependencyTests-268296630 None] Acquiring lock "cinder-quobyte-d0134cda-5688-4138-b33f-8f095bdb9be2-754b1b88-840d-493f-ad5e-eb14197ea285" by "_create_volume_from_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:31:06 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-87076265-3309-46bd-ba0e-9ca82623c88d tempest-VolumeDependencyTests-268296630 None] Lock "cinder-quobyte-d0134cda-5688-4138-b33f-8f095bdb9be2-754b1b88-840d-493f-ad5e-eb14197ea285" acquired by "_create_volume_from_snapshot" :: waited 0.026s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:31:06 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-87076265-3309-46bd-ba0e-9ca82623c88d tempest-VolumeDependencyTests-268296630 None] Creating volume 754b1b88-840d-493f-ad5e-eb14197ea285 from snapshot d0134cda-5688-4138-b33f-8f095bdb9be2 {{(pid=87068) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 04 10:31:06 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-87076265-3309-46bd-ba0e-9ca82623c88d tempest-VolumeDependencyTests-268296630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:31:06 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-87076265-3309-46bd-ba0e-9ca82623c88d tempest-VolumeDependencyTests-268296630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:31:06 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-87076265-3309-46bd-ba0e-9ca82623c88d tempest-VolumeDependencyTests-268296630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:31:06 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-87076265-3309-46bd-ba0e-9ca82623c88d tempest-VolumeDependencyTests-268296630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:31:06 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-87076265-3309-46bd-ba0e-9ca82623c88d tempest-VolumeDependencyTests-268296630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:31:06 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-87076265-3309-46bd-ba0e-9ca82623c88d tempest-VolumeDependencyTests-268296630 None] Selected osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:31:06 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-87076265-3309-46bd-ba0e-9ca82623c88d tempest-VolumeDependencyTests-268296630 None] Acquiring lock "cinder-quobyte-754b1b88-840d-493f-ad5e-eb14197ea285" by "_copy_volume_from_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:31:06 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-87076265-3309-46bd-ba0e-9ca82623c88d tempest-VolumeDependencyTests-268296630 None] Lock "cinder-quobyte-754b1b88-840d-493f-ad5e-eb14197ea285" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:31:06 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-87076265-3309-46bd-ba0e-9ca82623c88d tempest-VolumeDependencyTests-268296630 None] snapshot: d0134cda-5688-4138-b33f-8f095bdb9be2, volume: 754b1b88-840d-493f-ad5e-eb14197ea285, {{(pid=87068) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 04 10:31:06 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-87076265-3309-46bd-ba0e-9ca82623c88d tempest-VolumeDependencyTests-268296630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:31:06 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-87076265-3309-46bd-ba0e-9ca82623c88d tempest-VolumeDependencyTests-268296630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:31:06 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-87076265-3309-46bd-ba0e-9ca82623c88d tempest-VolumeDependencyTests-268296630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:31:06 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-87076265-3309-46bd-ba0e-9ca82623c88d tempest-VolumeDependencyTests-268296630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:31:06 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-87076265-3309-46bd-ba0e-9ca82623c88d tempest-VolumeDependencyTests-268296630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:31:06 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[1747a4ce-86dc-4c3d-91e3-da3ba7ead296]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:31:06 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-87076265-3309-46bd-ba0e-9ca82623c88d tempest-VolumeDependencyTests-268296630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-89a35098-136f-4c6f-978a-dff445a37b20.d0134cda-5688-4138-b33f-8f095bdb9be2 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:31:06 devstack sudo[105198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-89a35098-136f-4c6f-978a-dff445a37b20.d0134cda-5688-4138-b33f-8f095bdb9be2 Nov 04 10:31:06 devstack sudo[105198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:31:06 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-639f4804-8156-47db-ba6b-abefb3ec0a86 tempest-ProjectReaderTests-888867065 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:31:06 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-639f4804-8156-47db-ba6b-abefb3ec0a86 tempest-ProjectReaderTests-888867065 None] Flow 'volume_create_manager' (c0b396bf-1334-40ca-b792-46472330d8fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:31:06 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-639f4804-8156-47db-ba6b-abefb3ec0a86 tempest-ProjectReaderTests-888867065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8b373d3-9230-4ae0-aaa4-58fa34ab98b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:31:06 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-639f4804-8156-47db-ba6b-abefb3ec0a86 tempest-ProjectReaderTests-888867065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8b373d3-9230-4ae0-aaa4-58fa34ab98b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:31:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-238229636',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f79ffe57-b970-42ab-85fc-e8cacdc3e0ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ceada5c21c0840989abb5a48b7006da6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:31:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:31:07Z,use_quota=True,user_id='8e11bec0815c4b9e994b7a51e248abd4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:31:06 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-639f4804-8156-47db-ba6b-abefb3ec0a86 tempest-ProjectReaderTests-888867065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e720f45-b363-4ffe-843a-85905633363e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:31:06 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-639f4804-8156-47db-ba6b-abefb3ec0a86 tempest-ProjectReaderTests-888867065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e720f45-b363-4ffe-843a-85905633363e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:31:06 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-639f4804-8156-47db-ba6b-abefb3ec0a86 tempest-ProjectReaderTests-888867065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fa4a25f-edd3-4884-bce0-1588c23a8dc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:31:06 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-639f4804-8156-47db-ba6b-abefb3ec0a86 tempest-ProjectReaderTests-888867065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fa4a25f-edd3-4884-bce0-1588c23a8dc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f79ffe57-b970-42ab-85fc-e8cacdc3e0ef', 'volume_name': 'volume-f79ffe57-b970-42ab-85fc-e8cacdc3e0ef', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:31:06 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-639f4804-8156-47db-ba6b-abefb3ec0a86 tempest-ProjectReaderTests-888867065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87dc1225-9b48-44f9-97a2-95cf925b2fe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:31:06 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-639f4804-8156-47db-ba6b-abefb3ec0a86 tempest-ProjectReaderTests-888867065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87dc1225-9b48-44f9-97a2-95cf925b2fe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:31:06 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-639f4804-8156-47db-ba6b-abefb3ec0a86 tempest-ProjectReaderTests-888867065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2df2a981-9a83-48d6-a9a1-d41da76d22a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:31:06 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-639f4804-8156-47db-ba6b-abefb3ec0a86 tempest-ProjectReaderTests-888867065 None] Volume f79ffe57-b970-42ab-85fc-e8cacdc3e0ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f79ffe57-b970-42ab-85fc-e8cacdc3e0ef', 'volume_size': 1} Nov 04 10:31:06 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-639f4804-8156-47db-ba6b-abefb3ec0a86 tempest-ProjectReaderTests-888867065 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:31:07 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-263a5fa0-e6ba-4b0d-b2e7-583d6ca7eac0 tempest-ProjectReaderTests-869798815 None] Acquiring lock "cinder-8bfaa668-6c43-4335-9fb3-470ac8f0765b-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:31:07 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-263a5fa0-e6ba-4b0d-b2e7-583d6ca7eac0 tempest-ProjectReaderTests-869798815 None] Lock "cinder-8bfaa668-6c43-4335-9fb3-470ac8f0765b-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:31:07 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-263a5fa0-e6ba-4b0d-b2e7-583d6ca7eac0 tempest-ProjectReaderTests-869798815 None] Acquiring lock "cinder-quobyte-8bfaa668-6c43-4335-9fb3-470ac8f0765b" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:31:07 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-263a5fa0-e6ba-4b0d-b2e7-583d6ca7eac0 tempest-ProjectReaderTests-869798815 None] Lock "cinder-quobyte-8bfaa668-6c43-4335-9fb3-470ac8f0765b" acquired by "delete_volume" :: waited 0.017s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:31:07 devstack sudo[105198]: pam_unix(sudo:session): session closed for user root Nov 04 10:31:07 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-87076265-3309-46bd-ba0e-9ca82623c88d tempest-VolumeDependencyTests-268296630 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-89a35098-136f-4c6f-978a-dff445a37b20.d0134cda-5688-4138-b33f-8f095bdb9be2" returned: 0 in 0.487s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:31:07 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-87076265-3309-46bd-ba0e-9ca82623c88d tempest-VolumeDependencyTests-268296630 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-89a35098-136f-4c6f-978a-dff445a37b20(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87068) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 10:31:07 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[59f664a2-f2b0-4666-95f6-d0e189b1abe1]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:31:07 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-263a5fa0-e6ba-4b0d-b2e7-583d6ca7eac0 tempest-ProjectReaderTests-869798815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-8bfaa668-6c43-4335-9fb3-470ac8f0765b {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:31:07 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[6128c132-aaae-4962-8075-ec9002ccda38]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:31:07 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-87076265-3309-46bd-ba0e-9ca82623c88d tempest-VolumeDependencyTests-268296630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-89a35098-136f-4c6f-978a-dff445a37b20 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:31:07 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-125d9df0-95a5-40ca-8b6f-02393ea36819 tempest-ProjectAdminTests-2083437064 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.62748336792, 'free_capacity_gb': 1773.62748336792, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87068) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Nov 04 10:31:07 devstack sudo[105204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-8bfaa668-6c43-4335-9fb3-470ac8f0765b Nov 04 10:31:07 devstack sudo[105204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:31:07 devstack sudo[105205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-89a35098-136f-4c6f-978a-dff445a37b20 Nov 04 10:31:07 devstack sudo[105205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:31:07 devstack sudo[105204]: pam_unix(sudo:session): session closed for user root Nov 04 10:31:07 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-263a5fa0-e6ba-4b0d-b2e7-583d6ca7eac0 tempest-ProjectReaderTests-869798815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-8bfaa668-6c43-4335-9fb3-470ac8f0765b" returned: 0 in 0.394s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:31:07 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-263a5fa0-e6ba-4b0d-b2e7-583d6ca7eac0 tempest-ProjectReaderTests-869798815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-8bfaa668-6c43-4335-9fb3-470ac8f0765b {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:31:07 devstack sudo[105205]: pam_unix(sudo:session): session closed for user root Nov 04 10:31:07 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-87076265-3309-46bd-ba0e-9ca82623c88d tempest-VolumeDependencyTests-268296630 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-89a35098-136f-4c6f-978a-dff445a37b20" returned: 0 in 0.397s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:31:07 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-87076265-3309-46bd-ba0e-9ca82623c88d tempest-VolumeDependencyTests-268296630 None] will copy from snapshot at /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-89a35098-136f-4c6f-978a-dff445a37b20 {{(pid=87068) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 04 10:31:07 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-87076265-3309-46bd-ba0e-9ca82623c88d tempest-VolumeDependencyTests-268296630 None] Creating direct copy from snapshot {{(pid=87068) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 04 10:31:07 devstack cinder-volume[87068]: DEBUG cinder.utils [None req-87076265-3309-46bd-ba0e-9ca82623c88d tempest-VolumeDependencyTests-268296630 None] Path /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-754b1b88-840d-493f-ad5e-eb14197ea285 not found in is_blk_device check {{(pid=87068) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 04 10:31:07 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-87076265-3309-46bd-ba0e-9ca82623c88d tempest-VolumeDependencyTests-268296630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-89a35098-136f-4c6f-978a-dff445a37b20 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-754b1b88-840d-493f-ad5e-eb14197ea285 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:31:07 devstack sudo[105214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-8bfaa668-6c43-4335-9fb3-470ac8f0765b Nov 04 10:31:07 devstack sudo[105214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:31:07 devstack sudo[105216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-89a35098-136f-4c6f-978a-dff445a37b20 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-754b1b88-840d-493f-ad5e-eb14197ea285 Nov 04 10:31:07 devstack sudo[105216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:31:07 devstack sudo[105214]: pam_unix(sudo:session): session closed for user root Nov 04 10:31:07 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-263a5fa0-e6ba-4b0d-b2e7-583d6ca7eac0 tempest-ProjectReaderTests-869798815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-8bfaa668-6c43-4335-9fb3-470ac8f0765b" returned: 0 in 0.266s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:31:07 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-263a5fa0-e6ba-4b0d-b2e7-583d6ca7eac0 tempest-ProjectReaderTests-869798815 None] Lock "cinder-quobyte-8bfaa668-6c43-4335-9fb3-470ac8f0765b" released by "delete_volume" :: held 0.710s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:31:07 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-263a5fa0-e6ba-4b0d-b2e7-583d6ca7eac0 tempest-ProjectReaderTests-869798815 None] Created reservations ['25d0d9f7-5a04-4b9e-a371-f66b89eea35c', '8b6872e9-3d83-4498-9a7d-bbb612fd00f4', 'f0a12f8a-54c4-4344-8acb-b61828959a61', '70e43135-306b-4a25-a699-d5d49a37d6bc'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:31:07 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-263a5fa0-e6ba-4b0d-b2e7-583d6ca7eac0 tempest-ProjectReaderTests-869798815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:31:07 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-263a5fa0-e6ba-4b0d-b2e7-583d6ca7eac0 tempest-ProjectReaderTests-869798815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:31:07 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-263a5fa0-e6ba-4b0d-b2e7-583d6ca7eac0 tempest-ProjectReaderTests-869798815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:31:07 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-263a5fa0-e6ba-4b0d-b2e7-583d6ca7eac0 tempest-ProjectReaderTests-869798815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:31:07 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-263a5fa0-e6ba-4b0d-b2e7-583d6ca7eac0 tempest-ProjectReaderTests-869798815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:31:07 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-263a5fa0-e6ba-4b0d-b2e7-583d6ca7eac0 tempest-ProjectReaderTests-869798815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:31:07 devstack sudo[105223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:31:07 devstack sudo[105223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:31:08 devstack sudo[105223]: pam_unix(sudo:session): session closed for user root Nov 04 10:31:08 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-263a5fa0-e6ba-4b0d-b2e7-583d6ca7eac0 tempest-ProjectReaderTests-869798815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.406s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:31:08 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-263a5fa0-e6ba-4b0d-b2e7-583d6ca7eac0 tempest-ProjectReaderTests-869798815 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:31:08 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-263a5fa0-e6ba-4b0d-b2e7-583d6ca7eac0 tempest-ProjectReaderTests-869798815 None] Deleted volume successfully. Nov 04 10:31:08 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-263a5fa0-e6ba-4b0d-b2e7-583d6ca7eac0 tempest-ProjectReaderTests-869798815 None] Lock "cinder-8bfaa668-6c43-4335-9fb3-470ac8f0765b-delete_volume" released by "delete_volume" :: held 1.390s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:31:15 devstack sudo[105216]: pam_unix(sudo:session): session closed for user root Nov 04 10:31:15 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-87076265-3309-46bd-ba0e-9ca82623c88d tempest-VolumeDependencyTests-268296630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-89a35098-136f-4c6f-978a-dff445a37b20 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-754b1b88-840d-493f-ad5e-eb14197ea285" returned: 0 in 7.734s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:31:15 devstack cinder-volume[87068]: DEBUG cinder.image.image_utils [None req-87076265-3309-46bd-ba0e-9ca82623c88d tempest-VolumeDependencyTests-268296630 None] Image conversion details: src /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-89a35098-136f-4c6f-978a-dff445a37b20, size 1024.00 MB, duration 7.74 sec, destination /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-754b1b88-840d-493f-ad5e-eb14197ea285 {{(pid=87068) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 04 10:31:15 devstack cinder-volume[87068]: INFO cinder.image.image_utils [None req-87076265-3309-46bd-ba0e-9ca82623c88d tempest-VolumeDependencyTests-268296630 None] Converted 1024.00 MB image at 132.38 MB/s Nov 04 10:31:15 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-87076265-3309-46bd-ba0e-9ca82623c88d tempest-VolumeDependencyTests-268296630 None] /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-754b1b88-840d-493f-ad5e-eb14197ea285 is being set with open permissions: ugo+rw Nov 04 10:31:15 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-87076265-3309-46bd-ba0e-9ca82623c88d tempest-VolumeDependencyTests-268296630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-754b1b88-840d-493f-ad5e-eb14197ea285 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:31:15 devstack sudo[105234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-754b1b88-840d-493f-ad5e-eb14197ea285 Nov 04 10:31:15 devstack sudo[105234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:31:15 devstack cinder-volume[87068]: DEBUG dbcounter [-] [87068] Writing DB stats cinder:SELECT=215,cinder:UPDATE=309,cinder:DELETE=25,cinder:INSERT=98 {{(pid=87068) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 10:31:15 devstack cinder-volume[87068]: DEBUG dbcounter [-] [87068] Writing DB stats cinder:UPDATE=315,cinder:SELECT=240,cinder:INSERT=68,cinder:DELETE=31 {{(pid=87068) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 10:31:15 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-2fbbb57f-fbde-4e0e-ac18-a8a2114710a0 tempest-ProjectReaderTests-1792574560 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:31:15 devstack sudo[105234]: pam_unix(sudo:session): session closed for user root Nov 04 10:31:15 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-2fbbb57f-fbde-4e0e-ac18-a8a2114710a0 tempest-ProjectReaderTests-1792574560 None] Flow 'volume_create_manager' (cff05403-cd85-4746-8eed-ad9297ca256b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:31:15 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-2fbbb57f-fbde-4e0e-ac18-a8a2114710a0 tempest-ProjectReaderTests-1792574560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ba7f5ea-82ad-480b-87aa-ddf811b85875) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:31:15 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-87076265-3309-46bd-ba0e-9ca82623c88d tempest-VolumeDependencyTests-268296630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-754b1b88-840d-493f-ad5e-eb14197ea285" returned: 0 in 0.327s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:31:15 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-2fbbb57f-fbde-4e0e-ac18-a8a2114710a0 tempest-ProjectReaderTests-1792574560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ba7f5ea-82ad-480b-87aa-ddf811b85875) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:31:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1098452414',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9ff5abb-1ac3-4627-9b3e-51050d127274,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d5f6699319c422cb51af416536b2187',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:31:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:31:15Z,use_quota=True,user_id='fd7c08c0f13a4754b388258d2b1fb297',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:31:15 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-2fbbb57f-fbde-4e0e-ac18-a8a2114710a0 tempest-ProjectReaderTests-1792574560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61ed4755-3f27-484d-8727-c382b9a6f6ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:31:15 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-2fbbb57f-fbde-4e0e-ac18-a8a2114710a0 tempest-ProjectReaderTests-1792574560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61ed4755-3f27-484d-8727-c382b9a6f6ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:31:15 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-2fbbb57f-fbde-4e0e-ac18-a8a2114710a0 tempest-ProjectReaderTests-1792574560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30d032f7-867c-4a22-ae35-c7642a86147f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:31:15 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-2fbbb57f-fbde-4e0e-ac18-a8a2114710a0 tempest-ProjectReaderTests-1792574560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30d032f7-867c-4a22-ae35-c7642a86147f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9ff5abb-1ac3-4627-9b3e-51050d127274', 'volume_name': 'volume-d9ff5abb-1ac3-4627-9b3e-51050d127274', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:31:15 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-2fbbb57f-fbde-4e0e-ac18-a8a2114710a0 tempest-ProjectReaderTests-1792574560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5eac7792-72b9-40eb-a58f-444ce203b879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:31:15 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-2fbbb57f-fbde-4e0e-ac18-a8a2114710a0 tempest-ProjectReaderTests-1792574560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5eac7792-72b9-40eb-a58f-444ce203b879) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:31:15 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-2fbbb57f-fbde-4e0e-ac18-a8a2114710a0 tempest-ProjectReaderTests-1792574560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c40b8045-3804-4344-84d1-232bca088f74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:31:15 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-2fbbb57f-fbde-4e0e-ac18-a8a2114710a0 tempest-ProjectReaderTests-1792574560 None] Volume d9ff5abb-1ac3-4627-9b3e-51050d127274: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9ff5abb-1ac3-4627-9b3e-51050d127274', 'volume_size': 1} Nov 04 10:31:15 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-2fbbb57f-fbde-4e0e-ac18-a8a2114710a0 tempest-ProjectReaderTests-1792574560 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:31:15 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-87076265-3309-46bd-ba0e-9ca82623c88d tempest-VolumeDependencyTests-268296630 None] Lock "cinder-quobyte-754b1b88-840d-493f-ad5e-eb14197ea285" released by "_copy_volume_from_snapshot" :: held 9.104s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:31:15 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-87076265-3309-46bd-ba0e-9ca82623c88d tempest-VolumeDependencyTests-268296630 None] Lock "cinder-quobyte-d0134cda-5688-4138-b33f-8f095bdb9be2-754b1b88-840d-493f-ad5e-eb14197ea285" released by "_create_volume_from_snapshot" :: held 9.170s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:31:15 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-87076265-3309-46bd-ba0e-9ca82623c88d tempest-VolumeDependencyTests-268296630 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.197s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:31:15 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-639f4804-8156-47db-ba6b-abefb3ec0a86 tempest-ProjectReaderTests-888867065 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.688s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:31:15 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-639f4804-8156-47db-ba6b-abefb3ec0a86 tempest-ProjectReaderTests-888867065 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:31:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-238229636',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f79ffe57-b970-42ab-85fc-e8cacdc3e0ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ceada5c21c0840989abb5a48b7006da6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:31:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:31:07Z,use_quota=True,user_id='8e11bec0815c4b9e994b7a51e248abd4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 10:31:15 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-639f4804-8156-47db-ba6b-abefb3ec0a86 tempest-ProjectReaderTests-888867065 None] Creating volume f79ffe57-b970-42ab-85fc-e8cacdc3e0ef {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:31:15 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-639f4804-8156-47db-ba6b-abefb3ec0a86 tempest-ProjectReaderTests-888867065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:31:15 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-639f4804-8156-47db-ba6b-abefb3ec0a86 tempest-ProjectReaderTests-888867065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:31:15 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-639f4804-8156-47db-ba6b-abefb3ec0a86 tempest-ProjectReaderTests-888867065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:31:15 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-639f4804-8156-47db-ba6b-abefb3ec0a86 tempest-ProjectReaderTests-888867065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:31:15 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-639f4804-8156-47db-ba6b-abefb3ec0a86 tempest-ProjectReaderTests-888867065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:31:15 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-639f4804-8156-47db-ba6b-abefb3ec0a86 tempest-ProjectReaderTests-888867065 None] Selected osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:31:15 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-639f4804-8156-47db-ba6b-abefb3ec0a86 tempest-ProjectReaderTests-888867065 None] casted to osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 Nov 04 10:31:15 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-639f4804-8156-47db-ba6b-abefb3ec0a86 tempest-ProjectReaderTests-888867065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-f79ffe57-b970-42ab-85fc-e8cacdc3e0ef 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:31:15 devstack sudo[105237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-f79ffe57-b970-42ab-85fc-e8cacdc3e0ef 1073741824 Nov 04 10:31:15 devstack sudo[105237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:31:15 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-87076265-3309-46bd-ba0e-9ca82623c88d tempest-VolumeDependencyTests-268296630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6adc9855-aa41-401a-af2e-3fa437ea79ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-754b1b88-840d-493f-ad5e-eb14197ea285', 'volume_size': 1, 'snapshot_id': 'd0134cda-5688-4138-b33f-8f095bdb9be2'}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:31:15 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-87076265-3309-46bd-ba0e-9ca82623c88d tempest-VolumeDependencyTests-268296630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a271b0ab-b8aa-4006-b3e1-417e1ec8c652) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:31:15 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-87076265-3309-46bd-ba0e-9ca82623c88d tempest-VolumeDependencyTests-268296630 None] Volume volume-754b1b88-840d-493f-ad5e-eb14197ea285 (754b1b88-840d-493f-ad5e-eb14197ea285): created successfully Nov 04 10:31:15 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-87076265-3309-46bd-ba0e-9ca82623c88d tempest-VolumeDependencyTests-268296630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a271b0ab-b8aa-4006-b3e1-417e1ec8c652) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:31:15 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-87076265-3309-46bd-ba0e-9ca82623c88d tempest-VolumeDependencyTests-268296630 None] Flow 'volume_create_manager' (56fb65f4-180d-41a3-a1ca-ad6b43df54fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:31:15 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-87076265-3309-46bd-ba0e-9ca82623c88d tempest-VolumeDependencyTests-268296630 None] Created volume successfully. Nov 04 10:31:16 devstack sudo[105237]: pam_unix(sudo:session): session closed for user root Nov 04 10:31:16 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-639f4804-8156-47db-ba6b-abefb3ec0a86 tempest-ProjectReaderTests-888867065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-f79ffe57-b970-42ab-85fc-e8cacdc3e0ef 1073741824" returned: 0 in 0.463s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:31:16 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-639f4804-8156-47db-ba6b-abefb3ec0a86 tempest-ProjectReaderTests-888867065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-f79ffe57-b970-42ab-85fc-e8cacdc3e0ef {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:31:16 devstack sudo[105243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-f79ffe57-b970-42ab-85fc-e8cacdc3e0ef Nov 04 10:31:16 devstack sudo[105243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:31:16 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-f87fa5ce-bcad-4a30-9e1a-2de3ef7f0b55 tempest-VolumeDependencyTests-268296630 None] Acquiring lock "cinder-d0134cda-5688-4138-b33f-8f095bdb9be2-delete_snapshot" by "delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:31:16 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-f87fa5ce-bcad-4a30-9e1a-2de3ef7f0b55 tempest-VolumeDependencyTests-268296630 None] Lock "cinder-d0134cda-5688-4138-b33f-8f095bdb9be2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:31:16 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-f87fa5ce-bcad-4a30-9e1a-2de3ef7f0b55 tempest-VolumeDependencyTests-268296630 None] Acquiring lock "cinder-quobyte-89a35098-136f-4c6f-978a-dff445a37b20" by "delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:31:16 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-f87fa5ce-bcad-4a30-9e1a-2de3ef7f0b55 tempest-VolumeDependencyTests-268296630 None] Lock "cinder-quobyte-89a35098-136f-4c6f-978a-dff445a37b20" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:31:16 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-f87fa5ce-bcad-4a30-9e1a-2de3ef7f0b55 tempest-VolumeDependencyTests-268296630 None] Acquiring lock "cinder-quobyte-d0134cda-5688-4138-b33f-8f095bdb9be2" by "_delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:31:16 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-f87fa5ce-bcad-4a30-9e1a-2de3ef7f0b55 tempest-VolumeDependencyTests-268296630 None] Lock "cinder-quobyte-d0134cda-5688-4138-b33f-8f095bdb9be2" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:31:16 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-f87fa5ce-bcad-4a30-9e1a-2de3ef7f0b55 tempest-VolumeDependencyTests-268296630 None] Deleting offline snapshot d0134cda-5688-4138-b33f-8f095bdb9be2 of volume 89a35098-136f-4c6f-978a-dff445a37b20 {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 10:31:16 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-f87fa5ce-bcad-4a30-9e1a-2de3ef7f0b55 tempest-VolumeDependencyTests-268296630 None] snapshot_file for this snap is: volume-89a35098-136f-4c6f-978a-dff445a37b20.d0134cda-5688-4138-b33f-8f095bdb9be2 {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 10:31:16 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[f12f5544-1f7a-4791-94a3-8a328ada95ba]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:31:16 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f87fa5ce-bcad-4a30-9e1a-2de3ef7f0b55 tempest-VolumeDependencyTests-268296630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-89a35098-136f-4c6f-978a-dff445a37b20.d0134cda-5688-4138-b33f-8f095bdb9be2 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:31:16 devstack sudo[105243]: pam_unix(sudo:session): session closed for user root Nov 04 10:31:16 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-639f4804-8156-47db-ba6b-abefb3ec0a86 tempest-ProjectReaderTests-888867065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-f79ffe57-b970-42ab-85fc-e8cacdc3e0ef" returned: 0 in 0.310s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:31:16 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-639f4804-8156-47db-ba6b-abefb3ec0a86 tempest-ProjectReaderTests-888867065 None] <== create_volume: return (815ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 10:31:16 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-639f4804-8156-47db-ba6b-abefb3ec0a86 tempest-ProjectReaderTests-888867065 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.817s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:31:16 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-2fbbb57f-fbde-4e0e-ac18-a8a2114710a0 tempest-ProjectReaderTests-1792574560 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.869s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:31:16 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-2fbbb57f-fbde-4e0e-ac18-a8a2114710a0 tempest-ProjectReaderTests-1792574560 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:31:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1098452414',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9ff5abb-1ac3-4627-9b3e-51050d127274,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d5f6699319c422cb51af416536b2187',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:31:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:31:15Z,use_quota=True,user_id='fd7c08c0f13a4754b388258d2b1fb297',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 10:31:16 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-2fbbb57f-fbde-4e0e-ac18-a8a2114710a0 tempest-ProjectReaderTests-1792574560 None] Creating volume d9ff5abb-1ac3-4627-9b3e-51050d127274 {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:31:16 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-2fbbb57f-fbde-4e0e-ac18-a8a2114710a0 tempest-ProjectReaderTests-1792574560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:31:16 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-2fbbb57f-fbde-4e0e-ac18-a8a2114710a0 tempest-ProjectReaderTests-1792574560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:31:16 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-2fbbb57f-fbde-4e0e-ac18-a8a2114710a0 tempest-ProjectReaderTests-1792574560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:31:16 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-2fbbb57f-fbde-4e0e-ac18-a8a2114710a0 tempest-ProjectReaderTests-1792574560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:31:16 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-2fbbb57f-fbde-4e0e-ac18-a8a2114710a0 tempest-ProjectReaderTests-1792574560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:31:16 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-2fbbb57f-fbde-4e0e-ac18-a8a2114710a0 tempest-ProjectReaderTests-1792574560 None] Selected osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:31:16 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-2fbbb57f-fbde-4e0e-ac18-a8a2114710a0 tempest-ProjectReaderTests-1792574560 None] casted to osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 Nov 04 10:31:16 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-2fbbb57f-fbde-4e0e-ac18-a8a2114710a0 tempest-ProjectReaderTests-1792574560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-d9ff5abb-1ac3-4627-9b3e-51050d127274 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:31:16 devstack sudo[105245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-89a35098-136f-4c6f-978a-dff445a37b20.d0134cda-5688-4138-b33f-8f095bdb9be2 Nov 04 10:31:16 devstack sudo[105245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:31:16 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-639f4804-8156-47db-ba6b-abefb3ec0a86 tempest-ProjectReaderTests-888867065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2df2a981-9a83-48d6-a9a1-d41da76d22a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f79ffe57-b970-42ab-85fc-e8cacdc3e0ef', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:31:16 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-639f4804-8156-47db-ba6b-abefb3ec0a86 tempest-ProjectReaderTests-888867065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1b773f6-3a2d-45c7-bc3e-68b135ac2654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:31:16 devstack sudo[105247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-d9ff5abb-1ac3-4627-9b3e-51050d127274 1073741824 Nov 04 10:31:16 devstack sudo[105247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:31:16 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-639f4804-8156-47db-ba6b-abefb3ec0a86 tempest-ProjectReaderTests-888867065 None] Volume volume-f79ffe57-b970-42ab-85fc-e8cacdc3e0ef (f79ffe57-b970-42ab-85fc-e8cacdc3e0ef): created successfully Nov 04 10:31:16 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-639f4804-8156-47db-ba6b-abefb3ec0a86 tempest-ProjectReaderTests-888867065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1b773f6-3a2d-45c7-bc3e-68b135ac2654) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:31:16 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-639f4804-8156-47db-ba6b-abefb3ec0a86 tempest-ProjectReaderTests-888867065 None] Flow 'volume_create_manager' (c0b396bf-1334-40ca-b792-46472330d8fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:31:16 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-639f4804-8156-47db-ba6b-abefb3ec0a86 tempest-ProjectReaderTests-888867065 None] Created volume successfully. Nov 04 10:31:16 devstack sudo[105245]: pam_unix(sudo:session): session closed for user root Nov 04 10:31:16 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f87fa5ce-bcad-4a30-9e1a-2de3ef7f0b55 tempest-VolumeDependencyTests-268296630 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-89a35098-136f-4c6f-978a-dff445a37b20.d0134cda-5688-4138-b33f-8f095bdb9be2" returned: 0 in 0.491s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:31:16 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-f87fa5ce-bcad-4a30-9e1a-2de3ef7f0b55 tempest-VolumeDependencyTests-268296630 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-89a35098-136f-4c6f-978a-dff445a37b20(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87068) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 10:31:16 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[79f9168c-2fc4-4eab-8399-639b4334dc75]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:31:16 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f87fa5ce-bcad-4a30-9e1a-2de3ef7f0b55 tempest-VolumeDependencyTests-268296630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-89a35098-136f-4c6f-978a-dff445a37b20 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:31:17 devstack sudo[105257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-89a35098-136f-4c6f-978a-dff445a37b20 Nov 04 10:31:17 devstack sudo[105257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:31:17 devstack sudo[105247]: pam_unix(sudo:session): session closed for user root Nov 04 10:31:17 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-2fbbb57f-fbde-4e0e-ac18-a8a2114710a0 tempest-ProjectReaderTests-1792574560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-d9ff5abb-1ac3-4627-9b3e-51050d127274 1073741824" returned: 0 in 0.518s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:31:17 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-2fbbb57f-fbde-4e0e-ac18-a8a2114710a0 tempest-ProjectReaderTests-1792574560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-d9ff5abb-1ac3-4627-9b3e-51050d127274 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:31:17 devstack sudo[105259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-d9ff5abb-1ac3-4627-9b3e-51050d127274 Nov 04 10:31:17 devstack sudo[105259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:31:17 devstack sudo[105259]: pam_unix(sudo:session): session closed for user root Nov 04 10:31:17 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-2fbbb57f-fbde-4e0e-ac18-a8a2114710a0 tempest-ProjectReaderTests-1792574560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-d9ff5abb-1ac3-4627-9b3e-51050d127274" returned: 0 in 0.298s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:31:17 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-2fbbb57f-fbde-4e0e-ac18-a8a2114710a0 tempest-ProjectReaderTests-1792574560 None] <== create_volume: return (940ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 10:31:17 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-2fbbb57f-fbde-4e0e-ac18-a8a2114710a0 tempest-ProjectReaderTests-1792574560 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.945s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:31:17 devstack sudo[105257]: pam_unix(sudo:session): session closed for user root Nov 04 10:31:17 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-2fbbb57f-fbde-4e0e-ac18-a8a2114710a0 tempest-ProjectReaderTests-1792574560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c40b8045-3804-4344-84d1-232bca088f74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9ff5abb-1ac3-4627-9b3e-51050d127274', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:31:17 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-2fbbb57f-fbde-4e0e-ac18-a8a2114710a0 tempest-ProjectReaderTests-1792574560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26bcce59-a008-4a2e-a97c-639f805f5768) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:31:17 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f87fa5ce-bcad-4a30-9e1a-2de3ef7f0b55 tempest-VolumeDependencyTests-268296630 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-89a35098-136f-4c6f-978a-dff445a37b20" returned: 0 in 0.567s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:31:17 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f87fa5ce-bcad-4a30-9e1a-2de3ef7f0b55 tempest-VolumeDependencyTests-268296630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-89a35098-136f-4c6f-978a-dff445a37b20.d0134cda-5688-4138-b33f-8f095bdb9be2 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:31:17 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-2fbbb57f-fbde-4e0e-ac18-a8a2114710a0 tempest-ProjectReaderTests-1792574560 None] Volume volume-d9ff5abb-1ac3-4627-9b3e-51050d127274 (d9ff5abb-1ac3-4627-9b3e-51050d127274): created successfully Nov 04 10:31:17 devstack sudo[105265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-89a35098-136f-4c6f-978a-dff445a37b20.d0134cda-5688-4138-b33f-8f095bdb9be2 Nov 04 10:31:17 devstack sudo[105265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:31:17 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-2fbbb57f-fbde-4e0e-ac18-a8a2114710a0 tempest-ProjectReaderTests-1792574560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26bcce59-a008-4a2e-a97c-639f805f5768) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:31:17 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-2fbbb57f-fbde-4e0e-ac18-a8a2114710a0 tempest-ProjectReaderTests-1792574560 None] Flow 'volume_create_manager' (cff05403-cd85-4746-8eed-ad9297ca256b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:31:17 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-2fbbb57f-fbde-4e0e-ac18-a8a2114710a0 tempest-ProjectReaderTests-1792574560 None] Created volume successfully. Nov 04 10:31:17 devstack sudo[105265]: pam_unix(sudo:session): session closed for user root Nov 04 10:31:17 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f87fa5ce-bcad-4a30-9e1a-2de3ef7f0b55 tempest-VolumeDependencyTests-268296630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-89a35098-136f-4c6f-978a-dff445a37b20.d0134cda-5688-4138-b33f-8f095bdb9be2" returned: 0 in 0.446s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:31:17 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f87fa5ce-bcad-4a30-9e1a-2de3ef7f0b55 tempest-VolumeDependencyTests-268296630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-89a35098-136f-4c6f-978a-dff445a37b20.d0134cda-5688-4138-b33f-8f095bdb9be2 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:31:17 devstack sudo[105270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-89a35098-136f-4c6f-978a-dff445a37b20.d0134cda-5688-4138-b33f-8f095bdb9be2 Nov 04 10:31:17 devstack sudo[105270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:31:18 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-7f6844e0-4aab-4778-94f3-458801b67964 tempest-ProjectReaderTests-1792574560 None] Acquiring lock "cinder-d9ff5abb-1ac3-4627-9b3e-51050d127274-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:31:18 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-7f6844e0-4aab-4778-94f3-458801b67964 tempest-ProjectReaderTests-1792574560 None] Lock "cinder-d9ff5abb-1ac3-4627-9b3e-51050d127274-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:31:18 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-6f29f706-2fa0-46a7-ab92-84288e35d5a6 tempest-ProjectReaderTests-888867065 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:31:18 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-6f29f706-2fa0-46a7-ab92-84288e35d5a6 tempest-ProjectReaderTests-888867065 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:31:18 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-7f6844e0-4aab-4778-94f3-458801b67964 tempest-ProjectReaderTests-1792574560 None] Acquiring lock "cinder-quobyte-d9ff5abb-1ac3-4627-9b3e-51050d127274" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:31:18 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-6f29f706-2fa0-46a7-ab92-84288e35d5a6 tempest-ProjectReaderTests-888867065 None] Creating offline snapshot 9769a201-f4aa-44d6-bad3-0a5088cab8e4 of volume f79ffe57-b970-42ab-85fc-e8cacdc3e0ef {{(pid=87068) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 10:31:18 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-7f6844e0-4aab-4778-94f3-458801b67964 tempest-ProjectReaderTests-1792574560 None] Lock "cinder-quobyte-d9ff5abb-1ac3-4627-9b3e-51050d127274" acquired by "delete_volume" :: waited 0.027s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:31:18 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[25730034-feeb-49d9-939e-8d276c51458e]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:31:18 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6f29f706-2fa0-46a7-ab92-84288e35d5a6 tempest-ProjectReaderTests-888867065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-f79ffe57-b970-42ab-85fc-e8cacdc3e0ef {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:31:18 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaa3b9f5-a448-47ad-ac8b-619ea1aacc7f]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:31:18 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7f6844e0-4aab-4778-94f3-458801b67964 tempest-ProjectReaderTests-1792574560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-d9ff5abb-1ac3-4627-9b3e-51050d127274 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:31:18 devstack sudo[105270]: pam_unix(sudo:session): session closed for user root Nov 04 10:31:18 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f87fa5ce-bcad-4a30-9e1a-2de3ef7f0b55 tempest-VolumeDependencyTests-268296630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-89a35098-136f-4c6f-978a-dff445a37b20.d0134cda-5688-4138-b33f-8f095bdb9be2" returned: 0 in 0.383s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:31:18 devstack sudo[105273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-d9ff5abb-1ac3-4627-9b3e-51050d127274 Nov 04 10:31:18 devstack sudo[105272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-f79ffe57-b970-42ab-85fc-e8cacdc3e0ef Nov 04 10:31:18 devstack sudo[105273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:31:18 devstack sudo[105272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:31:18 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-f87fa5ce-bcad-4a30-9e1a-2de3ef7f0b55 tempest-VolumeDependencyTests-268296630 None] Lock "cinder-quobyte-d0134cda-5688-4138-b33f-8f095bdb9be2" released by "_delete_snapshot" :: held 2.069s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:31:18 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-f87fa5ce-bcad-4a30-9e1a-2de3ef7f0b55 tempest-VolumeDependencyTests-268296630 None] Lock "cinder-quobyte-89a35098-136f-4c6f-978a-dff445a37b20" released by "delete_snapshot" :: held 2.108s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:31:18 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-f87fa5ce-bcad-4a30-9e1a-2de3ef7f0b55 tempest-VolumeDependencyTests-268296630 None] Created reservations ['e8935727-208d-496a-a3c6-f7cdc5c72934', '4ed4d7e5-f132-49f6-8eb1-908a1598865b', 'c3e91795-376a-42d6-af90-f21c85f821e8', 'b42483d8-d713-4966-bc28-9ed2eae0a4ef'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:31:18 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-f87fa5ce-bcad-4a30-9e1a-2de3ef7f0b55 tempest-VolumeDependencyTests-268296630 None] Delete snapshot completed successfully. Nov 04 10:31:18 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-f87fa5ce-bcad-4a30-9e1a-2de3ef7f0b55 tempest-VolumeDependencyTests-268296630 None] Lock "cinder-d0134cda-5688-4138-b33f-8f095bdb9be2-delete_snapshot" released by "delete_snapshot" :: held 2.298s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:31:18 devstack sudo[105272]: pam_unix(sudo:session): session closed for user root Nov 04 10:31:18 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6f29f706-2fa0-46a7-ab92-84288e35d5a6 tempest-ProjectReaderTests-888867065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-f79ffe57-b970-42ab-85fc-e8cacdc3e0ef" returned: 0 in 0.469s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:31:18 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6f29f706-2fa0-46a7-ab92-84288e35d5a6 tempest-ProjectReaderTests-888867065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-f79ffe57-b970-42ab-85fc-e8cacdc3e0ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-f79ffe57-b970-42ab-85fc-e8cacdc3e0ef.9769a201-f4aa-44d6-bad3-0a5088cab8e4 1G {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:31:18 devstack sudo[105273]: pam_unix(sudo:session): session closed for user root Nov 04 10:31:18 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7f6844e0-4aab-4778-94f3-458801b67964 tempest-ProjectReaderTests-1792574560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-d9ff5abb-1ac3-4627-9b3e-51050d127274" returned: 0 in 0.460s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:31:18 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7f6844e0-4aab-4778-94f3-458801b67964 tempest-ProjectReaderTests-1792574560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-d9ff5abb-1ac3-4627-9b3e-51050d127274 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:31:18 devstack sudo[105283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-f79ffe57-b970-42ab-85fc-e8cacdc3e0ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-f79ffe57-b970-42ab-85fc-e8cacdc3e0ef.9769a201-f4aa-44d6-bad3-0a5088cab8e4 1G Nov 04 10:31:18 devstack sudo[105283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:31:18 devstack sudo[105284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-d9ff5abb-1ac3-4627-9b3e-51050d127274 Nov 04 10:31:18 devstack sudo[105284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:31:18 devstack sudo[105284]: pam_unix(sudo:session): session closed for user root Nov 04 10:31:18 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7f6844e0-4aab-4778-94f3-458801b67964 tempest-ProjectReaderTests-1792574560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-d9ff5abb-1ac3-4627-9b3e-51050d127274" returned: 0 in 0.254s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:31:18 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-7f6844e0-4aab-4778-94f3-458801b67964 tempest-ProjectReaderTests-1792574560 None] Lock "cinder-quobyte-d9ff5abb-1ac3-4627-9b3e-51050d127274" released by "delete_volume" :: held 0.777s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:31:18 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-7f6844e0-4aab-4778-94f3-458801b67964 tempest-ProjectReaderTests-1792574560 None] Created reservations ['3cb4e6e6-e1b6-45fb-b164-a508d6aa6e78', 'd62a21c6-b984-48b9-8529-90699f911b2a', 'f4f0041a-1d7c-4f0d-85ef-9b894f16c362', 'c8fd530f-2111-4fc1-b1cd-73e68177aea7'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:31:19 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-7f6844e0-4aab-4778-94f3-458801b67964 tempest-ProjectReaderTests-1792574560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:31:19 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-7f6844e0-4aab-4778-94f3-458801b67964 tempest-ProjectReaderTests-1792574560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:31:19 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-7f6844e0-4aab-4778-94f3-458801b67964 tempest-ProjectReaderTests-1792574560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:31:19 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-7f6844e0-4aab-4778-94f3-458801b67964 tempest-ProjectReaderTests-1792574560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:31:19 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-7f6844e0-4aab-4778-94f3-458801b67964 tempest-ProjectReaderTests-1792574560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:31:19 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7f6844e0-4aab-4778-94f3-458801b67964 tempest-ProjectReaderTests-1792574560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:31:19 devstack sudo[105292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:31:19 devstack sudo[105292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:31:19 devstack sudo[105283]: pam_unix(sudo:session): session closed for user root Nov 04 10:31:19 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6f29f706-2fa0-46a7-ab92-84288e35d5a6 tempest-ProjectReaderTests-888867065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-f79ffe57-b970-42ab-85fc-e8cacdc3e0ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-f79ffe57-b970-42ab-85fc-e8cacdc3e0ef.9769a201-f4aa-44d6-bad3-0a5088cab8e4 1G" returned: 0 in 0.507s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:31:19 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6f29f706-2fa0-46a7-ab92-84288e35d5a6 tempest-ProjectReaderTests-888867065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f79ffe57-b970-42ab-85fc-e8cacdc3e0ef -F qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-f79ffe57-b970-42ab-85fc-e8cacdc3e0ef.9769a201-f4aa-44d6-bad3-0a5088cab8e4 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:31:19 devstack sudo[105294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f79ffe57-b970-42ab-85fc-e8cacdc3e0ef -F qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-f79ffe57-b970-42ab-85fc-e8cacdc3e0ef.9769a201-f4aa-44d6-bad3-0a5088cab8e4 Nov 04 10:31:19 devstack sudo[105294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:31:19 devstack sudo[105292]: pam_unix(sudo:session): session closed for user root Nov 04 10:31:19 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-7f6844e0-4aab-4778-94f3-458801b67964 tempest-ProjectReaderTests-1792574560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.253s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:31:19 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-7f6844e0-4aab-4778-94f3-458801b67964 tempest-ProjectReaderTests-1792574560 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:31:19 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-7f6844e0-4aab-4778-94f3-458801b67964 tempest-ProjectReaderTests-1792574560 None] Deleted volume successfully. Nov 04 10:31:19 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-7f6844e0-4aab-4778-94f3-458801b67964 tempest-ProjectReaderTests-1792574560 None] Lock "cinder-d9ff5abb-1ac3-4627-9b3e-51050d127274-delete_volume" released by "delete_volume" :: held 1.340s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:31:19 devstack sudo[105294]: pam_unix(sudo:session): session closed for user root Nov 04 10:31:19 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6f29f706-2fa0-46a7-ab92-84288e35d5a6 tempest-ProjectReaderTests-888867065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f79ffe57-b970-42ab-85fc-e8cacdc3e0ef -F qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-f79ffe57-b970-42ab-85fc-e8cacdc3e0ef.9769a201-f4aa-44d6-bad3-0a5088cab8e4" returned: 0 in 0.365s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:31:19 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-6f29f706-2fa0-46a7-ab92-84288e35d5a6 tempest-ProjectReaderTests-888867065 None] /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-f79ffe57-b970-42ab-85fc-e8cacdc3e0ef.9769a201-f4aa-44d6-bad3-0a5088cab8e4 is being set with open permissions: ugo+rw Nov 04 10:31:19 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6f29f706-2fa0-46a7-ab92-84288e35d5a6 tempest-ProjectReaderTests-888867065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-f79ffe57-b970-42ab-85fc-e8cacdc3e0ef.9769a201-f4aa-44d6-bad3-0a5088cab8e4 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:31:19 devstack sudo[105300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-f79ffe57-b970-42ab-85fc-e8cacdc3e0ef.9769a201-f4aa-44d6-bad3-0a5088cab8e4 Nov 04 10:31:19 devstack sudo[105300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:31:19 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-f9cfbcc8-d4c7-432f-b964-7b6d47583ff2 tempest-VolumeDependencyTests-268296630 None] Acquiring lock "cinder-89a35098-136f-4c6f-978a-dff445a37b20-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:31:19 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-f9cfbcc8-d4c7-432f-b964-7b6d47583ff2 tempest-VolumeDependencyTests-268296630 None] Lock "cinder-89a35098-136f-4c6f-978a-dff445a37b20-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:31:19 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-f9cfbcc8-d4c7-432f-b964-7b6d47583ff2 tempest-VolumeDependencyTests-268296630 None] Acquiring lock "cinder-quobyte-89a35098-136f-4c6f-978a-dff445a37b20" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:31:19 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-f9cfbcc8-d4c7-432f-b964-7b6d47583ff2 tempest-VolumeDependencyTests-268296630 None] Lock "cinder-quobyte-89a35098-136f-4c6f-978a-dff445a37b20" acquired by "delete_volume" :: waited 0.018s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:31:19 devstack sudo[105300]: pam_unix(sudo:session): session closed for user root Nov 04 10:31:19 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[25897169-bb65-4558-93f5-787a1d6e6a53]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:31:19 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f9cfbcc8-d4c7-432f-b964-7b6d47583ff2 tempest-VolumeDependencyTests-268296630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-89a35098-136f-4c6f-978a-dff445a37b20 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:31:19 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6f29f706-2fa0-46a7-ab92-84288e35d5a6 tempest-ProjectReaderTests-888867065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-f79ffe57-b970-42ab-85fc-e8cacdc3e0ef.9769a201-f4aa-44d6-bad3-0a5088cab8e4" returned: 0 in 0.364s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:31:19 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed502326-61e7-43e8-b01a-edd46bb99b36 tempest-ProjectReaderTests-1792574560 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:31:19 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-ed502326-61e7-43e8-b01a-edd46bb99b36 tempest-ProjectReaderTests-1792574560 None] Flow 'volume_create_manager' (ba490580-e10c-4fdc-ad51-57dfdef7d6f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:31:19 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-ed502326-61e7-43e8-b01a-edd46bb99b36 tempest-ProjectReaderTests-1792574560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b4bae79-0f34-46e2-88b0-b9d2ceed0034) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:31:19 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-ed502326-61e7-43e8-b01a-edd46bb99b36 tempest-ProjectReaderTests-1792574560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b4bae79-0f34-46e2-88b0-b9d2ceed0034) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:31:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1223732640',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00da087b-4db9-4265-baa9-3e2084f257e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d5f6699319c422cb51af416536b2187',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:31:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:31:20Z,use_quota=True,user_id='fd7c08c0f13a4754b388258d2b1fb297',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:31:19 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-ed502326-61e7-43e8-b01a-edd46bb99b36 tempest-ProjectReaderTests-1792574560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43d4b67b-2752-4537-928a-158aea3c1174) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:31:19 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-ed502326-61e7-43e8-b01a-edd46bb99b36 tempest-ProjectReaderTests-1792574560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43d4b67b-2752-4537-928a-158aea3c1174) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:31:19 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-ed502326-61e7-43e8-b01a-edd46bb99b36 tempest-ProjectReaderTests-1792574560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50cb9cb3-ced9-4058-b120-0467cbe02fc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:31:19 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-ed502326-61e7-43e8-b01a-edd46bb99b36 tempest-ProjectReaderTests-1792574560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50cb9cb3-ced9-4058-b120-0467cbe02fc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00da087b-4db9-4265-baa9-3e2084f257e1', 'volume_name': 'volume-00da087b-4db9-4265-baa9-3e2084f257e1', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:31:19 devstack sudo[105303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-89a35098-136f-4c6f-978a-dff445a37b20 Nov 04 10:31:19 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-ed502326-61e7-43e8-b01a-edd46bb99b36 tempest-ProjectReaderTests-1792574560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (deed8ff1-fd6a-4a38-8f7e-e17d4cc1f68d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:31:19 devstack sudo[105303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:31:19 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-ed502326-61e7-43e8-b01a-edd46bb99b36 tempest-ProjectReaderTests-1792574560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (deed8ff1-fd6a-4a38-8f7e-e17d4cc1f68d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:31:19 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-ed502326-61e7-43e8-b01a-edd46bb99b36 tempest-ProjectReaderTests-1792574560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79debda8-b348-4444-9be6-f78006fdaa3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:31:19 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-ed502326-61e7-43e8-b01a-edd46bb99b36 tempest-ProjectReaderTests-1792574560 None] Volume 00da087b-4db9-4265-baa9-3e2084f257e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00da087b-4db9-4265-baa9-3e2084f257e1', 'volume_size': 1} Nov 04 10:31:19 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-ed502326-61e7-43e8-b01a-edd46bb99b36 tempest-ProjectReaderTests-1792574560 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:31:19 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6f29f706-2fa0-46a7-ab92-84288e35d5a6 tempest-ProjectReaderTests-888867065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-f79ffe57-b970-42ab-85fc-e8cacdc3e0ef.info {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:31:20 devstack sudo[105305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-f79ffe57-b970-42ab-85fc-e8cacdc3e0ef.info Nov 04 10:31:20 devstack sudo[105305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:31:20 devstack sudo[105303]: pam_unix(sudo:session): session closed for user root Nov 04 10:31:20 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f9cfbcc8-d4c7-432f-b964-7b6d47583ff2 tempest-VolumeDependencyTests-268296630 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-89a35098-136f-4c6f-978a-dff445a37b20" returned: 0 in 0.399s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:31:20 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f9cfbcc8-d4c7-432f-b964-7b6d47583ff2 tempest-VolumeDependencyTests-268296630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-89a35098-136f-4c6f-978a-dff445a37b20 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:31:20 devstack sudo[105305]: pam_unix(sudo:session): session closed for user root Nov 04 10:31:20 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6f29f706-2fa0-46a7-ab92-84288e35d5a6 tempest-ProjectReaderTests-888867065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-f79ffe57-b970-42ab-85fc-e8cacdc3e0ef.info" returned: 0 in 0.288s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:31:20 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-6f29f706-2fa0-46a7-ab92-84288e35d5a6 tempest-ProjectReaderTests-888867065 None] /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-f79ffe57-b970-42ab-85fc-e8cacdc3e0ef.info is being set with open permissions: ugo+rw Nov 04 10:31:20 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6f29f706-2fa0-46a7-ab92-84288e35d5a6 tempest-ProjectReaderTests-888867065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-f79ffe57-b970-42ab-85fc-e8cacdc3e0ef.info {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:31:20 devstack sudo[105311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-89a35098-136f-4c6f-978a-dff445a37b20 Nov 04 10:31:20 devstack sudo[105311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:31:20 devstack sudo[105312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-f79ffe57-b970-42ab-85fc-e8cacdc3e0ef.info Nov 04 10:31:20 devstack sudo[105312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:31:20 devstack sudo[105311]: pam_unix(sudo:session): session closed for user root Nov 04 10:31:20 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f9cfbcc8-d4c7-432f-b964-7b6d47583ff2 tempest-VolumeDependencyTests-268296630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-89a35098-136f-4c6f-978a-dff445a37b20" returned: 0 in 0.303s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:31:20 devstack sudo[105312]: pam_unix(sudo:session): session closed for user root Nov 04 10:31:20 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6f29f706-2fa0-46a7-ab92-84288e35d5a6 tempest-ProjectReaderTests-888867065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-f79ffe57-b970-42ab-85fc-e8cacdc3e0ef.info" returned: 0 in 0.298s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:31:20 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-6f29f706-2fa0-46a7-ab92-84288e35d5a6 tempest-ProjectReaderTests-888867065 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.482s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:31:20 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-f9cfbcc8-d4c7-432f-b964-7b6d47583ff2 tempest-VolumeDependencyTests-268296630 None] Lock "cinder-quobyte-89a35098-136f-4c6f-978a-dff445a37b20" released by "delete_volume" :: held 0.810s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:31:20 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-ed502326-61e7-43e8-b01a-edd46bb99b36 tempest-ProjectReaderTests-1792574560 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.621s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:31:20 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-ed502326-61e7-43e8-b01a-edd46bb99b36 tempest-ProjectReaderTests-1792574560 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:31:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1223732640',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00da087b-4db9-4265-baa9-3e2084f257e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d5f6699319c422cb51af416536b2187',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:31:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:31:20Z,use_quota=True,user_id='fd7c08c0f13a4754b388258d2b1fb297',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 10:31:20 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-ed502326-61e7-43e8-b01a-edd46bb99b36 tempest-ProjectReaderTests-1792574560 None] Creating volume 00da087b-4db9-4265-baa9-3e2084f257e1 {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:31:20 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-ed502326-61e7-43e8-b01a-edd46bb99b36 tempest-ProjectReaderTests-1792574560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:31:20 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-ed502326-61e7-43e8-b01a-edd46bb99b36 tempest-ProjectReaderTests-1792574560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:31:20 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-ed502326-61e7-43e8-b01a-edd46bb99b36 tempest-ProjectReaderTests-1792574560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:31:20 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-ed502326-61e7-43e8-b01a-edd46bb99b36 tempest-ProjectReaderTests-1792574560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:31:20 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-ed502326-61e7-43e8-b01a-edd46bb99b36 tempest-ProjectReaderTests-1792574560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:31:20 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-ed502326-61e7-43e8-b01a-edd46bb99b36 tempest-ProjectReaderTests-1792574560 None] Selected osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:31:20 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-ed502326-61e7-43e8-b01a-edd46bb99b36 tempest-ProjectReaderTests-1792574560 None] casted to osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 Nov 04 10:31:20 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ed502326-61e7-43e8-b01a-edd46bb99b36 tempest-ProjectReaderTests-1792574560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-00da087b-4db9-4265-baa9-3e2084f257e1 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:31:20 devstack sudo[105317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-00da087b-4db9-4265-baa9-3e2084f257e1 1073741824 Nov 04 10:31:20 devstack sudo[105317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:31:20 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-6f29f706-2fa0-46a7-ab92-84288e35d5a6 tempest-ProjectReaderTests-888867065 None] Create snapshot completed successfully Nov 04 10:31:20 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-f9cfbcc8-d4c7-432f-b964-7b6d47583ff2 tempest-VolumeDependencyTests-268296630 None] Created reservations ['f7a201c6-c648-4d6d-a022-6d40e560cace', '19304e7c-897f-4fb3-bc97-033cfd6a4731', '44ba2a80-6e95-43a2-aa84-82906f89e0e0', '10a3b834-1a3e-4dfb-9334-5846dfae21f8'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:31:20 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-f9cfbcc8-d4c7-432f-b964-7b6d47583ff2 tempest-VolumeDependencyTests-268296630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:31:20 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-f9cfbcc8-d4c7-432f-b964-7b6d47583ff2 tempest-VolumeDependencyTests-268296630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:31:20 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-f9cfbcc8-d4c7-432f-b964-7b6d47583ff2 tempest-VolumeDependencyTests-268296630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:31:20 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-f9cfbcc8-d4c7-432f-b964-7b6d47583ff2 tempest-VolumeDependencyTests-268296630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:31:20 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-f9cfbcc8-d4c7-432f-b964-7b6d47583ff2 tempest-VolumeDependencyTests-268296630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:31:20 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f9cfbcc8-d4c7-432f-b964-7b6d47583ff2 tempest-VolumeDependencyTests-268296630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:31:20 devstack sudo[105319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:31:20 devstack sudo[105319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:31:20 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-ab438a24-4db4-4052-ad15-f731daca6d9a tempest-VolumeDependencyTests-268296630 None] Acquiring lock "cinder-754b1b88-840d-493f-ad5e-eb14197ea285-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:31:20 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-ab438a24-4db4-4052-ad15-f731daca6d9a tempest-VolumeDependencyTests-268296630 None] Lock "cinder-754b1b88-840d-493f-ad5e-eb14197ea285-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:31:21 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-ab438a24-4db4-4052-ad15-f731daca6d9a tempest-VolumeDependencyTests-268296630 None] Acquiring lock "cinder-quobyte-754b1b88-840d-493f-ad5e-eb14197ea285" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:31:21 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-ab438a24-4db4-4052-ad15-f731daca6d9a tempest-VolumeDependencyTests-268296630 None] Lock "cinder-quobyte-754b1b88-840d-493f-ad5e-eb14197ea285" acquired by "delete_volume" :: waited 0.021s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:31:21 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c229285-0537-4e99-a58c-1cea21750994]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:31:21 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ab438a24-4db4-4052-ad15-f731daca6d9a tempest-VolumeDependencyTests-268296630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-754b1b88-840d-493f-ad5e-eb14197ea285 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:31:21 devstack sudo[105319]: pam_unix(sudo:session): session closed for user root Nov 04 10:31:21 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f9cfbcc8-d4c7-432f-b964-7b6d47583ff2 tempest-VolumeDependencyTests-268296630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.380s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:31:21 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-f9cfbcc8-d4c7-432f-b964-7b6d47583ff2 tempest-VolumeDependencyTests-268296630 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:31:21 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-f9cfbcc8-d4c7-432f-b964-7b6d47583ff2 tempest-VolumeDependencyTests-268296630 None] Deleted volume successfully. Nov 04 10:31:21 devstack sudo[105317]: pam_unix(sudo:session): session closed for user root Nov 04 10:31:21 devstack sudo[105324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-754b1b88-840d-493f-ad5e-eb14197ea285 Nov 04 10:31:21 devstack sudo[105324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:31:21 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-550ea138-45bf-493b-a9be-bea247725c83 tempest-ProjectReaderTests-888867065 None] Acquiring lock "cinder-9769a201-f4aa-44d6-bad3-0a5088cab8e4-delete_snapshot" by "delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:31:21 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ed502326-61e7-43e8-b01a-edd46bb99b36 tempest-ProjectReaderTests-1792574560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-00da087b-4db9-4265-baa9-3e2084f257e1 1073741824" returned: 0 in 0.650s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:31:21 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-550ea138-45bf-493b-a9be-bea247725c83 tempest-ProjectReaderTests-888867065 None] Lock "cinder-9769a201-f4aa-44d6-bad3-0a5088cab8e4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:31:21 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-550ea138-45bf-493b-a9be-bea247725c83 tempest-ProjectReaderTests-888867065 None] Acquiring lock "cinder-quobyte-f79ffe57-b970-42ab-85fc-e8cacdc3e0ef" by "delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:31:21 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-f9cfbcc8-d4c7-432f-b964-7b6d47583ff2 tempest-VolumeDependencyTests-268296630 None] Lock "cinder-89a35098-136f-4c6f-978a-dff445a37b20-delete_volume" released by "delete_volume" :: held 1.566s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:31:21 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-550ea138-45bf-493b-a9be-bea247725c83 tempest-ProjectReaderTests-888867065 None] Lock "cinder-quobyte-f79ffe57-b970-42ab-85fc-e8cacdc3e0ef" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:31:21 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-550ea138-45bf-493b-a9be-bea247725c83 tempest-ProjectReaderTests-888867065 None] Acquiring lock "cinder-quobyte-9769a201-f4aa-44d6-bad3-0a5088cab8e4" by "_delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:31:21 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ed502326-61e7-43e8-b01a-edd46bb99b36 tempest-ProjectReaderTests-1792574560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-00da087b-4db9-4265-baa9-3e2084f257e1 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:31:21 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-550ea138-45bf-493b-a9be-bea247725c83 tempest-ProjectReaderTests-888867065 None] Lock "cinder-quobyte-9769a201-f4aa-44d6-bad3-0a5088cab8e4" acquired by "_delete_snapshot" :: waited 0.038s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:31:21 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-550ea138-45bf-493b-a9be-bea247725c83 tempest-ProjectReaderTests-888867065 None] Deleting offline snapshot 9769a201-f4aa-44d6-bad3-0a5088cab8e4 of volume f79ffe57-b970-42ab-85fc-e8cacdc3e0ef {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 10:31:21 devstack sudo[105327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-00da087b-4db9-4265-baa9-3e2084f257e1 Nov 04 10:31:21 devstack sudo[105327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:31:21 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-550ea138-45bf-493b-a9be-bea247725c83 tempest-ProjectReaderTests-888867065 None] snapshot_file for this snap is: volume-f79ffe57-b970-42ab-85fc-e8cacdc3e0ef.9769a201-f4aa-44d6-bad3-0a5088cab8e4 {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 10:31:21 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[b96c70cd-000e-4356-bfec-aa7d4c689d37]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:31:21 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-550ea138-45bf-493b-a9be-bea247725c83 tempest-ProjectReaderTests-888867065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-f79ffe57-b970-42ab-85fc-e8cacdc3e0ef.9769a201-f4aa-44d6-bad3-0a5088cab8e4 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:31:21 devstack sudo[105329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-f79ffe57-b970-42ab-85fc-e8cacdc3e0ef.9769a201-f4aa-44d6-bad3-0a5088cab8e4 Nov 04 10:31:21 devstack sudo[105329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:31:21 devstack sudo[105324]: pam_unix(sudo:session): session closed for user root Nov 04 10:31:21 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ab438a24-4db4-4052-ad15-f731daca6d9a tempest-VolumeDependencyTests-268296630 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-754b1b88-840d-493f-ad5e-eb14197ea285" returned: 0 in 0.507s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:31:21 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ab438a24-4db4-4052-ad15-f731daca6d9a tempest-VolumeDependencyTests-268296630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-754b1b88-840d-493f-ad5e-eb14197ea285 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:31:21 devstack sudo[105334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-754b1b88-840d-493f-ad5e-eb14197ea285 Nov 04 10:31:21 devstack sudo[105334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:31:21 devstack sudo[105327]: pam_unix(sudo:session): session closed for user root Nov 04 10:31:21 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ed502326-61e7-43e8-b01a-edd46bb99b36 tempest-ProjectReaderTests-1792574560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-00da087b-4db9-4265-baa9-3e2084f257e1" returned: 0 in 0.309s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:31:21 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-ed502326-61e7-43e8-b01a-edd46bb99b36 tempest-ProjectReaderTests-1792574560 None] <== create_volume: return (1059ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 10:31:21 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-ed502326-61e7-43e8-b01a-edd46bb99b36 tempest-ProjectReaderTests-1792574560 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.062s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:31:21 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-ed502326-61e7-43e8-b01a-edd46bb99b36 tempest-ProjectReaderTests-1792574560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79debda8-b348-4444-9be6-f78006fdaa3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00da087b-4db9-4265-baa9-3e2084f257e1', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:31:21 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-ed502326-61e7-43e8-b01a-edd46bb99b36 tempest-ProjectReaderTests-1792574560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80d8f5a6-1194-463c-b3e6-38630a73b9d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:31:21 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-ed502326-61e7-43e8-b01a-edd46bb99b36 tempest-ProjectReaderTests-1792574560 None] Volume volume-00da087b-4db9-4265-baa9-3e2084f257e1 (00da087b-4db9-4265-baa9-3e2084f257e1): created successfully Nov 04 10:31:21 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-ed502326-61e7-43e8-b01a-edd46bb99b36 tempest-ProjectReaderTests-1792574560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80d8f5a6-1194-463c-b3e6-38630a73b9d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:31:21 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-ed502326-61e7-43e8-b01a-edd46bb99b36 tempest-ProjectReaderTests-1792574560 None] Flow 'volume_create_manager' (ba490580-e10c-4fdc-ad51-57dfdef7d6f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:31:21 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-ed502326-61e7-43e8-b01a-edd46bb99b36 tempest-ProjectReaderTests-1792574560 None] Created volume successfully. Nov 04 10:31:21 devstack sudo[105329]: pam_unix(sudo:session): session closed for user root Nov 04 10:31:21 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-550ea138-45bf-493b-a9be-bea247725c83 tempest-ProjectReaderTests-888867065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-f79ffe57-b970-42ab-85fc-e8cacdc3e0ef.9769a201-f4aa-44d6-bad3-0a5088cab8e4" returned: 0 in 0.464s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:31:21 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-550ea138-45bf-493b-a9be-bea247725c83 tempest-ProjectReaderTests-888867065 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f79ffe57-b970-42ab-85fc-e8cacdc3e0ef(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87068) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 10:31:21 devstack sudo[105334]: pam_unix(sudo:session): session closed for user root Nov 04 10:31:21 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ab438a24-4db4-4052-ad15-f731daca6d9a tempest-VolumeDependencyTests-268296630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-754b1b88-840d-493f-ad5e-eb14197ea285" returned: 0 in 0.335s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:31:21 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[edbe88f3-5fca-4284-8778-4c346d3665d6]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:31:21 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-550ea138-45bf-493b-a9be-bea247725c83 tempest-ProjectReaderTests-888867065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-f79ffe57-b970-42ab-85fc-e8cacdc3e0ef {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:31:21 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-ab438a24-4db4-4052-ad15-f731daca6d9a tempest-VolumeDependencyTests-268296630 None] Lock "cinder-quobyte-754b1b88-840d-493f-ad5e-eb14197ea285" released by "delete_volume" :: held 0.903s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:31:22 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-a73b6654-5aa3-424e-903b-c4055d8d4af3 tempest-ProjectReaderTests-1792574560 None] Acquiring lock "cinder-00da087b-4db9-4265-baa9-3e2084f257e1-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:31:22 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-ab438a24-4db4-4052-ad15-f731daca6d9a tempest-VolumeDependencyTests-268296630 None] Created reservations ['0bd5456b-85cd-4ffd-b40e-e67ab71e8998', '40394fdc-91f9-4f92-b4a3-c5f8ed8acad3', '8de2b361-d0f6-4831-96f4-0029575d5829', 'c8323c95-827b-4fdc-b496-f486ec72a2b9'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:31:22 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-a73b6654-5aa3-424e-903b-c4055d8d4af3 tempest-ProjectReaderTests-1792574560 None] Lock "cinder-00da087b-4db9-4265-baa9-3e2084f257e1-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:31:22 devstack sudo[105341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-f79ffe57-b970-42ab-85fc-e8cacdc3e0ef Nov 04 10:31:22 devstack sudo[105341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:31:22 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-a73b6654-5aa3-424e-903b-c4055d8d4af3 tempest-ProjectReaderTests-1792574560 None] Acquiring lock "cinder-quobyte-00da087b-4db9-4265-baa9-3e2084f257e1" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:31:22 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-ab438a24-4db4-4052-ad15-f731daca6d9a tempest-VolumeDependencyTests-268296630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:31:22 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-ab438a24-4db4-4052-ad15-f731daca6d9a tempest-VolumeDependencyTests-268296630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:31:22 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-ab438a24-4db4-4052-ad15-f731daca6d9a tempest-VolumeDependencyTests-268296630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:31:22 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-ab438a24-4db4-4052-ad15-f731daca6d9a tempest-VolumeDependencyTests-268296630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:31:22 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-ab438a24-4db4-4052-ad15-f731daca6d9a tempest-VolumeDependencyTests-268296630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:31:22 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ab438a24-4db4-4052-ad15-f731daca6d9a tempest-VolumeDependencyTests-268296630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:31:22 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-a73b6654-5aa3-424e-903b-c4055d8d4af3 tempest-ProjectReaderTests-1792574560 None] Lock "cinder-quobyte-00da087b-4db9-4265-baa9-3e2084f257e1" acquired by "delete_volume" :: waited 0.044s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:31:22 devstack sudo[105343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:31:22 devstack sudo[105343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:31:22 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f319352-f083-47af-9f9c-dac55901f0ed]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:31:22 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-a73b6654-5aa3-424e-903b-c4055d8d4af3 tempest-ProjectReaderTests-1792574560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-00da087b-4db9-4265-baa9-3e2084f257e1 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:31:22 devstack sudo[105345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-00da087b-4db9-4265-baa9-3e2084f257e1 Nov 04 10:31:22 devstack sudo[105345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:31:22 devstack sudo[105343]: pam_unix(sudo:session): session closed for user root Nov 04 10:31:22 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ab438a24-4db4-4052-ad15-f731daca6d9a tempest-VolumeDependencyTests-268296630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.318s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:31:22 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-ab438a24-4db4-4052-ad15-f731daca6d9a tempest-VolumeDependencyTests-268296630 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:31:22 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-ab438a24-4db4-4052-ad15-f731daca6d9a tempest-VolumeDependencyTests-268296630 None] Deleted volume successfully. Nov 04 10:31:22 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-ab438a24-4db4-4052-ad15-f731daca6d9a tempest-VolumeDependencyTests-268296630 None] Lock "cinder-754b1b88-840d-493f-ad5e-eb14197ea285-delete_volume" released by "delete_volume" :: held 1.585s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:31:22 devstack sudo[105341]: pam_unix(sudo:session): session closed for user root Nov 04 10:31:22 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-550ea138-45bf-493b-a9be-bea247725c83 tempest-ProjectReaderTests-888867065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-f79ffe57-b970-42ab-85fc-e8cacdc3e0ef" returned: 0 in 0.750s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:31:22 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-550ea138-45bf-493b-a9be-bea247725c83 tempest-ProjectReaderTests-888867065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-f79ffe57-b970-42ab-85fc-e8cacdc3e0ef.9769a201-f4aa-44d6-bad3-0a5088cab8e4 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:31:22 devstack sudo[105353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-f79ffe57-b970-42ab-85fc-e8cacdc3e0ef.9769a201-f4aa-44d6-bad3-0a5088cab8e4 Nov 04 10:31:22 devstack sudo[105353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:31:22 devstack sudo[105345]: pam_unix(sudo:session): session closed for user root Nov 04 10:31:22 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-a73b6654-5aa3-424e-903b-c4055d8d4af3 tempest-ProjectReaderTests-1792574560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-00da087b-4db9-4265-baa9-3e2084f257e1" returned: 0 in 0.551s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:31:22 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-a73b6654-5aa3-424e-903b-c4055d8d4af3 tempest-ProjectReaderTests-1792574560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-00da087b-4db9-4265-baa9-3e2084f257e1 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:31:22 devstack sudo[105356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-00da087b-4db9-4265-baa9-3e2084f257e1 Nov 04 10:31:22 devstack sudo[105356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:31:23 devstack sudo[105356]: pam_unix(sudo:session): session closed for user root Nov 04 10:31:23 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-a73b6654-5aa3-424e-903b-c4055d8d4af3 tempest-ProjectReaderTests-1792574560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-00da087b-4db9-4265-baa9-3e2084f257e1" returned: 0 in 0.272s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:31:23 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-a73b6654-5aa3-424e-903b-c4055d8d4af3 tempest-ProjectReaderTests-1792574560 None] Lock "cinder-quobyte-00da087b-4db9-4265-baa9-3e2084f257e1" released by "delete_volume" :: held 0.911s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:31:23 devstack sudo[105353]: pam_unix(sudo:session): session closed for user root Nov 04 10:31:23 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-550ea138-45bf-493b-a9be-bea247725c83 tempest-ProjectReaderTests-888867065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-f79ffe57-b970-42ab-85fc-e8cacdc3e0ef.9769a201-f4aa-44d6-bad3-0a5088cab8e4" returned: 0 in 0.475s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:31:23 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-550ea138-45bf-493b-a9be-bea247725c83 tempest-ProjectReaderTests-888867065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-f79ffe57-b970-42ab-85fc-e8cacdc3e0ef.9769a201-f4aa-44d6-bad3-0a5088cab8e4 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:31:23 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-a73b6654-5aa3-424e-903b-c4055d8d4af3 tempest-ProjectReaderTests-1792574560 None] Created reservations ['fdb08ee0-6bd2-43f9-bf00-ca87c3a7e231', '94b0d6e2-1d40-4392-86da-793d625202b0', '1c7326ae-2238-4a07-9e03-e82f9f3b2e92', '565060e4-eb6e-4607-9b6d-dfb5095fe74d'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:31:23 devstack sudo[105364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-f79ffe57-b970-42ab-85fc-e8cacdc3e0ef.9769a201-f4aa-44d6-bad3-0a5088cab8e4 Nov 04 10:31:23 devstack sudo[105364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:31:23 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-a73b6654-5aa3-424e-903b-c4055d8d4af3 tempest-ProjectReaderTests-1792574560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:31:23 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-a73b6654-5aa3-424e-903b-c4055d8d4af3 tempest-ProjectReaderTests-1792574560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:31:23 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-a73b6654-5aa3-424e-903b-c4055d8d4af3 tempest-ProjectReaderTests-1792574560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:31:23 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-a73b6654-5aa3-424e-903b-c4055d8d4af3 tempest-ProjectReaderTests-1792574560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:31:23 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-a73b6654-5aa3-424e-903b-c4055d8d4af3 tempest-ProjectReaderTests-1792574560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:31:23 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-a73b6654-5aa3-424e-903b-c4055d8d4af3 tempest-ProjectReaderTests-1792574560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:31:23 devstack sudo[105366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:31:23 devstack sudo[105366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:31:23 devstack sudo[105364]: pam_unix(sudo:session): session closed for user root Nov 04 10:31:23 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-550ea138-45bf-493b-a9be-bea247725c83 tempest-ProjectReaderTests-888867065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-f79ffe57-b970-42ab-85fc-e8cacdc3e0ef.9769a201-f4aa-44d6-bad3-0a5088cab8e4" returned: 0 in 0.406s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:31:23 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-550ea138-45bf-493b-a9be-bea247725c83 tempest-ProjectReaderTests-888867065 None] Lock "cinder-quobyte-9769a201-f4aa-44d6-bad3-0a5088cab8e4" released by "_delete_snapshot" :: held 2.267s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:31:23 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-550ea138-45bf-493b-a9be-bea247725c83 tempest-ProjectReaderTests-888867065 None] Lock "cinder-quobyte-f79ffe57-b970-42ab-85fc-e8cacdc3e0ef" released by "delete_snapshot" :: held 2.314s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:31:23 devstack sudo[105366]: pam_unix(sudo:session): session closed for user root Nov 04 10:31:23 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-a73b6654-5aa3-424e-903b-c4055d8d4af3 tempest-ProjectReaderTests-1792574560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.306s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:31:23 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-a73b6654-5aa3-424e-903b-c4055d8d4af3 tempest-ProjectReaderTests-1792574560 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:31:23 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-a73b6654-5aa3-424e-903b-c4055d8d4af3 tempest-ProjectReaderTests-1792574560 None] Deleted volume successfully. Nov 04 10:31:23 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-a73b6654-5aa3-424e-903b-c4055d8d4af3 tempest-ProjectReaderTests-1792574560 None] Lock "cinder-00da087b-4db9-4265-baa9-3e2084f257e1-delete_volume" released by "delete_volume" :: held 1.668s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:31:23 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-550ea138-45bf-493b-a9be-bea247725c83 tempest-ProjectReaderTests-888867065 None] Created reservations ['172f3de5-4f63-48b5-a933-04fc242b0bce', 'd54a9bee-a105-444e-9738-56b1e832cf04', '46bfb823-c0c0-4f13-a7f7-28a628a2ee5e', '38e868bf-c98f-4981-bcf0-2cdd0b9d8785'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:31:23 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-550ea138-45bf-493b-a9be-bea247725c83 tempest-ProjectReaderTests-888867065 None] Delete snapshot completed successfully. Nov 04 10:31:23 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-550ea138-45bf-493b-a9be-bea247725c83 tempest-ProjectReaderTests-888867065 None] Lock "cinder-9769a201-f4aa-44d6-bad3-0a5088cab8e4-delete_snapshot" released by "delete_snapshot" :: held 2.525s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:31:24 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-d894d3c4-e26d-429f-a5c1-ae4edb5fc94c tempest-ProjectReaderTests-888867065 None] Acquiring lock "cinder-f79ffe57-b970-42ab-85fc-e8cacdc3e0ef-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:31:24 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-d894d3c4-e26d-429f-a5c1-ae4edb5fc94c tempest-ProjectReaderTests-888867065 None] Lock "cinder-f79ffe57-b970-42ab-85fc-e8cacdc3e0ef-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:31:24 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-d894d3c4-e26d-429f-a5c1-ae4edb5fc94c tempest-ProjectReaderTests-888867065 None] Acquiring lock "cinder-quobyte-f79ffe57-b970-42ab-85fc-e8cacdc3e0ef" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:31:24 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-d894d3c4-e26d-429f-a5c1-ae4edb5fc94c tempest-ProjectReaderTests-888867065 None] Lock "cinder-quobyte-f79ffe57-b970-42ab-85fc-e8cacdc3e0ef" acquired by "delete_volume" :: waited 0.037s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:31:24 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c26d91a-dcba-498d-bd5b-9ae3611e4e4d]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:31:24 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d894d3c4-e26d-429f-a5c1-ae4edb5fc94c tempest-ProjectReaderTests-888867065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-f79ffe57-b970-42ab-85fc-e8cacdc3e0ef {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:31:24 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d7f14b7-89d7-432f-ab20-e1562eab7208 tempest-ProjectReaderTests-1792574560 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:31:24 devstack sudo[105370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-f79ffe57-b970-42ab-85fc-e8cacdc3e0ef Nov 04 10:31:24 devstack sudo[105370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:31:24 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1d7f14b7-89d7-432f-ab20-e1562eab7208 tempest-ProjectReaderTests-1792574560 None] Flow 'volume_create_manager' (ae65bacc-6be4-4bda-9eda-62f77ec0bd3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:31:24 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1d7f14b7-89d7-432f-ab20-e1562eab7208 tempest-ProjectReaderTests-1792574560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f3bd8b6-f2ff-481b-b432-fc4ed7e933fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:31:24 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1d7f14b7-89d7-432f-ab20-e1562eab7208 tempest-ProjectReaderTests-1792574560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f3bd8b6-f2ff-481b-b432-fc4ed7e933fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:31:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1204663680',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a93cf409-7e84-4f9f-a3ac-68944e1e78fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d5f6699319c422cb51af416536b2187',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:31:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:31:25Z,use_quota=True,user_id='fd7c08c0f13a4754b388258d2b1fb297',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:31:24 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1d7f14b7-89d7-432f-ab20-e1562eab7208 tempest-ProjectReaderTests-1792574560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (203e7ac4-0357-450f-8698-93df1b8fba4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:31:25 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1d7f14b7-89d7-432f-ab20-e1562eab7208 tempest-ProjectReaderTests-1792574560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (203e7ac4-0357-450f-8698-93df1b8fba4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:31:25 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1d7f14b7-89d7-432f-ab20-e1562eab7208 tempest-ProjectReaderTests-1792574560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3604487d-6873-435c-85df-5dc0c1677b31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:31:25 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1d7f14b7-89d7-432f-ab20-e1562eab7208 tempest-ProjectReaderTests-1792574560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3604487d-6873-435c-85df-5dc0c1677b31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a93cf409-7e84-4f9f-a3ac-68944e1e78fe', 'volume_name': 'volume-a93cf409-7e84-4f9f-a3ac-68944e1e78fe', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:31:25 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1d7f14b7-89d7-432f-ab20-e1562eab7208 tempest-ProjectReaderTests-1792574560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd147cab-d603-4777-b021-6c82128540ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:31:25 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1d7f14b7-89d7-432f-ab20-e1562eab7208 tempest-ProjectReaderTests-1792574560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd147cab-d603-4777-b021-6c82128540ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:31:25 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1d7f14b7-89d7-432f-ab20-e1562eab7208 tempest-ProjectReaderTests-1792574560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f94c821-299f-4878-83a7-a4a270627619) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:31:25 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-1d7f14b7-89d7-432f-ab20-e1562eab7208 tempest-ProjectReaderTests-1792574560 None] Volume a93cf409-7e84-4f9f-a3ac-68944e1e78fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a93cf409-7e84-4f9f-a3ac-68944e1e78fe', 'volume_size': 1} Nov 04 10:31:25 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-1d7f14b7-89d7-432f-ab20-e1562eab7208 tempest-ProjectReaderTests-1792574560 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:31:25 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-1d7f14b7-89d7-432f-ab20-e1562eab7208 tempest-ProjectReaderTests-1792574560 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:31:25 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-1d7f14b7-89d7-432f-ab20-e1562eab7208 tempest-ProjectReaderTests-1792574560 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:31:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1204663680',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a93cf409-7e84-4f9f-a3ac-68944e1e78fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d5f6699319c422cb51af416536b2187',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:31:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:31:25Z,use_quota=True,user_id='fd7c08c0f13a4754b388258d2b1fb297',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 10:31:25 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-1d7f14b7-89d7-432f-ab20-e1562eab7208 tempest-ProjectReaderTests-1792574560 None] Creating volume a93cf409-7e84-4f9f-a3ac-68944e1e78fe {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:31:25 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-1d7f14b7-89d7-432f-ab20-e1562eab7208 tempest-ProjectReaderTests-1792574560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:31:25 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-1d7f14b7-89d7-432f-ab20-e1562eab7208 tempest-ProjectReaderTests-1792574560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:31:25 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-1d7f14b7-89d7-432f-ab20-e1562eab7208 tempest-ProjectReaderTests-1792574560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:31:25 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-1d7f14b7-89d7-432f-ab20-e1562eab7208 tempest-ProjectReaderTests-1792574560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:31:25 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-1d7f14b7-89d7-432f-ab20-e1562eab7208 tempest-ProjectReaderTests-1792574560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:31:25 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-1d7f14b7-89d7-432f-ab20-e1562eab7208 tempest-ProjectReaderTests-1792574560 None] Selected osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:31:25 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-1d7f14b7-89d7-432f-ab20-e1562eab7208 tempest-ProjectReaderTests-1792574560 None] casted to osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 Nov 04 10:31:25 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-1d7f14b7-89d7-432f-ab20-e1562eab7208 tempest-ProjectReaderTests-1792574560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-a93cf409-7e84-4f9f-a3ac-68944e1e78fe 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:31:25 devstack sudo[105372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-a93cf409-7e84-4f9f-a3ac-68944e1e78fe 1073741824 Nov 04 10:31:25 devstack sudo[105372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:31:25 devstack sudo[105370]: pam_unix(sudo:session): session closed for user root Nov 04 10:31:25 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d894d3c4-e26d-429f-a5c1-ae4edb5fc94c tempest-ProjectReaderTests-888867065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-f79ffe57-b970-42ab-85fc-e8cacdc3e0ef" returned: 0 in 0.494s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:31:25 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d894d3c4-e26d-429f-a5c1-ae4edb5fc94c tempest-ProjectReaderTests-888867065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-f79ffe57-b970-42ab-85fc-e8cacdc3e0ef {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:31:25 devstack sudo[105377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-f79ffe57-b970-42ab-85fc-e8cacdc3e0ef Nov 04 10:31:25 devstack sudo[105377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:31:25 devstack sudo[105377]: pam_unix(sudo:session): session closed for user root Nov 04 10:31:25 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d894d3c4-e26d-429f-a5c1-ae4edb5fc94c tempest-ProjectReaderTests-888867065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-f79ffe57-b970-42ab-85fc-e8cacdc3e0ef" returned: 0 in 0.302s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:31:25 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-d894d3c4-e26d-429f-a5c1-ae4edb5fc94c tempest-ProjectReaderTests-888867065 None] Lock "cinder-quobyte-f79ffe57-b970-42ab-85fc-e8cacdc3e0ef" released by "delete_volume" :: held 0.935s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:31:25 devstack sudo[105372]: pam_unix(sudo:session): session closed for user root Nov 04 10:31:25 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-1d7f14b7-89d7-432f-ab20-e1562eab7208 tempest-ProjectReaderTests-1792574560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-a93cf409-7e84-4f9f-a3ac-68944e1e78fe 1073741824" returned: 0 in 0.643s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:31:25 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-d894d3c4-e26d-429f-a5c1-ae4edb5fc94c tempest-ProjectReaderTests-888867065 None] Created reservations ['7a45d07f-0584-4bed-894f-d2b87aca6b59', 'c28ba9f1-4b41-4e70-a93a-027f80c20cb5', '8a1b4d68-63e9-45b0-9f4a-6c26823f903c', 'babdab32-fa91-407d-88fc-66f4d07ae397'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:31:25 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-1d7f14b7-89d7-432f-ab20-e1562eab7208 tempest-ProjectReaderTests-1792574560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-a93cf409-7e84-4f9f-a3ac-68944e1e78fe {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:31:25 devstack sudo[105384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-a93cf409-7e84-4f9f-a3ac-68944e1e78fe Nov 04 10:31:25 devstack sudo[105384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:31:25 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-d894d3c4-e26d-429f-a5c1-ae4edb5fc94c tempest-ProjectReaderTests-888867065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:31:25 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-d894d3c4-e26d-429f-a5c1-ae4edb5fc94c tempest-ProjectReaderTests-888867065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:31:25 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-d894d3c4-e26d-429f-a5c1-ae4edb5fc94c tempest-ProjectReaderTests-888867065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:31:25 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-d894d3c4-e26d-429f-a5c1-ae4edb5fc94c tempest-ProjectReaderTests-888867065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:31:25 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-d894d3c4-e26d-429f-a5c1-ae4edb5fc94c tempest-ProjectReaderTests-888867065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:31:25 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d894d3c4-e26d-429f-a5c1-ae4edb5fc94c tempest-ProjectReaderTests-888867065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:31:25 devstack sudo[105386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:31:25 devstack sudo[105386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:31:26 devstack sudo[105384]: pam_unix(sudo:session): session closed for user root Nov 04 10:31:26 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-1d7f14b7-89d7-432f-ab20-e1562eab7208 tempest-ProjectReaderTests-1792574560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-a93cf409-7e84-4f9f-a3ac-68944e1e78fe" returned: 0 in 0.287s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:31:26 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-1d7f14b7-89d7-432f-ab20-e1562eab7208 tempest-ProjectReaderTests-1792574560 None] <== create_volume: return (1000ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 10:31:26 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-1d7f14b7-89d7-432f-ab20-e1562eab7208 tempest-ProjectReaderTests-1792574560 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.003s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:31:26 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1d7f14b7-89d7-432f-ab20-e1562eab7208 tempest-ProjectReaderTests-1792574560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f94c821-299f-4878-83a7-a4a270627619) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a93cf409-7e84-4f9f-a3ac-68944e1e78fe', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:31:26 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1d7f14b7-89d7-432f-ab20-e1562eab7208 tempest-ProjectReaderTests-1792574560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7a57219-6df0-4e3f-9a8f-1a3da75ef783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:31:26 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-1d7f14b7-89d7-432f-ab20-e1562eab7208 tempest-ProjectReaderTests-1792574560 None] Volume volume-a93cf409-7e84-4f9f-a3ac-68944e1e78fe (a93cf409-7e84-4f9f-a3ac-68944e1e78fe): created successfully Nov 04 10:31:26 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1d7f14b7-89d7-432f-ab20-e1562eab7208 tempest-ProjectReaderTests-1792574560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7a57219-6df0-4e3f-9a8f-1a3da75ef783) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:31:26 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1d7f14b7-89d7-432f-ab20-e1562eab7208 tempest-ProjectReaderTests-1792574560 None] Flow 'volume_create_manager' (ae65bacc-6be4-4bda-9eda-62f77ec0bd3a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:31:26 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-1d7f14b7-89d7-432f-ab20-e1562eab7208 tempest-ProjectReaderTests-1792574560 None] Created volume successfully. Nov 04 10:31:26 devstack sudo[105386]: pam_unix(sudo:session): session closed for user root Nov 04 10:31:26 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d894d3c4-e26d-429f-a5c1-ae4edb5fc94c tempest-ProjectReaderTests-888867065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.279s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:31:26 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-d894d3c4-e26d-429f-a5c1-ae4edb5fc94c tempest-ProjectReaderTests-888867065 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:31:26 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-d894d3c4-e26d-429f-a5c1-ae4edb5fc94c tempest-ProjectReaderTests-888867065 None] Deleted volume successfully. Nov 04 10:31:26 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-d894d3c4-e26d-429f-a5c1-ae4edb5fc94c tempest-ProjectReaderTests-888867065 None] Lock "cinder-f79ffe57-b970-42ab-85fc-e8cacdc3e0ef-delete_volume" released by "delete_volume" :: held 1.558s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:31:26 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-1590981c-7688-423b-ac58-af62cef232ba tempest-ProjectMemberTests-163191203 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:31:26 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1590981c-7688-423b-ac58-af62cef232ba tempest-ProjectMemberTests-163191203 None] Flow 'volume_create_manager' (95126a1e-4035-4e12-851e-91faf9fb47d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:31:26 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1590981c-7688-423b-ac58-af62cef232ba tempest-ProjectMemberTests-163191203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3922dad-a0d1-4d6d-bd75-5d753f06dc5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:31:26 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1590981c-7688-423b-ac58-af62cef232ba tempest-ProjectMemberTests-163191203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3922dad-a0d1-4d6d-bd75-5d753f06dc5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:31:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-309484745',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=deb4f42a-25f3-45a3-a864-96b5880d42be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6102192fe22c4f298ee9815860bd7a9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:31:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:31:27Z,use_quota=True,user_id='df3853accc6242909d45cceeb3a0db9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:31:26 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1590981c-7688-423b-ac58-af62cef232ba tempest-ProjectMemberTests-163191203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2178e994-e34a-4daf-bf4d-b034a5dc84a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:31:26 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1590981c-7688-423b-ac58-af62cef232ba tempest-ProjectMemberTests-163191203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2178e994-e34a-4daf-bf4d-b034a5dc84a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:31:26 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1590981c-7688-423b-ac58-af62cef232ba tempest-ProjectMemberTests-163191203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a74d9195-75d9-4b7b-8c0d-3c6d3f5d0271) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:31:26 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1590981c-7688-423b-ac58-af62cef232ba tempest-ProjectMemberTests-163191203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a74d9195-75d9-4b7b-8c0d-3c6d3f5d0271) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'deb4f42a-25f3-45a3-a864-96b5880d42be', 'volume_name': 'volume-deb4f42a-25f3-45a3-a864-96b5880d42be', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:31:26 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1590981c-7688-423b-ac58-af62cef232ba tempest-ProjectMemberTests-163191203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (765958b1-29ac-4629-bf37-d394fdb7c6be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:31:26 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1590981c-7688-423b-ac58-af62cef232ba tempest-ProjectMemberTests-163191203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (765958b1-29ac-4629-bf37-d394fdb7c6be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:31:26 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1590981c-7688-423b-ac58-af62cef232ba tempest-ProjectMemberTests-163191203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed01a936-228f-41bd-a88a-448bfe947b63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:31:26 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-1590981c-7688-423b-ac58-af62cef232ba tempest-ProjectMemberTests-163191203 None] Volume deb4f42a-25f3-45a3-a864-96b5880d42be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-deb4f42a-25f3-45a3-a864-96b5880d42be', 'volume_size': 1} Nov 04 10:31:26 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-1590981c-7688-423b-ac58-af62cef232ba tempest-ProjectMemberTests-163191203 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:31:26 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-1590981c-7688-423b-ac58-af62cef232ba tempest-ProjectMemberTests-163191203 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:31:26 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-1590981c-7688-423b-ac58-af62cef232ba tempest-ProjectMemberTests-163191203 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:31:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-309484745',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=deb4f42a-25f3-45a3-a864-96b5880d42be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6102192fe22c4f298ee9815860bd7a9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:31:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:31:27Z,use_quota=True,user_id='df3853accc6242909d45cceeb3a0db9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 10:31:26 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-1590981c-7688-423b-ac58-af62cef232ba tempest-ProjectMemberTests-163191203 None] Creating volume deb4f42a-25f3-45a3-a864-96b5880d42be {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:31:26 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-1590981c-7688-423b-ac58-af62cef232ba tempest-ProjectMemberTests-163191203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:31:26 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-1590981c-7688-423b-ac58-af62cef232ba tempest-ProjectMemberTests-163191203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:31:26 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-1590981c-7688-423b-ac58-af62cef232ba tempest-ProjectMemberTests-163191203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:31:26 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-1590981c-7688-423b-ac58-af62cef232ba tempest-ProjectMemberTests-163191203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:31:26 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-1590981c-7688-423b-ac58-af62cef232ba tempest-ProjectMemberTests-163191203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:31:26 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-1590981c-7688-423b-ac58-af62cef232ba tempest-ProjectMemberTests-163191203 None] Selected osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:31:26 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-1590981c-7688-423b-ac58-af62cef232ba tempest-ProjectMemberTests-163191203 None] casted to osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 Nov 04 10:31:26 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-1590981c-7688-423b-ac58-af62cef232ba tempest-ProjectMemberTests-163191203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-deb4f42a-25f3-45a3-a864-96b5880d42be 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:31:27 devstack sudo[105391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-deb4f42a-25f3-45a3-a864-96b5880d42be 1073741824 Nov 04 10:31:27 devstack sudo[105391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:31:27 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-1c4ddd33-31c5-462b-8b62-fba4bb2056b9 tempest-ProjectReaderTests-1792574560 None] Acquiring lock "cinder-a93cf409-7e84-4f9f-a3ac-68944e1e78fe-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:31:27 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-1c4ddd33-31c5-462b-8b62-fba4bb2056b9 tempest-ProjectReaderTests-1792574560 None] Lock "cinder-a93cf409-7e84-4f9f-a3ac-68944e1e78fe-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:31:27 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-1c4ddd33-31c5-462b-8b62-fba4bb2056b9 tempest-ProjectReaderTests-1792574560 None] Acquiring lock "cinder-quobyte-a93cf409-7e84-4f9f-a3ac-68944e1e78fe" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:31:27 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-1c4ddd33-31c5-462b-8b62-fba4bb2056b9 tempest-ProjectReaderTests-1792574560 None] Lock "cinder-quobyte-a93cf409-7e84-4f9f-a3ac-68944e1e78fe" acquired by "delete_volume" :: waited 0.019s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:31:27 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb08c181-60e5-4402-9b7a-bd6e3a84fa56]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:31:27 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-1c4ddd33-31c5-462b-8b62-fba4bb2056b9 tempest-ProjectReaderTests-1792574560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-a93cf409-7e84-4f9f-a3ac-68944e1e78fe {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:31:27 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d95c8fa-885d-480c-9566-37761872b627 tempest-ProjectReaderTests-888867065 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:31:27 devstack sudo[105396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-a93cf409-7e84-4f9f-a3ac-68944e1e78fe Nov 04 10:31:27 devstack sudo[105396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:31:27 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-8d95c8fa-885d-480c-9566-37761872b627 tempest-ProjectReaderTests-888867065 None] Flow 'volume_create_manager' (82579845-6909-4ad7-83d2-77471ef235cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:31:27 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-8d95c8fa-885d-480c-9566-37761872b627 tempest-ProjectReaderTests-888867065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df64cfce-7fbe-4619-8775-308c662ff13c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:31:27 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-8d95c8fa-885d-480c-9566-37761872b627 tempest-ProjectReaderTests-888867065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df64cfce-7fbe-4619-8775-308c662ff13c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:31:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-440757275',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e893c48c-3c57-4d74-ac31-34e1f6b0519f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ceada5c21c0840989abb5a48b7006da6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:31:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:31:27Z,use_quota=True,user_id='8e11bec0815c4b9e994b7a51e248abd4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:31:27 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-8d95c8fa-885d-480c-9566-37761872b627 tempest-ProjectReaderTests-888867065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a9bc2ff-48ba-4b62-92f8-61e738298ed4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:31:27 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-8d95c8fa-885d-480c-9566-37761872b627 tempest-ProjectReaderTests-888867065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a9bc2ff-48ba-4b62-92f8-61e738298ed4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:31:27 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-8d95c8fa-885d-480c-9566-37761872b627 tempest-ProjectReaderTests-888867065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80bfcb02-8fbc-4d64-bde5-0ecd6345e580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:31:27 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-8d95c8fa-885d-480c-9566-37761872b627 tempest-ProjectReaderTests-888867065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80bfcb02-8fbc-4d64-bde5-0ecd6345e580) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e893c48c-3c57-4d74-ac31-34e1f6b0519f', 'volume_name': 'volume-e893c48c-3c57-4d74-ac31-34e1f6b0519f', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:31:27 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-8d95c8fa-885d-480c-9566-37761872b627 tempest-ProjectReaderTests-888867065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba004bbb-36b8-4cac-bead-f290ed8aa4ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:31:27 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-8d95c8fa-885d-480c-9566-37761872b627 tempest-ProjectReaderTests-888867065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba004bbb-36b8-4cac-bead-f290ed8aa4ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:31:27 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-8d95c8fa-885d-480c-9566-37761872b627 tempest-ProjectReaderTests-888867065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f8ae4da-5a13-4b49-b5d0-cda669c4ddc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:31:27 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-8d95c8fa-885d-480c-9566-37761872b627 tempest-ProjectReaderTests-888867065 None] Volume e893c48c-3c57-4d74-ac31-34e1f6b0519f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e893c48c-3c57-4d74-ac31-34e1f6b0519f', 'volume_size': 1} Nov 04 10:31:27 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-8d95c8fa-885d-480c-9566-37761872b627 tempest-ProjectReaderTests-888867065 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:31:27 devstack sudo[105391]: pam_unix(sudo:session): session closed for user root Nov 04 10:31:27 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-1590981c-7688-423b-ac58-af62cef232ba tempest-ProjectMemberTests-163191203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-deb4f42a-25f3-45a3-a864-96b5880d42be 1073741824" returned: 0 in 0.616s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:31:27 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-1590981c-7688-423b-ac58-af62cef232ba tempest-ProjectMemberTests-163191203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-deb4f42a-25f3-45a3-a864-96b5880d42be {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:31:27 devstack sudo[105399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-deb4f42a-25f3-45a3-a864-96b5880d42be Nov 04 10:31:27 devstack sudo[105399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:31:27 devstack sudo[105396]: pam_unix(sudo:session): session closed for user root Nov 04 10:31:27 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-1c4ddd33-31c5-462b-8b62-fba4bb2056b9 tempest-ProjectReaderTests-1792574560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-a93cf409-7e84-4f9f-a3ac-68944e1e78fe" returned: 0 in 0.455s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:31:27 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-1c4ddd33-31c5-462b-8b62-fba4bb2056b9 tempest-ProjectReaderTests-1792574560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-a93cf409-7e84-4f9f-a3ac-68944e1e78fe {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:31:27 devstack sudo[105404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-a93cf409-7e84-4f9f-a3ac-68944e1e78fe Nov 04 10:31:27 devstack sudo[105404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:31:27 devstack sudo[105399]: pam_unix(sudo:session): session closed for user root Nov 04 10:31:27 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-1590981c-7688-423b-ac58-af62cef232ba tempest-ProjectMemberTests-163191203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-deb4f42a-25f3-45a3-a864-96b5880d42be" returned: 0 in 0.278s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:31:27 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-1590981c-7688-423b-ac58-af62cef232ba tempest-ProjectMemberTests-163191203 None] <== create_volume: return (937ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 10:31:27 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-1590981c-7688-423b-ac58-af62cef232ba tempest-ProjectMemberTests-163191203 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.940s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:31:27 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-8d95c8fa-885d-480c-9566-37761872b627 tempest-ProjectReaderTests-888867065 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.322s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:31:27 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-8d95c8fa-885d-480c-9566-37761872b627 tempest-ProjectReaderTests-888867065 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:31:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-440757275',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e893c48c-3c57-4d74-ac31-34e1f6b0519f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ceada5c21c0840989abb5a48b7006da6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:31:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:31:27Z,use_quota=True,user_id='8e11bec0815c4b9e994b7a51e248abd4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 10:31:27 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-8d95c8fa-885d-480c-9566-37761872b627 tempest-ProjectReaderTests-888867065 None] Creating volume e893c48c-3c57-4d74-ac31-34e1f6b0519f {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:31:27 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-8d95c8fa-885d-480c-9566-37761872b627 tempest-ProjectReaderTests-888867065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:31:27 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-8d95c8fa-885d-480c-9566-37761872b627 tempest-ProjectReaderTests-888867065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:31:27 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-8d95c8fa-885d-480c-9566-37761872b627 tempest-ProjectReaderTests-888867065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:31:27 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-8d95c8fa-885d-480c-9566-37761872b627 tempest-ProjectReaderTests-888867065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:31:27 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-8d95c8fa-885d-480c-9566-37761872b627 tempest-ProjectReaderTests-888867065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:31:27 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-8d95c8fa-885d-480c-9566-37761872b627 tempest-ProjectReaderTests-888867065 None] Selected osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:31:27 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-8d95c8fa-885d-480c-9566-37761872b627 tempest-ProjectReaderTests-888867065 None] casted to osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 Nov 04 10:31:27 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-8d95c8fa-885d-480c-9566-37761872b627 tempest-ProjectReaderTests-888867065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-e893c48c-3c57-4d74-ac31-34e1f6b0519f 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:31:27 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1590981c-7688-423b-ac58-af62cef232ba tempest-ProjectMemberTests-163191203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed01a936-228f-41bd-a88a-448bfe947b63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-deb4f42a-25f3-45a3-a864-96b5880d42be', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:31:27 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1590981c-7688-423b-ac58-af62cef232ba tempest-ProjectMemberTests-163191203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (279aa3b1-cd45-4730-a25e-be62d0f01fac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:31:27 devstack sudo[105407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-e893c48c-3c57-4d74-ac31-34e1f6b0519f 1073741824 Nov 04 10:31:27 devstack sudo[105407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:31:27 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-1590981c-7688-423b-ac58-af62cef232ba tempest-ProjectMemberTests-163191203 None] Volume volume-deb4f42a-25f3-45a3-a864-96b5880d42be (deb4f42a-25f3-45a3-a864-96b5880d42be): created successfully Nov 04 10:31:27 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1590981c-7688-423b-ac58-af62cef232ba tempest-ProjectMemberTests-163191203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (279aa3b1-cd45-4730-a25e-be62d0f01fac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:31:27 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-1590981c-7688-423b-ac58-af62cef232ba tempest-ProjectMemberTests-163191203 None] Flow 'volume_create_manager' (95126a1e-4035-4e12-851e-91faf9fb47d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:31:27 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-1590981c-7688-423b-ac58-af62cef232ba tempest-ProjectMemberTests-163191203 None] Created volume successfully. Nov 04 10:31:28 devstack sudo[105404]: pam_unix(sudo:session): session closed for user root Nov 04 10:31:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-1c4ddd33-31c5-462b-8b62-fba4bb2056b9 tempest-ProjectReaderTests-1792574560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-a93cf409-7e84-4f9f-a3ac-68944e1e78fe" returned: 0 in 0.278s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:31:28 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-1c4ddd33-31c5-462b-8b62-fba4bb2056b9 tempest-ProjectReaderTests-1792574560 None] Lock "cinder-quobyte-a93cf409-7e84-4f9f-a3ac-68944e1e78fe" released by "delete_volume" :: held 0.792s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:31:28 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-1c4ddd33-31c5-462b-8b62-fba4bb2056b9 tempest-ProjectReaderTests-1792574560 None] Created reservations ['9f4bb11c-fd28-4940-bf95-58c18ef830df', '28b3370c-5176-465d-b8b5-d0d1188995a8', '611ce448-21ff-492e-a9c7-e7e7d48949eb', '8836b4e8-05d6-416c-a48d-819be215b415'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:31:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-1c4ddd33-31c5-462b-8b62-fba4bb2056b9 tempest-ProjectReaderTests-1792574560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:31:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-1c4ddd33-31c5-462b-8b62-fba4bb2056b9 tempest-ProjectReaderTests-1792574560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:31:28 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-1c4ddd33-31c5-462b-8b62-fba4bb2056b9 tempest-ProjectReaderTests-1792574560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:31:28 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-1c4ddd33-31c5-462b-8b62-fba4bb2056b9 tempest-ProjectReaderTests-1792574560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:31:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-1c4ddd33-31c5-462b-8b62-fba4bb2056b9 tempest-ProjectReaderTests-1792574560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:31:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-1c4ddd33-31c5-462b-8b62-fba4bb2056b9 tempest-ProjectReaderTests-1792574560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:31:28 devstack sudo[105413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:31:28 devstack sudo[105413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:31:28 devstack sudo[105413]: pam_unix(sudo:session): session closed for user root Nov 04 10:31:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-1c4ddd33-31c5-462b-8b62-fba4bb2056b9 tempest-ProjectReaderTests-1792574560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.308s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:31:28 devstack sudo[105407]: pam_unix(sudo:session): session closed for user root Nov 04 10:31:28 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-1c4ddd33-31c5-462b-8b62-fba4bb2056b9 tempest-ProjectReaderTests-1792574560 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:31:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-8d95c8fa-885d-480c-9566-37761872b627 tempest-ProjectReaderTests-888867065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-e893c48c-3c57-4d74-ac31-34e1f6b0519f 1073741824" returned: 0 in 0.625s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:31:28 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-1c4ddd33-31c5-462b-8b62-fba4bb2056b9 tempest-ProjectReaderTests-1792574560 None] Deleted volume successfully. Nov 04 10:31:28 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-1c4ddd33-31c5-462b-8b62-fba4bb2056b9 tempest-ProjectReaderTests-1792574560 None] Lock "cinder-a93cf409-7e84-4f9f-a3ac-68944e1e78fe-delete_volume" released by "delete_volume" :: held 1.391s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:31:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-8d95c8fa-885d-480c-9566-37761872b627 tempest-ProjectReaderTests-888867065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-e893c48c-3c57-4d74-ac31-34e1f6b0519f {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:31:28 devstack sudo[105417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-e893c48c-3c57-4d74-ac31-34e1f6b0519f Nov 04 10:31:28 devstack sudo[105417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:31:28 devstack sudo[105417]: pam_unix(sudo:session): session closed for user root Nov 04 10:31:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-8d95c8fa-885d-480c-9566-37761872b627 tempest-ProjectReaderTests-888867065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-e893c48c-3c57-4d74-ac31-34e1f6b0519f" returned: 0 in 0.366s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:31:28 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-8d95c8fa-885d-480c-9566-37761872b627 tempest-ProjectReaderTests-888867065 None] <== create_volume: return (1062ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 10:31:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-8d95c8fa-885d-480c-9566-37761872b627 tempest-ProjectReaderTests-888867065 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.068s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:31:29 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-8d95c8fa-885d-480c-9566-37761872b627 tempest-ProjectReaderTests-888867065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f8ae4da-5a13-4b49-b5d0-cda669c4ddc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e893c48c-3c57-4d74-ac31-34e1f6b0519f', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:31:29 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-8d95c8fa-885d-480c-9566-37761872b627 tempest-ProjectReaderTests-888867065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a267aa5b-8fc4-4e67-89b8-5b29cac1b3b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:31:29 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-8d95c8fa-885d-480c-9566-37761872b627 tempest-ProjectReaderTests-888867065 None] Volume volume-e893c48c-3c57-4d74-ac31-34e1f6b0519f (e893c48c-3c57-4d74-ac31-34e1f6b0519f): created successfully Nov 04 10:31:29 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-8d95c8fa-885d-480c-9566-37761872b627 tempest-ProjectReaderTests-888867065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a267aa5b-8fc4-4e67-89b8-5b29cac1b3b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:31:29 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-8d95c8fa-885d-480c-9566-37761872b627 tempest-ProjectReaderTests-888867065 None] Flow 'volume_create_manager' (82579845-6909-4ad7-83d2-77471ef235cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:31:29 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-2453885b-5088-4ed6-8dd9-b8edc0e0482a tempest-ProjectReaderTests-1792574560 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:31:29 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-2453885b-5088-4ed6-8dd9-b8edc0e0482a tempest-ProjectReaderTests-1792574560 None] Flow 'volume_create_manager' (83c2cecc-f2dc-4fe6-8ca6-ba4dd9610a2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:31:29 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-2453885b-5088-4ed6-8dd9-b8edc0e0482a tempest-ProjectReaderTests-1792574560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e2dc57d-d5dc-4b5c-8554-d0930b0027a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:31:29 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-8d95c8fa-885d-480c-9566-37761872b627 tempest-ProjectReaderTests-888867065 None] Created volume successfully. Nov 04 10:31:29 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-2453885b-5088-4ed6-8dd9-b8edc0e0482a tempest-ProjectReaderTests-1792574560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e2dc57d-d5dc-4b5c-8554-d0930b0027a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:31:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-39044320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05033725-3412-451c-a957-57c132568a2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d5f6699319c422cb51af416536b2187',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:31:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:31:29Z,use_quota=True,user_id='fd7c08c0f13a4754b388258d2b1fb297',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:31:29 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-2453885b-5088-4ed6-8dd9-b8edc0e0482a tempest-ProjectReaderTests-1792574560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4d72aec-154c-46b0-a812-ee35dd0f6c84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:31:29 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-2453885b-5088-4ed6-8dd9-b8edc0e0482a tempest-ProjectReaderTests-1792574560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4d72aec-154c-46b0-a812-ee35dd0f6c84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:31:29 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-2453885b-5088-4ed6-8dd9-b8edc0e0482a tempest-ProjectReaderTests-1792574560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67948469-6725-4c23-8c28-9fc3a48b9bcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:31:29 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-2453885b-5088-4ed6-8dd9-b8edc0e0482a tempest-ProjectReaderTests-1792574560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67948469-6725-4c23-8c28-9fc3a48b9bcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05033725-3412-451c-a957-57c132568a2d', 'volume_name': 'volume-05033725-3412-451c-a957-57c132568a2d', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:31:29 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-2453885b-5088-4ed6-8dd9-b8edc0e0482a tempest-ProjectReaderTests-1792574560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f75c949-1055-417a-bdc4-e0b48b33abb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:31:29 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-2453885b-5088-4ed6-8dd9-b8edc0e0482a tempest-ProjectReaderTests-1792574560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f75c949-1055-417a-bdc4-e0b48b33abb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:31:29 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-2453885b-5088-4ed6-8dd9-b8edc0e0482a tempest-ProjectReaderTests-1792574560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b1e7d56-9a64-4429-b1df-adcf2a34f0d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:31:29 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-2453885b-5088-4ed6-8dd9-b8edc0e0482a tempest-ProjectReaderTests-1792574560 None] Volume 05033725-3412-451c-a957-57c132568a2d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05033725-3412-451c-a957-57c132568a2d', 'volume_size': 1} Nov 04 10:31:29 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-2453885b-5088-4ed6-8dd9-b8edc0e0482a tempest-ProjectReaderTests-1792574560 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:31:29 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-2453885b-5088-4ed6-8dd9-b8edc0e0482a tempest-ProjectReaderTests-1792574560 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:31:29 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-2453885b-5088-4ed6-8dd9-b8edc0e0482a tempest-ProjectReaderTests-1792574560 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:31:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-39044320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05033725-3412-451c-a957-57c132568a2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d5f6699319c422cb51af416536b2187',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:31:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:31:29Z,use_quota=True,user_id='fd7c08c0f13a4754b388258d2b1fb297',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 10:31:29 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-2453885b-5088-4ed6-8dd9-b8edc0e0482a tempest-ProjectReaderTests-1792574560 None] Creating volume 05033725-3412-451c-a957-57c132568a2d {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:31:29 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-2453885b-5088-4ed6-8dd9-b8edc0e0482a tempest-ProjectReaderTests-1792574560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:31:29 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-2453885b-5088-4ed6-8dd9-b8edc0e0482a tempest-ProjectReaderTests-1792574560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:31:29 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-2453885b-5088-4ed6-8dd9-b8edc0e0482a tempest-ProjectReaderTests-1792574560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:31:29 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-2453885b-5088-4ed6-8dd9-b8edc0e0482a tempest-ProjectReaderTests-1792574560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:31:29 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-2453885b-5088-4ed6-8dd9-b8edc0e0482a tempest-ProjectReaderTests-1792574560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:31:29 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-2453885b-5088-4ed6-8dd9-b8edc0e0482a tempest-ProjectReaderTests-1792574560 None] Selected osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:31:29 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-2453885b-5088-4ed6-8dd9-b8edc0e0482a tempest-ProjectReaderTests-1792574560 None] casted to osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 Nov 04 10:31:29 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-2453885b-5088-4ed6-8dd9-b8edc0e0482a tempest-ProjectReaderTests-1792574560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-05033725-3412-451c-a957-57c132568a2d 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:31:29 devstack sudo[105422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-05033725-3412-451c-a957-57c132568a2d 1073741824 Nov 04 10:31:29 devstack sudo[105422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:31:29 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-219a8824-b91b-4a60-90ca-373dd43c24b9 tempest-ProjectMemberTests-163191203 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:31:29 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-6a57fd79-ab2b-4d8c-b2b9-43ca6e36e5b7 tempest-ProjectReaderTests-888867065 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:31:29 devstack sudo[105422]: pam_unix(sudo:session): session closed for user root Nov 04 10:31:29 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-2453885b-5088-4ed6-8dd9-b8edc0e0482a tempest-ProjectReaderTests-1792574560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-05033725-3412-451c-a957-57c132568a2d 1073741824" returned: 0 in 0.599s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:31:29 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-2453885b-5088-4ed6-8dd9-b8edc0e0482a tempest-ProjectReaderTests-1792574560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-05033725-3412-451c-a957-57c132568a2d {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:31:29 devstack sudo[105428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-05033725-3412-451c-a957-57c132568a2d Nov 04 10:31:29 devstack sudo[105428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:31:30 devstack sudo[105428]: pam_unix(sudo:session): session closed for user root Nov 04 10:31:30 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-2453885b-5088-4ed6-8dd9-b8edc0e0482a tempest-ProjectReaderTests-1792574560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-05033725-3412-451c-a957-57c132568a2d" returned: 0 in 0.252s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:31:30 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-2453885b-5088-4ed6-8dd9-b8edc0e0482a tempest-ProjectReaderTests-1792574560 None] <== create_volume: return (896ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 10:31:30 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-2453885b-5088-4ed6-8dd9-b8edc0e0482a tempest-ProjectReaderTests-1792574560 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.899s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:31:30 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-219a8824-b91b-4a60-90ca-373dd43c24b9 tempest-ProjectMemberTests-163191203 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.555s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:31:30 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-2453885b-5088-4ed6-8dd9-b8edc0e0482a tempest-ProjectReaderTests-1792574560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b1e7d56-9a64-4429-b1df-adcf2a34f0d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05033725-3412-451c-a957-57c132568a2d', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:31:30 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-2453885b-5088-4ed6-8dd9-b8edc0e0482a tempest-ProjectReaderTests-1792574560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24e46d2e-3d75-4087-b540-cfb7a248c3c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:31:30 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-219a8824-b91b-4a60-90ca-373dd43c24b9 tempest-ProjectMemberTests-163191203 None] Creating offline snapshot 90d5cad1-3ca8-4ac9-a033-2be64f8d9b43 of volume deb4f42a-25f3-45a3-a864-96b5880d42be {{(pid=87068) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 10:31:30 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-2453885b-5088-4ed6-8dd9-b8edc0e0482a tempest-ProjectReaderTests-1792574560 None] Volume volume-05033725-3412-451c-a957-57c132568a2d (05033725-3412-451c-a957-57c132568a2d): created successfully Nov 04 10:31:30 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-2453885b-5088-4ed6-8dd9-b8edc0e0482a tempest-ProjectReaderTests-1792574560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24e46d2e-3d75-4087-b540-cfb7a248c3c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:31:30 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-2453885b-5088-4ed6-8dd9-b8edc0e0482a tempest-ProjectReaderTests-1792574560 None] Flow 'volume_create_manager' (83c2cecc-f2dc-4fe6-8ca6-ba4dd9610a2d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:31:30 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7f26a9d-df25-4bb5-a9da-84c5e4a1ab73]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:31:30 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-219a8824-b91b-4a60-90ca-373dd43c24b9 tempest-ProjectMemberTests-163191203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-deb4f42a-25f3-45a3-a864-96b5880d42be {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:31:30 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-2453885b-5088-4ed6-8dd9-b8edc0e0482a tempest-ProjectReaderTests-1792574560 None] Created volume successfully. Nov 04 10:31:30 devstack sudo[105431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-deb4f42a-25f3-45a3-a864-96b5880d42be Nov 04 10:31:30 devstack sudo[105431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:31:30 devstack sudo[105431]: pam_unix(sudo:session): session closed for user root Nov 04 10:31:30 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-219a8824-b91b-4a60-90ca-373dd43c24b9 tempest-ProjectMemberTests-163191203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-deb4f42a-25f3-45a3-a864-96b5880d42be" returned: 0 in 0.495s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:31:30 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-219a8824-b91b-4a60-90ca-373dd43c24b9 tempest-ProjectMemberTests-163191203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-deb4f42a-25f3-45a3-a864-96b5880d42be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-deb4f42a-25f3-45a3-a864-96b5880d42be.90d5cad1-3ca8-4ac9-a033-2be64f8d9b43 1G {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:31:30 devstack sudo[105436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-deb4f42a-25f3-45a3-a864-96b5880d42be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-deb4f42a-25f3-45a3-a864-96b5880d42be.90d5cad1-3ca8-4ac9-a033-2be64f8d9b43 1G Nov 04 10:31:30 devstack sudo[105436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:31:31 devstack sudo[105436]: pam_unix(sudo:session): session closed for user root Nov 04 10:31:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-219a8824-b91b-4a60-90ca-373dd43c24b9 tempest-ProjectMemberTests-163191203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-deb4f42a-25f3-45a3-a864-96b5880d42be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-deb4f42a-25f3-45a3-a864-96b5880d42be.90d5cad1-3ca8-4ac9-a033-2be64f8d9b43 1G" returned: 0 in 0.498s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:31:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-219a8824-b91b-4a60-90ca-373dd43c24b9 tempest-ProjectMemberTests-163191203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-deb4f42a-25f3-45a3-a864-96b5880d42be -F qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-deb4f42a-25f3-45a3-a864-96b5880d42be.90d5cad1-3ca8-4ac9-a033-2be64f8d9b43 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:31:31 devstack sudo[105442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-deb4f42a-25f3-45a3-a864-96b5880d42be -F qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-deb4f42a-25f3-45a3-a864-96b5880d42be.90d5cad1-3ca8-4ac9-a033-2be64f8d9b43 Nov 04 10:31:31 devstack sudo[105442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:31:31 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-ef60296d-9f22-41a3-b324-51396be6ff68 tempest-ProjectReaderTests-1792574560 None] Acquiring lock "cinder-05033725-3412-451c-a957-57c132568a2d-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:31:31 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-ef60296d-9f22-41a3-b324-51396be6ff68 tempest-ProjectReaderTests-1792574560 None] Lock "cinder-05033725-3412-451c-a957-57c132568a2d-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:31:31 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-ef60296d-9f22-41a3-b324-51396be6ff68 tempest-ProjectReaderTests-1792574560 None] Acquiring lock "cinder-quobyte-05033725-3412-451c-a957-57c132568a2d" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:31:31 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-ef60296d-9f22-41a3-b324-51396be6ff68 tempest-ProjectReaderTests-1792574560 None] Lock "cinder-quobyte-05033725-3412-451c-a957-57c132568a2d" acquired by "delete_volume" :: waited 0.017s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:31:31 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee9be2fa-3edf-4ba5-82f8-c178ae1eee53]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:31:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ef60296d-9f22-41a3-b324-51396be6ff68 tempest-ProjectReaderTests-1792574560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-05033725-3412-451c-a957-57c132568a2d {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:31:31 devstack sudo[105445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-05033725-3412-451c-a957-57c132568a2d Nov 04 10:31:31 devstack sudo[105445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:31:31 devstack sudo[105442]: pam_unix(sudo:session): session closed for user root Nov 04 10:31:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-219a8824-b91b-4a60-90ca-373dd43c24b9 tempest-ProjectMemberTests-163191203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-deb4f42a-25f3-45a3-a864-96b5880d42be -F qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-deb4f42a-25f3-45a3-a864-96b5880d42be.90d5cad1-3ca8-4ac9-a033-2be64f8d9b43" returned: 0 in 0.400s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:31:31 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-219a8824-b91b-4a60-90ca-373dd43c24b9 tempest-ProjectMemberTests-163191203 None] /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-deb4f42a-25f3-45a3-a864-96b5880d42be.90d5cad1-3ca8-4ac9-a033-2be64f8d9b43 is being set with open permissions: ugo+rw Nov 04 10:31:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-219a8824-b91b-4a60-90ca-373dd43c24b9 tempest-ProjectMemberTests-163191203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-deb4f42a-25f3-45a3-a864-96b5880d42be.90d5cad1-3ca8-4ac9-a033-2be64f8d9b43 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:31:31 devstack sudo[105450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-deb4f42a-25f3-45a3-a864-96b5880d42be.90d5cad1-3ca8-4ac9-a033-2be64f8d9b43 Nov 04 10:31:31 devstack sudo[105450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:31:31 devstack sudo[105445]: pam_unix(sudo:session): session closed for user root Nov 04 10:31:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ef60296d-9f22-41a3-b324-51396be6ff68 tempest-ProjectReaderTests-1792574560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-05033725-3412-451c-a957-57c132568a2d" returned: 0 in 0.405s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:31:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ef60296d-9f22-41a3-b324-51396be6ff68 tempest-ProjectReaderTests-1792574560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-05033725-3412-451c-a957-57c132568a2d {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:31:31 devstack sudo[105455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-05033725-3412-451c-a957-57c132568a2d Nov 04 10:31:31 devstack sudo[105455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:31:31 devstack sudo[105450]: pam_unix(sudo:session): session closed for user root Nov 04 10:31:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-219a8824-b91b-4a60-90ca-373dd43c24b9 tempest-ProjectMemberTests-163191203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-deb4f42a-25f3-45a3-a864-96b5880d42be.90d5cad1-3ca8-4ac9-a033-2be64f8d9b43" returned: 0 in 0.273s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:31:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-219a8824-b91b-4a60-90ca-373dd43c24b9 tempest-ProjectMemberTests-163191203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-deb4f42a-25f3-45a3-a864-96b5880d42be.info {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:31:31 devstack sudo[105458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-deb4f42a-25f3-45a3-a864-96b5880d42be.info Nov 04 10:31:31 devstack sudo[105458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:31:31 devstack sudo[105455]: pam_unix(sudo:session): session closed for user root Nov 04 10:31:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ef60296d-9f22-41a3-b324-51396be6ff68 tempest-ProjectReaderTests-1792574560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-05033725-3412-451c-a957-57c132568a2d" returned: 0 in 0.278s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:31:31 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-ef60296d-9f22-41a3-b324-51396be6ff68 tempest-ProjectReaderTests-1792574560 None] Lock "cinder-quobyte-05033725-3412-451c-a957-57c132568a2d" released by "delete_volume" :: held 0.747s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:31:32 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-ef60296d-9f22-41a3-b324-51396be6ff68 tempest-ProjectReaderTests-1792574560 None] Created reservations ['0fff7ef5-cd62-413a-9fdb-907077ab0c13', '06772e9e-a26b-44c5-a21a-4eafc9deeeba', '9289f95f-b824-49d9-88b4-4fc9e61db658', '9772e499-9553-440a-a24e-f01044eff3a0'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:31:32 devstack sudo[105458]: pam_unix(sudo:session): session closed for user root Nov 04 10:31:32 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-219a8824-b91b-4a60-90ca-373dd43c24b9 tempest-ProjectMemberTests-163191203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-deb4f42a-25f3-45a3-a864-96b5880d42be.info" returned: 0 in 0.280s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:31:32 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-219a8824-b91b-4a60-90ca-373dd43c24b9 tempest-ProjectMemberTests-163191203 None] /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-deb4f42a-25f3-45a3-a864-96b5880d42be.info is being set with open permissions: ugo+rw Nov 04 10:31:32 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-219a8824-b91b-4a60-90ca-373dd43c24b9 tempest-ProjectMemberTests-163191203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-deb4f42a-25f3-45a3-a864-96b5880d42be.info {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:31:32 devstack sudo[105462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-deb4f42a-25f3-45a3-a864-96b5880d42be.info Nov 04 10:31:32 devstack sudo[105462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:31:32 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-ef60296d-9f22-41a3-b324-51396be6ff68 tempest-ProjectReaderTests-1792574560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:31:32 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-ef60296d-9f22-41a3-b324-51396be6ff68 tempest-ProjectReaderTests-1792574560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:31:32 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-ef60296d-9f22-41a3-b324-51396be6ff68 tempest-ProjectReaderTests-1792574560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:31:32 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-ef60296d-9f22-41a3-b324-51396be6ff68 tempest-ProjectReaderTests-1792574560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:31:32 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-ef60296d-9f22-41a3-b324-51396be6ff68 tempest-ProjectReaderTests-1792574560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:31:32 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ef60296d-9f22-41a3-b324-51396be6ff68 tempest-ProjectReaderTests-1792574560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:31:32 devstack sudo[105464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:31:32 devstack sudo[105464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:31:32 devstack sudo[105462]: pam_unix(sudo:session): session closed for user root Nov 04 10:31:32 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-219a8824-b91b-4a60-90ca-373dd43c24b9 tempest-ProjectMemberTests-163191203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-deb4f42a-25f3-45a3-a864-96b5880d42be.info" returned: 0 in 0.326s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:31:32 devstack sudo[105464]: pam_unix(sudo:session): session closed for user root Nov 04 10:31:32 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-219a8824-b91b-4a60-90ca-373dd43c24b9 tempest-ProjectMemberTests-163191203 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.410s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:31:32 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-6a57fd79-ab2b-4d8c-b2b9-43ca6e36e5b7 tempest-ProjectReaderTests-888867065 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.736s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:31:32 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ef60296d-9f22-41a3-b324-51396be6ff68 tempest-ProjectReaderTests-1792574560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.310s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:31:32 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-ef60296d-9f22-41a3-b324-51396be6ff68 tempest-ProjectReaderTests-1792574560 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:31:32 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-ef60296d-9f22-41a3-b324-51396be6ff68 tempest-ProjectReaderTests-1792574560 None] Deleted volume successfully. Nov 04 10:31:32 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-6a57fd79-ab2b-4d8c-b2b9-43ca6e36e5b7 tempest-ProjectReaderTests-888867065 None] Creating offline snapshot 3fd34478-96e6-461d-9552-2fc13cdd9c9f of volume e893c48c-3c57-4d74-ac31-34e1f6b0519f {{(pid=87068) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 10:31:32 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-219a8824-b91b-4a60-90ca-373dd43c24b9 tempest-ProjectMemberTests-163191203 None] Create snapshot completed successfully Nov 04 10:31:32 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-ef60296d-9f22-41a3-b324-51396be6ff68 tempest-ProjectReaderTests-1792574560 None] Lock "cinder-05033725-3412-451c-a957-57c132568a2d-delete_volume" released by "delete_volume" :: held 1.376s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:31:32 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7682040-d2ac-4239-8e61-aebc23e27f09]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:31:32 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6a57fd79-ab2b-4d8c-b2b9-43ca6e36e5b7 tempest-ProjectReaderTests-888867065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-e893c48c-3c57-4d74-ac31-34e1f6b0519f {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:31:32 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-f0cba050-c5e5-4e41-82ba-5aaa272d5fad tempest-ProjectMemberTests-163191203 None] Acquiring lock "cinder-90d5cad1-3ca8-4ac9-a033-2be64f8d9b43-delete_snapshot" by "delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:31:32 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-f0cba050-c5e5-4e41-82ba-5aaa272d5fad tempest-ProjectMemberTests-163191203 None] Lock "cinder-90d5cad1-3ca8-4ac9-a033-2be64f8d9b43-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:31:32 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-f0cba050-c5e5-4e41-82ba-5aaa272d5fad tempest-ProjectMemberTests-163191203 None] Acquiring lock "cinder-quobyte-deb4f42a-25f3-45a3-a864-96b5880d42be" by "delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:31:32 devstack sudo[105468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-e893c48c-3c57-4d74-ac31-34e1f6b0519f Nov 04 10:31:32 devstack sudo[105468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:31:32 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-f0cba050-c5e5-4e41-82ba-5aaa272d5fad tempest-ProjectMemberTests-163191203 None] Lock "cinder-quobyte-deb4f42a-25f3-45a3-a864-96b5880d42be" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:31:32 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-f0cba050-c5e5-4e41-82ba-5aaa272d5fad tempest-ProjectMemberTests-163191203 None] Acquiring lock "cinder-quobyte-90d5cad1-3ca8-4ac9-a033-2be64f8d9b43" by "_delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:31:32 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-f0cba050-c5e5-4e41-82ba-5aaa272d5fad tempest-ProjectMemberTests-163191203 None] Lock "cinder-quobyte-90d5cad1-3ca8-4ac9-a033-2be64f8d9b43" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:31:32 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-f0cba050-c5e5-4e41-82ba-5aaa272d5fad tempest-ProjectMemberTests-163191203 None] Deleting offline snapshot 90d5cad1-3ca8-4ac9-a033-2be64f8d9b43 of volume deb4f42a-25f3-45a3-a864-96b5880d42be {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 10:31:32 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-f0cba050-c5e5-4e41-82ba-5aaa272d5fad tempest-ProjectMemberTests-163191203 None] snapshot_file for this snap is: volume-deb4f42a-25f3-45a3-a864-96b5880d42be.90d5cad1-3ca8-4ac9-a033-2be64f8d9b43 {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 10:31:32 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[f358b488-8ee1-42cd-8791-696fa5f82b9c]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:31:32 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f0cba050-c5e5-4e41-82ba-5aaa272d5fad tempest-ProjectMemberTests-163191203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-deb4f42a-25f3-45a3-a864-96b5880d42be.90d5cad1-3ca8-4ac9-a033-2be64f8d9b43 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:31:32 devstack sudo[105470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-deb4f42a-25f3-45a3-a864-96b5880d42be.90d5cad1-3ca8-4ac9-a033-2be64f8d9b43 Nov 04 10:31:32 devstack sudo[105470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:31:33 devstack sudo[105468]: pam_unix(sudo:session): session closed for user root Nov 04 10:31:33 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6a57fd79-ab2b-4d8c-b2b9-43ca6e36e5b7 tempest-ProjectReaderTests-888867065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-e893c48c-3c57-4d74-ac31-34e1f6b0519f" returned: 0 in 0.655s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:31:33 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6a57fd79-ab2b-4d8c-b2b9-43ca6e36e5b7 tempest-ProjectReaderTests-888867065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-e893c48c-3c57-4d74-ac31-34e1f6b0519f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-e893c48c-3c57-4d74-ac31-34e1f6b0519f.3fd34478-96e6-461d-9552-2fc13cdd9c9f 1G {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:31:33 devstack sudo[105476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-e893c48c-3c57-4d74-ac31-34e1f6b0519f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-e893c48c-3c57-4d74-ac31-34e1f6b0519f.3fd34478-96e6-461d-9552-2fc13cdd9c9f 1G Nov 04 10:31:33 devstack sudo[105476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:31:33 devstack sudo[105470]: pam_unix(sudo:session): session closed for user root Nov 04 10:31:33 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f0cba050-c5e5-4e41-82ba-5aaa272d5fad tempest-ProjectMemberTests-163191203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-deb4f42a-25f3-45a3-a864-96b5880d42be.90d5cad1-3ca8-4ac9-a033-2be64f8d9b43" returned: 0 in 0.493s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:31:33 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-f0cba050-c5e5-4e41-82ba-5aaa272d5fad tempest-ProjectMemberTests-163191203 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-deb4f42a-25f3-45a3-a864-96b5880d42be(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87068) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 10:31:33 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6468cc4-56de-44da-ae76-3f5dc7fc6e39]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:31:33 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f0cba050-c5e5-4e41-82ba-5aaa272d5fad tempest-ProjectMemberTests-163191203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-deb4f42a-25f3-45a3-a864-96b5880d42be {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:31:33 devstack sudo[105487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-deb4f42a-25f3-45a3-a864-96b5880d42be Nov 04 10:31:33 devstack sudo[105487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:31:33 devstack sudo[105476]: pam_unix(sudo:session): session closed for user root Nov 04 10:31:33 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6a57fd79-ab2b-4d8c-b2b9-43ca6e36e5b7 tempest-ProjectReaderTests-888867065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-e893c48c-3c57-4d74-ac31-34e1f6b0519f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-e893c48c-3c57-4d74-ac31-34e1f6b0519f.3fd34478-96e6-461d-9552-2fc13cdd9c9f 1G" returned: 0 in 0.598s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:31:33 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6a57fd79-ab2b-4d8c-b2b9-43ca6e36e5b7 tempest-ProjectReaderTests-888867065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e893c48c-3c57-4d74-ac31-34e1f6b0519f -F qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-e893c48c-3c57-4d74-ac31-34e1f6b0519f.3fd34478-96e6-461d-9552-2fc13cdd9c9f {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:31:33 devstack sudo[105493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e893c48c-3c57-4d74-ac31-34e1f6b0519f -F qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-e893c48c-3c57-4d74-ac31-34e1f6b0519f.3fd34478-96e6-461d-9552-2fc13cdd9c9f Nov 04 10:31:33 devstack sudo[105493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:31:33 devstack sudo[105487]: pam_unix(sudo:session): session closed for user root Nov 04 10:31:33 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f0cba050-c5e5-4e41-82ba-5aaa272d5fad tempest-ProjectMemberTests-163191203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-deb4f42a-25f3-45a3-a864-96b5880d42be" returned: 0 in 0.569s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:31:33 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f0cba050-c5e5-4e41-82ba-5aaa272d5fad tempest-ProjectMemberTests-163191203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-deb4f42a-25f3-45a3-a864-96b5880d42be.90d5cad1-3ca8-4ac9-a033-2be64f8d9b43 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:31:34 devstack sudo[105499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-deb4f42a-25f3-45a3-a864-96b5880d42be.90d5cad1-3ca8-4ac9-a033-2be64f8d9b43 Nov 04 10:31:34 devstack sudo[105499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:31:34 devstack sudo[105493]: pam_unix(sudo:session): session closed for user root Nov 04 10:31:34 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6a57fd79-ab2b-4d8c-b2b9-43ca6e36e5b7 tempest-ProjectReaderTests-888867065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e893c48c-3c57-4d74-ac31-34e1f6b0519f -F qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-e893c48c-3c57-4d74-ac31-34e1f6b0519f.3fd34478-96e6-461d-9552-2fc13cdd9c9f" returned: 0 in 0.428s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:31:34 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-6a57fd79-ab2b-4d8c-b2b9-43ca6e36e5b7 tempest-ProjectReaderTests-888867065 None] /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-e893c48c-3c57-4d74-ac31-34e1f6b0519f.3fd34478-96e6-461d-9552-2fc13cdd9c9f is being set with open permissions: ugo+rw Nov 04 10:31:34 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6a57fd79-ab2b-4d8c-b2b9-43ca6e36e5b7 tempest-ProjectReaderTests-888867065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-e893c48c-3c57-4d74-ac31-34e1f6b0519f.3fd34478-96e6-461d-9552-2fc13cdd9c9f {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:31:34 devstack sudo[105505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-e893c48c-3c57-4d74-ac31-34e1f6b0519f.3fd34478-96e6-461d-9552-2fc13cdd9c9f Nov 04 10:31:34 devstack sudo[105505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:31:34 devstack sudo[105499]: pam_unix(sudo:session): session closed for user root Nov 04 10:31:34 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f0cba050-c5e5-4e41-82ba-5aaa272d5fad tempest-ProjectMemberTests-163191203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-deb4f42a-25f3-45a3-a864-96b5880d42be.90d5cad1-3ca8-4ac9-a033-2be64f8d9b43" returned: 0 in 0.514s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:31:34 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f0cba050-c5e5-4e41-82ba-5aaa272d5fad tempest-ProjectMemberTests-163191203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-deb4f42a-25f3-45a3-a864-96b5880d42be.90d5cad1-3ca8-4ac9-a033-2be64f8d9b43 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:31:34 devstack sudo[105511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-deb4f42a-25f3-45a3-a864-96b5880d42be.90d5cad1-3ca8-4ac9-a033-2be64f8d9b43 Nov 04 10:31:34 devstack sudo[105511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:31:34 devstack sudo[105505]: pam_unix(sudo:session): session closed for user root Nov 04 10:31:34 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6a57fd79-ab2b-4d8c-b2b9-43ca6e36e5b7 tempest-ProjectReaderTests-888867065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-e893c48c-3c57-4d74-ac31-34e1f6b0519f.3fd34478-96e6-461d-9552-2fc13cdd9c9f" returned: 0 in 0.413s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:31:34 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6a57fd79-ab2b-4d8c-b2b9-43ca6e36e5b7 tempest-ProjectReaderTests-888867065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-e893c48c-3c57-4d74-ac31-34e1f6b0519f.info {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:31:34 devstack sudo[105514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-e893c48c-3c57-4d74-ac31-34e1f6b0519f.info Nov 04 10:31:34 devstack sudo[105514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:31:34 devstack sudo[105511]: pam_unix(sudo:session): session closed for user root Nov 04 10:31:34 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f0cba050-c5e5-4e41-82ba-5aaa272d5fad tempest-ProjectMemberTests-163191203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-deb4f42a-25f3-45a3-a864-96b5880d42be.90d5cad1-3ca8-4ac9-a033-2be64f8d9b43" returned: 0 in 0.331s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:31:34 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-f0cba050-c5e5-4e41-82ba-5aaa272d5fad tempest-ProjectMemberTests-163191203 None] Lock "cinder-quobyte-90d5cad1-3ca8-4ac9-a033-2be64f8d9b43" released by "_delete_snapshot" :: held 2.109s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:31:34 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-f0cba050-c5e5-4e41-82ba-5aaa272d5fad tempest-ProjectMemberTests-163191203 None] Lock "cinder-quobyte-deb4f42a-25f3-45a3-a864-96b5880d42be" released by "delete_snapshot" :: held 2.136s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:31:34 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-f0cba050-c5e5-4e41-82ba-5aaa272d5fad tempest-ProjectMemberTests-163191203 None] Created reservations ['c46f2b55-1991-444a-bdc5-94965a4deb77', '8971a75b-5cb7-4947-a64a-f5575d2f42a5', '982db22d-5225-4000-898a-25b352623fae', '1b6e0eee-c505-44fd-b7fc-7413c907c278'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:31:35 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-f0cba050-c5e5-4e41-82ba-5aaa272d5fad tempest-ProjectMemberTests-163191203 None] Delete snapshot completed successfully. Nov 04 10:31:35 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-f0cba050-c5e5-4e41-82ba-5aaa272d5fad tempest-ProjectMemberTests-163191203 None] Lock "cinder-90d5cad1-3ca8-4ac9-a033-2be64f8d9b43-delete_snapshot" released by "delete_snapshot" :: held 2.306s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:31:35 devstack sudo[105514]: pam_unix(sudo:session): session closed for user root Nov 04 10:31:35 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6a57fd79-ab2b-4d8c-b2b9-43ca6e36e5b7 tempest-ProjectReaderTests-888867065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-e893c48c-3c57-4d74-ac31-34e1f6b0519f.info" returned: 0 in 0.338s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:31:35 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-6a57fd79-ab2b-4d8c-b2b9-43ca6e36e5b7 tempest-ProjectReaderTests-888867065 None] /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-e893c48c-3c57-4d74-ac31-34e1f6b0519f.info is being set with open permissions: ugo+rw Nov 04 10:31:35 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6a57fd79-ab2b-4d8c-b2b9-43ca6e36e5b7 tempest-ProjectReaderTests-888867065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-e893c48c-3c57-4d74-ac31-34e1f6b0519f.info {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:31:35 devstack sudo[105518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-e893c48c-3c57-4d74-ac31-34e1f6b0519f.info Nov 04 10:31:35 devstack sudo[105518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:31:35 devstack sudo[105518]: pam_unix(sudo:session): session closed for user root Nov 04 10:31:35 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6a57fd79-ab2b-4d8c-b2b9-43ca6e36e5b7 tempest-ProjectReaderTests-888867065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-e893c48c-3c57-4d74-ac31-34e1f6b0519f.info" returned: 0 in 0.261s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:31:35 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-6a57fd79-ab2b-4d8c-b2b9-43ca6e36e5b7 tempest-ProjectReaderTests-888867065 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.854s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:31:35 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-6a57fd79-ab2b-4d8c-b2b9-43ca6e36e5b7 tempest-ProjectReaderTests-888867065 None] Create snapshot completed successfully Nov 04 10:31:35 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-25b3c11c-63eb-45e2-a4f5-8b798448b792 tempest-ProjectMemberTests-163191203 None] Acquiring lock "cinder-deb4f42a-25f3-45a3-a864-96b5880d42be-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:31:35 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-25b3c11c-63eb-45e2-a4f5-8b798448b792 tempest-ProjectMemberTests-163191203 None] Lock "cinder-deb4f42a-25f3-45a3-a864-96b5880d42be-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:31:36 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-25b3c11c-63eb-45e2-a4f5-8b798448b792 tempest-ProjectMemberTests-163191203 None] Acquiring lock "cinder-quobyte-deb4f42a-25f3-45a3-a864-96b5880d42be" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:31:36 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-25b3c11c-63eb-45e2-a4f5-8b798448b792 tempest-ProjectMemberTests-163191203 None] Lock "cinder-quobyte-deb4f42a-25f3-45a3-a864-96b5880d42be" acquired by "delete_volume" :: waited 0.022s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:31:36 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-5db53604-3c68-4c1c-a31e-09ae377568e8 tempest-ProjectReaderTests-888867065 None] Acquiring lock "cinder-3fd34478-96e6-461d-9552-2fc13cdd9c9f-delete_snapshot" by "delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:31:36 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-5db53604-3c68-4c1c-a31e-09ae377568e8 tempest-ProjectReaderTests-888867065 None] Lock "cinder-3fd34478-96e6-461d-9552-2fc13cdd9c9f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:31:36 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-5db53604-3c68-4c1c-a31e-09ae377568e8 tempest-ProjectReaderTests-888867065 None] Acquiring lock "cinder-quobyte-e893c48c-3c57-4d74-ac31-34e1f6b0519f" by "delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:31:36 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd4c2dad-50ec-48ae-87c9-922505124a26]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:31:36 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-25b3c11c-63eb-45e2-a4f5-8b798448b792 tempest-ProjectMemberTests-163191203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-deb4f42a-25f3-45a3-a864-96b5880d42be {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:31:36 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-5db53604-3c68-4c1c-a31e-09ae377568e8 tempest-ProjectReaderTests-888867065 None] Lock "cinder-quobyte-e893c48c-3c57-4d74-ac31-34e1f6b0519f" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:31:36 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-5db53604-3c68-4c1c-a31e-09ae377568e8 tempest-ProjectReaderTests-888867065 None] Acquiring lock "cinder-quobyte-3fd34478-96e6-461d-9552-2fc13cdd9c9f" by "_delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:31:36 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-5db53604-3c68-4c1c-a31e-09ae377568e8 tempest-ProjectReaderTests-888867065 None] Lock "cinder-quobyte-3fd34478-96e6-461d-9552-2fc13cdd9c9f" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:31:36 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-5db53604-3c68-4c1c-a31e-09ae377568e8 tempest-ProjectReaderTests-888867065 None] Deleting offline snapshot 3fd34478-96e6-461d-9552-2fc13cdd9c9f of volume e893c48c-3c57-4d74-ac31-34e1f6b0519f {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 10:31:36 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-5db53604-3c68-4c1c-a31e-09ae377568e8 tempest-ProjectReaderTests-888867065 None] snapshot_file for this snap is: volume-e893c48c-3c57-4d74-ac31-34e1f6b0519f.3fd34478-96e6-461d-9552-2fc13cdd9c9f {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 10:31:36 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[129981e9-1fd6-40b2-b9dd-5129eef42985]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:31:36 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-5db53604-3c68-4c1c-a31e-09ae377568e8 tempest-ProjectReaderTests-888867065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-e893c48c-3c57-4d74-ac31-34e1f6b0519f.3fd34478-96e6-461d-9552-2fc13cdd9c9f {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:31:36 devstack sudo[105521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-deb4f42a-25f3-45a3-a864-96b5880d42be Nov 04 10:31:36 devstack sudo[105521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:31:36 devstack sudo[105522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-e893c48c-3c57-4d74-ac31-34e1f6b0519f.3fd34478-96e6-461d-9552-2fc13cdd9c9f Nov 04 10:31:36 devstack sudo[105522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:31:36 devstack sudo[105521]: pam_unix(sudo:session): session closed for user root Nov 04 10:31:36 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-25b3c11c-63eb-45e2-a4f5-8b798448b792 tempest-ProjectMemberTests-163191203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-deb4f42a-25f3-45a3-a864-96b5880d42be" returned: 0 in 0.422s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:31:36 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-25b3c11c-63eb-45e2-a4f5-8b798448b792 tempest-ProjectMemberTests-163191203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-deb4f42a-25f3-45a3-a864-96b5880d42be {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:31:36 devstack sudo[105530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-deb4f42a-25f3-45a3-a864-96b5880d42be Nov 04 10:31:36 devstack sudo[105530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:31:36 devstack sudo[105522]: pam_unix(sudo:session): session closed for user root Nov 04 10:31:36 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-5db53604-3c68-4c1c-a31e-09ae377568e8 tempest-ProjectReaderTests-888867065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-e893c48c-3c57-4d74-ac31-34e1f6b0519f.3fd34478-96e6-461d-9552-2fc13cdd9c9f" returned: 0 in 0.436s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:31:36 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-5db53604-3c68-4c1c-a31e-09ae377568e8 tempest-ProjectReaderTests-888867065 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e893c48c-3c57-4d74-ac31-34e1f6b0519f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87068) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 10:31:36 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[a44d543c-081d-4be3-86e8-ac3a6f9ecd9b]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:31:36 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-5db53604-3c68-4c1c-a31e-09ae377568e8 tempest-ProjectReaderTests-888867065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-e893c48c-3c57-4d74-ac31-34e1f6b0519f {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:31:36 devstack sudo[105533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-e893c48c-3c57-4d74-ac31-34e1f6b0519f Nov 04 10:31:36 devstack sudo[105533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:31:36 devstack sudo[105530]: pam_unix(sudo:session): session closed for user root Nov 04 10:31:36 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-25b3c11c-63eb-45e2-a4f5-8b798448b792 tempest-ProjectMemberTests-163191203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-deb4f42a-25f3-45a3-a864-96b5880d42be" returned: 0 in 0.303s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:31:36 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-25b3c11c-63eb-45e2-a4f5-8b798448b792 tempest-ProjectMemberTests-163191203 None] Lock "cinder-quobyte-deb4f42a-25f3-45a3-a864-96b5880d42be" released by "delete_volume" :: held 0.833s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:31:36 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-25b3c11c-63eb-45e2-a4f5-8b798448b792 tempest-ProjectMemberTests-163191203 None] Created reservations ['e4294351-4d34-44b2-8d90-f915d2b51377', '3a301654-76ad-41fe-9e70-1060687c7d32', '07600b9f-cc36-4c6c-abb0-be17fe687dd8', '82d66926-a6bd-4e3f-9eaf-3bd2c8949a38'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:31:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-25b3c11c-63eb-45e2-a4f5-8b798448b792 tempest-ProjectMemberTests-163191203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:31:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-25b3c11c-63eb-45e2-a4f5-8b798448b792 tempest-ProjectMemberTests-163191203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:31:37 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-25b3c11c-63eb-45e2-a4f5-8b798448b792 tempest-ProjectMemberTests-163191203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:31:37 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-25b3c11c-63eb-45e2-a4f5-8b798448b792 tempest-ProjectMemberTests-163191203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:31:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-25b3c11c-63eb-45e2-a4f5-8b798448b792 tempest-ProjectMemberTests-163191203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:31:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-25b3c11c-63eb-45e2-a4f5-8b798448b792 tempest-ProjectMemberTests-163191203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:31:37 devstack sudo[105533]: pam_unix(sudo:session): session closed for user root Nov 04 10:31:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-5db53604-3c68-4c1c-a31e-09ae377568e8 tempest-ProjectReaderTests-888867065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-e893c48c-3c57-4d74-ac31-34e1f6b0519f" returned: 0 in 0.463s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:31:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-5db53604-3c68-4c1c-a31e-09ae377568e8 tempest-ProjectReaderTests-888867065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-e893c48c-3c57-4d74-ac31-34e1f6b0519f.3fd34478-96e6-461d-9552-2fc13cdd9c9f {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:31:37 devstack sudo[105539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:31:37 devstack sudo[105539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:31:37 devstack sudo[105541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-e893c48c-3c57-4d74-ac31-34e1f6b0519f.3fd34478-96e6-461d-9552-2fc13cdd9c9f Nov 04 10:31:37 devstack sudo[105541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:31:37 devstack sudo[105539]: pam_unix(sudo:session): session closed for user root Nov 04 10:31:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-25b3c11c-63eb-45e2-a4f5-8b798448b792 tempest-ProjectMemberTests-163191203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.393s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:31:37 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-25b3c11c-63eb-45e2-a4f5-8b798448b792 tempest-ProjectMemberTests-163191203 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:31:37 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-25b3c11c-63eb-45e2-a4f5-8b798448b792 tempest-ProjectMemberTests-163191203 None] Deleted volume successfully. Nov 04 10:31:37 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-25b3c11c-63eb-45e2-a4f5-8b798448b792 tempest-ProjectMemberTests-163191203 None] Lock "cinder-deb4f42a-25f3-45a3-a864-96b5880d42be-delete_volume" released by "delete_volume" :: held 1.581s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:31:37 devstack sudo[105541]: pam_unix(sudo:session): session closed for user root Nov 04 10:31:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-5db53604-3c68-4c1c-a31e-09ae377568e8 tempest-ProjectReaderTests-888867065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-e893c48c-3c57-4d74-ac31-34e1f6b0519f.3fd34478-96e6-461d-9552-2fc13cdd9c9f" returned: 0 in 0.533s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:31:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-5db53604-3c68-4c1c-a31e-09ae377568e8 tempest-ProjectReaderTests-888867065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-e893c48c-3c57-4d74-ac31-34e1f6b0519f.3fd34478-96e6-461d-9552-2fc13cdd9c9f {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:31:37 devstack sudo[105547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-e893c48c-3c57-4d74-ac31-34e1f6b0519f.3fd34478-96e6-461d-9552-2fc13cdd9c9f Nov 04 10:31:37 devstack sudo[105547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:31:37 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-4866ddda-2d2d-4309-8277-71dde353fb64 tempest-ProjectMemberTests-163191203 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:31:37 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-4866ddda-2d2d-4309-8277-71dde353fb64 tempest-ProjectMemberTests-163191203 None] Flow 'volume_create_manager' (9d6d837b-a006-422e-a17b-88d4c4ad3d6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:31:37 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-4866ddda-2d2d-4309-8277-71dde353fb64 tempest-ProjectMemberTests-163191203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5486dfa0-41dd-4f83-be22-3c324b9ee61c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:31:38 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-4866ddda-2d2d-4309-8277-71dde353fb64 tempest-ProjectMemberTests-163191203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5486dfa0-41dd-4f83-be22-3c324b9ee61c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:31:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1202215882',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b63e27f8-1a80-42bb-b9f7-12e036cc259b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6102192fe22c4f298ee9815860bd7a9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:31:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:31:38Z,use_quota=True,user_id='df3853accc6242909d45cceeb3a0db9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:31:38 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-4866ddda-2d2d-4309-8277-71dde353fb64 tempest-ProjectMemberTests-163191203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1b5e452-69a9-42a9-905b-c9c72c4a5721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:31:38 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-4866ddda-2d2d-4309-8277-71dde353fb64 tempest-ProjectMemberTests-163191203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1b5e452-69a9-42a9-905b-c9c72c4a5721) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:31:38 devstack sudo[105547]: pam_unix(sudo:session): session closed for user root Nov 04 10:31:38 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-4866ddda-2d2d-4309-8277-71dde353fb64 tempest-ProjectMemberTests-163191203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bab99cd-2c78-4889-a00d-da4ab4e68f12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:31:38 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-4866ddda-2d2d-4309-8277-71dde353fb64 tempest-ProjectMemberTests-163191203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bab99cd-2c78-4889-a00d-da4ab4e68f12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b63e27f8-1a80-42bb-b9f7-12e036cc259b', 'volume_name': 'volume-b63e27f8-1a80-42bb-b9f7-12e036cc259b', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:31:38 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-4866ddda-2d2d-4309-8277-71dde353fb64 tempest-ProjectMemberTests-163191203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6400c9a5-ad8e-4e81-99ed-1576a53fbdec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:31:38 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-4866ddda-2d2d-4309-8277-71dde353fb64 tempest-ProjectMemberTests-163191203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6400c9a5-ad8e-4e81-99ed-1576a53fbdec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:31:38 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-4866ddda-2d2d-4309-8277-71dde353fb64 tempest-ProjectMemberTests-163191203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f114508-3356-4ce2-ab7b-77bfabc2ac55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:31:38 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-4866ddda-2d2d-4309-8277-71dde353fb64 tempest-ProjectMemberTests-163191203 None] Volume b63e27f8-1a80-42bb-b9f7-12e036cc259b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b63e27f8-1a80-42bb-b9f7-12e036cc259b', 'volume_size': 1} Nov 04 10:31:38 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-4866ddda-2d2d-4309-8277-71dde353fb64 tempest-ProjectMemberTests-163191203 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:31:38 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-4866ddda-2d2d-4309-8277-71dde353fb64 tempest-ProjectMemberTests-163191203 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:31:38 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-4866ddda-2d2d-4309-8277-71dde353fb64 tempest-ProjectMemberTests-163191203 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:31:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1202215882',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b63e27f8-1a80-42bb-b9f7-12e036cc259b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6102192fe22c4f298ee9815860bd7a9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:31:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:31:38Z,use_quota=True,user_id='df3853accc6242909d45cceeb3a0db9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 10:31:38 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-4866ddda-2d2d-4309-8277-71dde353fb64 tempest-ProjectMemberTests-163191203 None] Creating volume b63e27f8-1a80-42bb-b9f7-12e036cc259b {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:31:38 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-4866ddda-2d2d-4309-8277-71dde353fb64 tempest-ProjectMemberTests-163191203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:31:38 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-4866ddda-2d2d-4309-8277-71dde353fb64 tempest-ProjectMemberTests-163191203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:31:38 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-4866ddda-2d2d-4309-8277-71dde353fb64 tempest-ProjectMemberTests-163191203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:31:38 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-4866ddda-2d2d-4309-8277-71dde353fb64 tempest-ProjectMemberTests-163191203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:31:38 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-4866ddda-2d2d-4309-8277-71dde353fb64 tempest-ProjectMemberTests-163191203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:31:38 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-4866ddda-2d2d-4309-8277-71dde353fb64 tempest-ProjectMemberTests-163191203 None] Selected osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:31:38 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-4866ddda-2d2d-4309-8277-71dde353fb64 tempest-ProjectMemberTests-163191203 None] casted to osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 Nov 04 10:31:38 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-4866ddda-2d2d-4309-8277-71dde353fb64 tempest-ProjectMemberTests-163191203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b63e27f8-1a80-42bb-b9f7-12e036cc259b 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:31:38 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-5db53604-3c68-4c1c-a31e-09ae377568e8 tempest-ProjectReaderTests-888867065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-e893c48c-3c57-4d74-ac31-34e1f6b0519f.3fd34478-96e6-461d-9552-2fc13cdd9c9f" returned: 0 in 0.336s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:31:38 devstack sudo[105550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b63e27f8-1a80-42bb-b9f7-12e036cc259b 1073741824 Nov 04 10:31:38 devstack sudo[105550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:31:38 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-5db53604-3c68-4c1c-a31e-09ae377568e8 tempest-ProjectReaderTests-888867065 None] Lock "cinder-quobyte-3fd34478-96e6-461d-9552-2fc13cdd9c9f" released by "_delete_snapshot" :: held 1.900s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:31:38 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-5db53604-3c68-4c1c-a31e-09ae377568e8 tempest-ProjectReaderTests-888867065 None] Lock "cinder-quobyte-e893c48c-3c57-4d74-ac31-34e1f6b0519f" released by "delete_snapshot" :: held 1.921s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:31:38 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-5db53604-3c68-4c1c-a31e-09ae377568e8 tempest-ProjectReaderTests-888867065 None] Created reservations ['f57676d2-04c2-4530-b8aa-9505b6d38c49', '4b12f681-bd9c-4b12-8cc7-f63d85fbdf10', '0dcab4fd-786c-4ce1-8aae-fb0f00cbbf59', 'bdae592a-c286-4ea7-ab47-b0f6ccc233ba'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:31:38 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-5db53604-3c68-4c1c-a31e-09ae377568e8 tempest-ProjectReaderTests-888867065 None] Delete snapshot completed successfully. Nov 04 10:31:38 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-5db53604-3c68-4c1c-a31e-09ae377568e8 tempest-ProjectReaderTests-888867065 None] Lock "cinder-3fd34478-96e6-461d-9552-2fc13cdd9c9f-delete_snapshot" released by "delete_snapshot" :: held 2.094s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:31:38 devstack sudo[105550]: pam_unix(sudo:session): session closed for user root Nov 04 10:31:38 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-4866ddda-2d2d-4309-8277-71dde353fb64 tempest-ProjectMemberTests-163191203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b63e27f8-1a80-42bb-b9f7-12e036cc259b 1073741824" returned: 0 in 0.490s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:31:38 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-4866ddda-2d2d-4309-8277-71dde353fb64 tempest-ProjectMemberTests-163191203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b63e27f8-1a80-42bb-b9f7-12e036cc259b {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:31:38 devstack sudo[105556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b63e27f8-1a80-42bb-b9f7-12e036cc259b Nov 04 10:31:38 devstack sudo[105556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:31:38 devstack sudo[105556]: pam_unix(sudo:session): session closed for user root Nov 04 10:31:38 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-4866ddda-2d2d-4309-8277-71dde353fb64 tempest-ProjectMemberTests-163191203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b63e27f8-1a80-42bb-b9f7-12e036cc259b" returned: 0 in 0.282s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:31:38 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-4866ddda-2d2d-4309-8277-71dde353fb64 tempest-ProjectMemberTests-163191203 None] <== create_volume: return (816ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 10:31:38 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-4866ddda-2d2d-4309-8277-71dde353fb64 tempest-ProjectMemberTests-163191203 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.820s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:31:38 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-4866ddda-2d2d-4309-8277-71dde353fb64 tempest-ProjectMemberTests-163191203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f114508-3356-4ce2-ab7b-77bfabc2ac55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b63e27f8-1a80-42bb-b9f7-12e036cc259b', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:31:38 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-4866ddda-2d2d-4309-8277-71dde353fb64 tempest-ProjectMemberTests-163191203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (314a8811-f1a6-4c99-92f9-d1ae4bc5e657) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:31:38 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-4866ddda-2d2d-4309-8277-71dde353fb64 tempest-ProjectMemberTests-163191203 None] Volume volume-b63e27f8-1a80-42bb-b9f7-12e036cc259b (b63e27f8-1a80-42bb-b9f7-12e036cc259b): created successfully Nov 04 10:31:38 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-4866ddda-2d2d-4309-8277-71dde353fb64 tempest-ProjectMemberTests-163191203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (314a8811-f1a6-4c99-92f9-d1ae4bc5e657) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:31:38 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-4866ddda-2d2d-4309-8277-71dde353fb64 tempest-ProjectMemberTests-163191203 None] Flow 'volume_create_manager' (9d6d837b-a006-422e-a17b-88d4c4ad3d6c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:31:38 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-4866ddda-2d2d-4309-8277-71dde353fb64 tempest-ProjectMemberTests-163191203 None] Created volume successfully. Nov 04 10:31:39 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-6e3d431b-b8fe-40bf-a201-fc229836e9f6 tempest-ProjectReaderTests-888867065 None] Acquiring lock "cinder-e893c48c-3c57-4d74-ac31-34e1f6b0519f-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:31:39 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-6e3d431b-b8fe-40bf-a201-fc229836e9f6 tempest-ProjectReaderTests-888867065 None] Lock "cinder-e893c48c-3c57-4d74-ac31-34e1f6b0519f-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:31:39 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-6e3d431b-b8fe-40bf-a201-fc229836e9f6 tempest-ProjectReaderTests-888867065 None] Acquiring lock "cinder-quobyte-e893c48c-3c57-4d74-ac31-34e1f6b0519f" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:31:39 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-6e3d431b-b8fe-40bf-a201-fc229836e9f6 tempest-ProjectReaderTests-888867065 None] Lock "cinder-quobyte-e893c48c-3c57-4d74-ac31-34e1f6b0519f" acquired by "delete_volume" :: waited 0.021s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:31:39 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[67ee40bc-a54f-4677-83df-837e2e515abb]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:31:39 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6e3d431b-b8fe-40bf-a201-fc229836e9f6 tempest-ProjectReaderTests-888867065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-e893c48c-3c57-4d74-ac31-34e1f6b0519f {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:31:39 devstack sudo[105559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-e893c48c-3c57-4d74-ac31-34e1f6b0519f Nov 04 10:31:39 devstack sudo[105559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:31:39 devstack sudo[105559]: pam_unix(sudo:session): session closed for user root Nov 04 10:31:39 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6e3d431b-b8fe-40bf-a201-fc229836e9f6 tempest-ProjectReaderTests-888867065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-e893c48c-3c57-4d74-ac31-34e1f6b0519f" returned: 0 in 0.413s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:31:39 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6e3d431b-b8fe-40bf-a201-fc229836e9f6 tempest-ProjectReaderTests-888867065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-e893c48c-3c57-4d74-ac31-34e1f6b0519f {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:31:39 devstack sudo[105564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-e893c48c-3c57-4d74-ac31-34e1f6b0519f Nov 04 10:31:39 devstack sudo[105564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:31:40 devstack sudo[105564]: pam_unix(sudo:session): session closed for user root Nov 04 10:31:40 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-f59c3794-c05a-41c3-af4a-10fc11dcd8f0 tempest-ProjectMemberTests-163191203 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:31:40 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-f59c3794-c05a-41c3-af4a-10fc11dcd8f0 tempest-ProjectMemberTests-163191203 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:31:40 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6e3d431b-b8fe-40bf-a201-fc229836e9f6 tempest-ProjectReaderTests-888867065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-e893c48c-3c57-4d74-ac31-34e1f6b0519f" returned: 0 in 0.308s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:31:40 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-f59c3794-c05a-41c3-af4a-10fc11dcd8f0 tempest-ProjectMemberTests-163191203 None] Creating offline snapshot b029cc24-aade-480a-aeb2-6af7473d23b5 of volume b63e27f8-1a80-42bb-b9f7-12e036cc259b {{(pid=87068) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 10:31:40 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-6e3d431b-b8fe-40bf-a201-fc229836e9f6 tempest-ProjectReaderTests-888867065 None] Lock "cinder-quobyte-e893c48c-3c57-4d74-ac31-34e1f6b0519f" released by "delete_volume" :: held 0.819s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:31:40 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[d129e145-ebe0-4d3b-9bb9-6681faacdaa1]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:31:40 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f59c3794-c05a-41c3-af4a-10fc11dcd8f0 tempest-ProjectMemberTests-163191203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b63e27f8-1a80-42bb-b9f7-12e036cc259b {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:31:40 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-6e3d431b-b8fe-40bf-a201-fc229836e9f6 tempest-ProjectReaderTests-888867065 None] Created reservations ['acd8f508-f3bf-4b3d-8dc5-213e2bab15c7', '72d29dc0-5659-4209-9a69-396f94ead37d', 'c5265126-91f2-47a2-8fbe-16e0606e666c', '29038515-9e71-4a83-8418-74d706eeb44a'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:31:40 devstack sudo[105567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b63e27f8-1a80-42bb-b9f7-12e036cc259b Nov 04 10:31:40 devstack sudo[105567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:31:40 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-6e3d431b-b8fe-40bf-a201-fc229836e9f6 tempest-ProjectReaderTests-888867065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:31:40 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-6e3d431b-b8fe-40bf-a201-fc229836e9f6 tempest-ProjectReaderTests-888867065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:31:40 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-6e3d431b-b8fe-40bf-a201-fc229836e9f6 tempest-ProjectReaderTests-888867065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:31:40 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-6e3d431b-b8fe-40bf-a201-fc229836e9f6 tempest-ProjectReaderTests-888867065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:31:40 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-6e3d431b-b8fe-40bf-a201-fc229836e9f6 tempest-ProjectReaderTests-888867065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:31:40 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6e3d431b-b8fe-40bf-a201-fc229836e9f6 tempest-ProjectReaderTests-888867065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:31:40 devstack sudo[105569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:31:40 devstack sudo[105569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:31:40 devstack sudo[105569]: pam_unix(sudo:session): session closed for user root Nov 04 10:31:40 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6e3d431b-b8fe-40bf-a201-fc229836e9f6 tempest-ProjectReaderTests-888867065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.278s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:31:40 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-6e3d431b-b8fe-40bf-a201-fc229836e9f6 tempest-ProjectReaderTests-888867065 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:31:40 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-6e3d431b-b8fe-40bf-a201-fc229836e9f6 tempest-ProjectReaderTests-888867065 None] Deleted volume successfully. Nov 04 10:31:40 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-6e3d431b-b8fe-40bf-a201-fc229836e9f6 tempest-ProjectReaderTests-888867065 None] Lock "cinder-e893c48c-3c57-4d74-ac31-34e1f6b0519f-delete_volume" released by "delete_volume" :: held 1.383s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:31:40 devstack sudo[105567]: pam_unix(sudo:session): session closed for user root Nov 04 10:31:40 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f59c3794-c05a-41c3-af4a-10fc11dcd8f0 tempest-ProjectMemberTests-163191203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b63e27f8-1a80-42bb-b9f7-12e036cc259b" returned: 0 in 0.498s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:31:40 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f59c3794-c05a-41c3-af4a-10fc11dcd8f0 tempest-ProjectMemberTests-163191203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b63e27f8-1a80-42bb-b9f7-12e036cc259b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b63e27f8-1a80-42bb-b9f7-12e036cc259b.b029cc24-aade-480a-aeb2-6af7473d23b5 1G {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:31:40 devstack sudo[105576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b63e27f8-1a80-42bb-b9f7-12e036cc259b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b63e27f8-1a80-42bb-b9f7-12e036cc259b.b029cc24-aade-480a-aeb2-6af7473d23b5 1G Nov 04 10:31:40 devstack sudo[105576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:31:41 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-14590736-7723-44b8-96df-71b43f0f8180 tempest-ProjectReaderTests-888867065 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:31:41 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-14590736-7723-44b8-96df-71b43f0f8180 tempest-ProjectReaderTests-888867065 None] Flow 'volume_create_manager' (076ec0aa-a1b5-4c05-81ee-bf69153c43e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:31:41 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-14590736-7723-44b8-96df-71b43f0f8180 tempest-ProjectReaderTests-888867065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b264fd44-4c6e-4b7b-8a04-e6297cae8ae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:31:41 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-14590736-7723-44b8-96df-71b43f0f8180 tempest-ProjectReaderTests-888867065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b264fd44-4c6e-4b7b-8a04-e6297cae8ae9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:31:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-905333011',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91584d48-6727-455d-8fbf-517104f072a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ceada5c21c0840989abb5a48b7006da6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:31:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:31:41Z,use_quota=True,user_id='8e11bec0815c4b9e994b7a51e248abd4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:31:41 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-14590736-7723-44b8-96df-71b43f0f8180 tempest-ProjectReaderTests-888867065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53be1588-7559-4be5-835f-7596f0734c51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:31:41 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-14590736-7723-44b8-96df-71b43f0f8180 tempest-ProjectReaderTests-888867065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53be1588-7559-4be5-835f-7596f0734c51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:31:41 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-14590736-7723-44b8-96df-71b43f0f8180 tempest-ProjectReaderTests-888867065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83487e85-4a7f-4c32-8106-8916329c5ff2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:31:41 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-14590736-7723-44b8-96df-71b43f0f8180 tempest-ProjectReaderTests-888867065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83487e85-4a7f-4c32-8106-8916329c5ff2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91584d48-6727-455d-8fbf-517104f072a1', 'volume_name': 'volume-91584d48-6727-455d-8fbf-517104f072a1', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:31:41 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-14590736-7723-44b8-96df-71b43f0f8180 tempest-ProjectReaderTests-888867065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b00f585-3d0a-4c1b-8010-cc6ca781b509) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:31:41 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-14590736-7723-44b8-96df-71b43f0f8180 tempest-ProjectReaderTests-888867065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b00f585-3d0a-4c1b-8010-cc6ca781b509) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:31:41 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-14590736-7723-44b8-96df-71b43f0f8180 tempest-ProjectReaderTests-888867065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48a5bbd7-2dec-4479-81a6-a113e6d1d424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:31:41 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-14590736-7723-44b8-96df-71b43f0f8180 tempest-ProjectReaderTests-888867065 None] Volume 91584d48-6727-455d-8fbf-517104f072a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91584d48-6727-455d-8fbf-517104f072a1', 'volume_size': 1} Nov 04 10:31:41 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-14590736-7723-44b8-96df-71b43f0f8180 tempest-ProjectReaderTests-888867065 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:31:41 devstack sudo[105576]: pam_unix(sudo:session): session closed for user root Nov 04 10:31:41 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f59c3794-c05a-41c3-af4a-10fc11dcd8f0 tempest-ProjectMemberTests-163191203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b63e27f8-1a80-42bb-b9f7-12e036cc259b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b63e27f8-1a80-42bb-b9f7-12e036cc259b.b029cc24-aade-480a-aeb2-6af7473d23b5 1G" returned: 0 in 0.533s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:31:41 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f59c3794-c05a-41c3-af4a-10fc11dcd8f0 tempest-ProjectMemberTests-163191203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b63e27f8-1a80-42bb-b9f7-12e036cc259b -F qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b63e27f8-1a80-42bb-b9f7-12e036cc259b.b029cc24-aade-480a-aeb2-6af7473d23b5 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:31:41 devstack sudo[105582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b63e27f8-1a80-42bb-b9f7-12e036cc259b -F qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b63e27f8-1a80-42bb-b9f7-12e036cc259b.b029cc24-aade-480a-aeb2-6af7473d23b5 Nov 04 10:31:41 devstack sudo[105582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:31:41 devstack sudo[105582]: pam_unix(sudo:session): session closed for user root Nov 04 10:31:41 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f59c3794-c05a-41c3-af4a-10fc11dcd8f0 tempest-ProjectMemberTests-163191203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b63e27f8-1a80-42bb-b9f7-12e036cc259b -F qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b63e27f8-1a80-42bb-b9f7-12e036cc259b.b029cc24-aade-480a-aeb2-6af7473d23b5" returned: 0 in 0.301s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:31:41 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-f59c3794-c05a-41c3-af4a-10fc11dcd8f0 tempest-ProjectMemberTests-163191203 None] /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b63e27f8-1a80-42bb-b9f7-12e036cc259b.b029cc24-aade-480a-aeb2-6af7473d23b5 is being set with open permissions: ugo+rw Nov 04 10:31:41 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f59c3794-c05a-41c3-af4a-10fc11dcd8f0 tempest-ProjectMemberTests-163191203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b63e27f8-1a80-42bb-b9f7-12e036cc259b.b029cc24-aade-480a-aeb2-6af7473d23b5 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:31:41 devstack sudo[105588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b63e27f8-1a80-42bb-b9f7-12e036cc259b.b029cc24-aade-480a-aeb2-6af7473d23b5 Nov 04 10:31:41 devstack sudo[105588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:31:41 devstack sudo[105588]: pam_unix(sudo:session): session closed for user root Nov 04 10:31:41 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f59c3794-c05a-41c3-af4a-10fc11dcd8f0 tempest-ProjectMemberTests-163191203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b63e27f8-1a80-42bb-b9f7-12e036cc259b.b029cc24-aade-480a-aeb2-6af7473d23b5" returned: 0 in 0.240s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:31:41 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f59c3794-c05a-41c3-af4a-10fc11dcd8f0 tempest-ProjectMemberTests-163191203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b63e27f8-1a80-42bb-b9f7-12e036cc259b.info {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:31:41 devstack sudo[105591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b63e27f8-1a80-42bb-b9f7-12e036cc259b.info Nov 04 10:31:41 devstack sudo[105591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:31:42 devstack sudo[105591]: pam_unix(sudo:session): session closed for user root Nov 04 10:31:42 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f59c3794-c05a-41c3-af4a-10fc11dcd8f0 tempest-ProjectMemberTests-163191203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b63e27f8-1a80-42bb-b9f7-12e036cc259b.info" returned: 0 in 0.272s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:31:42 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-f59c3794-c05a-41c3-af4a-10fc11dcd8f0 tempest-ProjectMemberTests-163191203 None] /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b63e27f8-1a80-42bb-b9f7-12e036cc259b.info is being set with open permissions: ugo+rw Nov 04 10:31:42 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f59c3794-c05a-41c3-af4a-10fc11dcd8f0 tempest-ProjectMemberTests-163191203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b63e27f8-1a80-42bb-b9f7-12e036cc259b.info {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:31:42 devstack sudo[105594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b63e27f8-1a80-42bb-b9f7-12e036cc259b.info Nov 04 10:31:42 devstack sudo[105594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:31:42 devstack sudo[105594]: pam_unix(sudo:session): session closed for user root Nov 04 10:31:42 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f59c3794-c05a-41c3-af4a-10fc11dcd8f0 tempest-ProjectMemberTests-163191203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b63e27f8-1a80-42bb-b9f7-12e036cc259b.info" returned: 0 in 0.291s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:31:42 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-f59c3794-c05a-41c3-af4a-10fc11dcd8f0 tempest-ProjectMemberTests-163191203 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.249s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:31:42 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-14590736-7723-44b8-96df-71b43f0f8180 tempest-ProjectReaderTests-888867065 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.299s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:31:42 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-14590736-7723-44b8-96df-71b43f0f8180 tempest-ProjectReaderTests-888867065 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:31:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-905333011',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91584d48-6727-455d-8fbf-517104f072a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ceada5c21c0840989abb5a48b7006da6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:31:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:31:41Z,use_quota=True,user_id='8e11bec0815c4b9e994b7a51e248abd4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 10:31:42 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-14590736-7723-44b8-96df-71b43f0f8180 tempest-ProjectReaderTests-888867065 None] Creating volume 91584d48-6727-455d-8fbf-517104f072a1 {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:31:42 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-14590736-7723-44b8-96df-71b43f0f8180 tempest-ProjectReaderTests-888867065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:31:42 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-14590736-7723-44b8-96df-71b43f0f8180 tempest-ProjectReaderTests-888867065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:31:42 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-14590736-7723-44b8-96df-71b43f0f8180 tempest-ProjectReaderTests-888867065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:31:42 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-14590736-7723-44b8-96df-71b43f0f8180 tempest-ProjectReaderTests-888867065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:31:42 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-14590736-7723-44b8-96df-71b43f0f8180 tempest-ProjectReaderTests-888867065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:31:42 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-14590736-7723-44b8-96df-71b43f0f8180 tempest-ProjectReaderTests-888867065 None] Selected osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:31:42 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-14590736-7723-44b8-96df-71b43f0f8180 tempest-ProjectReaderTests-888867065 None] casted to osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 Nov 04 10:31:42 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-14590736-7723-44b8-96df-71b43f0f8180 tempest-ProjectReaderTests-888867065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-91584d48-6727-455d-8fbf-517104f072a1 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:31:42 devstack sudo[105597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-91584d48-6727-455d-8fbf-517104f072a1 1073741824 Nov 04 10:31:42 devstack sudo[105597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:31:42 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-f59c3794-c05a-41c3-af4a-10fc11dcd8f0 tempest-ProjectMemberTests-163191203 None] Create snapshot completed successfully Nov 04 10:31:42 devstack sudo[105597]: pam_unix(sudo:session): session closed for user root Nov 04 10:31:42 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-14590736-7723-44b8-96df-71b43f0f8180 tempest-ProjectReaderTests-888867065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-91584d48-6727-455d-8fbf-517104f072a1 1073741824" returned: 0 in 0.452s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:31:42 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-14590736-7723-44b8-96df-71b43f0f8180 tempest-ProjectReaderTests-888867065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-91584d48-6727-455d-8fbf-517104f072a1 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:31:42 devstack sudo[105604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-91584d48-6727-455d-8fbf-517104f072a1 Nov 04 10:31:42 devstack sudo[105604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:31:43 devstack sudo[105604]: pam_unix(sudo:session): session closed for user root Nov 04 10:31:43 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-14590736-7723-44b8-96df-71b43f0f8180 tempest-ProjectReaderTests-888867065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-91584d48-6727-455d-8fbf-517104f072a1" returned: 0 in 0.256s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:31:43 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-14590736-7723-44b8-96df-71b43f0f8180 tempest-ProjectReaderTests-888867065 None] <== create_volume: return (752ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 10:31:43 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-14590736-7723-44b8-96df-71b43f0f8180 tempest-ProjectReaderTests-888867065 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.755s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:31:43 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-14590736-7723-44b8-96df-71b43f0f8180 tempest-ProjectReaderTests-888867065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48a5bbd7-2dec-4479-81a6-a113e6d1d424) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91584d48-6727-455d-8fbf-517104f072a1', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:31:43 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-14590736-7723-44b8-96df-71b43f0f8180 tempest-ProjectReaderTests-888867065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be0422c0-9afe-44c3-9b3f-322736a11f67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:31:43 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-14590736-7723-44b8-96df-71b43f0f8180 tempest-ProjectReaderTests-888867065 None] Volume volume-91584d48-6727-455d-8fbf-517104f072a1 (91584d48-6727-455d-8fbf-517104f072a1): created successfully Nov 04 10:31:43 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-14590736-7723-44b8-96df-71b43f0f8180 tempest-ProjectReaderTests-888867065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be0422c0-9afe-44c3-9b3f-322736a11f67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:31:43 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-14590736-7723-44b8-96df-71b43f0f8180 tempest-ProjectReaderTests-888867065 None] Flow 'volume_create_manager' (076ec0aa-a1b5-4c05-81ee-bf69153c43e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:31:43 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-14590736-7723-44b8-96df-71b43f0f8180 tempest-ProjectReaderTests-888867065 None] Created volume successfully. Nov 04 10:31:43 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-4cc21caf-5326-4650-8c1b-9663322c6671 tempest-ProjectMemberTests-163191203 None] Acquiring lock "cinder-b029cc24-aade-480a-aeb2-6af7473d23b5-delete_snapshot" by "delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:31:43 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-4cc21caf-5326-4650-8c1b-9663322c6671 tempest-ProjectMemberTests-163191203 None] Lock "cinder-b029cc24-aade-480a-aeb2-6af7473d23b5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:31:43 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-4cc21caf-5326-4650-8c1b-9663322c6671 tempest-ProjectMemberTests-163191203 None] Acquiring lock "cinder-quobyte-b63e27f8-1a80-42bb-b9f7-12e036cc259b" by "delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:31:43 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-4cc21caf-5326-4650-8c1b-9663322c6671 tempest-ProjectMemberTests-163191203 None] Lock "cinder-quobyte-b63e27f8-1a80-42bb-b9f7-12e036cc259b" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:31:43 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-4cc21caf-5326-4650-8c1b-9663322c6671 tempest-ProjectMemberTests-163191203 None] Acquiring lock "cinder-quobyte-b029cc24-aade-480a-aeb2-6af7473d23b5" by "_delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:31:43 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-4cc21caf-5326-4650-8c1b-9663322c6671 tempest-ProjectMemberTests-163191203 None] Lock "cinder-quobyte-b029cc24-aade-480a-aeb2-6af7473d23b5" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:31:43 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-4cc21caf-5326-4650-8c1b-9663322c6671 tempest-ProjectMemberTests-163191203 None] Deleting offline snapshot b029cc24-aade-480a-aeb2-6af7473d23b5 of volume b63e27f8-1a80-42bb-b9f7-12e036cc259b {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 10:31:43 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-4cc21caf-5326-4650-8c1b-9663322c6671 tempest-ProjectMemberTests-163191203 None] snapshot_file for this snap is: volume-b63e27f8-1a80-42bb-b9f7-12e036cc259b.b029cc24-aade-480a-aeb2-6af7473d23b5 {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 10:31:43 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[19245db4-c9a4-4556-8039-2ae33c59b543]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:31:43 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-4cc21caf-5326-4650-8c1b-9663322c6671 tempest-ProjectMemberTests-163191203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b63e27f8-1a80-42bb-b9f7-12e036cc259b.b029cc24-aade-480a-aeb2-6af7473d23b5 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:31:43 devstack sudo[105607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b63e27f8-1a80-42bb-b9f7-12e036cc259b.b029cc24-aade-480a-aeb2-6af7473d23b5 Nov 04 10:31:43 devstack sudo[105607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:31:43 devstack sudo[105607]: pam_unix(sudo:session): session closed for user root Nov 04 10:31:43 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-4cc21caf-5326-4650-8c1b-9663322c6671 tempest-ProjectMemberTests-163191203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b63e27f8-1a80-42bb-b9f7-12e036cc259b.b029cc24-aade-480a-aeb2-6af7473d23b5" returned: 0 in 0.405s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:31:43 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-4cc21caf-5326-4650-8c1b-9663322c6671 tempest-ProjectMemberTests-163191203 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b63e27f8-1a80-42bb-b9f7-12e036cc259b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87068) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 10:31:43 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce302e66-cfc3-4a0c-935c-4fc3ae1aecb0]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:31:43 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-4cc21caf-5326-4650-8c1b-9663322c6671 tempest-ProjectMemberTests-163191203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b63e27f8-1a80-42bb-b9f7-12e036cc259b {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:31:44 devstack sudo[105612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b63e27f8-1a80-42bb-b9f7-12e036cc259b Nov 04 10:31:44 devstack sudo[105612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:31:44 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-93f043ab-f524-4f03-a96c-e6c8ee326596 tempest-ProjectReaderTests-888867065 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:31:44 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-93f043ab-f524-4f03-a96c-e6c8ee326596 tempest-ProjectReaderTests-888867065 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:31:44 devstack sudo[105612]: pam_unix(sudo:session): session closed for user root Nov 04 10:31:44 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-93f043ab-f524-4f03-a96c-e6c8ee326596 tempest-ProjectReaderTests-888867065 None] Creating offline snapshot 30b9adcc-18f3-412d-9f1c-09f5bd23bdb1 of volume 91584d48-6727-455d-8fbf-517104f072a1 {{(pid=87068) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 10:31:44 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-4cc21caf-5326-4650-8c1b-9663322c6671 tempest-ProjectMemberTests-163191203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b63e27f8-1a80-42bb-b9f7-12e036cc259b" returned: 0 in 0.454s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:31:44 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-4cc21caf-5326-4650-8c1b-9663322c6671 tempest-ProjectMemberTests-163191203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b63e27f8-1a80-42bb-b9f7-12e036cc259b.b029cc24-aade-480a-aeb2-6af7473d23b5 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:31:44 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[54293750-9eb1-41e9-bc72-850edaef8cdc]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:31:44 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-93f043ab-f524-4f03-a96c-e6c8ee326596 tempest-ProjectReaderTests-888867065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-91584d48-6727-455d-8fbf-517104f072a1 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:31:44 devstack sudo[105618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b63e27f8-1a80-42bb-b9f7-12e036cc259b.b029cc24-aade-480a-aeb2-6af7473d23b5 Nov 04 10:31:44 devstack sudo[105618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:31:44 devstack sudo[105619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-91584d48-6727-455d-8fbf-517104f072a1 Nov 04 10:31:44 devstack sudo[105619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:31:44 devstack sudo[105618]: pam_unix(sudo:session): session closed for user root Nov 04 10:31:44 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-4cc21caf-5326-4650-8c1b-9663322c6671 tempest-ProjectMemberTests-163191203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b63e27f8-1a80-42bb-b9f7-12e036cc259b.b029cc24-aade-480a-aeb2-6af7473d23b5" returned: 0 in 0.406s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:31:44 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-4cc21caf-5326-4650-8c1b-9663322c6671 tempest-ProjectMemberTests-163191203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b63e27f8-1a80-42bb-b9f7-12e036cc259b.b029cc24-aade-480a-aeb2-6af7473d23b5 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:31:44 devstack sudo[105629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b63e27f8-1a80-42bb-b9f7-12e036cc259b.b029cc24-aade-480a-aeb2-6af7473d23b5 Nov 04 10:31:44 devstack sudo[105629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:31:44 devstack sudo[105619]: pam_unix(sudo:session): session closed for user root Nov 04 10:31:44 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-93f043ab-f524-4f03-a96c-e6c8ee326596 tempest-ProjectReaderTests-888867065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-91584d48-6727-455d-8fbf-517104f072a1" returned: 0 in 0.421s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:31:44 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-93f043ab-f524-4f03-a96c-e6c8ee326596 tempest-ProjectReaderTests-888867065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-91584d48-6727-455d-8fbf-517104f072a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-91584d48-6727-455d-8fbf-517104f072a1.30b9adcc-18f3-412d-9f1c-09f5bd23bdb1 1G {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:31:44 devstack sudo[105631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-91584d48-6727-455d-8fbf-517104f072a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-91584d48-6727-455d-8fbf-517104f072a1.30b9adcc-18f3-412d-9f1c-09f5bd23bdb1 1G Nov 04 10:31:44 devstack sudo[105631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:31:45 devstack sudo[105629]: pam_unix(sudo:session): session closed for user root Nov 04 10:31:45 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-4cc21caf-5326-4650-8c1b-9663322c6671 tempest-ProjectMemberTests-163191203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b63e27f8-1a80-42bb-b9f7-12e036cc259b.b029cc24-aade-480a-aeb2-6af7473d23b5" returned: 0 in 0.274s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:31:45 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-4cc21caf-5326-4650-8c1b-9663322c6671 tempest-ProjectMemberTests-163191203 None] Lock "cinder-quobyte-b029cc24-aade-480a-aeb2-6af7473d23b5" released by "_delete_snapshot" :: held 1.670s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:31:45 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-4cc21caf-5326-4650-8c1b-9663322c6671 tempest-ProjectMemberTests-163191203 None] Lock "cinder-quobyte-b63e27f8-1a80-42bb-b9f7-12e036cc259b" released by "delete_snapshot" :: held 1.696s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:31:45 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-4cc21caf-5326-4650-8c1b-9663322c6671 tempest-ProjectMemberTests-163191203 None] Created reservations ['23410598-16f6-4341-a20f-63d11509c781', '04c38913-7e82-4e2b-af15-caa706dd9301', '9d3f6dad-cf39-482f-bd63-6309e28f455e', '892aa06e-89c3-499d-baa2-27d01d8dba8c'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:31:45 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-4cc21caf-5326-4650-8c1b-9663322c6671 tempest-ProjectMemberTests-163191203 None] Delete snapshot completed successfully. Nov 04 10:31:45 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-4cc21caf-5326-4650-8c1b-9663322c6671 tempest-ProjectMemberTests-163191203 None] Lock "cinder-b029cc24-aade-480a-aeb2-6af7473d23b5-delete_snapshot" released by "delete_snapshot" :: held 1.870s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:31:45 devstack sudo[105631]: pam_unix(sudo:session): session closed for user root Nov 04 10:31:45 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-93f043ab-f524-4f03-a96c-e6c8ee326596 tempest-ProjectReaderTests-888867065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-91584d48-6727-455d-8fbf-517104f072a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-91584d48-6727-455d-8fbf-517104f072a1.30b9adcc-18f3-412d-9f1c-09f5bd23bdb1 1G" returned: 0 in 0.505s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:31:45 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-93f043ab-f524-4f03-a96c-e6c8ee326596 tempest-ProjectReaderTests-888867065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-91584d48-6727-455d-8fbf-517104f072a1 -F qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-91584d48-6727-455d-8fbf-517104f072a1.30b9adcc-18f3-412d-9f1c-09f5bd23bdb1 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:31:45 devstack sudo[105638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-91584d48-6727-455d-8fbf-517104f072a1 -F qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-91584d48-6727-455d-8fbf-517104f072a1.30b9adcc-18f3-412d-9f1c-09f5bd23bdb1 Nov 04 10:31:45 devstack sudo[105638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:31:45 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-0f8cf281-5560-439b-8f94-882e2c6513a5 tempest-ProjectMemberTests-163191203 None] Acquiring lock "cinder-b63e27f8-1a80-42bb-b9f7-12e036cc259b-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:31:45 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-0f8cf281-5560-439b-8f94-882e2c6513a5 tempest-ProjectMemberTests-163191203 None] Lock "cinder-b63e27f8-1a80-42bb-b9f7-12e036cc259b-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:31:45 devstack sudo[105638]: pam_unix(sudo:session): session closed for user root Nov 04 10:31:45 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-93f043ab-f524-4f03-a96c-e6c8ee326596 tempest-ProjectReaderTests-888867065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-91584d48-6727-455d-8fbf-517104f072a1 -F qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-91584d48-6727-455d-8fbf-517104f072a1.30b9adcc-18f3-412d-9f1c-09f5bd23bdb1" returned: 0 in 0.361s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:31:45 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-93f043ab-f524-4f03-a96c-e6c8ee326596 tempest-ProjectReaderTests-888867065 None] /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-91584d48-6727-455d-8fbf-517104f072a1.30b9adcc-18f3-412d-9f1c-09f5bd23bdb1 is being set with open permissions: ugo+rw Nov 04 10:31:45 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-93f043ab-f524-4f03-a96c-e6c8ee326596 tempest-ProjectReaderTests-888867065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-91584d48-6727-455d-8fbf-517104f072a1.30b9adcc-18f3-412d-9f1c-09f5bd23bdb1 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:31:45 devstack sudo[105643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-91584d48-6727-455d-8fbf-517104f072a1.30b9adcc-18f3-412d-9f1c-09f5bd23bdb1 Nov 04 10:31:45 devstack sudo[105643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:31:45 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-0f8cf281-5560-439b-8f94-882e2c6513a5 tempest-ProjectMemberTests-163191203 None] Acquiring lock "cinder-quobyte-b63e27f8-1a80-42bb-b9f7-12e036cc259b" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:31:45 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-0f8cf281-5560-439b-8f94-882e2c6513a5 tempest-ProjectMemberTests-163191203 None] Lock "cinder-quobyte-b63e27f8-1a80-42bb-b9f7-12e036cc259b" acquired by "delete_volume" :: waited 0.020s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:31:45 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fe9a345-4c0d-4f18-af80-79ff4e19dcae]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:31:45 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-0f8cf281-5560-439b-8f94-882e2c6513a5 tempest-ProjectMemberTests-163191203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b63e27f8-1a80-42bb-b9f7-12e036cc259b {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:31:46 devstack sudo[105645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b63e27f8-1a80-42bb-b9f7-12e036cc259b Nov 04 10:31:46 devstack sudo[105645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:31:46 devstack sudo[105643]: pam_unix(sudo:session): session closed for user root Nov 04 10:31:46 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-93f043ab-f524-4f03-a96c-e6c8ee326596 tempest-ProjectReaderTests-888867065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-91584d48-6727-455d-8fbf-517104f072a1.30b9adcc-18f3-412d-9f1c-09f5bd23bdb1" returned: 0 in 0.276s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:31:46 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-93f043ab-f524-4f03-a96c-e6c8ee326596 tempest-ProjectReaderTests-888867065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-91584d48-6727-455d-8fbf-517104f072a1.info {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:31:46 devstack sudo[105648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-91584d48-6727-455d-8fbf-517104f072a1.info Nov 04 10:31:46 devstack sudo[105648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:31:46 devstack sudo[105645]: pam_unix(sudo:session): session closed for user root Nov 04 10:31:46 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-0f8cf281-5560-439b-8f94-882e2c6513a5 tempest-ProjectMemberTests-163191203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b63e27f8-1a80-42bb-b9f7-12e036cc259b" returned: 0 in 0.458s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:31:46 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-0f8cf281-5560-439b-8f94-882e2c6513a5 tempest-ProjectMemberTests-163191203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b63e27f8-1a80-42bb-b9f7-12e036cc259b {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:31:46 devstack sudo[105648]: pam_unix(sudo:session): session closed for user root Nov 04 10:31:46 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-93f043ab-f524-4f03-a96c-e6c8ee326596 tempest-ProjectReaderTests-888867065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-91584d48-6727-455d-8fbf-517104f072a1.info" returned: 0 in 0.287s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:31:46 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-93f043ab-f524-4f03-a96c-e6c8ee326596 tempest-ProjectReaderTests-888867065 None] /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-91584d48-6727-455d-8fbf-517104f072a1.info is being set with open permissions: ugo+rw Nov 04 10:31:46 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-93f043ab-f524-4f03-a96c-e6c8ee326596 tempest-ProjectReaderTests-888867065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-91584d48-6727-455d-8fbf-517104f072a1.info {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:31:46 devstack sudo[105654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b63e27f8-1a80-42bb-b9f7-12e036cc259b Nov 04 10:31:46 devstack sudo[105654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:31:46 devstack sudo[105655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-91584d48-6727-455d-8fbf-517104f072a1.info Nov 04 10:31:46 devstack sudo[105655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:31:46 devstack sudo[105654]: pam_unix(sudo:session): session closed for user root Nov 04 10:31:46 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-0f8cf281-5560-439b-8f94-882e2c6513a5 tempest-ProjectMemberTests-163191203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b63e27f8-1a80-42bb-b9f7-12e036cc259b" returned: 0 in 0.269s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:31:46 devstack sudo[105655]: pam_unix(sudo:session): session closed for user root Nov 04 10:31:46 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-93f043ab-f524-4f03-a96c-e6c8ee326596 tempest-ProjectReaderTests-888867065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-91584d48-6727-455d-8fbf-517104f072a1.info" returned: 0 in 0.270s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:31:46 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-93f043ab-f524-4f03-a96c-e6c8ee326596 tempest-ProjectReaderTests-888867065 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.251s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:31:46 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-0f8cf281-5560-439b-8f94-882e2c6513a5 tempest-ProjectMemberTests-163191203 None] Lock "cinder-quobyte-b63e27f8-1a80-42bb-b9f7-12e036cc259b" released by "delete_volume" :: held 0.833s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:31:46 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-93f043ab-f524-4f03-a96c-e6c8ee326596 tempest-ProjectReaderTests-888867065 None] Create snapshot completed successfully Nov 04 10:31:46 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-0f8cf281-5560-439b-8f94-882e2c6513a5 tempest-ProjectMemberTests-163191203 None] Created reservations ['0b0051aa-c743-42b0-9867-23a3f2bf9eb1', '3cf5722c-75fd-4c18-bc74-6500564a3a61', '2ee2b0b0-5e1f-4050-94c8-17ad36d7034b', 'a6e81e31-e373-44e7-a231-f7cecf48a298'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:31:46 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-0f8cf281-5560-439b-8f94-882e2c6513a5 tempest-ProjectMemberTests-163191203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:31:46 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-0f8cf281-5560-439b-8f94-882e2c6513a5 tempest-ProjectMemberTests-163191203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:31:46 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-0f8cf281-5560-439b-8f94-882e2c6513a5 tempest-ProjectMemberTests-163191203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:31:46 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-0f8cf281-5560-439b-8f94-882e2c6513a5 tempest-ProjectMemberTests-163191203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:31:46 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-0f8cf281-5560-439b-8f94-882e2c6513a5 tempest-ProjectMemberTests-163191203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:31:46 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-0f8cf281-5560-439b-8f94-882e2c6513a5 tempest-ProjectMemberTests-163191203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:31:46 devstack sudo[105660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:31:46 devstack sudo[105660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:31:47 devstack sudo[105660]: pam_unix(sudo:session): session closed for user root Nov 04 10:31:47 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-0f8cf281-5560-439b-8f94-882e2c6513a5 tempest-ProjectMemberTests-163191203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.294s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:31:47 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-0f8cf281-5560-439b-8f94-882e2c6513a5 tempest-ProjectMemberTests-163191203 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:31:47 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-0f8cf281-5560-439b-8f94-882e2c6513a5 tempest-ProjectMemberTests-163191203 None] Deleted volume successfully. Nov 04 10:31:47 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-0f8cf281-5560-439b-8f94-882e2c6513a5 tempest-ProjectMemberTests-163191203 None] Lock "cinder-b63e27f8-1a80-42bb-b9f7-12e036cc259b-delete_volume" released by "delete_volume" :: held 1.425s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:31:47 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7a9b4a0-c1a6-402f-b887-a646a371fafd tempest-ProjectMemberTests-163191203 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:31:47 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-f7a9b4a0-c1a6-402f-b887-a646a371fafd tempest-ProjectMemberTests-163191203 None] Flow 'volume_create_manager' (a4561083-f346-4799-a4b3-02b346d4b21a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:31:47 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-f7a9b4a0-c1a6-402f-b887-a646a371fafd tempest-ProjectMemberTests-163191203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ad34d27-32f3-4340-bc0a-8411334f464a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:31:47 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-f7a9b4a0-c1a6-402f-b887-a646a371fafd tempest-ProjectMemberTests-163191203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ad34d27-32f3-4340-bc0a-8411334f464a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:31:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1367810900',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c625a33e-ab7a-4926-b291-84e9e2a1d28e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6102192fe22c4f298ee9815860bd7a9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:31:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:31:47Z,use_quota=True,user_id='df3853accc6242909d45cceeb3a0db9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:31:47 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-f7a9b4a0-c1a6-402f-b887-a646a371fafd tempest-ProjectMemberTests-163191203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48cca016-4a6c-460a-a27e-77c7c0a53a03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:31:47 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-f7a9b4a0-c1a6-402f-b887-a646a371fafd tempest-ProjectMemberTests-163191203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48cca016-4a6c-460a-a27e-77c7c0a53a03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:31:47 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-f7a9b4a0-c1a6-402f-b887-a646a371fafd tempest-ProjectMemberTests-163191203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b1e6a2d-777a-4cd3-879d-eb7e10259c3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:31:47 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-f7a9b4a0-c1a6-402f-b887-a646a371fafd tempest-ProjectMemberTests-163191203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b1e6a2d-777a-4cd3-879d-eb7e10259c3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c625a33e-ab7a-4926-b291-84e9e2a1d28e', 'volume_name': 'volume-c625a33e-ab7a-4926-b291-84e9e2a1d28e', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:31:47 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-f7a9b4a0-c1a6-402f-b887-a646a371fafd tempest-ProjectMemberTests-163191203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f441070-398e-43fb-b3ae-31fc3402698a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:31:47 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-f7a9b4a0-c1a6-402f-b887-a646a371fafd tempest-ProjectMemberTests-163191203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f441070-398e-43fb-b3ae-31fc3402698a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:31:47 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-f7a9b4a0-c1a6-402f-b887-a646a371fafd tempest-ProjectMemberTests-163191203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (769de366-6703-4607-8f24-762ce571589c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:31:47 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-f7a9b4a0-c1a6-402f-b887-a646a371fafd tempest-ProjectMemberTests-163191203 None] Volume c625a33e-ab7a-4926-b291-84e9e2a1d28e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c625a33e-ab7a-4926-b291-84e9e2a1d28e', 'volume_size': 1} Nov 04 10:31:47 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-f7a9b4a0-c1a6-402f-b887-a646a371fafd tempest-ProjectMemberTests-163191203 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:31:47 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-f7a9b4a0-c1a6-402f-b887-a646a371fafd tempest-ProjectMemberTests-163191203 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:31:47 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-f7a9b4a0-c1a6-402f-b887-a646a371fafd tempest-ProjectMemberTests-163191203 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:31:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1367810900',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c625a33e-ab7a-4926-b291-84e9e2a1d28e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6102192fe22c4f298ee9815860bd7a9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:31:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:31:47Z,use_quota=True,user_id='df3853accc6242909d45cceeb3a0db9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 10:31:47 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-f7a9b4a0-c1a6-402f-b887-a646a371fafd tempest-ProjectMemberTests-163191203 None] Creating volume c625a33e-ab7a-4926-b291-84e9e2a1d28e {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:31:47 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-f7a9b4a0-c1a6-402f-b887-a646a371fafd tempest-ProjectMemberTests-163191203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:31:47 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-f7a9b4a0-c1a6-402f-b887-a646a371fafd tempest-ProjectMemberTests-163191203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:31:47 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-f7a9b4a0-c1a6-402f-b887-a646a371fafd tempest-ProjectMemberTests-163191203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:31:47 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-f7a9b4a0-c1a6-402f-b887-a646a371fafd tempest-ProjectMemberTests-163191203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:31:47 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-f7a9b4a0-c1a6-402f-b887-a646a371fafd tempest-ProjectMemberTests-163191203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:31:47 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-f7a9b4a0-c1a6-402f-b887-a646a371fafd tempest-ProjectMemberTests-163191203 None] Selected osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:31:47 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-f7a9b4a0-c1a6-402f-b887-a646a371fafd tempest-ProjectMemberTests-163191203 None] casted to osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 Nov 04 10:31:47 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f7a9b4a0-c1a6-402f-b887-a646a371fafd tempest-ProjectMemberTests-163191203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-c625a33e-ab7a-4926-b291-84e9e2a1d28e 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:31:47 devstack sudo[105669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-c625a33e-ab7a-4926-b291-84e9e2a1d28e 1073741824 Nov 04 10:31:47 devstack sudo[105669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:31:47 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-b5ca6ffa-49ec-4f9e-9ee2-17fc6e6726b4 tempest-ProjectReaderTests-888867065 None] Acquiring lock "cinder-30b9adcc-18f3-412d-9f1c-09f5bd23bdb1-delete_snapshot" by "delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:31:47 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-b5ca6ffa-49ec-4f9e-9ee2-17fc6e6726b4 tempest-ProjectReaderTests-888867065 None] Lock "cinder-30b9adcc-18f3-412d-9f1c-09f5bd23bdb1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:31:47 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-b5ca6ffa-49ec-4f9e-9ee2-17fc6e6726b4 tempest-ProjectReaderTests-888867065 None] Acquiring lock "cinder-quobyte-91584d48-6727-455d-8fbf-517104f072a1" by "delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:31:47 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-b5ca6ffa-49ec-4f9e-9ee2-17fc6e6726b4 tempest-ProjectReaderTests-888867065 None] Lock "cinder-quobyte-91584d48-6727-455d-8fbf-517104f072a1" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:31:47 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-b5ca6ffa-49ec-4f9e-9ee2-17fc6e6726b4 tempest-ProjectReaderTests-888867065 None] Acquiring lock "cinder-quobyte-30b9adcc-18f3-412d-9f1c-09f5bd23bdb1" by "_delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:31:47 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-b5ca6ffa-49ec-4f9e-9ee2-17fc6e6726b4 tempest-ProjectReaderTests-888867065 None] Lock "cinder-quobyte-30b9adcc-18f3-412d-9f1c-09f5bd23bdb1" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:31:47 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-b5ca6ffa-49ec-4f9e-9ee2-17fc6e6726b4 tempest-ProjectReaderTests-888867065 None] Deleting offline snapshot 30b9adcc-18f3-412d-9f1c-09f5bd23bdb1 of volume 91584d48-6727-455d-8fbf-517104f072a1 {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 10:31:47 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-b5ca6ffa-49ec-4f9e-9ee2-17fc6e6726b4 tempest-ProjectReaderTests-888867065 None] snapshot_file for this snap is: volume-91584d48-6727-455d-8fbf-517104f072a1.30b9adcc-18f3-412d-9f1c-09f5bd23bdb1 {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 10:31:47 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[8100a7e1-2e8c-48c2-b354-3b57e902fc1a]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:31:47 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-b5ca6ffa-49ec-4f9e-9ee2-17fc6e6726b4 tempest-ProjectReaderTests-888867065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-91584d48-6727-455d-8fbf-517104f072a1.30b9adcc-18f3-412d-9f1c-09f5bd23bdb1 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:31:47 devstack sudo[105671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-91584d48-6727-455d-8fbf-517104f072a1.30b9adcc-18f3-412d-9f1c-09f5bd23bdb1 Nov 04 10:31:47 devstack sudo[105671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:31:48 devstack sudo[105669]: pam_unix(sudo:session): session closed for user root Nov 04 10:31:48 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f7a9b4a0-c1a6-402f-b887-a646a371fafd tempest-ProjectMemberTests-163191203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-c625a33e-ab7a-4926-b291-84e9e2a1d28e 1073741824" returned: 0 in 0.543s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:31:48 devstack sudo[105671]: pam_unix(sudo:session): session closed for user root Nov 04 10:31:48 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-b5ca6ffa-49ec-4f9e-9ee2-17fc6e6726b4 tempest-ProjectReaderTests-888867065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-91584d48-6727-455d-8fbf-517104f072a1.30b9adcc-18f3-412d-9f1c-09f5bd23bdb1" returned: 0 in 0.407s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:31:48 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-b5ca6ffa-49ec-4f9e-9ee2-17fc6e6726b4 tempest-ProjectReaderTests-888867065 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-91584d48-6727-455d-8fbf-517104f072a1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87068) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 10:31:48 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3a10283-ffe9-4c47-a91f-3f69c0b68b21]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:31:48 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-b5ca6ffa-49ec-4f9e-9ee2-17fc6e6726b4 tempest-ProjectReaderTests-888867065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-91584d48-6727-455d-8fbf-517104f072a1 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:31:48 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f7a9b4a0-c1a6-402f-b887-a646a371fafd tempest-ProjectMemberTests-163191203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-c625a33e-ab7a-4926-b291-84e9e2a1d28e {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:31:48 devstack sudo[105695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-c625a33e-ab7a-4926-b291-84e9e2a1d28e Nov 04 10:31:48 devstack sudo[105695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:31:48 devstack sudo[105690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-91584d48-6727-455d-8fbf-517104f072a1 Nov 04 10:31:48 devstack sudo[105690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:31:48 devstack sudo[105695]: pam_unix(sudo:session): session closed for user root Nov 04 10:31:48 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f7a9b4a0-c1a6-402f-b887-a646a371fafd tempest-ProjectMemberTests-163191203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-c625a33e-ab7a-4926-b291-84e9e2a1d28e" returned: 0 in 0.333s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:31:48 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-f7a9b4a0-c1a6-402f-b887-a646a371fafd tempest-ProjectMemberTests-163191203 None] <== create_volume: return (968ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 10:31:48 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-f7a9b4a0-c1a6-402f-b887-a646a371fafd tempest-ProjectMemberTests-163191203 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.971s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:31:48 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-f7a9b4a0-c1a6-402f-b887-a646a371fafd tempest-ProjectMemberTests-163191203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (769de366-6703-4607-8f24-762ce571589c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c625a33e-ab7a-4926-b291-84e9e2a1d28e', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:31:48 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-f7a9b4a0-c1a6-402f-b887-a646a371fafd tempest-ProjectMemberTests-163191203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6da71e7d-d22c-4cfc-9aa9-05957c8d9db3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:31:48 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-f7a9b4a0-c1a6-402f-b887-a646a371fafd tempest-ProjectMemberTests-163191203 None] Volume volume-c625a33e-ab7a-4926-b291-84e9e2a1d28e (c625a33e-ab7a-4926-b291-84e9e2a1d28e): created successfully Nov 04 10:31:48 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-f7a9b4a0-c1a6-402f-b887-a646a371fafd tempest-ProjectMemberTests-163191203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6da71e7d-d22c-4cfc-9aa9-05957c8d9db3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:31:48 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-f7a9b4a0-c1a6-402f-b887-a646a371fafd tempest-ProjectMemberTests-163191203 None] Flow 'volume_create_manager' (a4561083-f346-4799-a4b3-02b346d4b21a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:31:48 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-f7a9b4a0-c1a6-402f-b887-a646a371fafd tempest-ProjectMemberTests-163191203 None] Created volume successfully. Nov 04 10:31:48 devstack sudo[105690]: pam_unix(sudo:session): session closed for user root Nov 04 10:31:48 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-b5ca6ffa-49ec-4f9e-9ee2-17fc6e6726b4 tempest-ProjectReaderTests-888867065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-91584d48-6727-455d-8fbf-517104f072a1" returned: 0 in 0.526s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:31:48 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-b5ca6ffa-49ec-4f9e-9ee2-17fc6e6726b4 tempest-ProjectReaderTests-888867065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-91584d48-6727-455d-8fbf-517104f072a1.30b9adcc-18f3-412d-9f1c-09f5bd23bdb1 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:31:48 devstack sudo[105723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-91584d48-6727-455d-8fbf-517104f072a1.30b9adcc-18f3-412d-9f1c-09f5bd23bdb1 Nov 04 10:31:48 devstack sudo[105723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:31:49 devstack sudo[105723]: pam_unix(sudo:session): session closed for user root Nov 04 10:31:49 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-b5ca6ffa-49ec-4f9e-9ee2-17fc6e6726b4 tempest-ProjectReaderTests-888867065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-91584d48-6727-455d-8fbf-517104f072a1.30b9adcc-18f3-412d-9f1c-09f5bd23bdb1" returned: 0 in 0.368s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:31:49 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-b5ca6ffa-49ec-4f9e-9ee2-17fc6e6726b4 tempest-ProjectReaderTests-888867065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-91584d48-6727-455d-8fbf-517104f072a1.30b9adcc-18f3-412d-9f1c-09f5bd23bdb1 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:31:49 devstack sudo[105730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-91584d48-6727-455d-8fbf-517104f072a1.30b9adcc-18f3-412d-9f1c-09f5bd23bdb1 Nov 04 10:31:49 devstack sudo[105730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:31:49 devstack sudo[105730]: pam_unix(sudo:session): session closed for user root Nov 04 10:31:49 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-b5ca6ffa-49ec-4f9e-9ee2-17fc6e6726b4 tempest-ProjectReaderTests-888867065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-91584d48-6727-455d-8fbf-517104f072a1.30b9adcc-18f3-412d-9f1c-09f5bd23bdb1" returned: 0 in 0.300s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:31:49 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-b5ca6ffa-49ec-4f9e-9ee2-17fc6e6726b4 tempest-ProjectReaderTests-888867065 None] Lock "cinder-quobyte-30b9adcc-18f3-412d-9f1c-09f5bd23bdb1" released by "_delete_snapshot" :: held 1.732s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:31:49 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-b5ca6ffa-49ec-4f9e-9ee2-17fc6e6726b4 tempest-ProjectReaderTests-888867065 None] Lock "cinder-quobyte-91584d48-6727-455d-8fbf-517104f072a1" released by "delete_snapshot" :: held 1.760s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:31:49 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-b5ca6ffa-49ec-4f9e-9ee2-17fc6e6726b4 tempest-ProjectReaderTests-888867065 None] Created reservations ['1304db45-493e-42c2-b74a-a77b45c2e791', '7f318c0d-604c-4083-b306-6b7dac889b07', '74130f12-4f4b-4e1e-a73d-8df3c5e9d558', '329294be-aef8-4f48-849f-a3d34e7e854a'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:31:49 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-b5ca6ffa-49ec-4f9e-9ee2-17fc6e6726b4 tempest-ProjectReaderTests-888867065 None] Delete snapshot completed successfully. Nov 04 10:31:49 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-b5ca6ffa-49ec-4f9e-9ee2-17fc6e6726b4 tempest-ProjectReaderTests-888867065 None] Lock "cinder-30b9adcc-18f3-412d-9f1c-09f5bd23bdb1-delete_snapshot" released by "delete_snapshot" :: held 1.934s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:31:49 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-f25bc12f-1ac2-4749-a8e0-0afa2a89c208 tempest-ProjectMemberTests-163191203 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:31:49 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-f25bc12f-1ac2-4749-a8e0-0afa2a89c208 tempest-ProjectMemberTests-163191203 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:31:49 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-f25bc12f-1ac2-4749-a8e0-0afa2a89c208 tempest-ProjectMemberTests-163191203 None] Creating offline snapshot 5987bbfc-ef9f-4d1d-84f1-805afac812fc of volume c625a33e-ab7a-4926-b291-84e9e2a1d28e {{(pid=87068) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 10:31:49 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[008b26f6-3e73-4338-9a84-c1ac6379102f]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:31:49 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f25bc12f-1ac2-4749-a8e0-0afa2a89c208 tempest-ProjectMemberTests-163191203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-c625a33e-ab7a-4926-b291-84e9e2a1d28e {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:31:49 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-2ec33b21-aa23-4321-862e-ab45ace62e70 tempest-ProjectReaderTests-888867065 None] Acquiring lock "cinder-91584d48-6727-455d-8fbf-517104f072a1-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:31:49 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-2ec33b21-aa23-4321-862e-ab45ace62e70 tempest-ProjectReaderTests-888867065 None] Lock "cinder-91584d48-6727-455d-8fbf-517104f072a1-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:31:49 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-2ec33b21-aa23-4321-862e-ab45ace62e70 tempest-ProjectReaderTests-888867065 None] Acquiring lock "cinder-quobyte-91584d48-6727-455d-8fbf-517104f072a1" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:31:49 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-2ec33b21-aa23-4321-862e-ab45ace62e70 tempest-ProjectReaderTests-888867065 None] Lock "cinder-quobyte-91584d48-6727-455d-8fbf-517104f072a1" acquired by "delete_volume" :: waited 0.020s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:31:49 devstack sudo[105733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-c625a33e-ab7a-4926-b291-84e9e2a1d28e Nov 04 10:31:49 devstack sudo[105733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:31:49 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[0001a8b1-8f66-4c2c-b362-6fbf00dd0df1]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:31:49 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-2ec33b21-aa23-4321-862e-ab45ace62e70 tempest-ProjectReaderTests-888867065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-91584d48-6727-455d-8fbf-517104f072a1 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:31:50 devstack sudo[105735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-91584d48-6727-455d-8fbf-517104f072a1 Nov 04 10:31:50 devstack sudo[105735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:31:50 devstack sudo[105733]: pam_unix(sudo:session): session closed for user root Nov 04 10:31:50 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f25bc12f-1ac2-4749-a8e0-0afa2a89c208 tempest-ProjectMemberTests-163191203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-c625a33e-ab7a-4926-b291-84e9e2a1d28e" returned: 0 in 0.439s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:31:50 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f25bc12f-1ac2-4749-a8e0-0afa2a89c208 tempest-ProjectMemberTests-163191203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-c625a33e-ab7a-4926-b291-84e9e2a1d28e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-c625a33e-ab7a-4926-b291-84e9e2a1d28e.5987bbfc-ef9f-4d1d-84f1-805afac812fc 1G {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:31:50 devstack sudo[105742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-c625a33e-ab7a-4926-b291-84e9e2a1d28e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-c625a33e-ab7a-4926-b291-84e9e2a1d28e.5987bbfc-ef9f-4d1d-84f1-805afac812fc 1G Nov 04 10:31:50 devstack sudo[105742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:31:50 devstack sudo[105735]: pam_unix(sudo:session): session closed for user root Nov 04 10:31:50 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-2ec33b21-aa23-4321-862e-ab45ace62e70 tempest-ProjectReaderTests-888867065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-91584d48-6727-455d-8fbf-517104f072a1" returned: 0 in 0.451s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:31:50 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-2ec33b21-aa23-4321-862e-ab45ace62e70 tempest-ProjectReaderTests-888867065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-91584d48-6727-455d-8fbf-517104f072a1 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:31:50 devstack sudo[105747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-91584d48-6727-455d-8fbf-517104f072a1 Nov 04 10:31:50 devstack sudo[105747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:31:50 devstack sudo[105747]: pam_unix(sudo:session): session closed for user root Nov 04 10:31:50 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-2ec33b21-aa23-4321-862e-ab45ace62e70 tempest-ProjectReaderTests-888867065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-91584d48-6727-455d-8fbf-517104f072a1" returned: 0 in 0.310s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:31:50 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f9e1f1c-70a6-4b6d-a0aa-2978e7343e6e tempest-SnapshotDependencyTests-1015910850 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:31:50 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-4f9e1f1c-70a6-4b6d-a0aa-2978e7343e6e tempest-SnapshotDependencyTests-1015910850 None] Flow 'volume_create_manager' (3f498d58-22bf-42fa-96d4-20d56950163d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:31:50 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-4f9e1f1c-70a6-4b6d-a0aa-2978e7343e6e tempest-SnapshotDependencyTests-1015910850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b243a16b-e329-4bd9-85dd-7dbb245e481f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:31:50 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-2ec33b21-aa23-4321-862e-ab45ace62e70 tempest-ProjectReaderTests-888867065 None] Lock "cinder-quobyte-91584d48-6727-455d-8fbf-517104f072a1" released by "delete_volume" :: held 0.865s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:31:50 devstack sudo[105742]: pam_unix(sudo:session): session closed for user root Nov 04 10:31:50 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-4f9e1f1c-70a6-4b6d-a0aa-2978e7343e6e tempest-SnapshotDependencyTests-1015910850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b243a16b-e329-4bd9-85dd-7dbb245e481f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:31:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-887708350',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa37f106-26c4-4f91-a423-dda0d57d503d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79c43f33bd664cb9b2c1cb58817e440b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:31:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:31:51Z,use_quota=True,user_id='9818a77312b646f1b62d889a0e807295',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:31:50 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-4f9e1f1c-70a6-4b6d-a0aa-2978e7343e6e tempest-SnapshotDependencyTests-1015910850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d5ca9de-3b44-4f3a-8700-9487c5b9a235) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:31:50 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-4f9e1f1c-70a6-4b6d-a0aa-2978e7343e6e tempest-SnapshotDependencyTests-1015910850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d5ca9de-3b44-4f3a-8700-9487c5b9a235) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:31:50 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-4f9e1f1c-70a6-4b6d-a0aa-2978e7343e6e tempest-SnapshotDependencyTests-1015910850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b498546e-0cc1-4f88-b640-2b23abc48796) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:31:50 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-4f9e1f1c-70a6-4b6d-a0aa-2978e7343e6e tempest-SnapshotDependencyTests-1015910850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b498546e-0cc1-4f88-b640-2b23abc48796) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa37f106-26c4-4f91-a423-dda0d57d503d', 'volume_name': 'volume-aa37f106-26c4-4f91-a423-dda0d57d503d', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:31:50 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-4f9e1f1c-70a6-4b6d-a0aa-2978e7343e6e tempest-SnapshotDependencyTests-1015910850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d2b7f78-ba94-44c9-962e-7ad6a50881fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:31:50 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-4f9e1f1c-70a6-4b6d-a0aa-2978e7343e6e tempest-SnapshotDependencyTests-1015910850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d2b7f78-ba94-44c9-962e-7ad6a50881fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:31:50 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-4f9e1f1c-70a6-4b6d-a0aa-2978e7343e6e tempest-SnapshotDependencyTests-1015910850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (879c0330-3eea-4328-85de-95ee5a8fd12c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:31:50 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-4f9e1f1c-70a6-4b6d-a0aa-2978e7343e6e tempest-SnapshotDependencyTests-1015910850 None] Volume aa37f106-26c4-4f91-a423-dda0d57d503d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa37f106-26c4-4f91-a423-dda0d57d503d', 'volume_size': 1} Nov 04 10:31:50 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-4f9e1f1c-70a6-4b6d-a0aa-2978e7343e6e tempest-SnapshotDependencyTests-1015910850 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:31:50 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f25bc12f-1ac2-4749-a8e0-0afa2a89c208 tempest-ProjectMemberTests-163191203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-c625a33e-ab7a-4926-b291-84e9e2a1d28e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-c625a33e-ab7a-4926-b291-84e9e2a1d28e.5987bbfc-ef9f-4d1d-84f1-805afac812fc 1G" returned: 0 in 0.582s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:31:50 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f25bc12f-1ac2-4749-a8e0-0afa2a89c208 tempest-ProjectMemberTests-163191203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c625a33e-ab7a-4926-b291-84e9e2a1d28e -F qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-c625a33e-ab7a-4926-b291-84e9e2a1d28e.5987bbfc-ef9f-4d1d-84f1-805afac812fc {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:31:50 devstack sudo[105754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c625a33e-ab7a-4926-b291-84e9e2a1d28e -F qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-c625a33e-ab7a-4926-b291-84e9e2a1d28e.5987bbfc-ef9f-4d1d-84f1-805afac812fc Nov 04 10:31:50 devstack sudo[105754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:31:50 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-2ec33b21-aa23-4321-862e-ab45ace62e70 tempest-ProjectReaderTests-888867065 None] Created reservations ['d0851f15-445c-4426-bc62-d9bacd200203', 'ad4ff5e2-3b38-4d28-aa5c-673a63aa9bd9', '4c2b212a-c4cd-4fd5-8a94-d6edf29f0c83', '4098bab6-9f51-4f5a-b1e3-6e2bbcb9adee'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:31:50 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-2ec33b21-aa23-4321-862e-ab45ace62e70 tempest-ProjectReaderTests-888867065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:31:50 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-2ec33b21-aa23-4321-862e-ab45ace62e70 tempest-ProjectReaderTests-888867065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:31:50 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-2ec33b21-aa23-4321-862e-ab45ace62e70 tempest-ProjectReaderTests-888867065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:31:50 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-2ec33b21-aa23-4321-862e-ab45ace62e70 tempest-ProjectReaderTests-888867065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:31:50 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-2ec33b21-aa23-4321-862e-ab45ace62e70 tempest-ProjectReaderTests-888867065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:31:50 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-2ec33b21-aa23-4321-862e-ab45ace62e70 tempest-ProjectReaderTests-888867065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:31:50 devstack sudo[105756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:31:50 devstack sudo[105756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:31:51 devstack sudo[105754]: pam_unix(sudo:session): session closed for user root Nov 04 10:31:51 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f25bc12f-1ac2-4749-a8e0-0afa2a89c208 tempest-ProjectMemberTests-163191203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c625a33e-ab7a-4926-b291-84e9e2a1d28e -F qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-c625a33e-ab7a-4926-b291-84e9e2a1d28e.5987bbfc-ef9f-4d1d-84f1-805afac812fc" returned: 0 in 0.332s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:31:51 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-f25bc12f-1ac2-4749-a8e0-0afa2a89c208 tempest-ProjectMemberTests-163191203 None] /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-c625a33e-ab7a-4926-b291-84e9e2a1d28e.5987bbfc-ef9f-4d1d-84f1-805afac812fc is being set with open permissions: ugo+rw Nov 04 10:31:51 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f25bc12f-1ac2-4749-a8e0-0afa2a89c208 tempest-ProjectMemberTests-163191203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-c625a33e-ab7a-4926-b291-84e9e2a1d28e.5987bbfc-ef9f-4d1d-84f1-805afac812fc {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:31:51 devstack sudo[105761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-c625a33e-ab7a-4926-b291-84e9e2a1d28e.5987bbfc-ef9f-4d1d-84f1-805afac812fc Nov 04 10:31:51 devstack sudo[105761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:31:51 devstack sudo[105756]: pam_unix(sudo:session): session closed for user root Nov 04 10:31:51 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-2ec33b21-aa23-4321-862e-ab45ace62e70 tempest-ProjectReaderTests-888867065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.257s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:31:51 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-2ec33b21-aa23-4321-862e-ab45ace62e70 tempest-ProjectReaderTests-888867065 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:31:51 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-2ec33b21-aa23-4321-862e-ab45ace62e70 tempest-ProjectReaderTests-888867065 None] Deleted volume successfully. Nov 04 10:31:51 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-2ec33b21-aa23-4321-862e-ab45ace62e70 tempest-ProjectReaderTests-888867065 None] Lock "cinder-91584d48-6727-455d-8fbf-517104f072a1-delete_volume" released by "delete_volume" :: held 1.423s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:31:51 devstack sudo[105761]: pam_unix(sudo:session): session closed for user root Nov 04 10:31:51 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f25bc12f-1ac2-4749-a8e0-0afa2a89c208 tempest-ProjectMemberTests-163191203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-c625a33e-ab7a-4926-b291-84e9e2a1d28e.5987bbfc-ef9f-4d1d-84f1-805afac812fc" returned: 0 in 0.282s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:31:51 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f25bc12f-1ac2-4749-a8e0-0afa2a89c208 tempest-ProjectMemberTests-163191203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-c625a33e-ab7a-4926-b291-84e9e2a1d28e.info {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:31:51 devstack sudo[105765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-c625a33e-ab7a-4926-b291-84e9e2a1d28e.info Nov 04 10:31:51 devstack sudo[105765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:31:51 devstack sudo[105765]: pam_unix(sudo:session): session closed for user root Nov 04 10:31:51 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f25bc12f-1ac2-4749-a8e0-0afa2a89c208 tempest-ProjectMemberTests-163191203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-c625a33e-ab7a-4926-b291-84e9e2a1d28e.info" returned: 0 in 0.274s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:31:51 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-f25bc12f-1ac2-4749-a8e0-0afa2a89c208 tempest-ProjectMemberTests-163191203 None] /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-c625a33e-ab7a-4926-b291-84e9e2a1d28e.info is being set with open permissions: ugo+rw Nov 04 10:31:51 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f25bc12f-1ac2-4749-a8e0-0afa2a89c208 tempest-ProjectMemberTests-163191203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-c625a33e-ab7a-4926-b291-84e9e2a1d28e.info {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:31:51 devstack sudo[105768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-c625a33e-ab7a-4926-b291-84e9e2a1d28e.info Nov 04 10:31:51 devstack sudo[105768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:31:51 devstack sudo[105768]: pam_unix(sudo:session): session closed for user root Nov 04 10:31:51 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f25bc12f-1ac2-4749-a8e0-0afa2a89c208 tempest-ProjectMemberTests-163191203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-c625a33e-ab7a-4926-b291-84e9e2a1d28e.info" returned: 0 in 0.249s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:31:51 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-f25bc12f-1ac2-4749-a8e0-0afa2a89c208 tempest-ProjectMemberTests-163191203 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.262s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:31:51 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-4f9e1f1c-70a6-4b6d-a0aa-2978e7343e6e tempest-SnapshotDependencyTests-1015910850 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.206s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:31:51 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-4f9e1f1c-70a6-4b6d-a0aa-2978e7343e6e tempest-SnapshotDependencyTests-1015910850 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:31:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-887708350',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa37f106-26c4-4f91-a423-dda0d57d503d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79c43f33bd664cb9b2c1cb58817e440b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:31:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:31:51Z,use_quota=True,user_id='9818a77312b646f1b62d889a0e807295',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 10:31:51 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-4f9e1f1c-70a6-4b6d-a0aa-2978e7343e6e tempest-SnapshotDependencyTests-1015910850 None] Creating volume aa37f106-26c4-4f91-a423-dda0d57d503d {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:31:51 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-4f9e1f1c-70a6-4b6d-a0aa-2978e7343e6e tempest-SnapshotDependencyTests-1015910850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:31:51 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-4f9e1f1c-70a6-4b6d-a0aa-2978e7343e6e tempest-SnapshotDependencyTests-1015910850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:31:51 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-4f9e1f1c-70a6-4b6d-a0aa-2978e7343e6e tempest-SnapshotDependencyTests-1015910850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:31:51 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-4f9e1f1c-70a6-4b6d-a0aa-2978e7343e6e tempest-SnapshotDependencyTests-1015910850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:31:51 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-4f9e1f1c-70a6-4b6d-a0aa-2978e7343e6e tempest-SnapshotDependencyTests-1015910850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:31:51 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-4f9e1f1c-70a6-4b6d-a0aa-2978e7343e6e tempest-SnapshotDependencyTests-1015910850 None] Selected osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:31:51 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-4f9e1f1c-70a6-4b6d-a0aa-2978e7343e6e tempest-SnapshotDependencyTests-1015910850 None] casted to osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 Nov 04 10:31:51 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-4f9e1f1c-70a6-4b6d-a0aa-2978e7343e6e tempest-SnapshotDependencyTests-1015910850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-aa37f106-26c4-4f91-a423-dda0d57d503d 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:31:52 devstack sudo[105771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-aa37f106-26c4-4f91-a423-dda0d57d503d 1073741824 Nov 04 10:31:52 devstack sudo[105771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:31:52 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-f25bc12f-1ac2-4749-a8e0-0afa2a89c208 tempest-ProjectMemberTests-163191203 None] Create snapshot completed successfully Nov 04 10:31:52 devstack sudo[105771]: pam_unix(sudo:session): session closed for user root Nov 04 10:31:52 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-4f9e1f1c-70a6-4b6d-a0aa-2978e7343e6e tempest-SnapshotDependencyTests-1015910850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-aa37f106-26c4-4f91-a423-dda0d57d503d 1073741824" returned: 0 in 0.474s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:31:52 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-4f9e1f1c-70a6-4b6d-a0aa-2978e7343e6e tempest-SnapshotDependencyTests-1015910850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-aa37f106-26c4-4f91-a423-dda0d57d503d {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:31:52 devstack sudo[105777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-aa37f106-26c4-4f91-a423-dda0d57d503d Nov 04 10:31:52 devstack sudo[105777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:31:52 devstack sudo[105777]: pam_unix(sudo:session): session closed for user root Nov 04 10:31:52 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-4f9e1f1c-70a6-4b6d-a0aa-2978e7343e6e tempest-SnapshotDependencyTests-1015910850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-aa37f106-26c4-4f91-a423-dda0d57d503d" returned: 0 in 0.255s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:31:52 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-4f9e1f1c-70a6-4b6d-a0aa-2978e7343e6e tempest-SnapshotDependencyTests-1015910850 None] <== create_volume: return (770ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 10:31:52 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-4f9e1f1c-70a6-4b6d-a0aa-2978e7343e6e tempest-SnapshotDependencyTests-1015910850 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.773s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:31:52 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-4f9e1f1c-70a6-4b6d-a0aa-2978e7343e6e tempest-SnapshotDependencyTests-1015910850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (879c0330-3eea-4328-85de-95ee5a8fd12c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa37f106-26c4-4f91-a423-dda0d57d503d', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:31:52 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-4f9e1f1c-70a6-4b6d-a0aa-2978e7343e6e tempest-SnapshotDependencyTests-1015910850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10ea976e-ef04-4414-baec-beb3df0f7a44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:31:52 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-4f9e1f1c-70a6-4b6d-a0aa-2978e7343e6e tempest-SnapshotDependencyTests-1015910850 None] Volume volume-aa37f106-26c4-4f91-a423-dda0d57d503d (aa37f106-26c4-4f91-a423-dda0d57d503d): created successfully Nov 04 10:31:52 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-4f9e1f1c-70a6-4b6d-a0aa-2978e7343e6e tempest-SnapshotDependencyTests-1015910850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10ea976e-ef04-4414-baec-beb3df0f7a44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:31:52 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-4f9e1f1c-70a6-4b6d-a0aa-2978e7343e6e tempest-SnapshotDependencyTests-1015910850 None] Flow 'volume_create_manager' (3f498d58-22bf-42fa-96d4-20d56950163d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:31:52 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-4f9e1f1c-70a6-4b6d-a0aa-2978e7343e6e tempest-SnapshotDependencyTests-1015910850 None] Created volume successfully. Nov 04 10:31:52 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-60ac058b-a387-479b-bf59-7375476a6d6f tempest-ProjectMemberTests-163191203 None] Acquiring lock "cinder-5987bbfc-ef9f-4d1d-84f1-805afac812fc-delete_snapshot" by "delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:31:52 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-60ac058b-a387-479b-bf59-7375476a6d6f tempest-ProjectMemberTests-163191203 None] Lock "cinder-5987bbfc-ef9f-4d1d-84f1-805afac812fc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:31:52 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-60ac058b-a387-479b-bf59-7375476a6d6f tempest-ProjectMemberTests-163191203 None] Acquiring lock "cinder-quobyte-c625a33e-ab7a-4926-b291-84e9e2a1d28e" by "delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:31:52 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-60ac058b-a387-479b-bf59-7375476a6d6f tempest-ProjectMemberTests-163191203 None] Lock "cinder-quobyte-c625a33e-ab7a-4926-b291-84e9e2a1d28e" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:31:52 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-60ac058b-a387-479b-bf59-7375476a6d6f tempest-ProjectMemberTests-163191203 None] Acquiring lock "cinder-quobyte-5987bbfc-ef9f-4d1d-84f1-805afac812fc" by "_delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:31:52 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-60ac058b-a387-479b-bf59-7375476a6d6f tempest-ProjectMemberTests-163191203 None] Lock "cinder-quobyte-5987bbfc-ef9f-4d1d-84f1-805afac812fc" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:31:52 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-60ac058b-a387-479b-bf59-7375476a6d6f tempest-ProjectMemberTests-163191203 None] Deleting offline snapshot 5987bbfc-ef9f-4d1d-84f1-805afac812fc of volume c625a33e-ab7a-4926-b291-84e9e2a1d28e {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 10:31:52 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-60ac058b-a387-479b-bf59-7375476a6d6f tempest-ProjectMemberTests-163191203 None] snapshot_file for this snap is: volume-c625a33e-ab7a-4926-b291-84e9e2a1d28e.5987bbfc-ef9f-4d1d-84f1-805afac812fc {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 10:31:52 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[02e79816-932f-422f-802f-bce89816ee6c]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:31:52 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-60ac058b-a387-479b-bf59-7375476a6d6f tempest-ProjectMemberTests-163191203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-c625a33e-ab7a-4926-b291-84e9e2a1d28e.5987bbfc-ef9f-4d1d-84f1-805afac812fc {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:31:53 devstack sudo[105781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-c625a33e-ab7a-4926-b291-84e9e2a1d28e.5987bbfc-ef9f-4d1d-84f1-805afac812fc Nov 04 10:31:53 devstack sudo[105781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:31:53 devstack sudo[105781]: pam_unix(sudo:session): session closed for user root Nov 04 10:31:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-60ac058b-a387-479b-bf59-7375476a6d6f tempest-ProjectMemberTests-163191203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-c625a33e-ab7a-4926-b291-84e9e2a1d28e.5987bbfc-ef9f-4d1d-84f1-805afac812fc" returned: 0 in 0.371s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:31:53 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-60ac058b-a387-479b-bf59-7375476a6d6f tempest-ProjectMemberTests-163191203 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c625a33e-ab7a-4926-b291-84e9e2a1d28e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87068) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 10:31:53 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc9e815b-bef9-422d-97b7-ec6817578b6d]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:31:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-60ac058b-a387-479b-bf59-7375476a6d6f tempest-ProjectMemberTests-163191203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-c625a33e-ab7a-4926-b291-84e9e2a1d28e {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:31:53 devstack sudo[105789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-c625a33e-ab7a-4926-b291-84e9e2a1d28e Nov 04 10:31:53 devstack sudo[105789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:31:53 devstack sudo[105789]: pam_unix(sudo:session): session closed for user root Nov 04 10:31:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-60ac058b-a387-479b-bf59-7375476a6d6f tempest-ProjectMemberTests-163191203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-c625a33e-ab7a-4926-b291-84e9e2a1d28e" returned: 0 in 0.390s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:31:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-60ac058b-a387-479b-bf59-7375476a6d6f tempest-ProjectMemberTests-163191203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-c625a33e-ab7a-4926-b291-84e9e2a1d28e.5987bbfc-ef9f-4d1d-84f1-805afac812fc {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:31:53 devstack cinder-volume[87068]: DEBUG oslo_service.periodic_task [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87068) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 10:31:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:31:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:31:53 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:31:53 devstack sudo[105794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-c625a33e-ab7a-4926-b291-84e9e2a1d28e.5987bbfc-ef9f-4d1d-84f1-805afac812fc Nov 04 10:31:53 devstack sudo[105794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:31:53 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:31:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:31:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:31:53 devstack sudo[105796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:31:53 devstack sudo[105796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:31:54 devstack sudo[105796]: pam_unix(sudo:session): session closed for user root Nov 04 10:31:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.292s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:31:54 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:31:54 devstack cinder-volume[87068]: DEBUG oslo_service.periodic_task [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Running periodic task VolumeManager._thread_info {{(pid=87068) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 10:31:54 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] thread count: 28 {{(pid=87068) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 04 10:31:54 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] thread info: [<_MainThread(MainThread, started 126275656192128)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87068) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 04 10:31:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-9d838d93-6cc6-42de-866c-b6210b3ab7a6 tempest-SnapshotDependencyTests-1015910850 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:31:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-9d838d93-6cc6-42de-866c-b6210b3ab7a6 tempest-SnapshotDependencyTests-1015910850 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:31:54 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-9d838d93-6cc6-42de-866c-b6210b3ab7a6 tempest-SnapshotDependencyTests-1015910850 None] Creating offline snapshot a29d2335-8b38-4255-88bb-8414fef91518 of volume aa37f106-26c4-4f91-a423-dda0d57d503d {{(pid=87068) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 10:31:54 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[23720150-e92b-4d8a-825f-e0f57d216f64]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:31:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-9d838d93-6cc6-42de-866c-b6210b3ab7a6 tempest-SnapshotDependencyTests-1015910850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-aa37f106-26c4-4f91-a423-dda0d57d503d {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:31:54 devstack sudo[105794]: pam_unix(sudo:session): session closed for user root Nov 04 10:31:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-60ac058b-a387-479b-bf59-7375476a6d6f tempest-ProjectMemberTests-163191203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-c625a33e-ab7a-4926-b291-84e9e2a1d28e.5987bbfc-ef9f-4d1d-84f1-805afac812fc" returned: 0 in 0.431s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:31:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-60ac058b-a387-479b-bf59-7375476a6d6f tempest-ProjectMemberTests-163191203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-c625a33e-ab7a-4926-b291-84e9e2a1d28e.5987bbfc-ef9f-4d1d-84f1-805afac812fc {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:31:54 devstack sudo[105803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-c625a33e-ab7a-4926-b291-84e9e2a1d28e.5987bbfc-ef9f-4d1d-84f1-805afac812fc Nov 04 10:31:54 devstack sudo[105803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:31:54 devstack sudo[105802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-aa37f106-26c4-4f91-a423-dda0d57d503d Nov 04 10:31:54 devstack sudo[105802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:31:54 devstack sudo[105803]: pam_unix(sudo:session): session closed for user root Nov 04 10:31:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-60ac058b-a387-479b-bf59-7375476a6d6f tempest-ProjectMemberTests-163191203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-c625a33e-ab7a-4926-b291-84e9e2a1d28e.5987bbfc-ef9f-4d1d-84f1-805afac812fc" returned: 0 in 0.268s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:31:54 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-60ac058b-a387-479b-bf59-7375476a6d6f tempest-ProjectMemberTests-163191203 None] Lock "cinder-quobyte-5987bbfc-ef9f-4d1d-84f1-805afac812fc" released by "_delete_snapshot" :: held 1.573s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:31:54 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-60ac058b-a387-479b-bf59-7375476a6d6f tempest-ProjectMemberTests-163191203 None] Lock "cinder-quobyte-c625a33e-ab7a-4926-b291-84e9e2a1d28e" released by "delete_snapshot" :: held 1.599s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:31:54 devstack sudo[105802]: pam_unix(sudo:session): session closed for user root Nov 04 10:31:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-9d838d93-6cc6-42de-866c-b6210b3ab7a6 tempest-SnapshotDependencyTests-1015910850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-aa37f106-26c4-4f91-a423-dda0d57d503d" returned: 0 in 0.418s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:31:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-9d838d93-6cc6-42de-866c-b6210b3ab7a6 tempest-SnapshotDependencyTests-1015910850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-aa37f106-26c4-4f91-a423-dda0d57d503d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-aa37f106-26c4-4f91-a423-dda0d57d503d.a29d2335-8b38-4255-88bb-8414fef91518 1G {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:31:54 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-60ac058b-a387-479b-bf59-7375476a6d6f tempest-ProjectMemberTests-163191203 None] Created reservations ['f7cbde4e-fa18-4c3a-abf9-557d1526c2c9', '3f6f5d45-732e-4bac-b81b-03579c78539c', '48cdf746-8f65-4332-a5c7-8410c64ab5e5', 'c607c9b4-1d99-4781-97ee-fee2b48b59e2'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:31:54 devstack sudo[105811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-aa37f106-26c4-4f91-a423-dda0d57d503d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-aa37f106-26c4-4f91-a423-dda0d57d503d.a29d2335-8b38-4255-88bb-8414fef91518 1G Nov 04 10:31:54 devstack sudo[105811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:31:54 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-60ac058b-a387-479b-bf59-7375476a6d6f tempest-ProjectMemberTests-163191203 None] Delete snapshot completed successfully. Nov 04 10:31:54 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-60ac058b-a387-479b-bf59-7375476a6d6f tempest-ProjectMemberTests-163191203 None] Lock "cinder-5987bbfc-ef9f-4d1d-84f1-805afac812fc-delete_snapshot" released by "delete_snapshot" :: held 1.772s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:31:55 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-ce04280a-c0fd-4a02-8d8a-de644b27dfde tempest-ProjectMemberTests-163191203 None] Acquiring lock "cinder-c625a33e-ab7a-4926-b291-84e9e2a1d28e-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:31:55 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-ce04280a-c0fd-4a02-8d8a-de644b27dfde tempest-ProjectMemberTests-163191203 None] Lock "cinder-c625a33e-ab7a-4926-b291-84e9e2a1d28e-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:31:55 devstack sudo[105811]: pam_unix(sudo:session): session closed for user root Nov 04 10:31:55 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-9d838d93-6cc6-42de-866c-b6210b3ab7a6 tempest-SnapshotDependencyTests-1015910850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-aa37f106-26c4-4f91-a423-dda0d57d503d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-aa37f106-26c4-4f91-a423-dda0d57d503d.a29d2335-8b38-4255-88bb-8414fef91518 1G" returned: 0 in 0.532s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:31:55 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-9d838d93-6cc6-42de-866c-b6210b3ab7a6 tempest-SnapshotDependencyTests-1015910850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aa37f106-26c4-4f91-a423-dda0d57d503d -F qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-aa37f106-26c4-4f91-a423-dda0d57d503d.a29d2335-8b38-4255-88bb-8414fef91518 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:31:55 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-ce04280a-c0fd-4a02-8d8a-de644b27dfde tempest-ProjectMemberTests-163191203 None] Acquiring lock "cinder-quobyte-c625a33e-ab7a-4926-b291-84e9e2a1d28e" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:31:55 devstack sudo[105817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aa37f106-26c4-4f91-a423-dda0d57d503d -F qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-aa37f106-26c4-4f91-a423-dda0d57d503d.a29d2335-8b38-4255-88bb-8414fef91518 Nov 04 10:31:55 devstack sudo[105817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:31:55 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-ce04280a-c0fd-4a02-8d8a-de644b27dfde tempest-ProjectMemberTests-163191203 None] Lock "cinder-quobyte-c625a33e-ab7a-4926-b291-84e9e2a1d28e" acquired by "delete_volume" :: waited 0.020s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:31:55 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[056f9e38-b99a-4b18-9f55-165ab36389ef]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:31:55 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ce04280a-c0fd-4a02-8d8a-de644b27dfde tempest-ProjectMemberTests-163191203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-c625a33e-ab7a-4926-b291-84e9e2a1d28e {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:31:55 devstack sudo[105819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-c625a33e-ab7a-4926-b291-84e9e2a1d28e Nov 04 10:31:55 devstack sudo[105819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:31:55 devstack sudo[105817]: pam_unix(sudo:session): session closed for user root Nov 04 10:31:55 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-9d838d93-6cc6-42de-866c-b6210b3ab7a6 tempest-SnapshotDependencyTests-1015910850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aa37f106-26c4-4f91-a423-dda0d57d503d -F qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-aa37f106-26c4-4f91-a423-dda0d57d503d.a29d2335-8b38-4255-88bb-8414fef91518" returned: 0 in 0.362s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:31:55 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-9d838d93-6cc6-42de-866c-b6210b3ab7a6 tempest-SnapshotDependencyTests-1015910850 None] /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-aa37f106-26c4-4f91-a423-dda0d57d503d.a29d2335-8b38-4255-88bb-8414fef91518 is being set with open permissions: ugo+rw Nov 04 10:31:55 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-9d838d93-6cc6-42de-866c-b6210b3ab7a6 tempest-SnapshotDependencyTests-1015910850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-aa37f106-26c4-4f91-a423-dda0d57d503d.a29d2335-8b38-4255-88bb-8414fef91518 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:31:55 devstack sudo[105824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-aa37f106-26c4-4f91-a423-dda0d57d503d.a29d2335-8b38-4255-88bb-8414fef91518 Nov 04 10:31:55 devstack sudo[105824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:31:55 devstack sudo[105819]: pam_unix(sudo:session): session closed for user root Nov 04 10:31:55 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ce04280a-c0fd-4a02-8d8a-de644b27dfde tempest-ProjectMemberTests-163191203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-c625a33e-ab7a-4926-b291-84e9e2a1d28e" returned: 0 in 0.432s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:31:55 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ce04280a-c0fd-4a02-8d8a-de644b27dfde tempest-ProjectMemberTests-163191203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-c625a33e-ab7a-4926-b291-84e9e2a1d28e {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:31:55 devstack sudo[105829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-c625a33e-ab7a-4926-b291-84e9e2a1d28e Nov 04 10:31:55 devstack sudo[105829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:31:55 devstack sudo[105824]: pam_unix(sudo:session): session closed for user root Nov 04 10:31:55 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-9d838d93-6cc6-42de-866c-b6210b3ab7a6 tempest-SnapshotDependencyTests-1015910850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-aa37f106-26c4-4f91-a423-dda0d57d503d.a29d2335-8b38-4255-88bb-8414fef91518" returned: 0 in 0.276s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:31:55 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-9d838d93-6cc6-42de-866c-b6210b3ab7a6 tempest-SnapshotDependencyTests-1015910850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-aa37f106-26c4-4f91-a423-dda0d57d503d.info {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:31:55 devstack sudo[105832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-aa37f106-26c4-4f91-a423-dda0d57d503d.info Nov 04 10:31:55 devstack sudo[105832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:31:55 devstack sudo[105829]: pam_unix(sudo:session): session closed for user root Nov 04 10:31:55 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ce04280a-c0fd-4a02-8d8a-de644b27dfde tempest-ProjectMemberTests-163191203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-c625a33e-ab7a-4926-b291-84e9e2a1d28e" returned: 0 in 0.273s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:31:55 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-ce04280a-c0fd-4a02-8d8a-de644b27dfde tempest-ProjectMemberTests-163191203 None] Lock "cinder-quobyte-c625a33e-ab7a-4926-b291-84e9e2a1d28e" released by "delete_volume" :: held 0.795s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:31:56 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-ce04280a-c0fd-4a02-8d8a-de644b27dfde tempest-ProjectMemberTests-163191203 None] Created reservations ['8cd8a4aa-dae9-4dad-ae65-82c19dc9bc2c', 'f4770b5b-ae4f-42c4-8bee-82209fca8195', '05beba1a-7194-43f5-92b8-999c400eb49e', '8f3c2865-96ab-44b8-8d8f-161dbea582eb'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:31:56 devstack sudo[105832]: pam_unix(sudo:session): session closed for user root Nov 04 10:31:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-9d838d93-6cc6-42de-866c-b6210b3ab7a6 tempest-SnapshotDependencyTests-1015910850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-aa37f106-26c4-4f91-a423-dda0d57d503d.info" returned: 0 in 0.283s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:31:56 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-9d838d93-6cc6-42de-866c-b6210b3ab7a6 tempest-SnapshotDependencyTests-1015910850 None] /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-aa37f106-26c4-4f91-a423-dda0d57d503d.info is being set with open permissions: ugo+rw Nov 04 10:31:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-9d838d93-6cc6-42de-866c-b6210b3ab7a6 tempest-SnapshotDependencyTests-1015910850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-aa37f106-26c4-4f91-a423-dda0d57d503d.info {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:31:56 devstack sudo[105836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-aa37f106-26c4-4f91-a423-dda0d57d503d.info Nov 04 10:31:56 devstack sudo[105836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:31:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-ce04280a-c0fd-4a02-8d8a-de644b27dfde tempest-ProjectMemberTests-163191203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:31:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-ce04280a-c0fd-4a02-8d8a-de644b27dfde tempest-ProjectMemberTests-163191203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:31:56 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-ce04280a-c0fd-4a02-8d8a-de644b27dfde tempest-ProjectMemberTests-163191203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:31:56 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-ce04280a-c0fd-4a02-8d8a-de644b27dfde tempest-ProjectMemberTests-163191203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:31:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-ce04280a-c0fd-4a02-8d8a-de644b27dfde tempest-ProjectMemberTests-163191203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:31:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ce04280a-c0fd-4a02-8d8a-de644b27dfde tempest-ProjectMemberTests-163191203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:31:56 devstack sudo[105838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:31:56 devstack sudo[105838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:31:56 devstack sudo[105836]: pam_unix(sudo:session): session closed for user root Nov 04 10:31:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-9d838d93-6cc6-42de-866c-b6210b3ab7a6 tempest-SnapshotDependencyTests-1015910850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-aa37f106-26c4-4f91-a423-dda0d57d503d.info" returned: 0 in 0.318s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:31:56 devstack sudo[105838]: pam_unix(sudo:session): session closed for user root Nov 04 10:31:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-9d838d93-6cc6-42de-866c-b6210b3ab7a6 tempest-SnapshotDependencyTests-1015910850 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.307s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:31:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ce04280a-c0fd-4a02-8d8a-de644b27dfde tempest-ProjectMemberTests-163191203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.314s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:31:56 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-ce04280a-c0fd-4a02-8d8a-de644b27dfde tempest-ProjectMemberTests-163191203 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:31:56 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-ce04280a-c0fd-4a02-8d8a-de644b27dfde tempest-ProjectMemberTests-163191203 None] Deleted volume successfully. Nov 04 10:31:56 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-9d838d93-6cc6-42de-866c-b6210b3ab7a6 tempest-SnapshotDependencyTests-1015910850 None] Create snapshot completed successfully Nov 04 10:31:56 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-ce04280a-c0fd-4a02-8d8a-de644b27dfde tempest-ProjectMemberTests-163191203 None] Lock "cinder-c625a33e-ab7a-4926-b291-84e9e2a1d28e-delete_volume" released by "delete_volume" :: held 1.416s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:31:56 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-59c6c949-b207-436b-b43d-ddbc51108750 tempest-ProjectMemberTests-163191203 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:31:56 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-59c6c949-b207-436b-b43d-ddbc51108750 tempest-ProjectMemberTests-163191203 None] Flow 'volume_create_manager' (3db9ecfe-24b6-4c38-b8d6-5c098cbc5df7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:31:56 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-59c6c949-b207-436b-b43d-ddbc51108750 tempest-ProjectMemberTests-163191203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56dfb171-4cc3-4036-a451-44ee54186751) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:31:56 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-59c6c949-b207-436b-b43d-ddbc51108750 tempest-ProjectMemberTests-163191203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56dfb171-4cc3-4036-a451-44ee54186751) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:31:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-45891558',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0925c0c-e093-4132-a4ba-48739999ad8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6102192fe22c4f298ee9815860bd7a9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:31:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:31:57Z,use_quota=True,user_id='df3853accc6242909d45cceeb3a0db9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:31:56 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-59c6c949-b207-436b-b43d-ddbc51108750 tempest-ProjectMemberTests-163191203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebed3ba6-dc90-4a93-bb6d-f9490d9a20f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:31:56 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-59c6c949-b207-436b-b43d-ddbc51108750 tempest-ProjectMemberTests-163191203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebed3ba6-dc90-4a93-bb6d-f9490d9a20f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:31:56 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-59c6c949-b207-436b-b43d-ddbc51108750 tempest-ProjectMemberTests-163191203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5591ea61-5550-4f86-a22b-925cd9d72642) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:31:56 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-59c6c949-b207-436b-b43d-ddbc51108750 tempest-ProjectMemberTests-163191203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5591ea61-5550-4f86-a22b-925cd9d72642) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f0925c0c-e093-4132-a4ba-48739999ad8a', 'volume_name': 'volume-f0925c0c-e093-4132-a4ba-48739999ad8a', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:31:56 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-59c6c949-b207-436b-b43d-ddbc51108750 tempest-ProjectMemberTests-163191203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f72a02bb-0639-4e56-8c8c-810a49782258) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:31:56 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-59c6c949-b207-436b-b43d-ddbc51108750 tempest-ProjectMemberTests-163191203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f72a02bb-0639-4e56-8c8c-810a49782258) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:31:56 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-59c6c949-b207-436b-b43d-ddbc51108750 tempest-ProjectMemberTests-163191203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff8bbf2d-4638-4156-b170-486720830518) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:31:56 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-59c6c949-b207-436b-b43d-ddbc51108750 tempest-ProjectMemberTests-163191203 None] Volume f0925c0c-e093-4132-a4ba-48739999ad8a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f0925c0c-e093-4132-a4ba-48739999ad8a', 'volume_size': 1} Nov 04 10:31:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-59c6c949-b207-436b-b43d-ddbc51108750 tempest-ProjectMemberTests-163191203 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:31:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-59c6c949-b207-436b-b43d-ddbc51108750 tempest-ProjectMemberTests-163191203 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:31:56 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-59c6c949-b207-436b-b43d-ddbc51108750 tempest-ProjectMemberTests-163191203 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:31:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-45891558',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0925c0c-e093-4132-a4ba-48739999ad8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6102192fe22c4f298ee9815860bd7a9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:31:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:31:57Z,use_quota=True,user_id='df3853accc6242909d45cceeb3a0db9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 10:31:56 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-59c6c949-b207-436b-b43d-ddbc51108750 tempest-ProjectMemberTests-163191203 None] Creating volume f0925c0c-e093-4132-a4ba-48739999ad8a {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:31:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-59c6c949-b207-436b-b43d-ddbc51108750 tempest-ProjectMemberTests-163191203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:31:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-59c6c949-b207-436b-b43d-ddbc51108750 tempest-ProjectMemberTests-163191203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:31:56 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-59c6c949-b207-436b-b43d-ddbc51108750 tempest-ProjectMemberTests-163191203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:31:56 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-59c6c949-b207-436b-b43d-ddbc51108750 tempest-ProjectMemberTests-163191203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:31:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-59c6c949-b207-436b-b43d-ddbc51108750 tempest-ProjectMemberTests-163191203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:31:56 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-59c6c949-b207-436b-b43d-ddbc51108750 tempest-ProjectMemberTests-163191203 None] Selected osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:31:56 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-59c6c949-b207-436b-b43d-ddbc51108750 tempest-ProjectMemberTests-163191203 None] casted to osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 Nov 04 10:31:56 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-59c6c949-b207-436b-b43d-ddbc51108750 tempest-ProjectMemberTests-163191203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-f0925c0c-e093-4132-a4ba-48739999ad8a 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:31:56 devstack sudo[105842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-f0925c0c-e093-4132-a4ba-48739999ad8a 1073741824 Nov 04 10:31:56 devstack sudo[105842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:31:57 devstack sudo[105842]: pam_unix(sudo:session): session closed for user root Nov 04 10:31:57 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-59c6c949-b207-436b-b43d-ddbc51108750 tempest-ProjectMemberTests-163191203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-f0925c0c-e093-4132-a4ba-48739999ad8a 1073741824" returned: 0 in 0.484s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:31:57 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-59c6c949-b207-436b-b43d-ddbc51108750 tempest-ProjectMemberTests-163191203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-f0925c0c-e093-4132-a4ba-48739999ad8a {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:31:57 devstack sudo[105848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-f0925c0c-e093-4132-a4ba-48739999ad8a Nov 04 10:31:57 devstack sudo[105848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:31:57 devstack sudo[105848]: pam_unix(sudo:session): session closed for user root Nov 04 10:31:57 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-59c6c949-b207-436b-b43d-ddbc51108750 tempest-ProjectMemberTests-163191203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-f0925c0c-e093-4132-a4ba-48739999ad8a" returned: 0 in 0.305s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:31:57 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-59c6c949-b207-436b-b43d-ddbc51108750 tempest-ProjectMemberTests-163191203 None] <== create_volume: return (876ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 10:31:57 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-59c6c949-b207-436b-b43d-ddbc51108750 tempest-ProjectMemberTests-163191203 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.880s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:31:57 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-59c6c949-b207-436b-b43d-ddbc51108750 tempest-ProjectMemberTests-163191203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff8bbf2d-4638-4156-b170-486720830518) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0925c0c-e093-4132-a4ba-48739999ad8a', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:31:57 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-59c6c949-b207-436b-b43d-ddbc51108750 tempest-ProjectMemberTests-163191203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b7c95b0-242c-4ca3-bae4-1d66ce7dc1c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:31:57 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-59c6c949-b207-436b-b43d-ddbc51108750 tempest-ProjectMemberTests-163191203 None] Volume volume-f0925c0c-e093-4132-a4ba-48739999ad8a (f0925c0c-e093-4132-a4ba-48739999ad8a): created successfully Nov 04 10:31:57 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-59c6c949-b207-436b-b43d-ddbc51108750 tempest-ProjectMemberTests-163191203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b7c95b0-242c-4ca3-bae4-1d66ce7dc1c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:31:57 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-59c6c949-b207-436b-b43d-ddbc51108750 tempest-ProjectMemberTests-163191203 None] Flow 'volume_create_manager' (3db9ecfe-24b6-4c38-b8d6-5c098cbc5df7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:31:57 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-59c6c949-b207-436b-b43d-ddbc51108750 tempest-ProjectMemberTests-163191203 None] Created volume successfully. Nov 04 10:31:58 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0f546c4-06cc-4124-9432-33dd1e6571d1 tempest-SnapshotDependencyTests-1015910850 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:31:58 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-f0f546c4-06cc-4124-9432-33dd1e6571d1 tempest-SnapshotDependencyTests-1015910850 None] Flow 'volume_create_manager' (ca01b66c-fec6-4d61-8100-1917950aa673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:31:58 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-f0f546c4-06cc-4124-9432-33dd1e6571d1 tempest-SnapshotDependencyTests-1015910850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15d46935-1e02-4b6c-a4ab-93505ed9deef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:31:58 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-f0f546c4-06cc-4124-9432-33dd1e6571d1 tempest-SnapshotDependencyTests-1015910850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15d46935-1e02-4b6c-a4ab-93505ed9deef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:31:58Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=471b92c1-3e77-4bb7-b07e-88b3e4b62352,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79c43f33bd664cb9b2c1cb58817e440b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:31:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=a29d2335-8b38-4255-88bb-8414fef91518,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:31:58Z,use_quota=True,user_id='9818a77312b646f1b62d889a0e807295',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:31:58 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-f0f546c4-06cc-4124-9432-33dd1e6571d1 tempest-SnapshotDependencyTests-1015910850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18f17117-6d70-415c-8619-d1ff116f51a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:31:58 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-f0f546c4-06cc-4124-9432-33dd1e6571d1 tempest-SnapshotDependencyTests-1015910850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18f17117-6d70-415c-8619-d1ff116f51a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:31:58 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-f0f546c4-06cc-4124-9432-33dd1e6571d1 tempest-SnapshotDependencyTests-1015910850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd8f86ab-05f7-47dd-9569-6b70332b992d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:31:58 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-f0f546c4-06cc-4124-9432-33dd1e6571d1 tempest-SnapshotDependencyTests-1015910850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd8f86ab-05f7-47dd-9569-6b70332b992d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '471b92c1-3e77-4bb7-b07e-88b3e4b62352', 'volume_name': 'volume-471b92c1-3e77-4bb7-b07e-88b3e4b62352', 'volume_size': 1, 'snapshot_id': 'a29d2335-8b38-4255-88bb-8414fef91518'}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:31:58 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-f0f546c4-06cc-4124-9432-33dd1e6571d1 tempest-SnapshotDependencyTests-1015910850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (234bc744-6afc-48e8-b90a-91e33e952fef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:31:58 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-f0f546c4-06cc-4124-9432-33dd1e6571d1 tempest-SnapshotDependencyTests-1015910850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (234bc744-6afc-48e8-b90a-91e33e952fef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:31:58 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-f0f546c4-06cc-4124-9432-33dd1e6571d1 tempest-SnapshotDependencyTests-1015910850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a42f7926-8448-4c7f-adcd-8583720770b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:31:58 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-f0f546c4-06cc-4124-9432-33dd1e6571d1 tempest-SnapshotDependencyTests-1015910850 None] Volume 471b92c1-3e77-4bb7-b07e-88b3e4b62352: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-471b92c1-3e77-4bb7-b07e-88b3e4b62352', 'volume_size': 1, 'snapshot_id': 'a29d2335-8b38-4255-88bb-8414fef91518'} Nov 04 10:31:58 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-f0f546c4-06cc-4124-9432-33dd1e6571d1 tempest-SnapshotDependencyTests-1015910850 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:31:58 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-f0f546c4-06cc-4124-9432-33dd1e6571d1 tempest-SnapshotDependencyTests-1015910850 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:31:58 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-f0f546c4-06cc-4124-9432-33dd1e6571d1 tempest-SnapshotDependencyTests-1015910850 None] Acquiring lock "cinder-quobyte-a29d2335-8b38-4255-88bb-8414fef91518-471b92c1-3e77-4bb7-b07e-88b3e4b62352" by "_create_volume_from_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:31:58 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-f0f546c4-06cc-4124-9432-33dd1e6571d1 tempest-SnapshotDependencyTests-1015910850 None] Lock "cinder-quobyte-a29d2335-8b38-4255-88bb-8414fef91518-471b92c1-3e77-4bb7-b07e-88b3e4b62352" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:31:58 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-f0f546c4-06cc-4124-9432-33dd1e6571d1 tempest-SnapshotDependencyTests-1015910850 None] Creating volume 471b92c1-3e77-4bb7-b07e-88b3e4b62352 from snapshot a29d2335-8b38-4255-88bb-8414fef91518 {{(pid=87068) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 04 10:31:58 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-f0f546c4-06cc-4124-9432-33dd1e6571d1 tempest-SnapshotDependencyTests-1015910850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:31:58 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-f0f546c4-06cc-4124-9432-33dd1e6571d1 tempest-SnapshotDependencyTests-1015910850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:31:58 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-f0f546c4-06cc-4124-9432-33dd1e6571d1 tempest-SnapshotDependencyTests-1015910850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:31:58 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-f0f546c4-06cc-4124-9432-33dd1e6571d1 tempest-SnapshotDependencyTests-1015910850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:31:58 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-f0f546c4-06cc-4124-9432-33dd1e6571d1 tempest-SnapshotDependencyTests-1015910850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:31:58 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-f0f546c4-06cc-4124-9432-33dd1e6571d1 tempest-SnapshotDependencyTests-1015910850 None] Selected osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:31:58 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-f0f546c4-06cc-4124-9432-33dd1e6571d1 tempest-SnapshotDependencyTests-1015910850 None] Acquiring lock "cinder-quobyte-471b92c1-3e77-4bb7-b07e-88b3e4b62352" by "_copy_volume_from_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:31:58 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-f0f546c4-06cc-4124-9432-33dd1e6571d1 tempest-SnapshotDependencyTests-1015910850 None] Lock "cinder-quobyte-471b92c1-3e77-4bb7-b07e-88b3e4b62352" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:31:58 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-f0f546c4-06cc-4124-9432-33dd1e6571d1 tempest-SnapshotDependencyTests-1015910850 None] snapshot: a29d2335-8b38-4255-88bb-8414fef91518, volume: 471b92c1-3e77-4bb7-b07e-88b3e4b62352, {{(pid=87068) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 04 10:31:58 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-f0f546c4-06cc-4124-9432-33dd1e6571d1 tempest-SnapshotDependencyTests-1015910850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:31:58 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-f0f546c4-06cc-4124-9432-33dd1e6571d1 tempest-SnapshotDependencyTests-1015910850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:31:58 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-f0f546c4-06cc-4124-9432-33dd1e6571d1 tempest-SnapshotDependencyTests-1015910850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:31:58 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-f0f546c4-06cc-4124-9432-33dd1e6571d1 tempest-SnapshotDependencyTests-1015910850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:31:58 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-f0f546c4-06cc-4124-9432-33dd1e6571d1 tempest-SnapshotDependencyTests-1015910850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:31:58 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[661371e9-7566-454c-91ec-7c539cbdbfb9]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:31:58 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f0f546c4-06cc-4124-9432-33dd1e6571d1 tempest-SnapshotDependencyTests-1015910850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-aa37f106-26c4-4f91-a423-dda0d57d503d.a29d2335-8b38-4255-88bb-8414fef91518 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:31:58 devstack sudo[105852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-aa37f106-26c4-4f91-a423-dda0d57d503d.a29d2335-8b38-4255-88bb-8414fef91518 Nov 04 10:31:58 devstack sudo[105852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:31:58 devstack sudo[105852]: pam_unix(sudo:session): session closed for user root Nov 04 10:31:58 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f0f546c4-06cc-4124-9432-33dd1e6571d1 tempest-SnapshotDependencyTests-1015910850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-aa37f106-26c4-4f91-a423-dda0d57d503d.a29d2335-8b38-4255-88bb-8414fef91518" returned: 0 in 0.374s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:31:58 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-f0f546c4-06cc-4124-9432-33dd1e6571d1 tempest-SnapshotDependencyTests-1015910850 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aa37f106-26c4-4f91-a423-dda0d57d503d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87068) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 10:31:58 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[138c2373-3189-4f3e-8129-6c45dd6b37db]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:31:58 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f0f546c4-06cc-4124-9432-33dd1e6571d1 tempest-SnapshotDependencyTests-1015910850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-aa37f106-26c4-4f91-a423-dda0d57d503d {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:31:58 devstack sudo[105857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-aa37f106-26c4-4f91-a423-dda0d57d503d Nov 04 10:31:58 devstack sudo[105857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:31:59 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-d5544c45-d975-493b-bb24-2caa0409b034 tempest-ProjectMemberTests-163191203 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:31:59 devstack sudo[105857]: pam_unix(sudo:session): session closed for user root Nov 04 10:31:59 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f0f546c4-06cc-4124-9432-33dd1e6571d1 tempest-SnapshotDependencyTests-1015910850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-aa37f106-26c4-4f91-a423-dda0d57d503d" returned: 0 in 0.356s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:31:59 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-f0f546c4-06cc-4124-9432-33dd1e6571d1 tempest-SnapshotDependencyTests-1015910850 None] will copy from snapshot at /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-aa37f106-26c4-4f91-a423-dda0d57d503d {{(pid=87068) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 04 10:31:59 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-f0f546c4-06cc-4124-9432-33dd1e6571d1 tempest-SnapshotDependencyTests-1015910850 None] Creating direct copy from snapshot {{(pid=87068) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 04 10:31:59 devstack cinder-volume[87068]: DEBUG cinder.utils [None req-f0f546c4-06cc-4124-9432-33dd1e6571d1 tempest-SnapshotDependencyTests-1015910850 None] Path /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-471b92c1-3e77-4bb7-b07e-88b3e4b62352 not found in is_blk_device check {{(pid=87068) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 04 10:31:59 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f0f546c4-06cc-4124-9432-33dd1e6571d1 tempest-SnapshotDependencyTests-1015910850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-aa37f106-26c4-4f91-a423-dda0d57d503d /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-471b92c1-3e77-4bb7-b07e-88b3e4b62352 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:31:59 devstack sudo[105862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-aa37f106-26c4-4f91-a423-dda0d57d503d /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-471b92c1-3e77-4bb7-b07e-88b3e4b62352 Nov 04 10:31:59 devstack sudo[105862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:32:04 devstack sudo[105862]: pam_unix(sudo:session): session closed for user root Nov 04 10:32:04 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f0f546c4-06cc-4124-9432-33dd1e6571d1 tempest-SnapshotDependencyTests-1015910850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-aa37f106-26c4-4f91-a423-dda0d57d503d /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-471b92c1-3e77-4bb7-b07e-88b3e4b62352" returned: 0 in 5.612s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:32:04 devstack cinder-volume[87068]: DEBUG cinder.image.image_utils [None req-f0f546c4-06cc-4124-9432-33dd1e6571d1 tempest-SnapshotDependencyTests-1015910850 None] Image conversion details: src /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-aa37f106-26c4-4f91-a423-dda0d57d503d, size 1024.00 MB, duration 5.61 sec, destination /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-471b92c1-3e77-4bb7-b07e-88b3e4b62352 {{(pid=87068) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 04 10:32:04 devstack cinder-volume[87068]: INFO cinder.image.image_utils [None req-f0f546c4-06cc-4124-9432-33dd1e6571d1 tempest-SnapshotDependencyTests-1015910850 None] Converted 1024.00 MB image at 182.42 MB/s Nov 04 10:32:04 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-f0f546c4-06cc-4124-9432-33dd1e6571d1 tempest-SnapshotDependencyTests-1015910850 None] /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-471b92c1-3e77-4bb7-b07e-88b3e4b62352 is being set with open permissions: ugo+rw Nov 04 10:32:04 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f0f546c4-06cc-4124-9432-33dd1e6571d1 tempest-SnapshotDependencyTests-1015910850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-471b92c1-3e77-4bb7-b07e-88b3e4b62352 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:32:04 devstack sudo[105876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-471b92c1-3e77-4bb7-b07e-88b3e4b62352 Nov 04 10:32:04 devstack sudo[105876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:32:05 devstack sudo[105876]: pam_unix(sudo:session): session closed for user root Nov 04 10:32:05 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f0f546c4-06cc-4124-9432-33dd1e6571d1 tempest-SnapshotDependencyTests-1015910850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-471b92c1-3e77-4bb7-b07e-88b3e4b62352" returned: 0 in 0.251s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:32:05 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-f0f546c4-06cc-4124-9432-33dd1e6571d1 tempest-SnapshotDependencyTests-1015910850 None] Lock "cinder-quobyte-471b92c1-3e77-4bb7-b07e-88b3e4b62352" released by "_copy_volume_from_snapshot" :: held 6.720s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:32:05 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-f0f546c4-06cc-4124-9432-33dd1e6571d1 tempest-SnapshotDependencyTests-1015910850 None] Lock "cinder-quobyte-a29d2335-8b38-4255-88bb-8414fef91518-471b92c1-3e77-4bb7-b07e-88b3e4b62352" released by "_create_volume_from_snapshot" :: held 6.778s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:32:05 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-f0f546c4-06cc-4124-9432-33dd1e6571d1 tempest-SnapshotDependencyTests-1015910850 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.794s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:32:05 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-d5544c45-d975-493b-bb24-2caa0409b034 tempest-ProjectMemberTests-163191203 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.081s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:32:05 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-d5544c45-d975-493b-bb24-2caa0409b034 tempest-ProjectMemberTests-163191203 None] Creating offline snapshot 67ac49a6-bb64-4d87-8ffa-ebb465464fdb of volume f0925c0c-e093-4132-a4ba-48739999ad8a {{(pid=87068) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 10:32:05 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-f0f546c4-06cc-4124-9432-33dd1e6571d1 tempest-SnapshotDependencyTests-1015910850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a42f7926-8448-4c7f-adcd-8583720770b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-471b92c1-3e77-4bb7-b07e-88b3e4b62352', 'volume_size': 1, 'snapshot_id': 'a29d2335-8b38-4255-88bb-8414fef91518'}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:32:05 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-f0f546c4-06cc-4124-9432-33dd1e6571d1 tempest-SnapshotDependencyTests-1015910850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86bcefb2-1b7b-4f3e-9055-da70d421487a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:32:05 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[25fc943a-e998-4741-a818-532daf13dae5]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:32:05 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d5544c45-d975-493b-bb24-2caa0409b034 tempest-ProjectMemberTests-163191203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-f0925c0c-e093-4132-a4ba-48739999ad8a {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:32:05 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-f0f546c4-06cc-4124-9432-33dd1e6571d1 tempest-SnapshotDependencyTests-1015910850 None] Volume volume-471b92c1-3e77-4bb7-b07e-88b3e4b62352 (471b92c1-3e77-4bb7-b07e-88b3e4b62352): created successfully Nov 04 10:32:05 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-f0f546c4-06cc-4124-9432-33dd1e6571d1 tempest-SnapshotDependencyTests-1015910850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86bcefb2-1b7b-4f3e-9055-da70d421487a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:32:05 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-f0f546c4-06cc-4124-9432-33dd1e6571d1 tempest-SnapshotDependencyTests-1015910850 None] Flow 'volume_create_manager' (ca01b66c-fec6-4d61-8100-1917950aa673) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:32:05 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-f0f546c4-06cc-4124-9432-33dd1e6571d1 tempest-SnapshotDependencyTests-1015910850 None] Created volume successfully. Nov 04 10:32:05 devstack sudo[105879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-f0925c0c-e093-4132-a4ba-48739999ad8a Nov 04 10:32:05 devstack sudo[105879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:32:05 devstack sudo[105879]: pam_unix(sudo:session): session closed for user root Nov 04 10:32:05 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d5544c45-d975-493b-bb24-2caa0409b034 tempest-ProjectMemberTests-163191203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-f0925c0c-e093-4132-a4ba-48739999ad8a" returned: 0 in 0.375s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:32:05 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d5544c45-d975-493b-bb24-2caa0409b034 tempest-ProjectMemberTests-163191203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-f0925c0c-e093-4132-a4ba-48739999ad8a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-f0925c0c-e093-4132-a4ba-48739999ad8a.67ac49a6-bb64-4d87-8ffa-ebb465464fdb 1G {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:32:05 devstack sudo[105884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-f0925c0c-e093-4132-a4ba-48739999ad8a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-f0925c0c-e093-4132-a4ba-48739999ad8a.67ac49a6-bb64-4d87-8ffa-ebb465464fdb 1G Nov 04 10:32:05 devstack sudo[105884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:32:05 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-509c0bf1-87ca-4ab9-b21a-c833683020fc tempest-SnapshotDependencyTests-1015910850 None] Acquiring lock "cinder-a29d2335-8b38-4255-88bb-8414fef91518-delete_snapshot" by "delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:32:05 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-509c0bf1-87ca-4ab9-b21a-c833683020fc tempest-SnapshotDependencyTests-1015910850 None] Lock "cinder-a29d2335-8b38-4255-88bb-8414fef91518-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:32:05 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-509c0bf1-87ca-4ab9-b21a-c833683020fc tempest-SnapshotDependencyTests-1015910850 None] Acquiring lock "cinder-quobyte-aa37f106-26c4-4f91-a423-dda0d57d503d" by "delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:32:05 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-509c0bf1-87ca-4ab9-b21a-c833683020fc tempest-SnapshotDependencyTests-1015910850 None] Lock "cinder-quobyte-aa37f106-26c4-4f91-a423-dda0d57d503d" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:32:05 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-509c0bf1-87ca-4ab9-b21a-c833683020fc tempest-SnapshotDependencyTests-1015910850 None] Acquiring lock "cinder-quobyte-a29d2335-8b38-4255-88bb-8414fef91518" by "_delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:32:05 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-509c0bf1-87ca-4ab9-b21a-c833683020fc tempest-SnapshotDependencyTests-1015910850 None] Lock "cinder-quobyte-a29d2335-8b38-4255-88bb-8414fef91518" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:32:05 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-509c0bf1-87ca-4ab9-b21a-c833683020fc tempest-SnapshotDependencyTests-1015910850 None] Deleting offline snapshot a29d2335-8b38-4255-88bb-8414fef91518 of volume aa37f106-26c4-4f91-a423-dda0d57d503d {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 10:32:05 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-509c0bf1-87ca-4ab9-b21a-c833683020fc tempest-SnapshotDependencyTests-1015910850 None] snapshot_file for this snap is: volume-aa37f106-26c4-4f91-a423-dda0d57d503d.a29d2335-8b38-4255-88bb-8414fef91518 {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 10:32:05 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[50763062-4f16-430b-afd0-fbf204564474]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:32:05 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-509c0bf1-87ca-4ab9-b21a-c833683020fc tempest-SnapshotDependencyTests-1015910850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-aa37f106-26c4-4f91-a423-dda0d57d503d.a29d2335-8b38-4255-88bb-8414fef91518 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:32:05 devstack sudo[105884]: pam_unix(sudo:session): session closed for user root Nov 04 10:32:05 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d5544c45-d975-493b-bb24-2caa0409b034 tempest-ProjectMemberTests-163191203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-f0925c0c-e093-4132-a4ba-48739999ad8a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-f0925c0c-e093-4132-a4ba-48739999ad8a.67ac49a6-bb64-4d87-8ffa-ebb465464fdb 1G" returned: 0 in 0.448s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:32:05 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d5544c45-d975-493b-bb24-2caa0409b034 tempest-ProjectMemberTests-163191203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f0925c0c-e093-4132-a4ba-48739999ad8a -F qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-f0925c0c-e093-4132-a4ba-48739999ad8a.67ac49a6-bb64-4d87-8ffa-ebb465464fdb {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:32:05 devstack sudo[105891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f0925c0c-e093-4132-a4ba-48739999ad8a -F qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-f0925c0c-e093-4132-a4ba-48739999ad8a.67ac49a6-bb64-4d87-8ffa-ebb465464fdb Nov 04 10:32:05 devstack sudo[105891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:32:06 devstack sudo[105890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-aa37f106-26c4-4f91-a423-dda0d57d503d.a29d2335-8b38-4255-88bb-8414fef91518 Nov 04 10:32:06 devstack sudo[105890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:32:06 devstack sudo[105891]: pam_unix(sudo:session): session closed for user root Nov 04 10:32:06 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d5544c45-d975-493b-bb24-2caa0409b034 tempest-ProjectMemberTests-163191203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f0925c0c-e093-4132-a4ba-48739999ad8a -F qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-f0925c0c-e093-4132-a4ba-48739999ad8a.67ac49a6-bb64-4d87-8ffa-ebb465464fdb" returned: 0 in 0.312s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:32:06 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-d5544c45-d975-493b-bb24-2caa0409b034 tempest-ProjectMemberTests-163191203 None] /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-f0925c0c-e093-4132-a4ba-48739999ad8a.67ac49a6-bb64-4d87-8ffa-ebb465464fdb is being set with open permissions: ugo+rw Nov 04 10:32:06 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d5544c45-d975-493b-bb24-2caa0409b034 tempest-ProjectMemberTests-163191203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-f0925c0c-e093-4132-a4ba-48739999ad8a.67ac49a6-bb64-4d87-8ffa-ebb465464fdb {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:32:06 devstack sudo[105899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-f0925c0c-e093-4132-a4ba-48739999ad8a.67ac49a6-bb64-4d87-8ffa-ebb465464fdb Nov 04 10:32:06 devstack sudo[105899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:32:06 devstack sudo[105890]: pam_unix(sudo:session): session closed for user root Nov 04 10:32:06 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-509c0bf1-87ca-4ab9-b21a-c833683020fc tempest-SnapshotDependencyTests-1015910850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-aa37f106-26c4-4f91-a423-dda0d57d503d.a29d2335-8b38-4255-88bb-8414fef91518" returned: 0 in 0.441s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:32:06 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-509c0bf1-87ca-4ab9-b21a-c833683020fc tempest-SnapshotDependencyTests-1015910850 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aa37f106-26c4-4f91-a423-dda0d57d503d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87068) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 10:32:06 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f580980-2e66-4f58-9187-6a8710f7312e]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:32:06 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-509c0bf1-87ca-4ab9-b21a-c833683020fc tempest-SnapshotDependencyTests-1015910850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-aa37f106-26c4-4f91-a423-dda0d57d503d {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:32:06 devstack sudo[105902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-aa37f106-26c4-4f91-a423-dda0d57d503d Nov 04 10:32:06 devstack sudo[105902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:32:06 devstack sudo[105899]: pam_unix(sudo:session): session closed for user root Nov 04 10:32:06 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d5544c45-d975-493b-bb24-2caa0409b034 tempest-ProjectMemberTests-163191203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-f0925c0c-e093-4132-a4ba-48739999ad8a.67ac49a6-bb64-4d87-8ffa-ebb465464fdb" returned: 0 in 0.263s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:32:06 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d5544c45-d975-493b-bb24-2caa0409b034 tempest-ProjectMemberTests-163191203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-f0925c0c-e093-4132-a4ba-48739999ad8a.info {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:32:06 devstack sudo[105905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-f0925c0c-e093-4132-a4ba-48739999ad8a.info Nov 04 10:32:06 devstack sudo[105905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:32:06 devstack sudo[105905]: pam_unix(sudo:session): session closed for user root Nov 04 10:32:06 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d5544c45-d975-493b-bb24-2caa0409b034 tempest-ProjectMemberTests-163191203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-f0925c0c-e093-4132-a4ba-48739999ad8a.info" returned: 0 in 0.267s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:32:06 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-d5544c45-d975-493b-bb24-2caa0409b034 tempest-ProjectMemberTests-163191203 None] /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-f0925c0c-e093-4132-a4ba-48739999ad8a.info is being set with open permissions: ugo+rw Nov 04 10:32:06 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d5544c45-d975-493b-bb24-2caa0409b034 tempest-ProjectMemberTests-163191203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-f0925c0c-e093-4132-a4ba-48739999ad8a.info {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:32:06 devstack sudo[105910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-f0925c0c-e093-4132-a4ba-48739999ad8a.info Nov 04 10:32:06 devstack sudo[105910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:32:06 devstack sudo[105902]: pam_unix(sudo:session): session closed for user root Nov 04 10:32:06 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-509c0bf1-87ca-4ab9-b21a-c833683020fc tempest-SnapshotDependencyTests-1015910850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-aa37f106-26c4-4f91-a423-dda0d57d503d" returned: 0 in 0.575s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:32:06 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-509c0bf1-87ca-4ab9-b21a-c833683020fc tempest-SnapshotDependencyTests-1015910850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-aa37f106-26c4-4f91-a423-dda0d57d503d.a29d2335-8b38-4255-88bb-8414fef91518 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:32:07 devstack sudo[105913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-aa37f106-26c4-4f91-a423-dda0d57d503d.a29d2335-8b38-4255-88bb-8414fef91518 Nov 04 10:32:07 devstack sudo[105913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:32:07 devstack sudo[105910]: pam_unix(sudo:session): session closed for user root Nov 04 10:32:07 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-d5544c45-d975-493b-bb24-2caa0409b034 tempest-ProjectMemberTests-163191203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-f0925c0c-e093-4132-a4ba-48739999ad8a.info" returned: 0 in 0.267s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:32:07 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-d5544c45-d975-493b-bb24-2caa0409b034 tempest-ProjectMemberTests-163191203 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.032s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:32:07 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-d5544c45-d975-493b-bb24-2caa0409b034 tempest-ProjectMemberTests-163191203 None] Create snapshot completed successfully Nov 04 10:32:07 devstack sudo[105913]: pam_unix(sudo:session): session closed for user root Nov 04 10:32:07 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-509c0bf1-87ca-4ab9-b21a-c833683020fc tempest-SnapshotDependencyTests-1015910850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-aa37f106-26c4-4f91-a423-dda0d57d503d.a29d2335-8b38-4255-88bb-8414fef91518" returned: 0 in 0.368s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:32:07 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-509c0bf1-87ca-4ab9-b21a-c833683020fc tempest-SnapshotDependencyTests-1015910850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-aa37f106-26c4-4f91-a423-dda0d57d503d.a29d2335-8b38-4255-88bb-8414fef91518 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:32:07 devstack sudo[105919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-aa37f106-26c4-4f91-a423-dda0d57d503d.a29d2335-8b38-4255-88bb-8414fef91518 Nov 04 10:32:07 devstack sudo[105919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:32:07 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-2d4bc41f-c8a0-4be7-8aa6-ce1c6c102b19 tempest-ProjectMemberTests-163191203 None] Acquiring lock "cinder-67ac49a6-bb64-4d87-8ffa-ebb465464fdb-delete_snapshot" by "delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:32:07 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-2d4bc41f-c8a0-4be7-8aa6-ce1c6c102b19 tempest-ProjectMemberTests-163191203 None] Lock "cinder-67ac49a6-bb64-4d87-8ffa-ebb465464fdb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:32:07 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-2d4bc41f-c8a0-4be7-8aa6-ce1c6c102b19 tempest-ProjectMemberTests-163191203 None] Acquiring lock "cinder-quobyte-f0925c0c-e093-4132-a4ba-48739999ad8a" by "delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:32:07 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-2d4bc41f-c8a0-4be7-8aa6-ce1c6c102b19 tempest-ProjectMemberTests-163191203 None] Lock "cinder-quobyte-f0925c0c-e093-4132-a4ba-48739999ad8a" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:32:07 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-2d4bc41f-c8a0-4be7-8aa6-ce1c6c102b19 tempest-ProjectMemberTests-163191203 None] Acquiring lock "cinder-quobyte-67ac49a6-bb64-4d87-8ffa-ebb465464fdb" by "_delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:32:07 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-2d4bc41f-c8a0-4be7-8aa6-ce1c6c102b19 tempest-ProjectMemberTests-163191203 None] Lock "cinder-quobyte-67ac49a6-bb64-4d87-8ffa-ebb465464fdb" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:32:07 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-2d4bc41f-c8a0-4be7-8aa6-ce1c6c102b19 tempest-ProjectMemberTests-163191203 None] Deleting offline snapshot 67ac49a6-bb64-4d87-8ffa-ebb465464fdb of volume f0925c0c-e093-4132-a4ba-48739999ad8a {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 10:32:07 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-2d4bc41f-c8a0-4be7-8aa6-ce1c6c102b19 tempest-ProjectMemberTests-163191203 None] snapshot_file for this snap is: volume-f0925c0c-e093-4132-a4ba-48739999ad8a.67ac49a6-bb64-4d87-8ffa-ebb465464fdb {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 10:32:07 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb904bfc-5cd7-4aff-89cb-0b563756aca2]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:32:07 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-2d4bc41f-c8a0-4be7-8aa6-ce1c6c102b19 tempest-ProjectMemberTests-163191203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-f0925c0c-e093-4132-a4ba-48739999ad8a.67ac49a6-bb64-4d87-8ffa-ebb465464fdb {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:32:07 devstack sudo[105919]: pam_unix(sudo:session): session closed for user root Nov 04 10:32:07 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-509c0bf1-87ca-4ab9-b21a-c833683020fc tempest-SnapshotDependencyTests-1015910850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-aa37f106-26c4-4f91-a423-dda0d57d503d.a29d2335-8b38-4255-88bb-8414fef91518" returned: 0 in 0.274s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:32:07 devstack sudo[105921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-f0925c0c-e093-4132-a4ba-48739999ad8a.67ac49a6-bb64-4d87-8ffa-ebb465464fdb Nov 04 10:32:07 devstack sudo[105921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:32:07 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-509c0bf1-87ca-4ab9-b21a-c833683020fc tempest-SnapshotDependencyTests-1015910850 None] Lock "cinder-quobyte-a29d2335-8b38-4255-88bb-8414fef91518" released by "_delete_snapshot" :: held 1.769s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:32:07 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-509c0bf1-87ca-4ab9-b21a-c833683020fc tempest-SnapshotDependencyTests-1015910850 None] Lock "cinder-quobyte-aa37f106-26c4-4f91-a423-dda0d57d503d" released by "delete_snapshot" :: held 1.792s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:32:07 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-509c0bf1-87ca-4ab9-b21a-c833683020fc tempest-SnapshotDependencyTests-1015910850 None] Created reservations ['ee48987a-ca36-4174-9907-0664be1fdffd', '74c6dec8-02bc-44fe-8a63-0e01aeac2eff', '1a234e9e-6707-44b5-9946-f4d36baeb19e', 'e7a9a446-02f3-4133-96d3-5104c6b623d6'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:32:07 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-509c0bf1-87ca-4ab9-b21a-c833683020fc tempest-SnapshotDependencyTests-1015910850 None] Delete snapshot completed successfully. Nov 04 10:32:07 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-509c0bf1-87ca-4ab9-b21a-c833683020fc tempest-SnapshotDependencyTests-1015910850 None] Lock "cinder-a29d2335-8b38-4255-88bb-8414fef91518-delete_snapshot" released by "delete_snapshot" :: held 1.935s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:32:07 devstack sudo[105921]: pam_unix(sudo:session): session closed for user root Nov 04 10:32:07 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-2d4bc41f-c8a0-4be7-8aa6-ce1c6c102b19 tempest-ProjectMemberTests-163191203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-f0925c0c-e093-4132-a4ba-48739999ad8a.67ac49a6-bb64-4d87-8ffa-ebb465464fdb" returned: 0 in 0.416s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:32:07 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-2d4bc41f-c8a0-4be7-8aa6-ce1c6c102b19 tempest-ProjectMemberTests-163191203 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f0925c0c-e093-4132-a4ba-48739999ad8a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87068) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 10:32:07 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[86d430b6-8413-4639-a241-e621156fc78c]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:32:07 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-2d4bc41f-c8a0-4be7-8aa6-ce1c6c102b19 tempest-ProjectMemberTests-163191203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-f0925c0c-e093-4132-a4ba-48739999ad8a {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:32:08 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-689ba1c3-2086-4bd4-84a6-5d798e66604d tempest-SnapshotDependencyTests-1015910850 None] Acquiring lock "cinder-aa37f106-26c4-4f91-a423-dda0d57d503d-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:32:08 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-689ba1c3-2086-4bd4-84a6-5d798e66604d tempest-SnapshotDependencyTests-1015910850 None] Lock "cinder-aa37f106-26c4-4f91-a423-dda0d57d503d-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:32:08 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-689ba1c3-2086-4bd4-84a6-5d798e66604d tempest-SnapshotDependencyTests-1015910850 None] Acquiring lock "cinder-quobyte-aa37f106-26c4-4f91-a423-dda0d57d503d" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:32:08 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-689ba1c3-2086-4bd4-84a6-5d798e66604d tempest-SnapshotDependencyTests-1015910850 None] Lock "cinder-quobyte-aa37f106-26c4-4f91-a423-dda0d57d503d" acquired by "delete_volume" :: waited 0.015s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:32:08 devstack sudo[105929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-f0925c0c-e093-4132-a4ba-48739999ad8a Nov 04 10:32:08 devstack sudo[105929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:32:08 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad838028-4684-4f5e-b291-24f8035ff09e]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:32:08 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-689ba1c3-2086-4bd4-84a6-5d798e66604d tempest-SnapshotDependencyTests-1015910850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-aa37f106-26c4-4f91-a423-dda0d57d503d {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:32:08 devstack sudo[105931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-aa37f106-26c4-4f91-a423-dda0d57d503d Nov 04 10:32:08 devstack sudo[105931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:32:08 devstack sudo[105929]: pam_unix(sudo:session): session closed for user root Nov 04 10:32:08 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-2d4bc41f-c8a0-4be7-8aa6-ce1c6c102b19 tempest-ProjectMemberTests-163191203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-f0925c0c-e093-4132-a4ba-48739999ad8a" returned: 0 in 0.369s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:32:08 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-2d4bc41f-c8a0-4be7-8aa6-ce1c6c102b19 tempest-ProjectMemberTests-163191203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-f0925c0c-e093-4132-a4ba-48739999ad8a.67ac49a6-bb64-4d87-8ffa-ebb465464fdb {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:32:08 devstack sudo[105936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-f0925c0c-e093-4132-a4ba-48739999ad8a.67ac49a6-bb64-4d87-8ffa-ebb465464fdb Nov 04 10:32:08 devstack sudo[105936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:32:08 devstack sudo[105931]: pam_unix(sudo:session): session closed for user root Nov 04 10:32:08 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-689ba1c3-2086-4bd4-84a6-5d798e66604d tempest-SnapshotDependencyTests-1015910850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-aa37f106-26c4-4f91-a423-dda0d57d503d" returned: 0 in 0.385s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:32:08 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-689ba1c3-2086-4bd4-84a6-5d798e66604d tempest-SnapshotDependencyTests-1015910850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-aa37f106-26c4-4f91-a423-dda0d57d503d {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:32:08 devstack sudo[105941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-aa37f106-26c4-4f91-a423-dda0d57d503d Nov 04 10:32:08 devstack sudo[105941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:32:08 devstack sudo[105936]: pam_unix(sudo:session): session closed for user root Nov 04 10:32:08 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-2d4bc41f-c8a0-4be7-8aa6-ce1c6c102b19 tempest-ProjectMemberTests-163191203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-f0925c0c-e093-4132-a4ba-48739999ad8a.67ac49a6-bb64-4d87-8ffa-ebb465464fdb" returned: 0 in 0.336s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:32:08 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-2d4bc41f-c8a0-4be7-8aa6-ce1c6c102b19 tempest-ProjectMemberTests-163191203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-f0925c0c-e093-4132-a4ba-48739999ad8a.67ac49a6-bb64-4d87-8ffa-ebb465464fdb {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:32:08 devstack sudo[105946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-f0925c0c-e093-4132-a4ba-48739999ad8a.67ac49a6-bb64-4d87-8ffa-ebb465464fdb Nov 04 10:32:08 devstack sudo[105946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:32:08 devstack sudo[105941]: pam_unix(sudo:session): session closed for user root Nov 04 10:32:08 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-689ba1c3-2086-4bd4-84a6-5d798e66604d tempest-SnapshotDependencyTests-1015910850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-aa37f106-26c4-4f91-a423-dda0d57d503d" returned: 0 in 0.266s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:32:08 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-689ba1c3-2086-4bd4-84a6-5d798e66604d tempest-SnapshotDependencyTests-1015910850 None] Lock "cinder-quobyte-aa37f106-26c4-4f91-a423-dda0d57d503d" released by "delete_volume" :: held 0.721s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:32:08 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-689ba1c3-2086-4bd4-84a6-5d798e66604d tempest-SnapshotDependencyTests-1015910850 None] Created reservations ['4de7a0da-b7c0-4aba-952a-dcf2caa439ea', '387418f8-013f-4fda-95ad-87c88f860f36', 'a940457c-8174-4767-acb1-c76ff03835bc', 'a3361c43-ae04-4ece-a5d5-550b93da7181'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:32:08 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-689ba1c3-2086-4bd4-84a6-5d798e66604d tempest-SnapshotDependencyTests-1015910850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:32:08 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-689ba1c3-2086-4bd4-84a6-5d798e66604d tempest-SnapshotDependencyTests-1015910850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:32:08 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-689ba1c3-2086-4bd4-84a6-5d798e66604d tempest-SnapshotDependencyTests-1015910850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:32:08 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-689ba1c3-2086-4bd4-84a6-5d798e66604d tempest-SnapshotDependencyTests-1015910850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:32:08 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-689ba1c3-2086-4bd4-84a6-5d798e66604d tempest-SnapshotDependencyTests-1015910850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:32:08 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-689ba1c3-2086-4bd4-84a6-5d798e66604d tempest-SnapshotDependencyTests-1015910850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:32:08 devstack sudo[105946]: pam_unix(sudo:session): session closed for user root Nov 04 10:32:08 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-2d4bc41f-c8a0-4be7-8aa6-ce1c6c102b19 tempest-ProjectMemberTests-163191203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-f0925c0c-e093-4132-a4ba-48739999ad8a.67ac49a6-bb64-4d87-8ffa-ebb465464fdb" returned: 0 in 0.250s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:32:08 devstack sudo[105950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:32:08 devstack sudo[105950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:32:08 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-2d4bc41f-c8a0-4be7-8aa6-ce1c6c102b19 tempest-ProjectMemberTests-163191203 None] Lock "cinder-quobyte-67ac49a6-bb64-4d87-8ffa-ebb465464fdb" released by "_delete_snapshot" :: held 1.484s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:32:08 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-2d4bc41f-c8a0-4be7-8aa6-ce1c6c102b19 tempest-ProjectMemberTests-163191203 None] Lock "cinder-quobyte-f0925c0c-e093-4132-a4ba-48739999ad8a" released by "delete_snapshot" :: held 1.509s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:32:09 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-2d4bc41f-c8a0-4be7-8aa6-ce1c6c102b19 tempest-ProjectMemberTests-163191203 None] Created reservations ['cabb3193-144a-4a06-8e03-039c91e11c27', '7a102d62-66c7-41cf-b274-d69543f9917a', '8d4c0c1f-2e22-4e67-995a-3c632e88a2da', '70bb2b20-778d-4650-8056-2095bdeb2e5f'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:32:09 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-2d4bc41f-c8a0-4be7-8aa6-ce1c6c102b19 tempest-ProjectMemberTests-163191203 None] Delete snapshot completed successfully. Nov 04 10:32:09 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-2d4bc41f-c8a0-4be7-8aa6-ce1c6c102b19 tempest-ProjectMemberTests-163191203 None] Lock "cinder-67ac49a6-bb64-4d87-8ffa-ebb465464fdb-delete_snapshot" released by "delete_snapshot" :: held 1.674s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:32:09 devstack sudo[105950]: pam_unix(sudo:session): session closed for user root Nov 04 10:32:09 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-689ba1c3-2086-4bd4-84a6-5d798e66604d tempest-SnapshotDependencyTests-1015910850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.254s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:32:09 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-689ba1c3-2086-4bd4-84a6-5d798e66604d tempest-SnapshotDependencyTests-1015910850 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:32:09 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-689ba1c3-2086-4bd4-84a6-5d798e66604d tempest-SnapshotDependencyTests-1015910850 None] Deleted volume successfully. Nov 04 10:32:09 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-1dccccd3-f0e5-4c37-8aaf-68dbe491be6c tempest-SnapshotDependencyTests-1015910850 None] Acquiring lock "cinder-471b92c1-3e77-4bb7-b07e-88b3e4b62352-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:32:09 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-1dccccd3-f0e5-4c37-8aaf-68dbe491be6c tempest-SnapshotDependencyTests-1015910850 None] Lock "cinder-471b92c1-3e77-4bb7-b07e-88b3e4b62352-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:32:09 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-689ba1c3-2086-4bd4-84a6-5d798e66604d tempest-SnapshotDependencyTests-1015910850 None] Lock "cinder-aa37f106-26c4-4f91-a423-dda0d57d503d-delete_volume" released by "delete_volume" :: held 1.203s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:32:09 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-1dccccd3-f0e5-4c37-8aaf-68dbe491be6c tempest-SnapshotDependencyTests-1015910850 None] Acquiring lock "cinder-quobyte-471b92c1-3e77-4bb7-b07e-88b3e4b62352" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:32:09 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-1dccccd3-f0e5-4c37-8aaf-68dbe491be6c tempest-SnapshotDependencyTests-1015910850 None] Lock "cinder-quobyte-471b92c1-3e77-4bb7-b07e-88b3e4b62352" acquired by "delete_volume" :: waited 0.015s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:32:09 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[11c6ce3a-b21c-4888-83d5-0b234aaafaeb]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:32:09 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-1dccccd3-f0e5-4c37-8aaf-68dbe491be6c tempest-SnapshotDependencyTests-1015910850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-471b92c1-3e77-4bb7-b07e-88b3e4b62352 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:32:09 devstack sudo[105953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-471b92c1-3e77-4bb7-b07e-88b3e4b62352 Nov 04 10:32:09 devstack sudo[105953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:32:09 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-0490d912-fbfb-45ff-95c2-db7d201c3ae1 tempest-ProjectMemberTests-163191203 None] Acquiring lock "cinder-f0925c0c-e093-4132-a4ba-48739999ad8a-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:32:09 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-0490d912-fbfb-45ff-95c2-db7d201c3ae1 tempest-ProjectMemberTests-163191203 None] Lock "cinder-f0925c0c-e093-4132-a4ba-48739999ad8a-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:32:09 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-0490d912-fbfb-45ff-95c2-db7d201c3ae1 tempest-ProjectMemberTests-163191203 None] Acquiring lock "cinder-quobyte-f0925c0c-e093-4132-a4ba-48739999ad8a" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:32:09 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-0490d912-fbfb-45ff-95c2-db7d201c3ae1 tempest-ProjectMemberTests-163191203 None] Lock "cinder-quobyte-f0925c0c-e093-4132-a4ba-48739999ad8a" acquired by "delete_volume" :: waited 0.013s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:32:09 devstack sudo[105953]: pam_unix(sudo:session): session closed for user root Nov 04 10:32:09 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-1dccccd3-f0e5-4c37-8aaf-68dbe491be6c tempest-SnapshotDependencyTests-1015910850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-471b92c1-3e77-4bb7-b07e-88b3e4b62352" returned: 0 in 0.408s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:32:09 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-1dccccd3-f0e5-4c37-8aaf-68dbe491be6c tempest-SnapshotDependencyTests-1015910850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-471b92c1-3e77-4bb7-b07e-88b3e4b62352 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:32:09 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd9856dc-d873-457b-be25-3218623dd2ca]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:32:09 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-0490d912-fbfb-45ff-95c2-db7d201c3ae1 tempest-ProjectMemberTests-163191203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-f0925c0c-e093-4132-a4ba-48739999ad8a {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:32:09 devstack sudo[105959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-471b92c1-3e77-4bb7-b07e-88b3e4b62352 Nov 04 10:32:09 devstack sudo[105959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:32:09 devstack sudo[105960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-f0925c0c-e093-4132-a4ba-48739999ad8a Nov 04 10:32:09 devstack sudo[105960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:32:09 devstack sudo[105959]: pam_unix(sudo:session): session closed for user root Nov 04 10:32:09 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-1dccccd3-f0e5-4c37-8aaf-68dbe491be6c tempest-SnapshotDependencyTests-1015910850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-471b92c1-3e77-4bb7-b07e-88b3e4b62352" returned: 0 in 0.265s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:32:09 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-1dccccd3-f0e5-4c37-8aaf-68dbe491be6c tempest-SnapshotDependencyTests-1015910850 None] Lock "cinder-quobyte-471b92c1-3e77-4bb7-b07e-88b3e4b62352" released by "delete_volume" :: held 0.714s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:32:10 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-1dccccd3-f0e5-4c37-8aaf-68dbe491be6c tempest-SnapshotDependencyTests-1015910850 None] Created reservations ['b350ec30-e990-4c4b-ba3a-c751e680cd96', '939962bc-b71b-49f1-81d4-5ea31bf34c5c', '3f1de72a-a8b4-4c5d-97a0-b364a508591e', 'cf1bc0de-4206-4782-a279-6683726bb5ee'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:32:10 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-1dccccd3-f0e5-4c37-8aaf-68dbe491be6c tempest-SnapshotDependencyTests-1015910850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:32:10 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-1dccccd3-f0e5-4c37-8aaf-68dbe491be6c tempest-SnapshotDependencyTests-1015910850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:32:10 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-1dccccd3-f0e5-4c37-8aaf-68dbe491be6c tempest-SnapshotDependencyTests-1015910850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:32:10 devstack sudo[105960]: pam_unix(sudo:session): session closed for user root Nov 04 10:32:10 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-1dccccd3-f0e5-4c37-8aaf-68dbe491be6c tempest-SnapshotDependencyTests-1015910850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:32:10 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-1dccccd3-f0e5-4c37-8aaf-68dbe491be6c tempest-SnapshotDependencyTests-1015910850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:32:10 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-1dccccd3-f0e5-4c37-8aaf-68dbe491be6c tempest-SnapshotDependencyTests-1015910850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:32:10 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-0490d912-fbfb-45ff-95c2-db7d201c3ae1 tempest-ProjectMemberTests-163191203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-f0925c0c-e093-4132-a4ba-48739999ad8a" returned: 0 in 0.406s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:32:10 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-0490d912-fbfb-45ff-95c2-db7d201c3ae1 tempest-ProjectMemberTests-163191203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-f0925c0c-e093-4132-a4ba-48739999ad8a {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:32:10 devstack sudo[105967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:32:10 devstack sudo[105967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:32:10 devstack sudo[105968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-f0925c0c-e093-4132-a4ba-48739999ad8a Nov 04 10:32:10 devstack sudo[105968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:32:10 devstack sudo[105967]: pam_unix(sudo:session): session closed for user root Nov 04 10:32:10 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-1dccccd3-f0e5-4c37-8aaf-68dbe491be6c tempest-SnapshotDependencyTests-1015910850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.267s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:32:10 devstack sudo[105968]: pam_unix(sudo:session): session closed for user root Nov 04 10:32:10 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-1dccccd3-f0e5-4c37-8aaf-68dbe491be6c tempest-SnapshotDependencyTests-1015910850 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:32:10 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-0490d912-fbfb-45ff-95c2-db7d201c3ae1 tempest-ProjectMemberTests-163191203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-f0925c0c-e093-4132-a4ba-48739999ad8a" returned: 0 in 0.263s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:32:10 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-1dccccd3-f0e5-4c37-8aaf-68dbe491be6c tempest-SnapshotDependencyTests-1015910850 None] Deleted volume successfully. Nov 04 10:32:10 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-0490d912-fbfb-45ff-95c2-db7d201c3ae1 tempest-ProjectMemberTests-163191203 None] Lock "cinder-quobyte-f0925c0c-e093-4132-a4ba-48739999ad8a" released by "delete_volume" :: held 0.744s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:32:10 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-1dccccd3-f0e5-4c37-8aaf-68dbe491be6c tempest-SnapshotDependencyTests-1015910850 None] Lock "cinder-471b92c1-3e77-4bb7-b07e-88b3e4b62352-delete_volume" released by "delete_volume" :: held 1.214s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:32:10 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-0490d912-fbfb-45ff-95c2-db7d201c3ae1 tempest-ProjectMemberTests-163191203 None] Created reservations ['2b1b594d-44e0-49b4-887c-79b1322a3282', 'cf75bc4a-3166-4531-aab4-9f9619e86df1', '2475d385-8aba-4714-8d01-8ca504e096cf', 'c0a601df-c0fa-4fff-bbe4-5c2db8caaf1a'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:32:10 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-0490d912-fbfb-45ff-95c2-db7d201c3ae1 tempest-ProjectMemberTests-163191203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:32:10 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-0490d912-fbfb-45ff-95c2-db7d201c3ae1 tempest-ProjectMemberTests-163191203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:32:10 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-0490d912-fbfb-45ff-95c2-db7d201c3ae1 tempest-ProjectMemberTests-163191203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:32:10 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-0490d912-fbfb-45ff-95c2-db7d201c3ae1 tempest-ProjectMemberTests-163191203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:32:10 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-0490d912-fbfb-45ff-95c2-db7d201c3ae1 tempest-ProjectMemberTests-163191203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:32:10 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-0490d912-fbfb-45ff-95c2-db7d201c3ae1 tempest-ProjectMemberTests-163191203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:32:10 devstack sudo[105973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:32:10 devstack sudo[105973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:32:10 devstack sudo[105973]: pam_unix(sudo:session): session closed for user root Nov 04 10:32:10 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-0490d912-fbfb-45ff-95c2-db7d201c3ae1 tempest-ProjectMemberTests-163191203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.244s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:32:10 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-0490d912-fbfb-45ff-95c2-db7d201c3ae1 tempest-ProjectMemberTests-163191203 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:32:10 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-0490d912-fbfb-45ff-95c2-db7d201c3ae1 tempest-ProjectMemberTests-163191203 None] Deleted volume successfully. Nov 04 10:32:10 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-0490d912-fbfb-45ff-95c2-db7d201c3ae1 tempest-ProjectMemberTests-163191203 None] Lock "cinder-f0925c0c-e093-4132-a4ba-48739999ad8a-delete_volume" released by "delete_volume" :: held 1.217s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:32:11 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-cdbbb450-0960-4ca1-a8eb-2ff3d7e83602 tempest-ProjectMemberTests-163191203 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:32:11 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-cdbbb450-0960-4ca1-a8eb-2ff3d7e83602 tempest-ProjectMemberTests-163191203 None] Flow 'volume_create_manager' (db2eb484-b647-4c0f-a9c7-c045098aa727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:32:11 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-cdbbb450-0960-4ca1-a8eb-2ff3d7e83602 tempest-ProjectMemberTests-163191203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aae66e9d-b182-45e2-bc9a-bb91505a93a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:32:11 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-cdbbb450-0960-4ca1-a8eb-2ff3d7e83602 tempest-ProjectMemberTests-163191203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aae66e9d-b182-45e2-bc9a-bb91505a93a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:32:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1592775429',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4c407a1-25b3-480a-b72a-2ecc4057b359,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6102192fe22c4f298ee9815860bd7a9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:32:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:32:11Z,use_quota=True,user_id='df3853accc6242909d45cceeb3a0db9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:32:11 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-cdbbb450-0960-4ca1-a8eb-2ff3d7e83602 tempest-ProjectMemberTests-163191203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (785ff72a-ac93-442d-8747-ab1531c63bb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:32:11 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-cdbbb450-0960-4ca1-a8eb-2ff3d7e83602 tempest-ProjectMemberTests-163191203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (785ff72a-ac93-442d-8747-ab1531c63bb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:32:11 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-cdbbb450-0960-4ca1-a8eb-2ff3d7e83602 tempest-ProjectMemberTests-163191203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1da8034-e250-4f70-be6e-4bd916148d67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:32:11 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-cdbbb450-0960-4ca1-a8eb-2ff3d7e83602 tempest-ProjectMemberTests-163191203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1da8034-e250-4f70-be6e-4bd916148d67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b4c407a1-25b3-480a-b72a-2ecc4057b359', 'volume_name': 'volume-b4c407a1-25b3-480a-b72a-2ecc4057b359', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:32:11 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-cdbbb450-0960-4ca1-a8eb-2ff3d7e83602 tempest-ProjectMemberTests-163191203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b17aa1a5-62bd-490c-a17b-cacd4923b933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:32:11 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-cdbbb450-0960-4ca1-a8eb-2ff3d7e83602 tempest-ProjectMemberTests-163191203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b17aa1a5-62bd-490c-a17b-cacd4923b933) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:32:11 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-cdbbb450-0960-4ca1-a8eb-2ff3d7e83602 tempest-ProjectMemberTests-163191203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c28aa84-1ff6-4acd-9c6d-b5fd3408abaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:32:11 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-cdbbb450-0960-4ca1-a8eb-2ff3d7e83602 tempest-ProjectMemberTests-163191203 None] Volume b4c407a1-25b3-480a-b72a-2ecc4057b359: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b4c407a1-25b3-480a-b72a-2ecc4057b359', 'volume_size': 1} Nov 04 10:32:11 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-cdbbb450-0960-4ca1-a8eb-2ff3d7e83602 tempest-ProjectMemberTests-163191203 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:32:11 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-cdbbb450-0960-4ca1-a8eb-2ff3d7e83602 tempest-ProjectMemberTests-163191203 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:32:11 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-cdbbb450-0960-4ca1-a8eb-2ff3d7e83602 tempest-ProjectMemberTests-163191203 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:32:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1592775429',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4c407a1-25b3-480a-b72a-2ecc4057b359,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6102192fe22c4f298ee9815860bd7a9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:32:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:32:11Z,use_quota=True,user_id='df3853accc6242909d45cceeb3a0db9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 10:32:11 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-cdbbb450-0960-4ca1-a8eb-2ff3d7e83602 tempest-ProjectMemberTests-163191203 None] Creating volume b4c407a1-25b3-480a-b72a-2ecc4057b359 {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:32:11 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-cdbbb450-0960-4ca1-a8eb-2ff3d7e83602 tempest-ProjectMemberTests-163191203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:32:11 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-cdbbb450-0960-4ca1-a8eb-2ff3d7e83602 tempest-ProjectMemberTests-163191203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:32:11 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-cdbbb450-0960-4ca1-a8eb-2ff3d7e83602 tempest-ProjectMemberTests-163191203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:32:11 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-cdbbb450-0960-4ca1-a8eb-2ff3d7e83602 tempest-ProjectMemberTests-163191203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:32:11 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-cdbbb450-0960-4ca1-a8eb-2ff3d7e83602 tempest-ProjectMemberTests-163191203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:32:11 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-cdbbb450-0960-4ca1-a8eb-2ff3d7e83602 tempest-ProjectMemberTests-163191203 None] Selected osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:32:11 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-cdbbb450-0960-4ca1-a8eb-2ff3d7e83602 tempest-ProjectMemberTests-163191203 None] casted to osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 Nov 04 10:32:11 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-cdbbb450-0960-4ca1-a8eb-2ff3d7e83602 tempest-ProjectMemberTests-163191203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b4c407a1-25b3-480a-b72a-2ecc4057b359 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:32:11 devstack sudo[105976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b4c407a1-25b3-480a-b72a-2ecc4057b359 1073741824 Nov 04 10:32:11 devstack sudo[105976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:32:11 devstack sudo[105976]: pam_unix(sudo:session): session closed for user root Nov 04 10:32:11 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-cdbbb450-0960-4ca1-a8eb-2ff3d7e83602 tempest-ProjectMemberTests-163191203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b4c407a1-25b3-480a-b72a-2ecc4057b359 1073741824" returned: 0 in 0.437s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:32:11 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-cdbbb450-0960-4ca1-a8eb-2ff3d7e83602 tempest-ProjectMemberTests-163191203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b4c407a1-25b3-480a-b72a-2ecc4057b359 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:32:11 devstack sudo[105983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b4c407a1-25b3-480a-b72a-2ecc4057b359 Nov 04 10:32:11 devstack sudo[105983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:32:12 devstack sudo[105983]: pam_unix(sudo:session): session closed for user root Nov 04 10:32:12 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-cdbbb450-0960-4ca1-a8eb-2ff3d7e83602 tempest-ProjectMemberTests-163191203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b4c407a1-25b3-480a-b72a-2ecc4057b359" returned: 0 in 0.263s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:32:12 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-cdbbb450-0960-4ca1-a8eb-2ff3d7e83602 tempest-ProjectMemberTests-163191203 None] <== create_volume: return (759ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 10:32:12 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-cdbbb450-0960-4ca1-a8eb-2ff3d7e83602 tempest-ProjectMemberTests-163191203 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.762s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:32:12 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-cdbbb450-0960-4ca1-a8eb-2ff3d7e83602 tempest-ProjectMemberTests-163191203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c28aa84-1ff6-4acd-9c6d-b5fd3408abaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4c407a1-25b3-480a-b72a-2ecc4057b359', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:32:12 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-cdbbb450-0960-4ca1-a8eb-2ff3d7e83602 tempest-ProjectMemberTests-163191203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27a0ea5e-b62f-4739-882c-24e71223ffc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:32:12 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-cdbbb450-0960-4ca1-a8eb-2ff3d7e83602 tempest-ProjectMemberTests-163191203 None] Volume volume-b4c407a1-25b3-480a-b72a-2ecc4057b359 (b4c407a1-25b3-480a-b72a-2ecc4057b359): created successfully Nov 04 10:32:12 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-cdbbb450-0960-4ca1-a8eb-2ff3d7e83602 tempest-ProjectMemberTests-163191203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27a0ea5e-b62f-4739-882c-24e71223ffc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:32:12 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-cdbbb450-0960-4ca1-a8eb-2ff3d7e83602 tempest-ProjectMemberTests-163191203 None] Flow 'volume_create_manager' (db2eb484-b647-4c0f-a9c7-c045098aa727) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:32:12 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-cdbbb450-0960-4ca1-a8eb-2ff3d7e83602 tempest-ProjectMemberTests-163191203 None] Created volume successfully. Nov 04 10:32:13 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-deed397a-44e7-4f64-9128-f3961b934248 tempest-ProjectMemberTests-163191203 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:32:13 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-deed397a-44e7-4f64-9128-f3961b934248 tempest-ProjectMemberTests-163191203 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:32:13 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-deed397a-44e7-4f64-9128-f3961b934248 tempest-ProjectMemberTests-163191203 None] Creating offline snapshot 5eb7b7d0-0b98-4ef5-9f34-3dc3659a30b6 of volume b4c407a1-25b3-480a-b72a-2ecc4057b359 {{(pid=87068) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 10:32:13 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3861a8e-1655-45e6-8d93-20a7e70a15b0]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:32:13 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-deed397a-44e7-4f64-9128-f3961b934248 tempest-ProjectMemberTests-163191203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b4c407a1-25b3-480a-b72a-2ecc4057b359 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:32:13 devstack sudo[105987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b4c407a1-25b3-480a-b72a-2ecc4057b359 Nov 04 10:32:13 devstack sudo[105987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:32:13 devstack sudo[105987]: pam_unix(sudo:session): session closed for user root Nov 04 10:32:13 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-deed397a-44e7-4f64-9128-f3961b934248 tempest-ProjectMemberTests-163191203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b4c407a1-25b3-480a-b72a-2ecc4057b359" returned: 0 in 0.409s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:32:13 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-deed397a-44e7-4f64-9128-f3961b934248 tempest-ProjectMemberTests-163191203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b4c407a1-25b3-480a-b72a-2ecc4057b359,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b4c407a1-25b3-480a-b72a-2ecc4057b359.5eb7b7d0-0b98-4ef5-9f34-3dc3659a30b6 1G {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:32:13 devstack sudo[105992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b4c407a1-25b3-480a-b72a-2ecc4057b359,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b4c407a1-25b3-480a-b72a-2ecc4057b359.5eb7b7d0-0b98-4ef5-9f34-3dc3659a30b6 1G Nov 04 10:32:13 devstack sudo[105992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:32:14 devstack sudo[105992]: pam_unix(sudo:session): session closed for user root Nov 04 10:32:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-deed397a-44e7-4f64-9128-f3961b934248 tempest-ProjectMemberTests-163191203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b4c407a1-25b3-480a-b72a-2ecc4057b359,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b4c407a1-25b3-480a-b72a-2ecc4057b359.5eb7b7d0-0b98-4ef5-9f34-3dc3659a30b6 1G" returned: 0 in 0.421s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:32:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-deed397a-44e7-4f64-9128-f3961b934248 tempest-ProjectMemberTests-163191203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b4c407a1-25b3-480a-b72a-2ecc4057b359 -F qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b4c407a1-25b3-480a-b72a-2ecc4057b359.5eb7b7d0-0b98-4ef5-9f34-3dc3659a30b6 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:32:14 devstack sudo[105997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b4c407a1-25b3-480a-b72a-2ecc4057b359 -F qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b4c407a1-25b3-480a-b72a-2ecc4057b359.5eb7b7d0-0b98-4ef5-9f34-3dc3659a30b6 Nov 04 10:32:14 devstack sudo[105997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:32:14 devstack sudo[105997]: pam_unix(sudo:session): session closed for user root Nov 04 10:32:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-deed397a-44e7-4f64-9128-f3961b934248 tempest-ProjectMemberTests-163191203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b4c407a1-25b3-480a-b72a-2ecc4057b359 -F qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b4c407a1-25b3-480a-b72a-2ecc4057b359.5eb7b7d0-0b98-4ef5-9f34-3dc3659a30b6" returned: 0 in 0.351s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:32:14 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-deed397a-44e7-4f64-9128-f3961b934248 tempest-ProjectMemberTests-163191203 None] /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b4c407a1-25b3-480a-b72a-2ecc4057b359.5eb7b7d0-0b98-4ef5-9f34-3dc3659a30b6 is being set with open permissions: ugo+rw Nov 04 10:32:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-deed397a-44e7-4f64-9128-f3961b934248 tempest-ProjectMemberTests-163191203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b4c407a1-25b3-480a-b72a-2ecc4057b359.5eb7b7d0-0b98-4ef5-9f34-3dc3659a30b6 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:32:14 devstack sudo[106003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b4c407a1-25b3-480a-b72a-2ecc4057b359.5eb7b7d0-0b98-4ef5-9f34-3dc3659a30b6 Nov 04 10:32:14 devstack sudo[106003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:32:14 devstack sudo[106003]: pam_unix(sudo:session): session closed for user root Nov 04 10:32:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-deed397a-44e7-4f64-9128-f3961b934248 tempest-ProjectMemberTests-163191203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b4c407a1-25b3-480a-b72a-2ecc4057b359.5eb7b7d0-0b98-4ef5-9f34-3dc3659a30b6" returned: 0 in 0.246s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:32:14 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-deed397a-44e7-4f64-9128-f3961b934248 tempest-ProjectMemberTests-163191203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b4c407a1-25b3-480a-b72a-2ecc4057b359.info {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:32:14 devstack sudo[106006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b4c407a1-25b3-480a-b72a-2ecc4057b359.info Nov 04 10:32:14 devstack sudo[106006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:32:15 devstack sudo[106006]: pam_unix(sudo:session): session closed for user root Nov 04 10:32:15 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-deed397a-44e7-4f64-9128-f3961b934248 tempest-ProjectMemberTests-163191203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b4c407a1-25b3-480a-b72a-2ecc4057b359.info" returned: 0 in 0.257s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:32:15 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-deed397a-44e7-4f64-9128-f3961b934248 tempest-ProjectMemberTests-163191203 None] /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b4c407a1-25b3-480a-b72a-2ecc4057b359.info is being set with open permissions: ugo+rw Nov 04 10:32:15 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-deed397a-44e7-4f64-9128-f3961b934248 tempest-ProjectMemberTests-163191203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b4c407a1-25b3-480a-b72a-2ecc4057b359.info {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:32:15 devstack sudo[106009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b4c407a1-25b3-480a-b72a-2ecc4057b359.info Nov 04 10:32:15 devstack sudo[106009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:32:15 devstack sudo[106009]: pam_unix(sudo:session): session closed for user root Nov 04 10:32:15 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-deed397a-44e7-4f64-9128-f3961b934248 tempest-ProjectMemberTests-163191203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b4c407a1-25b3-480a-b72a-2ecc4057b359.info" returned: 0 in 0.276s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:32:15 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-deed397a-44e7-4f64-9128-f3961b934248 tempest-ProjectMemberTests-163191203 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.064s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:32:15 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-deed397a-44e7-4f64-9128-f3961b934248 tempest-ProjectMemberTests-163191203 None] Create snapshot completed successfully Nov 04 10:32:16 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-9acaff8d-70c9-41f3-b295-938e95d87fd8 tempest-ProjectMemberTests-163191203 None] Acquiring lock "cinder-5eb7b7d0-0b98-4ef5-9f34-3dc3659a30b6-delete_snapshot" by "delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:32:16 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-9acaff8d-70c9-41f3-b295-938e95d87fd8 tempest-ProjectMemberTests-163191203 None] Lock "cinder-5eb7b7d0-0b98-4ef5-9f34-3dc3659a30b6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:32:16 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-9acaff8d-70c9-41f3-b295-938e95d87fd8 tempest-ProjectMemberTests-163191203 None] Acquiring lock "cinder-quobyte-b4c407a1-25b3-480a-b72a-2ecc4057b359" by "delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:32:16 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-9acaff8d-70c9-41f3-b295-938e95d87fd8 tempest-ProjectMemberTests-163191203 None] Lock "cinder-quobyte-b4c407a1-25b3-480a-b72a-2ecc4057b359" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:32:16 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-9acaff8d-70c9-41f3-b295-938e95d87fd8 tempest-ProjectMemberTests-163191203 None] Acquiring lock "cinder-quobyte-5eb7b7d0-0b98-4ef5-9f34-3dc3659a30b6" by "_delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:32:16 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-9acaff8d-70c9-41f3-b295-938e95d87fd8 tempest-ProjectMemberTests-163191203 None] Lock "cinder-quobyte-5eb7b7d0-0b98-4ef5-9f34-3dc3659a30b6" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:32:16 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-9acaff8d-70c9-41f3-b295-938e95d87fd8 tempest-ProjectMemberTests-163191203 None] Deleting offline snapshot 5eb7b7d0-0b98-4ef5-9f34-3dc3659a30b6 of volume b4c407a1-25b3-480a-b72a-2ecc4057b359 {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 10:32:16 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-9acaff8d-70c9-41f3-b295-938e95d87fd8 tempest-ProjectMemberTests-163191203 None] snapshot_file for this snap is: volume-b4c407a1-25b3-480a-b72a-2ecc4057b359.5eb7b7d0-0b98-4ef5-9f34-3dc3659a30b6 {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 10:32:16 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[c92382a4-0ab4-4335-89cb-18c7bf2f294c]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:32:16 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-9acaff8d-70c9-41f3-b295-938e95d87fd8 tempest-ProjectMemberTests-163191203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b4c407a1-25b3-480a-b72a-2ecc4057b359.5eb7b7d0-0b98-4ef5-9f34-3dc3659a30b6 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:32:16 devstack sudo[106013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b4c407a1-25b3-480a-b72a-2ecc4057b359.5eb7b7d0-0b98-4ef5-9f34-3dc3659a30b6 Nov 04 10:32:16 devstack sudo[106013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:32:17 devstack sudo[106013]: pam_unix(sudo:session): session closed for user root Nov 04 10:32:17 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-9acaff8d-70c9-41f3-b295-938e95d87fd8 tempest-ProjectMemberTests-163191203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b4c407a1-25b3-480a-b72a-2ecc4057b359.5eb7b7d0-0b98-4ef5-9f34-3dc3659a30b6" returned: 0 in 0.377s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:32:17 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-9acaff8d-70c9-41f3-b295-938e95d87fd8 tempest-ProjectMemberTests-163191203 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b4c407a1-25b3-480a-b72a-2ecc4057b359(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87068) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 10:32:17 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[0494b40a-6fc9-4d44-96fc-59f52031caa5]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:32:17 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-9acaff8d-70c9-41f3-b295-938e95d87fd8 tempest-ProjectMemberTests-163191203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b4c407a1-25b3-480a-b72a-2ecc4057b359 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:32:17 devstack sudo[106018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b4c407a1-25b3-480a-b72a-2ecc4057b359 Nov 04 10:32:17 devstack sudo[106018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:32:17 devstack sudo[106018]: pam_unix(sudo:session): session closed for user root Nov 04 10:32:17 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-9acaff8d-70c9-41f3-b295-938e95d87fd8 tempest-ProjectMemberTests-163191203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b4c407a1-25b3-480a-b72a-2ecc4057b359" returned: 0 in 0.346s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:32:17 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-9acaff8d-70c9-41f3-b295-938e95d87fd8 tempest-ProjectMemberTests-163191203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b4c407a1-25b3-480a-b72a-2ecc4057b359.5eb7b7d0-0b98-4ef5-9f34-3dc3659a30b6 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:32:17 devstack sudo[106024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b4c407a1-25b3-480a-b72a-2ecc4057b359.5eb7b7d0-0b98-4ef5-9f34-3dc3659a30b6 Nov 04 10:32:17 devstack sudo[106024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:32:17 devstack sudo[106024]: pam_unix(sudo:session): session closed for user root Nov 04 10:32:17 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-9acaff8d-70c9-41f3-b295-938e95d87fd8 tempest-ProjectMemberTests-163191203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b4c407a1-25b3-480a-b72a-2ecc4057b359.5eb7b7d0-0b98-4ef5-9f34-3dc3659a30b6" returned: 0 in 0.368s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:32:17 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-9acaff8d-70c9-41f3-b295-938e95d87fd8 tempest-ProjectMemberTests-163191203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b4c407a1-25b3-480a-b72a-2ecc4057b359.5eb7b7d0-0b98-4ef5-9f34-3dc3659a30b6 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:32:17 devstack sudo[106029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b4c407a1-25b3-480a-b72a-2ecc4057b359.5eb7b7d0-0b98-4ef5-9f34-3dc3659a30b6 Nov 04 10:32:17 devstack sudo[106029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:32:18 devstack sudo[106029]: pam_unix(sudo:session): session closed for user root Nov 04 10:32:18 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-9acaff8d-70c9-41f3-b295-938e95d87fd8 tempest-ProjectMemberTests-163191203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b4c407a1-25b3-480a-b72a-2ecc4057b359.5eb7b7d0-0b98-4ef5-9f34-3dc3659a30b6" returned: 0 in 0.314s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:32:18 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-9acaff8d-70c9-41f3-b295-938e95d87fd8 tempest-ProjectMemberTests-163191203 None] Lock "cinder-quobyte-5eb7b7d0-0b98-4ef5-9f34-3dc3659a30b6" released by "_delete_snapshot" :: held 1.512s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:32:18 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-9acaff8d-70c9-41f3-b295-938e95d87fd8 tempest-ProjectMemberTests-163191203 None] Lock "cinder-quobyte-b4c407a1-25b3-480a-b72a-2ecc4057b359" released by "delete_snapshot" :: held 1.537s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:32:18 devstack cinder-volume[87068]: DEBUG dbcounter [-] [87068] Writing DB stats cinder:UPDATE=230,cinder:DELETE=16,cinder:SELECT=177,cinder:INSERT=66 {{(pid=87068) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 10:32:18 devstack cinder-volume[87068]: DEBUG dbcounter [-] [87068] Writing DB stats cinder:SELECT=173,cinder:UPDATE=224,cinder:INSERT=54,cinder:DELETE=23 {{(pid=87068) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 10:32:18 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-9acaff8d-70c9-41f3-b295-938e95d87fd8 tempest-ProjectMemberTests-163191203 None] Created reservations ['8d6e23da-6a2d-4dab-b048-c27f1ee872c2', 'b6641d45-d10b-49f7-a44e-f120a6cea1d8', 'ac953686-2a0c-45d6-9226-92b710a02fb7', '851af5da-c037-436d-80f6-87b4654b06e9'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:32:18 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-9acaff8d-70c9-41f3-b295-938e95d87fd8 tempest-ProjectMemberTests-163191203 None] Delete snapshot completed successfully. Nov 04 10:32:18 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-9acaff8d-70c9-41f3-b295-938e95d87fd8 tempest-ProjectMemberTests-163191203 None] Lock "cinder-5eb7b7d0-0b98-4ef5-9f34-3dc3659a30b6-delete_snapshot" released by "delete_snapshot" :: held 1.724s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:32:18 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-cb926819-8857-4c93-8116-920806e14c20 tempest-ProjectMemberTests-163191203 None] Acquiring lock "cinder-b4c407a1-25b3-480a-b72a-2ecc4057b359-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:32:18 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-cb926819-8857-4c93-8116-920806e14c20 tempest-ProjectMemberTests-163191203 None] Lock "cinder-b4c407a1-25b3-480a-b72a-2ecc4057b359-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:32:18 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-cb926819-8857-4c93-8116-920806e14c20 tempest-ProjectMemberTests-163191203 None] Acquiring lock "cinder-quobyte-b4c407a1-25b3-480a-b72a-2ecc4057b359" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:32:18 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-cb926819-8857-4c93-8116-920806e14c20 tempest-ProjectMemberTests-163191203 None] Lock "cinder-quobyte-b4c407a1-25b3-480a-b72a-2ecc4057b359" acquired by "delete_volume" :: waited 0.018s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:32:18 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[de7d6beb-955d-4a4d-8a11-9c36cdf84374]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:32:18 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-cb926819-8857-4c93-8116-920806e14c20 tempest-ProjectMemberTests-163191203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b4c407a1-25b3-480a-b72a-2ecc4057b359 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:32:19 devstack sudo[106033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b4c407a1-25b3-480a-b72a-2ecc4057b359 Nov 04 10:32:19 devstack sudo[106033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:32:19 devstack sudo[106033]: pam_unix(sudo:session): session closed for user root Nov 04 10:32:19 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-cb926819-8857-4c93-8116-920806e14c20 tempest-ProjectMemberTests-163191203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b4c407a1-25b3-480a-b72a-2ecc4057b359" returned: 0 in 0.366s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:32:19 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-cb926819-8857-4c93-8116-920806e14c20 tempest-ProjectMemberTests-163191203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b4c407a1-25b3-480a-b72a-2ecc4057b359 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:32:19 devstack sudo[106039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b4c407a1-25b3-480a-b72a-2ecc4057b359 Nov 04 10:32:19 devstack sudo[106039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:32:19 devstack sudo[106039]: pam_unix(sudo:session): session closed for user root Nov 04 10:32:19 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-cb926819-8857-4c93-8116-920806e14c20 tempest-ProjectMemberTests-163191203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-b4c407a1-25b3-480a-b72a-2ecc4057b359" returned: 0 in 0.261s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:32:19 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-cb926819-8857-4c93-8116-920806e14c20 tempest-ProjectMemberTests-163191203 None] Lock "cinder-quobyte-b4c407a1-25b3-480a-b72a-2ecc4057b359" released by "delete_volume" :: held 0.703s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:32:19 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-cb926819-8857-4c93-8116-920806e14c20 tempest-ProjectMemberTests-163191203 None] Created reservations ['bcdda693-76da-4bfe-a82d-205d192e964d', 'c8355aff-db3e-48a4-99e0-34613889d1aa', '5e2649c7-935a-4f62-8265-20cebcbbcf08', '9b20c03b-1971-440b-8900-65e0789a3013'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:32:19 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-cb926819-8857-4c93-8116-920806e14c20 tempest-ProjectMemberTests-163191203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:32:19 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-cb926819-8857-4c93-8116-920806e14c20 tempest-ProjectMemberTests-163191203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:32:19 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-cb926819-8857-4c93-8116-920806e14c20 tempest-ProjectMemberTests-163191203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:32:19 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-cb926819-8857-4c93-8116-920806e14c20 tempest-ProjectMemberTests-163191203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:32:19 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-cb926819-8857-4c93-8116-920806e14c20 tempest-ProjectMemberTests-163191203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:32:19 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-cb926819-8857-4c93-8116-920806e14c20 tempest-ProjectMemberTests-163191203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:32:19 devstack sudo[106042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:32:19 devstack sudo[106042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:32:20 devstack sudo[106042]: pam_unix(sudo:session): session closed for user root Nov 04 10:32:20 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-cb926819-8857-4c93-8116-920806e14c20 tempest-ProjectMemberTests-163191203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.271s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:32:20 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-cb926819-8857-4c93-8116-920806e14c20 tempest-ProjectMemberTests-163191203 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:32:20 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-cb926819-8857-4c93-8116-920806e14c20 tempest-ProjectMemberTests-163191203 None] Deleted volume successfully. Nov 04 10:32:20 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-cb926819-8857-4c93-8116-920806e14c20 tempest-ProjectMemberTests-163191203 None] Lock "cinder-b4c407a1-25b3-480a-b72a-2ecc4057b359-delete_volume" released by "delete_volume" :: held 1.208s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:32:20 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-373025d8-31d9-456e-94ee-366277f50589 tempest-ProjectMemberTests-163191203 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:32:20 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-373025d8-31d9-456e-94ee-366277f50589 tempest-ProjectMemberTests-163191203 None] Flow 'volume_create_manager' (ca956747-f874-4e99-834e-16ea30c72aae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:32:20 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-373025d8-31d9-456e-94ee-366277f50589 tempest-ProjectMemberTests-163191203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0149a4a5-e730-4138-bc7f-3c19d0f9983f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:32:20 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-373025d8-31d9-456e-94ee-366277f50589 tempest-ProjectMemberTests-163191203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0149a4a5-e730-4138-bc7f-3c19d0f9983f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:32:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1324400255',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45dbe4c4-771f-43e6-a42c-71d4b3465f6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6102192fe22c4f298ee9815860bd7a9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:32:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:32:20Z,use_quota=True,user_id='df3853accc6242909d45cceeb3a0db9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:32:20 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-373025d8-31d9-456e-94ee-366277f50589 tempest-ProjectMemberTests-163191203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5b5bc8a-3ebd-4e4d-b7ef-0466cd36e238) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:32:20 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-373025d8-31d9-456e-94ee-366277f50589 tempest-ProjectMemberTests-163191203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5b5bc8a-3ebd-4e4d-b7ef-0466cd36e238) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:32:20 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-373025d8-31d9-456e-94ee-366277f50589 tempest-ProjectMemberTests-163191203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ca98784-4fe1-4b70-8c7f-fad29401bf8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:32:20 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-373025d8-31d9-456e-94ee-366277f50589 tempest-ProjectMemberTests-163191203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ca98784-4fe1-4b70-8c7f-fad29401bf8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45dbe4c4-771f-43e6-a42c-71d4b3465f6f', 'volume_name': 'volume-45dbe4c4-771f-43e6-a42c-71d4b3465f6f', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:32:20 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-373025d8-31d9-456e-94ee-366277f50589 tempest-ProjectMemberTests-163191203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2dfc231-2735-44d2-9e58-071de7074389) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:32:20 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-373025d8-31d9-456e-94ee-366277f50589 tempest-ProjectMemberTests-163191203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2dfc231-2735-44d2-9e58-071de7074389) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:32:20 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-373025d8-31d9-456e-94ee-366277f50589 tempest-ProjectMemberTests-163191203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53d26490-f825-4979-82f0-84fc9ffbb8e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:32:20 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-373025d8-31d9-456e-94ee-366277f50589 tempest-ProjectMemberTests-163191203 None] Volume 45dbe4c4-771f-43e6-a42c-71d4b3465f6f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45dbe4c4-771f-43e6-a42c-71d4b3465f6f', 'volume_size': 1} Nov 04 10:32:20 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-373025d8-31d9-456e-94ee-366277f50589 tempest-ProjectMemberTests-163191203 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:32:20 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-373025d8-31d9-456e-94ee-366277f50589 tempest-ProjectMemberTests-163191203 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:32:20 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-373025d8-31d9-456e-94ee-366277f50589 tempest-ProjectMemberTests-163191203 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:32:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1324400255',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45dbe4c4-771f-43e6-a42c-71d4b3465f6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6102192fe22c4f298ee9815860bd7a9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:32:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:32:20Z,use_quota=True,user_id='df3853accc6242909d45cceeb3a0db9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 10:32:20 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-373025d8-31d9-456e-94ee-366277f50589 tempest-ProjectMemberTests-163191203 None] Creating volume 45dbe4c4-771f-43e6-a42c-71d4b3465f6f {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:32:20 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-373025d8-31d9-456e-94ee-366277f50589 tempest-ProjectMemberTests-163191203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:32:20 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-373025d8-31d9-456e-94ee-366277f50589 tempest-ProjectMemberTests-163191203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:32:20 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-373025d8-31d9-456e-94ee-366277f50589 tempest-ProjectMemberTests-163191203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:32:20 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-373025d8-31d9-456e-94ee-366277f50589 tempest-ProjectMemberTests-163191203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:32:20 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-373025d8-31d9-456e-94ee-366277f50589 tempest-ProjectMemberTests-163191203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:32:20 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-373025d8-31d9-456e-94ee-366277f50589 tempest-ProjectMemberTests-163191203 None] Selected osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:32:20 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-373025d8-31d9-456e-94ee-366277f50589 tempest-ProjectMemberTests-163191203 None] casted to osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 Nov 04 10:32:20 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-373025d8-31d9-456e-94ee-366277f50589 tempest-ProjectMemberTests-163191203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-45dbe4c4-771f-43e6-a42c-71d4b3465f6f 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:32:20 devstack sudo[106045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-45dbe4c4-771f-43e6-a42c-71d4b3465f6f 1073741824 Nov 04 10:32:20 devstack sudo[106045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:32:21 devstack sudo[106045]: pam_unix(sudo:session): session closed for user root Nov 04 10:32:21 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-373025d8-31d9-456e-94ee-366277f50589 tempest-ProjectMemberTests-163191203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-45dbe4c4-771f-43e6-a42c-71d4b3465f6f 1073741824" returned: 0 in 0.429s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:32:21 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-373025d8-31d9-456e-94ee-366277f50589 tempest-ProjectMemberTests-163191203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-45dbe4c4-771f-43e6-a42c-71d4b3465f6f {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:32:21 devstack sudo[106050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-45dbe4c4-771f-43e6-a42c-71d4b3465f6f Nov 04 10:32:21 devstack sudo[106050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:32:21 devstack sudo[106050]: pam_unix(sudo:session): session closed for user root Nov 04 10:32:21 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-373025d8-31d9-456e-94ee-366277f50589 tempest-ProjectMemberTests-163191203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-45dbe4c4-771f-43e6-a42c-71d4b3465f6f" returned: 0 in 0.227s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:32:21 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-373025d8-31d9-456e-94ee-366277f50589 tempest-ProjectMemberTests-163191203 None] <== create_volume: return (698ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 10:32:21 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-373025d8-31d9-456e-94ee-366277f50589 tempest-ProjectMemberTests-163191203 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.700s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:32:21 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-373025d8-31d9-456e-94ee-366277f50589 tempest-ProjectMemberTests-163191203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53d26490-f825-4979-82f0-84fc9ffbb8e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45dbe4c4-771f-43e6-a42c-71d4b3465f6f', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:32:21 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-373025d8-31d9-456e-94ee-366277f50589 tempest-ProjectMemberTests-163191203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2017ef1e-2751-45b8-9676-ea9b6f9a7d6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:32:21 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-373025d8-31d9-456e-94ee-366277f50589 tempest-ProjectMemberTests-163191203 None] Volume volume-45dbe4c4-771f-43e6-a42c-71d4b3465f6f (45dbe4c4-771f-43e6-a42c-71d4b3465f6f): created successfully Nov 04 10:32:21 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-373025d8-31d9-456e-94ee-366277f50589 tempest-ProjectMemberTests-163191203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2017ef1e-2751-45b8-9676-ea9b6f9a7d6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:32:21 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-373025d8-31d9-456e-94ee-366277f50589 tempest-ProjectMemberTests-163191203 None] Flow 'volume_create_manager' (ca956747-f874-4e99-834e-16ea30c72aae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:32:21 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-373025d8-31d9-456e-94ee-366277f50589 tempest-ProjectMemberTests-163191203 None] Created volume successfully. Nov 04 10:32:21 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-aa44d1d8-77fe-4e1d-88e8-ea312d147ea2 tempest-ProjectMemberTests-163191203 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:32:21 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-aa44d1d8-77fe-4e1d-88e8-ea312d147ea2 tempest-ProjectMemberTests-163191203 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:32:21 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-aa44d1d8-77fe-4e1d-88e8-ea312d147ea2 tempest-ProjectMemberTests-163191203 None] Creating offline snapshot 103d843f-7523-4885-9373-7621df32ac8d of volume 45dbe4c4-771f-43e6-a42c-71d4b3465f6f {{(pid=87068) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 10:32:21 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[31c43c4b-7bc8-43d2-aa58-0440a206960c]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:32:21 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-aa44d1d8-77fe-4e1d-88e8-ea312d147ea2 tempest-ProjectMemberTests-163191203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-45dbe4c4-771f-43e6-a42c-71d4b3465f6f {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:32:21 devstack sudo[106053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-45dbe4c4-771f-43e6-a42c-71d4b3465f6f Nov 04 10:32:21 devstack sudo[106053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:32:22 devstack sudo[106053]: pam_unix(sudo:session): session closed for user root Nov 04 10:32:22 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-aa44d1d8-77fe-4e1d-88e8-ea312d147ea2 tempest-ProjectMemberTests-163191203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-45dbe4c4-771f-43e6-a42c-71d4b3465f6f" returned: 0 in 0.341s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:32:22 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-aa44d1d8-77fe-4e1d-88e8-ea312d147ea2 tempest-ProjectMemberTests-163191203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-45dbe4c4-771f-43e6-a42c-71d4b3465f6f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-45dbe4c4-771f-43e6-a42c-71d4b3465f6f.103d843f-7523-4885-9373-7621df32ac8d 1G {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:32:22 devstack sudo[106058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-45dbe4c4-771f-43e6-a42c-71d4b3465f6f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-45dbe4c4-771f-43e6-a42c-71d4b3465f6f.103d843f-7523-4885-9373-7621df32ac8d 1G Nov 04 10:32:22 devstack sudo[106058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:32:22 devstack sudo[106058]: pam_unix(sudo:session): session closed for user root Nov 04 10:32:22 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-aa44d1d8-77fe-4e1d-88e8-ea312d147ea2 tempest-ProjectMemberTests-163191203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-45dbe4c4-771f-43e6-a42c-71d4b3465f6f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-45dbe4c4-771f-43e6-a42c-71d4b3465f6f.103d843f-7523-4885-9373-7621df32ac8d 1G" returned: 0 in 0.380s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:32:22 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-aa44d1d8-77fe-4e1d-88e8-ea312d147ea2 tempest-ProjectMemberTests-163191203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-45dbe4c4-771f-43e6-a42c-71d4b3465f6f -F qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-45dbe4c4-771f-43e6-a42c-71d4b3465f6f.103d843f-7523-4885-9373-7621df32ac8d {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:32:22 devstack sudo[106063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-45dbe4c4-771f-43e6-a42c-71d4b3465f6f -F qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-45dbe4c4-771f-43e6-a42c-71d4b3465f6f.103d843f-7523-4885-9373-7621df32ac8d Nov 04 10:32:22 devstack sudo[106063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:32:22 devstack sudo[106063]: pam_unix(sudo:session): session closed for user root Nov 04 10:32:22 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-aa44d1d8-77fe-4e1d-88e8-ea312d147ea2 tempest-ProjectMemberTests-163191203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-45dbe4c4-771f-43e6-a42c-71d4b3465f6f -F qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-45dbe4c4-771f-43e6-a42c-71d4b3465f6f.103d843f-7523-4885-9373-7621df32ac8d" returned: 0 in 0.274s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:32:22 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-aa44d1d8-77fe-4e1d-88e8-ea312d147ea2 tempest-ProjectMemberTests-163191203 None] /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-45dbe4c4-771f-43e6-a42c-71d4b3465f6f.103d843f-7523-4885-9373-7621df32ac8d is being set with open permissions: ugo+rw Nov 04 10:32:22 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-aa44d1d8-77fe-4e1d-88e8-ea312d147ea2 tempest-ProjectMemberTests-163191203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-45dbe4c4-771f-43e6-a42c-71d4b3465f6f.103d843f-7523-4885-9373-7621df32ac8d {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:32:22 devstack sudo[106068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-45dbe4c4-771f-43e6-a42c-71d4b3465f6f.103d843f-7523-4885-9373-7621df32ac8d Nov 04 10:32:22 devstack sudo[106068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:32:22 devstack sudo[106068]: pam_unix(sudo:session): session closed for user root Nov 04 10:32:22 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-aa44d1d8-77fe-4e1d-88e8-ea312d147ea2 tempest-ProjectMemberTests-163191203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-45dbe4c4-771f-43e6-a42c-71d4b3465f6f.103d843f-7523-4885-9373-7621df32ac8d" returned: 0 in 0.224s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:32:22 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-aa44d1d8-77fe-4e1d-88e8-ea312d147ea2 tempest-ProjectMemberTests-163191203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-45dbe4c4-771f-43e6-a42c-71d4b3465f6f.info {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:32:22 devstack sudo[106072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-45dbe4c4-771f-43e6-a42c-71d4b3465f6f.info Nov 04 10:32:22 devstack sudo[106072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:32:23 devstack sudo[106072]: pam_unix(sudo:session): session closed for user root Nov 04 10:32:23 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-aa44d1d8-77fe-4e1d-88e8-ea312d147ea2 tempest-ProjectMemberTests-163191203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-45dbe4c4-771f-43e6-a42c-71d4b3465f6f.info" returned: 0 in 0.230s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:32:23 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-aa44d1d8-77fe-4e1d-88e8-ea312d147ea2 tempest-ProjectMemberTests-163191203 None] /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-45dbe4c4-771f-43e6-a42c-71d4b3465f6f.info is being set with open permissions: ugo+rw Nov 04 10:32:23 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-aa44d1d8-77fe-4e1d-88e8-ea312d147ea2 tempest-ProjectMemberTests-163191203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-45dbe4c4-771f-43e6-a42c-71d4b3465f6f.info {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:32:23 devstack sudo[106075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-45dbe4c4-771f-43e6-a42c-71d4b3465f6f.info Nov 04 10:32:23 devstack sudo[106075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:32:23 devstack sudo[106075]: pam_unix(sudo:session): session closed for user root Nov 04 10:32:23 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-aa44d1d8-77fe-4e1d-88e8-ea312d147ea2 tempest-ProjectMemberTests-163191203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-45dbe4c4-771f-43e6-a42c-71d4b3465f6f.info" returned: 0 in 0.228s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:32:23 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-aa44d1d8-77fe-4e1d-88e8-ea312d147ea2 tempest-ProjectMemberTests-163191203 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.752s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:32:23 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-aa44d1d8-77fe-4e1d-88e8-ea312d147ea2 tempest-ProjectMemberTests-163191203 None] Create snapshot completed successfully Nov 04 10:32:23 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-ea02efa3-949a-4a4d-9da3-9d150be7c8eb tempest-ProjectMemberTests-163191203 None] Acquiring lock "cinder-103d843f-7523-4885-9373-7621df32ac8d-delete_snapshot" by "delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:32:23 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-ea02efa3-949a-4a4d-9da3-9d150be7c8eb tempest-ProjectMemberTests-163191203 None] Lock "cinder-103d843f-7523-4885-9373-7621df32ac8d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:32:23 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-ea02efa3-949a-4a4d-9da3-9d150be7c8eb tempest-ProjectMemberTests-163191203 None] Acquiring lock "cinder-quobyte-45dbe4c4-771f-43e6-a42c-71d4b3465f6f" by "delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:32:23 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-ea02efa3-949a-4a4d-9da3-9d150be7c8eb tempest-ProjectMemberTests-163191203 None] Lock "cinder-quobyte-45dbe4c4-771f-43e6-a42c-71d4b3465f6f" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:32:23 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-ea02efa3-949a-4a4d-9da3-9d150be7c8eb tempest-ProjectMemberTests-163191203 None] Acquiring lock "cinder-quobyte-103d843f-7523-4885-9373-7621df32ac8d" by "_delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:32:23 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-ea02efa3-949a-4a4d-9da3-9d150be7c8eb tempest-ProjectMemberTests-163191203 None] Lock "cinder-quobyte-103d843f-7523-4885-9373-7621df32ac8d" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:32:23 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-ea02efa3-949a-4a4d-9da3-9d150be7c8eb tempest-ProjectMemberTests-163191203 None] Deleting offline snapshot 103d843f-7523-4885-9373-7621df32ac8d of volume 45dbe4c4-771f-43e6-a42c-71d4b3465f6f {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 10:32:23 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-ea02efa3-949a-4a4d-9da3-9d150be7c8eb tempest-ProjectMemberTests-163191203 None] snapshot_file for this snap is: volume-45dbe4c4-771f-43e6-a42c-71d4b3465f6f.103d843f-7523-4885-9373-7621df32ac8d {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 10:32:23 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[4413cd78-0b81-44ac-91dd-a876859b2745]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:32:23 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ea02efa3-949a-4a4d-9da3-9d150be7c8eb tempest-ProjectMemberTests-163191203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-45dbe4c4-771f-43e6-a42c-71d4b3465f6f.103d843f-7523-4885-9373-7621df32ac8d {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:32:23 devstack sudo[106078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-45dbe4c4-771f-43e6-a42c-71d4b3465f6f.103d843f-7523-4885-9373-7621df32ac8d Nov 04 10:32:23 devstack sudo[106078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:32:24 devstack sudo[106078]: pam_unix(sudo:session): session closed for user root Nov 04 10:32:24 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ea02efa3-949a-4a4d-9da3-9d150be7c8eb tempest-ProjectMemberTests-163191203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-45dbe4c4-771f-43e6-a42c-71d4b3465f6f.103d843f-7523-4885-9373-7621df32ac8d" returned: 0 in 0.340s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:32:24 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-ea02efa3-949a-4a4d-9da3-9d150be7c8eb tempest-ProjectMemberTests-163191203 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-45dbe4c4-771f-43e6-a42c-71d4b3465f6f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87068) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 10:32:24 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd11c87f-35d4-45ac-96b0-1b0c947abeea]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:32:24 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ea02efa3-949a-4a4d-9da3-9d150be7c8eb tempest-ProjectMemberTests-163191203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-45dbe4c4-771f-43e6-a42c-71d4b3465f6f {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:32:24 devstack sudo[106083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-45dbe4c4-771f-43e6-a42c-71d4b3465f6f Nov 04 10:32:24 devstack sudo[106083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:32:24 devstack sudo[106083]: pam_unix(sudo:session): session closed for user root Nov 04 10:32:24 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ea02efa3-949a-4a4d-9da3-9d150be7c8eb tempest-ProjectMemberTests-163191203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-45dbe4c4-771f-43e6-a42c-71d4b3465f6f" returned: 0 in 0.341s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:32:24 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ea02efa3-949a-4a4d-9da3-9d150be7c8eb tempest-ProjectMemberTests-163191203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-45dbe4c4-771f-43e6-a42c-71d4b3465f6f.103d843f-7523-4885-9373-7621df32ac8d {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:32:24 devstack sudo[106088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-45dbe4c4-771f-43e6-a42c-71d4b3465f6f.103d843f-7523-4885-9373-7621df32ac8d Nov 04 10:32:24 devstack sudo[106088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:32:24 devstack sudo[106088]: pam_unix(sudo:session): session closed for user root Nov 04 10:32:24 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ea02efa3-949a-4a4d-9da3-9d150be7c8eb tempest-ProjectMemberTests-163191203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-45dbe4c4-771f-43e6-a42c-71d4b3465f6f.103d843f-7523-4885-9373-7621df32ac8d" returned: 0 in 0.330s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:32:24 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ea02efa3-949a-4a4d-9da3-9d150be7c8eb tempest-ProjectMemberTests-163191203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-45dbe4c4-771f-43e6-a42c-71d4b3465f6f.103d843f-7523-4885-9373-7621df32ac8d {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:32:24 devstack sudo[106094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-45dbe4c4-771f-43e6-a42c-71d4b3465f6f.103d843f-7523-4885-9373-7621df32ac8d Nov 04 10:32:24 devstack sudo[106094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:32:25 devstack sudo[106094]: pam_unix(sudo:session): session closed for user root Nov 04 10:32:25 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-ea02efa3-949a-4a4d-9da3-9d150be7c8eb tempest-ProjectMemberTests-163191203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-45dbe4c4-771f-43e6-a42c-71d4b3465f6f.103d843f-7523-4885-9373-7621df32ac8d" returned: 0 in 0.224s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:32:25 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-ea02efa3-949a-4a4d-9da3-9d150be7c8eb tempest-ProjectMemberTests-163191203 None] Lock "cinder-quobyte-103d843f-7523-4885-9373-7621df32ac8d" released by "_delete_snapshot" :: held 1.325s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:32:25 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-ea02efa3-949a-4a4d-9da3-9d150be7c8eb tempest-ProjectMemberTests-163191203 None] Lock "cinder-quobyte-45dbe4c4-771f-43e6-a42c-71d4b3465f6f" released by "delete_snapshot" :: held 1.347s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:32:25 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-ea02efa3-949a-4a4d-9da3-9d150be7c8eb tempest-ProjectMemberTests-163191203 None] Created reservations ['f9d1cbc0-a2d8-4590-baac-519f80d67678', '33e26893-44cb-4076-ac85-0ac2293064e9', 'd511b677-35f3-4358-be12-eb1a92b0c88f', 'c0d71e63-1bbb-4a5a-afac-12211c866607'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:32:25 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-ea02efa3-949a-4a4d-9da3-9d150be7c8eb tempest-ProjectMemberTests-163191203 None] Delete snapshot completed successfully. Nov 04 10:32:25 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-ea02efa3-949a-4a4d-9da3-9d150be7c8eb tempest-ProjectMemberTests-163191203 None] Lock "cinder-103d843f-7523-4885-9373-7621df32ac8d-delete_snapshot" released by "delete_snapshot" :: held 1.467s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:32:25 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-8f0172ba-32ea-4551-aae5-0f52b206337f tempest-ProjectMemberTests-163191203 None] Acquiring lock "cinder-45dbe4c4-771f-43e6-a42c-71d4b3465f6f-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:32:25 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-8f0172ba-32ea-4551-aae5-0f52b206337f tempest-ProjectMemberTests-163191203 None] Lock "cinder-45dbe4c4-771f-43e6-a42c-71d4b3465f6f-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:32:25 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-8f0172ba-32ea-4551-aae5-0f52b206337f tempest-ProjectMemberTests-163191203 None] Acquiring lock "cinder-quobyte-45dbe4c4-771f-43e6-a42c-71d4b3465f6f" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:32:25 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-8f0172ba-32ea-4551-aae5-0f52b206337f tempest-ProjectMemberTests-163191203 None] Lock "cinder-quobyte-45dbe4c4-771f-43e6-a42c-71d4b3465f6f" acquired by "delete_volume" :: waited 0.014s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:32:26 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[78557851-f024-49e1-a517-326a8b101af2]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:32:26 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-8f0172ba-32ea-4551-aae5-0f52b206337f tempest-ProjectMemberTests-163191203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-45dbe4c4-771f-43e6-a42c-71d4b3465f6f {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:32:26 devstack sudo[106098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-45dbe4c4-771f-43e6-a42c-71d4b3465f6f Nov 04 10:32:26 devstack sudo[106098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:32:26 devstack sudo[106098]: pam_unix(sudo:session): session closed for user root Nov 04 10:32:26 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-8f0172ba-32ea-4551-aae5-0f52b206337f tempest-ProjectMemberTests-163191203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-45dbe4c4-771f-43e6-a42c-71d4b3465f6f" returned: 0 in 0.329s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:32:26 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-8f0172ba-32ea-4551-aae5-0f52b206337f tempest-ProjectMemberTests-163191203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-45dbe4c4-771f-43e6-a42c-71d4b3465f6f {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:32:26 devstack sudo[106103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-45dbe4c4-771f-43e6-a42c-71d4b3465f6f Nov 04 10:32:26 devstack sudo[106103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:32:26 devstack sudo[106103]: pam_unix(sudo:session): session closed for user root Nov 04 10:32:26 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-8f0172ba-32ea-4551-aae5-0f52b206337f tempest-ProjectMemberTests-163191203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-45dbe4c4-771f-43e6-a42c-71d4b3465f6f" returned: 0 in 0.232s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:32:26 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-8f0172ba-32ea-4551-aae5-0f52b206337f tempest-ProjectMemberTests-163191203 None] Lock "cinder-quobyte-45dbe4c4-771f-43e6-a42c-71d4b3465f6f" released by "delete_volume" :: held 0.618s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:32:26 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-8f0172ba-32ea-4551-aae5-0f52b206337f tempest-ProjectMemberTests-163191203 None] Created reservations ['8f5faf1b-4279-4fac-ae2c-ef7b5671f12b', '585e5773-ab5c-428d-86d0-533ba8930aa7', 'b49c3172-6bb8-4c5e-8416-e85de7beea90', 'b1fdfda2-b0ba-4302-bcb7-6a7166217b0c'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:32:26 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-8f0172ba-32ea-4551-aae5-0f52b206337f tempest-ProjectMemberTests-163191203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:32:26 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-8f0172ba-32ea-4551-aae5-0f52b206337f tempest-ProjectMemberTests-163191203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:32:26 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-8f0172ba-32ea-4551-aae5-0f52b206337f tempest-ProjectMemberTests-163191203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:32:26 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-8f0172ba-32ea-4551-aae5-0f52b206337f tempest-ProjectMemberTests-163191203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:32:26 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-8f0172ba-32ea-4551-aae5-0f52b206337f tempest-ProjectMemberTests-163191203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:32:26 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-8f0172ba-32ea-4551-aae5-0f52b206337f tempest-ProjectMemberTests-163191203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:32:26 devstack sudo[106106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:32:26 devstack sudo[106106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:32:26 devstack sudo[106106]: pam_unix(sudo:session): session closed for user root Nov 04 10:32:26 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-8f0172ba-32ea-4551-aae5-0f52b206337f tempest-ProjectMemberTests-163191203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.226s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:32:26 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-8f0172ba-32ea-4551-aae5-0f52b206337f tempest-ProjectMemberTests-163191203 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:32:26 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-8f0172ba-32ea-4551-aae5-0f52b206337f tempest-ProjectMemberTests-163191203 None] Deleted volume successfully. Nov 04 10:32:26 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-8f0172ba-32ea-4551-aae5-0f52b206337f tempest-ProjectMemberTests-163191203 None] Lock "cinder-45dbe4c4-771f-43e6-a42c-71d4b3465f6f-delete_volume" released by "delete_volume" :: held 1.035s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:32:27 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-e467c3c6-ab38-4bd0-9e9e-1954291a4b0d tempest-ProjectMemberTests-163191203 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:32:27 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-e467c3c6-ab38-4bd0-9e9e-1954291a4b0d tempest-ProjectMemberTests-163191203 None] Flow 'volume_create_manager' (da78e8d9-92b2-46b2-816f-923b06be25d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:32:27 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-e467c3c6-ab38-4bd0-9e9e-1954291a4b0d tempest-ProjectMemberTests-163191203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b010de27-0984-4e65-a816-9704e40f9211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:32:27 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-e467c3c6-ab38-4bd0-9e9e-1954291a4b0d tempest-ProjectMemberTests-163191203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b010de27-0984-4e65-a816-9704e40f9211) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:32:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-694145413',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3978d63e-239b-4992-a827-31e28edc138e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6102192fe22c4f298ee9815860bd7a9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:32:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:32:27Z,use_quota=True,user_id='df3853accc6242909d45cceeb3a0db9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:32:27 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-e467c3c6-ab38-4bd0-9e9e-1954291a4b0d tempest-ProjectMemberTests-163191203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17ff8e3b-44e8-43c3-92d8-103ec8d687f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:32:27 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-e467c3c6-ab38-4bd0-9e9e-1954291a4b0d tempest-ProjectMemberTests-163191203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17ff8e3b-44e8-43c3-92d8-103ec8d687f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:32:27 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-e467c3c6-ab38-4bd0-9e9e-1954291a4b0d tempest-ProjectMemberTests-163191203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba12ef2e-ea7c-4b6b-9d42-eafbfbcf0e3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:32:27 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-e467c3c6-ab38-4bd0-9e9e-1954291a4b0d tempest-ProjectMemberTests-163191203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba12ef2e-ea7c-4b6b-9d42-eafbfbcf0e3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3978d63e-239b-4992-a827-31e28edc138e', 'volume_name': 'volume-3978d63e-239b-4992-a827-31e28edc138e', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:32:27 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-e467c3c6-ab38-4bd0-9e9e-1954291a4b0d tempest-ProjectMemberTests-163191203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c61952db-fe41-431a-994b-1679cbdab743) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:32:27 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-e467c3c6-ab38-4bd0-9e9e-1954291a4b0d tempest-ProjectMemberTests-163191203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c61952db-fe41-431a-994b-1679cbdab743) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:32:27 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-e467c3c6-ab38-4bd0-9e9e-1954291a4b0d tempest-ProjectMemberTests-163191203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (113ecfc3-f97e-43cb-92a5-d5ac88184bc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:32:27 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-e467c3c6-ab38-4bd0-9e9e-1954291a4b0d tempest-ProjectMemberTests-163191203 None] Volume 3978d63e-239b-4992-a827-31e28edc138e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3978d63e-239b-4992-a827-31e28edc138e', 'volume_size': 1} Nov 04 10:32:27 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-e467c3c6-ab38-4bd0-9e9e-1954291a4b0d tempest-ProjectMemberTests-163191203 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:32:27 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-e467c3c6-ab38-4bd0-9e9e-1954291a4b0d tempest-ProjectMemberTests-163191203 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:32:27 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-e467c3c6-ab38-4bd0-9e9e-1954291a4b0d tempest-ProjectMemberTests-163191203 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:32:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-694145413',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3978d63e-239b-4992-a827-31e28edc138e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6102192fe22c4f298ee9815860bd7a9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:32:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:32:27Z,use_quota=True,user_id='df3853accc6242909d45cceeb3a0db9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 10:32:27 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-e467c3c6-ab38-4bd0-9e9e-1954291a4b0d tempest-ProjectMemberTests-163191203 None] Creating volume 3978d63e-239b-4992-a827-31e28edc138e {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:32:27 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-e467c3c6-ab38-4bd0-9e9e-1954291a4b0d tempest-ProjectMemberTests-163191203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:32:27 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-e467c3c6-ab38-4bd0-9e9e-1954291a4b0d tempest-ProjectMemberTests-163191203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:32:27 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-e467c3c6-ab38-4bd0-9e9e-1954291a4b0d tempest-ProjectMemberTests-163191203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:32:27 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-e467c3c6-ab38-4bd0-9e9e-1954291a4b0d tempest-ProjectMemberTests-163191203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:32:27 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-e467c3c6-ab38-4bd0-9e9e-1954291a4b0d tempest-ProjectMemberTests-163191203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:32:27 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-e467c3c6-ab38-4bd0-9e9e-1954291a4b0d tempest-ProjectMemberTests-163191203 None] Selected osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:32:27 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-e467c3c6-ab38-4bd0-9e9e-1954291a4b0d tempest-ProjectMemberTests-163191203 None] casted to osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 Nov 04 10:32:27 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-e467c3c6-ab38-4bd0-9e9e-1954291a4b0d tempest-ProjectMemberTests-163191203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-3978d63e-239b-4992-a827-31e28edc138e 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:32:27 devstack sudo[106109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-3978d63e-239b-4992-a827-31e28edc138e 1073741824 Nov 04 10:32:27 devstack sudo[106109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:32:27 devstack sudo[106109]: pam_unix(sudo:session): session closed for user root Nov 04 10:32:27 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-e467c3c6-ab38-4bd0-9e9e-1954291a4b0d tempest-ProjectMemberTests-163191203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-3978d63e-239b-4992-a827-31e28edc138e 1073741824" returned: 0 in 0.410s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:32:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-e467c3c6-ab38-4bd0-9e9e-1954291a4b0d tempest-ProjectMemberTests-163191203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-3978d63e-239b-4992-a827-31e28edc138e {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:32:28 devstack sudo[106114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-3978d63e-239b-4992-a827-31e28edc138e Nov 04 10:32:28 devstack sudo[106114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:32:28 devstack sudo[106114]: pam_unix(sudo:session): session closed for user root Nov 04 10:32:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-e467c3c6-ab38-4bd0-9e9e-1954291a4b0d tempest-ProjectMemberTests-163191203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-3978d63e-239b-4992-a827-31e28edc138e" returned: 0 in 0.249s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:32:28 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-e467c3c6-ab38-4bd0-9e9e-1954291a4b0d tempest-ProjectMemberTests-163191203 None] <== create_volume: return (699ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 10:32:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-e467c3c6-ab38-4bd0-9e9e-1954291a4b0d tempest-ProjectMemberTests-163191203 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.702s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:32:28 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-e467c3c6-ab38-4bd0-9e9e-1954291a4b0d tempest-ProjectMemberTests-163191203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (113ecfc3-f97e-43cb-92a5-d5ac88184bc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3978d63e-239b-4992-a827-31e28edc138e', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:32:28 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-e467c3c6-ab38-4bd0-9e9e-1954291a4b0d tempest-ProjectMemberTests-163191203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3592c259-edd7-4b23-9acd-f95e9dfd3770) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:32:28 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-e467c3c6-ab38-4bd0-9e9e-1954291a4b0d tempest-ProjectMemberTests-163191203 None] Volume volume-3978d63e-239b-4992-a827-31e28edc138e (3978d63e-239b-4992-a827-31e28edc138e): created successfully Nov 04 10:32:28 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-e467c3c6-ab38-4bd0-9e9e-1954291a4b0d tempest-ProjectMemberTests-163191203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3592c259-edd7-4b23-9acd-f95e9dfd3770) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:32:28 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-e467c3c6-ab38-4bd0-9e9e-1954291a4b0d tempest-ProjectMemberTests-163191203 None] Flow 'volume_create_manager' (da78e8d9-92b2-46b2-816f-923b06be25d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:32:28 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-e467c3c6-ab38-4bd0-9e9e-1954291a4b0d tempest-ProjectMemberTests-163191203 None] Created volume successfully. Nov 04 10:32:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-adcb1cfc-0a7c-45a9-8d78-b06fcea5b4ed tempest-ProjectMemberTests-163191203 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:32:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-adcb1cfc-0a7c-45a9-8d78-b06fcea5b4ed tempest-ProjectMemberTests-163191203 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:32:28 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-adcb1cfc-0a7c-45a9-8d78-b06fcea5b4ed tempest-ProjectMemberTests-163191203 None] Creating offline snapshot ed707f76-3661-497a-b58d-8e8efa224686 of volume 3978d63e-239b-4992-a827-31e28edc138e {{(pid=87068) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 10:32:28 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[6516f60f-613e-452f-a0e5-57b094195cb9]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:32:28 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-adcb1cfc-0a7c-45a9-8d78-b06fcea5b4ed tempest-ProjectMemberTests-163191203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-3978d63e-239b-4992-a827-31e28edc138e {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:32:28 devstack sudo[106117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-3978d63e-239b-4992-a827-31e28edc138e Nov 04 10:32:28 devstack sudo[106117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:32:29 devstack sudo[106117]: pam_unix(sudo:session): session closed for user root Nov 04 10:32:29 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-adcb1cfc-0a7c-45a9-8d78-b06fcea5b4ed tempest-ProjectMemberTests-163191203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-3978d63e-239b-4992-a827-31e28edc138e" returned: 0 in 0.334s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:32:29 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-adcb1cfc-0a7c-45a9-8d78-b06fcea5b4ed tempest-ProjectMemberTests-163191203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-3978d63e-239b-4992-a827-31e28edc138e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-3978d63e-239b-4992-a827-31e28edc138e.ed707f76-3661-497a-b58d-8e8efa224686 1G {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:32:29 devstack sudo[106124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-3978d63e-239b-4992-a827-31e28edc138e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-3978d63e-239b-4992-a827-31e28edc138e.ed707f76-3661-497a-b58d-8e8efa224686 1G Nov 04 10:32:29 devstack sudo[106124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:32:29 devstack sudo[106124]: pam_unix(sudo:session): session closed for user root Nov 04 10:32:29 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-adcb1cfc-0a7c-45a9-8d78-b06fcea5b4ed tempest-ProjectMemberTests-163191203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-3978d63e-239b-4992-a827-31e28edc138e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-3978d63e-239b-4992-a827-31e28edc138e.ed707f76-3661-497a-b58d-8e8efa224686 1G" returned: 0 in 0.386s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:32:29 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-adcb1cfc-0a7c-45a9-8d78-b06fcea5b4ed tempest-ProjectMemberTests-163191203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3978d63e-239b-4992-a827-31e28edc138e -F qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-3978d63e-239b-4992-a827-31e28edc138e.ed707f76-3661-497a-b58d-8e8efa224686 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:32:29 devstack sudo[106129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3978d63e-239b-4992-a827-31e28edc138e -F qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-3978d63e-239b-4992-a827-31e28edc138e.ed707f76-3661-497a-b58d-8e8efa224686 Nov 04 10:32:29 devstack sudo[106129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:32:29 devstack sudo[106129]: pam_unix(sudo:session): session closed for user root Nov 04 10:32:29 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-adcb1cfc-0a7c-45a9-8d78-b06fcea5b4ed tempest-ProjectMemberTests-163191203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3978d63e-239b-4992-a827-31e28edc138e -F qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-3978d63e-239b-4992-a827-31e28edc138e.ed707f76-3661-497a-b58d-8e8efa224686" returned: 0 in 0.305s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:32:29 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-adcb1cfc-0a7c-45a9-8d78-b06fcea5b4ed tempest-ProjectMemberTests-163191203 None] /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-3978d63e-239b-4992-a827-31e28edc138e.ed707f76-3661-497a-b58d-8e8efa224686 is being set with open permissions: ugo+rw Nov 04 10:32:29 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-adcb1cfc-0a7c-45a9-8d78-b06fcea5b4ed tempest-ProjectMemberTests-163191203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-3978d63e-239b-4992-a827-31e28edc138e.ed707f76-3661-497a-b58d-8e8efa224686 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:32:29 devstack sudo[106134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-3978d63e-239b-4992-a827-31e28edc138e.ed707f76-3661-497a-b58d-8e8efa224686 Nov 04 10:32:29 devstack sudo[106134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:32:29 devstack sudo[106134]: pam_unix(sudo:session): session closed for user root Nov 04 10:32:29 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-adcb1cfc-0a7c-45a9-8d78-b06fcea5b4ed tempest-ProjectMemberTests-163191203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-3978d63e-239b-4992-a827-31e28edc138e.ed707f76-3661-497a-b58d-8e8efa224686" returned: 0 in 0.233s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:32:30 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-adcb1cfc-0a7c-45a9-8d78-b06fcea5b4ed tempest-ProjectMemberTests-163191203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-3978d63e-239b-4992-a827-31e28edc138e.info {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:32:30 devstack sudo[106137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-3978d63e-239b-4992-a827-31e28edc138e.info Nov 04 10:32:30 devstack sudo[106137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:32:30 devstack sudo[106137]: pam_unix(sudo:session): session closed for user root Nov 04 10:32:30 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-adcb1cfc-0a7c-45a9-8d78-b06fcea5b4ed tempest-ProjectMemberTests-163191203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-3978d63e-239b-4992-a827-31e28edc138e.info" returned: 0 in 0.231s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:32:30 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-adcb1cfc-0a7c-45a9-8d78-b06fcea5b4ed tempest-ProjectMemberTests-163191203 None] /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-3978d63e-239b-4992-a827-31e28edc138e.info is being set with open permissions: ugo+rw Nov 04 10:32:30 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-adcb1cfc-0a7c-45a9-8d78-b06fcea5b4ed tempest-ProjectMemberTests-163191203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-3978d63e-239b-4992-a827-31e28edc138e.info {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:32:30 devstack sudo[106140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-3978d63e-239b-4992-a827-31e28edc138e.info Nov 04 10:32:30 devstack sudo[106140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:32:30 devstack sudo[106140]: pam_unix(sudo:session): session closed for user root Nov 04 10:32:30 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-adcb1cfc-0a7c-45a9-8d78-b06fcea5b4ed tempest-ProjectMemberTests-163191203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-3978d63e-239b-4992-a827-31e28edc138e.info" returned: 0 in 0.226s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:32:30 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-adcb1cfc-0a7c-45a9-8d78-b06fcea5b4ed tempest-ProjectMemberTests-163191203 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.792s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:32:30 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-adcb1cfc-0a7c-45a9-8d78-b06fcea5b4ed tempest-ProjectMemberTests-163191203 None] Create snapshot completed successfully Nov 04 10:32:30 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-cec14760-aab5-494b-84de-daa3a98071fb tempest-ProjectMemberTests-163191203 None] Acquiring lock "cinder-ed707f76-3661-497a-b58d-8e8efa224686-delete_snapshot" by "delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:32:30 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-cec14760-aab5-494b-84de-daa3a98071fb tempest-ProjectMemberTests-163191203 None] Lock "cinder-ed707f76-3661-497a-b58d-8e8efa224686-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:32:30 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-cec14760-aab5-494b-84de-daa3a98071fb tempest-ProjectMemberTests-163191203 None] Acquiring lock "cinder-quobyte-3978d63e-239b-4992-a827-31e28edc138e" by "delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:32:30 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-cec14760-aab5-494b-84de-daa3a98071fb tempest-ProjectMemberTests-163191203 None] Lock "cinder-quobyte-3978d63e-239b-4992-a827-31e28edc138e" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:32:30 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-cec14760-aab5-494b-84de-daa3a98071fb tempest-ProjectMemberTests-163191203 None] Acquiring lock "cinder-quobyte-ed707f76-3661-497a-b58d-8e8efa224686" by "_delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:32:30 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-cec14760-aab5-494b-84de-daa3a98071fb tempest-ProjectMemberTests-163191203 None] Lock "cinder-quobyte-ed707f76-3661-497a-b58d-8e8efa224686" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:32:30 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-cec14760-aab5-494b-84de-daa3a98071fb tempest-ProjectMemberTests-163191203 None] Deleting offline snapshot ed707f76-3661-497a-b58d-8e8efa224686 of volume 3978d63e-239b-4992-a827-31e28edc138e {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 10:32:30 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-cec14760-aab5-494b-84de-daa3a98071fb tempest-ProjectMemberTests-163191203 None] snapshot_file for this snap is: volume-3978d63e-239b-4992-a827-31e28edc138e.ed707f76-3661-497a-b58d-8e8efa224686 {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 10:32:30 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[94a71ec4-8051-4024-8a07-11c6a9c703ff]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:32:30 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-cec14760-aab5-494b-84de-daa3a98071fb tempest-ProjectMemberTests-163191203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-3978d63e-239b-4992-a827-31e28edc138e.ed707f76-3661-497a-b58d-8e8efa224686 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:32:31 devstack sudo[106143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-3978d63e-239b-4992-a827-31e28edc138e.ed707f76-3661-497a-b58d-8e8efa224686 Nov 04 10:32:31 devstack sudo[106143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:32:31 devstack sudo[106143]: pam_unix(sudo:session): session closed for user root Nov 04 10:32:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-cec14760-aab5-494b-84de-daa3a98071fb tempest-ProjectMemberTests-163191203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-3978d63e-239b-4992-a827-31e28edc138e.ed707f76-3661-497a-b58d-8e8efa224686" returned: 0 in 0.335s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:32:31 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-cec14760-aab5-494b-84de-daa3a98071fb tempest-ProjectMemberTests-163191203 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3978d63e-239b-4992-a827-31e28edc138e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87068) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 10:32:31 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[8248f293-6125-4f8c-9f02-9d947a076297]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:32:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-cec14760-aab5-494b-84de-daa3a98071fb tempest-ProjectMemberTests-163191203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-3978d63e-239b-4992-a827-31e28edc138e {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:32:31 devstack sudo[106148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-3978d63e-239b-4992-a827-31e28edc138e Nov 04 10:32:31 devstack sudo[106148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:32:31 devstack sudo[106148]: pam_unix(sudo:session): session closed for user root Nov 04 10:32:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-cec14760-aab5-494b-84de-daa3a98071fb tempest-ProjectMemberTests-163191203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-3978d63e-239b-4992-a827-31e28edc138e" returned: 0 in 0.334s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:32:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-cec14760-aab5-494b-84de-daa3a98071fb tempest-ProjectMemberTests-163191203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-3978d63e-239b-4992-a827-31e28edc138e.ed707f76-3661-497a-b58d-8e8efa224686 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:32:31 devstack sudo[106153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-3978d63e-239b-4992-a827-31e28edc138e.ed707f76-3661-497a-b58d-8e8efa224686 Nov 04 10:32:31 devstack sudo[106153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:32:31 devstack sudo[106153]: pam_unix(sudo:session): session closed for user root Nov 04 10:32:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-cec14760-aab5-494b-84de-daa3a98071fb tempest-ProjectMemberTests-163191203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-3978d63e-239b-4992-a827-31e28edc138e.ed707f76-3661-497a-b58d-8e8efa224686" returned: 0 in 0.327s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:32:31 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-cec14760-aab5-494b-84de-daa3a98071fb tempest-ProjectMemberTests-163191203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-3978d63e-239b-4992-a827-31e28edc138e.ed707f76-3661-497a-b58d-8e8efa224686 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:32:31 devstack sudo[106159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-3978d63e-239b-4992-a827-31e28edc138e.ed707f76-3661-497a-b58d-8e8efa224686 Nov 04 10:32:31 devstack sudo[106159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:32:32 devstack sudo[106159]: pam_unix(sudo:session): session closed for user root Nov 04 10:32:32 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-cec14760-aab5-494b-84de-daa3a98071fb tempest-ProjectMemberTests-163191203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-3978d63e-239b-4992-a827-31e28edc138e.ed707f76-3661-497a-b58d-8e8efa224686" returned: 0 in 0.231s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:32:32 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-cec14760-aab5-494b-84de-daa3a98071fb tempest-ProjectMemberTests-163191203 None] Lock "cinder-quobyte-ed707f76-3661-497a-b58d-8e8efa224686" released by "_delete_snapshot" :: held 1.322s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:32:32 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-cec14760-aab5-494b-84de-daa3a98071fb tempest-ProjectMemberTests-163191203 None] Lock "cinder-quobyte-3978d63e-239b-4992-a827-31e28edc138e" released by "delete_snapshot" :: held 1.343s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:32:32 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-cec14760-aab5-494b-84de-daa3a98071fb tempest-ProjectMemberTests-163191203 None] Created reservations ['c2d9d60c-4a22-432e-b03c-83449e18f0d8', '324c237a-1216-4d09-8d7e-0a8fd716316f', '43016f8e-c9c9-4daf-b7dd-4b805ad4ee17', '1ff63007-fb5a-4adb-bcfc-32144ad97a79'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:32:32 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-cec14760-aab5-494b-84de-daa3a98071fb tempest-ProjectMemberTests-163191203 None] Delete snapshot completed successfully. Nov 04 10:32:32 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-cec14760-aab5-494b-84de-daa3a98071fb tempest-ProjectMemberTests-163191203 None] Lock "cinder-ed707f76-3661-497a-b58d-8e8efa224686-delete_snapshot" released by "delete_snapshot" :: held 1.486s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:32:32 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-5868a6ea-dc6f-4517-925e-401e0c3796a0 tempest-ProjectMemberTests-163191203 None] Acquiring lock "cinder-3978d63e-239b-4992-a827-31e28edc138e-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:32:32 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-5868a6ea-dc6f-4517-925e-401e0c3796a0 tempest-ProjectMemberTests-163191203 None] Lock "cinder-3978d63e-239b-4992-a827-31e28edc138e-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:32:33 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-5868a6ea-dc6f-4517-925e-401e0c3796a0 tempest-ProjectMemberTests-163191203 None] Acquiring lock "cinder-quobyte-3978d63e-239b-4992-a827-31e28edc138e" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:32:33 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-5868a6ea-dc6f-4517-925e-401e0c3796a0 tempest-ProjectMemberTests-163191203 None] Lock "cinder-quobyte-3978d63e-239b-4992-a827-31e28edc138e" acquired by "delete_volume" :: waited 0.016s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:32:33 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[87d248d9-d8c3-4317-a45d-0ec55bb2aef3]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:32:33 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-5868a6ea-dc6f-4517-925e-401e0c3796a0 tempest-ProjectMemberTests-163191203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-3978d63e-239b-4992-a827-31e28edc138e {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:32:33 devstack sudo[106163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-3978d63e-239b-4992-a827-31e28edc138e Nov 04 10:32:33 devstack sudo[106163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:32:33 devstack sudo[106163]: pam_unix(sudo:session): session closed for user root Nov 04 10:32:33 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-5868a6ea-dc6f-4517-925e-401e0c3796a0 tempest-ProjectMemberTests-163191203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-3978d63e-239b-4992-a827-31e28edc138e" returned: 0 in 0.356s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:32:33 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-5868a6ea-dc6f-4517-925e-401e0c3796a0 tempest-ProjectMemberTests-163191203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-3978d63e-239b-4992-a827-31e28edc138e {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:32:33 devstack sudo[106168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-3978d63e-239b-4992-a827-31e28edc138e Nov 04 10:32:33 devstack sudo[106168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:32:33 devstack sudo[106168]: pam_unix(sudo:session): session closed for user root Nov 04 10:32:33 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-5868a6ea-dc6f-4517-925e-401e0c3796a0 tempest-ProjectMemberTests-163191203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-3978d63e-239b-4992-a827-31e28edc138e" returned: 0 in 0.241s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:32:33 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-5868a6ea-dc6f-4517-925e-401e0c3796a0 tempest-ProjectMemberTests-163191203 None] Lock "cinder-quobyte-3978d63e-239b-4992-a827-31e28edc138e" released by "delete_volume" :: held 0.662s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:32:33 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-5868a6ea-dc6f-4517-925e-401e0c3796a0 tempest-ProjectMemberTests-163191203 None] Created reservations ['095080b5-9e5d-4762-bf86-eb56e48c755a', 'b7d2fb55-68ee-411e-b3f8-3305efdb4e96', '7aba9929-a9b5-4e69-a78e-9cf6526ff4d9', '727795f9-27dc-4454-a217-c6117e3d9f88'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:32:33 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-5868a6ea-dc6f-4517-925e-401e0c3796a0 tempest-ProjectMemberTests-163191203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:32:33 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-5868a6ea-dc6f-4517-925e-401e0c3796a0 tempest-ProjectMemberTests-163191203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:32:33 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-5868a6ea-dc6f-4517-925e-401e0c3796a0 tempest-ProjectMemberTests-163191203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:32:33 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-5868a6ea-dc6f-4517-925e-401e0c3796a0 tempest-ProjectMemberTests-163191203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:32:33 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-5868a6ea-dc6f-4517-925e-401e0c3796a0 tempest-ProjectMemberTests-163191203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:32:33 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-5868a6ea-dc6f-4517-925e-401e0c3796a0 tempest-ProjectMemberTests-163191203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:32:33 devstack sudo[106171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:32:33 devstack sudo[106171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:32:34 devstack sudo[106171]: pam_unix(sudo:session): session closed for user root Nov 04 10:32:34 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-5868a6ea-dc6f-4517-925e-401e0c3796a0 tempest-ProjectMemberTests-163191203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.231s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:32:34 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-5868a6ea-dc6f-4517-925e-401e0c3796a0 tempest-ProjectMemberTests-163191203 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:32:34 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-5868a6ea-dc6f-4517-925e-401e0c3796a0 tempest-ProjectMemberTests-163191203 None] Deleted volume successfully. Nov 04 10:32:34 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-5868a6ea-dc6f-4517-925e-401e0c3796a0 tempest-ProjectMemberTests-163191203 None] Lock "cinder-3978d63e-239b-4992-a827-31e28edc138e-delete_volume" released by "delete_volume" :: held 1.100s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:32:34 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-f32c05c7-bf7a-4ff0-ae9f-ab82d2aa7ef3 tempest-ProjectMemberTests-163191203 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:32:34 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-f32c05c7-bf7a-4ff0-ae9f-ab82d2aa7ef3 tempest-ProjectMemberTests-163191203 None] Flow 'volume_create_manager' (cc3ec6b6-c518-48c7-8e68-34bb6eaa089b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:32:34 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-f32c05c7-bf7a-4ff0-ae9f-ab82d2aa7ef3 tempest-ProjectMemberTests-163191203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed8ab8be-e360-4309-bcb9-ff44ad0fa719) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:32:34 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-f32c05c7-bf7a-4ff0-ae9f-ab82d2aa7ef3 tempest-ProjectMemberTests-163191203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed8ab8be-e360-4309-bcb9-ff44ad0fa719) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:32:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1683642827',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a595a820-cae2-4d5c-892c-a52d55b24014,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6102192fe22c4f298ee9815860bd7a9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:32:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:32:34Z,use_quota=True,user_id='df3853accc6242909d45cceeb3a0db9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:32:34 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-f32c05c7-bf7a-4ff0-ae9f-ab82d2aa7ef3 tempest-ProjectMemberTests-163191203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bd2091b-4a74-4160-afe1-e2428b2fcca9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:32:34 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-f32c05c7-bf7a-4ff0-ae9f-ab82d2aa7ef3 tempest-ProjectMemberTests-163191203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bd2091b-4a74-4160-afe1-e2428b2fcca9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:32:34 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-f32c05c7-bf7a-4ff0-ae9f-ab82d2aa7ef3 tempest-ProjectMemberTests-163191203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5be6e3e1-8950-4de0-895b-4cefb9289d8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:32:34 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-f32c05c7-bf7a-4ff0-ae9f-ab82d2aa7ef3 tempest-ProjectMemberTests-163191203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5be6e3e1-8950-4de0-895b-4cefb9289d8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a595a820-cae2-4d5c-892c-a52d55b24014', 'volume_name': 'volume-a595a820-cae2-4d5c-892c-a52d55b24014', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:32:34 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-f32c05c7-bf7a-4ff0-ae9f-ab82d2aa7ef3 tempest-ProjectMemberTests-163191203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92cc90cc-d71d-4fe6-ab4b-22759a9857d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:32:34 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-f32c05c7-bf7a-4ff0-ae9f-ab82d2aa7ef3 tempest-ProjectMemberTests-163191203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92cc90cc-d71d-4fe6-ab4b-22759a9857d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:32:34 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-f32c05c7-bf7a-4ff0-ae9f-ab82d2aa7ef3 tempest-ProjectMemberTests-163191203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad80b692-be02-4ee8-a8bc-e97b52c13f75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:32:34 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-f32c05c7-bf7a-4ff0-ae9f-ab82d2aa7ef3 tempest-ProjectMemberTests-163191203 None] Volume a595a820-cae2-4d5c-892c-a52d55b24014: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a595a820-cae2-4d5c-892c-a52d55b24014', 'volume_size': 1} Nov 04 10:32:34 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-f32c05c7-bf7a-4ff0-ae9f-ab82d2aa7ef3 tempest-ProjectMemberTests-163191203 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:32:34 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-f32c05c7-bf7a-4ff0-ae9f-ab82d2aa7ef3 tempest-ProjectMemberTests-163191203 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:32:34 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-f32c05c7-bf7a-4ff0-ae9f-ab82d2aa7ef3 tempest-ProjectMemberTests-163191203 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:32:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1683642827',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a595a820-cae2-4d5c-892c-a52d55b24014,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6102192fe22c4f298ee9815860bd7a9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:32:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:32:34Z,use_quota=True,user_id='df3853accc6242909d45cceeb3a0db9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 10:32:34 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-f32c05c7-bf7a-4ff0-ae9f-ab82d2aa7ef3 tempest-ProjectMemberTests-163191203 None] Creating volume a595a820-cae2-4d5c-892c-a52d55b24014 {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:32:34 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-f32c05c7-bf7a-4ff0-ae9f-ab82d2aa7ef3 tempest-ProjectMemberTests-163191203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:32:34 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-f32c05c7-bf7a-4ff0-ae9f-ab82d2aa7ef3 tempest-ProjectMemberTests-163191203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:32:34 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-f32c05c7-bf7a-4ff0-ae9f-ab82d2aa7ef3 tempest-ProjectMemberTests-163191203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:32:34 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-f32c05c7-bf7a-4ff0-ae9f-ab82d2aa7ef3 tempest-ProjectMemberTests-163191203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:32:34 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-f32c05c7-bf7a-4ff0-ae9f-ab82d2aa7ef3 tempest-ProjectMemberTests-163191203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:32:34 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-f32c05c7-bf7a-4ff0-ae9f-ab82d2aa7ef3 tempest-ProjectMemberTests-163191203 None] Selected osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:32:34 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-f32c05c7-bf7a-4ff0-ae9f-ab82d2aa7ef3 tempest-ProjectMemberTests-163191203 None] casted to osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 Nov 04 10:32:34 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f32c05c7-bf7a-4ff0-ae9f-ab82d2aa7ef3 tempest-ProjectMemberTests-163191203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-a595a820-cae2-4d5c-892c-a52d55b24014 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:32:34 devstack sudo[106174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-a595a820-cae2-4d5c-892c-a52d55b24014 1073741824 Nov 04 10:32:34 devstack sudo[106174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:32:34 devstack sudo[106174]: pam_unix(sudo:session): session closed for user root Nov 04 10:32:34 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f32c05c7-bf7a-4ff0-ae9f-ab82d2aa7ef3 tempest-ProjectMemberTests-163191203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-a595a820-cae2-4d5c-892c-a52d55b24014 1073741824" returned: 0 in 0.383s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:32:35 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f32c05c7-bf7a-4ff0-ae9f-ab82d2aa7ef3 tempest-ProjectMemberTests-163191203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-a595a820-cae2-4d5c-892c-a52d55b24014 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:32:35 devstack sudo[106180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-a595a820-cae2-4d5c-892c-a52d55b24014 Nov 04 10:32:35 devstack sudo[106180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:32:35 devstack sudo[106180]: pam_unix(sudo:session): session closed for user root Nov 04 10:32:35 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-f32c05c7-bf7a-4ff0-ae9f-ab82d2aa7ef3 tempest-ProjectMemberTests-163191203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-a595a820-cae2-4d5c-892c-a52d55b24014" returned: 0 in 0.243s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:32:35 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-f32c05c7-bf7a-4ff0-ae9f-ab82d2aa7ef3 tempest-ProjectMemberTests-163191203 None] <== create_volume: return (667ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 10:32:35 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-f32c05c7-bf7a-4ff0-ae9f-ab82d2aa7ef3 tempest-ProjectMemberTests-163191203 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.669s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:32:35 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-f32c05c7-bf7a-4ff0-ae9f-ab82d2aa7ef3 tempest-ProjectMemberTests-163191203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad80b692-be02-4ee8-a8bc-e97b52c13f75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a595a820-cae2-4d5c-892c-a52d55b24014', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:32:35 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-f32c05c7-bf7a-4ff0-ae9f-ab82d2aa7ef3 tempest-ProjectMemberTests-163191203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c61c42a9-98bb-43bc-8001-26daad8d3d36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:32:35 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-f32c05c7-bf7a-4ff0-ae9f-ab82d2aa7ef3 tempest-ProjectMemberTests-163191203 None] Volume volume-a595a820-cae2-4d5c-892c-a52d55b24014 (a595a820-cae2-4d5c-892c-a52d55b24014): created successfully Nov 04 10:32:35 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-f32c05c7-bf7a-4ff0-ae9f-ab82d2aa7ef3 tempest-ProjectMemberTests-163191203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c61c42a9-98bb-43bc-8001-26daad8d3d36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:32:35 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-f32c05c7-bf7a-4ff0-ae9f-ab82d2aa7ef3 tempest-ProjectMemberTests-163191203 None] Flow 'volume_create_manager' (cc3ec6b6-c518-48c7-8e68-34bb6eaa089b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:32:35 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-f32c05c7-bf7a-4ff0-ae9f-ab82d2aa7ef3 tempest-ProjectMemberTests-163191203 None] Created volume successfully. Nov 04 10:32:35 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-fd0e71c2-4d68-41c3-bd0a-65baf2b0f404 tempest-ProjectMemberTests-163191203 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:32:35 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-fd0e71c2-4d68-41c3-bd0a-65baf2b0f404 tempest-ProjectMemberTests-163191203 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:32:35 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-fd0e71c2-4d68-41c3-bd0a-65baf2b0f404 tempest-ProjectMemberTests-163191203 None] Creating offline snapshot f6bf5443-77a9-41d5-9ffe-a71eac2e9481 of volume a595a820-cae2-4d5c-892c-a52d55b24014 {{(pid=87068) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 10:32:35 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[d39322d8-93ef-4483-8fa7-79e18e5e6329]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:32:35 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-fd0e71c2-4d68-41c3-bd0a-65baf2b0f404 tempest-ProjectMemberTests-163191203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-a595a820-cae2-4d5c-892c-a52d55b24014 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:32:35 devstack sudo[106183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-a595a820-cae2-4d5c-892c-a52d55b24014 Nov 04 10:32:35 devstack sudo[106183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:32:36 devstack sudo[106183]: pam_unix(sudo:session): session closed for user root Nov 04 10:32:36 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-fd0e71c2-4d68-41c3-bd0a-65baf2b0f404 tempest-ProjectMemberTests-163191203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-a595a820-cae2-4d5c-892c-a52d55b24014" returned: 0 in 0.379s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:32:36 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-fd0e71c2-4d68-41c3-bd0a-65baf2b0f404 tempest-ProjectMemberTests-163191203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-a595a820-cae2-4d5c-892c-a52d55b24014,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-a595a820-cae2-4d5c-892c-a52d55b24014.f6bf5443-77a9-41d5-9ffe-a71eac2e9481 1G {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:32:36 devstack sudo[106188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-a595a820-cae2-4d5c-892c-a52d55b24014,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-a595a820-cae2-4d5c-892c-a52d55b24014.f6bf5443-77a9-41d5-9ffe-a71eac2e9481 1G Nov 04 10:32:36 devstack sudo[106188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:32:36 devstack sudo[106188]: pam_unix(sudo:session): session closed for user root Nov 04 10:32:36 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-fd0e71c2-4d68-41c3-bd0a-65baf2b0f404 tempest-ProjectMemberTests-163191203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-a595a820-cae2-4d5c-892c-a52d55b24014,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-a595a820-cae2-4d5c-892c-a52d55b24014.f6bf5443-77a9-41d5-9ffe-a71eac2e9481 1G" returned: 0 in 0.387s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:32:36 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-fd0e71c2-4d68-41c3-bd0a-65baf2b0f404 tempest-ProjectMemberTests-163191203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a595a820-cae2-4d5c-892c-a52d55b24014 -F qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-a595a820-cae2-4d5c-892c-a52d55b24014.f6bf5443-77a9-41d5-9ffe-a71eac2e9481 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:32:36 devstack sudo[106193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a595a820-cae2-4d5c-892c-a52d55b24014 -F qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-a595a820-cae2-4d5c-892c-a52d55b24014.f6bf5443-77a9-41d5-9ffe-a71eac2e9481 Nov 04 10:32:36 devstack sudo[106193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:32:36 devstack sudo[106193]: pam_unix(sudo:session): session closed for user root Nov 04 10:32:36 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-fd0e71c2-4d68-41c3-bd0a-65baf2b0f404 tempest-ProjectMemberTests-163191203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a595a820-cae2-4d5c-892c-a52d55b24014 -F qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-a595a820-cae2-4d5c-892c-a52d55b24014.f6bf5443-77a9-41d5-9ffe-a71eac2e9481" returned: 0 in 0.301s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:32:36 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-fd0e71c2-4d68-41c3-bd0a-65baf2b0f404 tempest-ProjectMemberTests-163191203 None] /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-a595a820-cae2-4d5c-892c-a52d55b24014.f6bf5443-77a9-41d5-9ffe-a71eac2e9481 is being set with open permissions: ugo+rw Nov 04 10:32:36 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-fd0e71c2-4d68-41c3-bd0a-65baf2b0f404 tempest-ProjectMemberTests-163191203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-a595a820-cae2-4d5c-892c-a52d55b24014.f6bf5443-77a9-41d5-9ffe-a71eac2e9481 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:32:36 devstack sudo[106199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-a595a820-cae2-4d5c-892c-a52d55b24014.f6bf5443-77a9-41d5-9ffe-a71eac2e9481 Nov 04 10:32:36 devstack sudo[106199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:32:37 devstack sudo[106199]: pam_unix(sudo:session): session closed for user root Nov 04 10:32:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-fd0e71c2-4d68-41c3-bd0a-65baf2b0f404 tempest-ProjectMemberTests-163191203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-a595a820-cae2-4d5c-892c-a52d55b24014.f6bf5443-77a9-41d5-9ffe-a71eac2e9481" returned: 0 in 0.236s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:32:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-fd0e71c2-4d68-41c3-bd0a-65baf2b0f404 tempest-ProjectMemberTests-163191203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-a595a820-cae2-4d5c-892c-a52d55b24014.info {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:32:37 devstack sudo[106202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-a595a820-cae2-4d5c-892c-a52d55b24014.info Nov 04 10:32:37 devstack sudo[106202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:32:37 devstack sudo[106202]: pam_unix(sudo:session): session closed for user root Nov 04 10:32:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-fd0e71c2-4d68-41c3-bd0a-65baf2b0f404 tempest-ProjectMemberTests-163191203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-a595a820-cae2-4d5c-892c-a52d55b24014.info" returned: 0 in 0.245s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:32:37 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-fd0e71c2-4d68-41c3-bd0a-65baf2b0f404 tempest-ProjectMemberTests-163191203 None] /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-a595a820-cae2-4d5c-892c-a52d55b24014.info is being set with open permissions: ugo+rw Nov 04 10:32:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-fd0e71c2-4d68-41c3-bd0a-65baf2b0f404 tempest-ProjectMemberTests-163191203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-a595a820-cae2-4d5c-892c-a52d55b24014.info {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:32:37 devstack sudo[106205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-a595a820-cae2-4d5c-892c-a52d55b24014.info Nov 04 10:32:37 devstack sudo[106205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:32:37 devstack sudo[106205]: pam_unix(sudo:session): session closed for user root Nov 04 10:32:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-fd0e71c2-4d68-41c3-bd0a-65baf2b0f404 tempest-ProjectMemberTests-163191203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-a595a820-cae2-4d5c-892c-a52d55b24014.info" returned: 0 in 0.238s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:32:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-fd0e71c2-4d68-41c3-bd0a-65baf2b0f404 tempest-ProjectMemberTests-163191203 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.864s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:32:37 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-fd0e71c2-4d68-41c3-bd0a-65baf2b0f404 tempest-ProjectMemberTests-163191203 None] Create snapshot completed successfully Nov 04 10:32:37 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-3fdd0db0-8cd3-4d97-8858-11804abe80c6 tempest-ProjectMemberTests-163191203 None] Acquiring lock "cinder-f6bf5443-77a9-41d5-9ffe-a71eac2e9481-delete_snapshot" by "delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:32:37 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-3fdd0db0-8cd3-4d97-8858-11804abe80c6 tempest-ProjectMemberTests-163191203 None] Lock "cinder-f6bf5443-77a9-41d5-9ffe-a71eac2e9481-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:32:37 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-3fdd0db0-8cd3-4d97-8858-11804abe80c6 tempest-ProjectMemberTests-163191203 None] Acquiring lock "cinder-quobyte-a595a820-cae2-4d5c-892c-a52d55b24014" by "delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:32:37 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-3fdd0db0-8cd3-4d97-8858-11804abe80c6 tempest-ProjectMemberTests-163191203 None] Lock "cinder-quobyte-a595a820-cae2-4d5c-892c-a52d55b24014" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:32:37 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-3fdd0db0-8cd3-4d97-8858-11804abe80c6 tempest-ProjectMemberTests-163191203 None] Acquiring lock "cinder-quobyte-f6bf5443-77a9-41d5-9ffe-a71eac2e9481" by "_delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:32:37 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-3fdd0db0-8cd3-4d97-8858-11804abe80c6 tempest-ProjectMemberTests-163191203 None] Lock "cinder-quobyte-f6bf5443-77a9-41d5-9ffe-a71eac2e9481" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:32:37 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-3fdd0db0-8cd3-4d97-8858-11804abe80c6 tempest-ProjectMemberTests-163191203 None] Deleting offline snapshot f6bf5443-77a9-41d5-9ffe-a71eac2e9481 of volume a595a820-cae2-4d5c-892c-a52d55b24014 {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 10:32:37 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-3fdd0db0-8cd3-4d97-8858-11804abe80c6 tempest-ProjectMemberTests-163191203 None] snapshot_file for this snap is: volume-a595a820-cae2-4d5c-892c-a52d55b24014.f6bf5443-77a9-41d5-9ffe-a71eac2e9481 {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 10:32:37 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e2bb549-60ac-4ad9-82bd-2621d22857e5]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:32:37 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-3fdd0db0-8cd3-4d97-8858-11804abe80c6 tempest-ProjectMemberTests-163191203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-a595a820-cae2-4d5c-892c-a52d55b24014.f6bf5443-77a9-41d5-9ffe-a71eac2e9481 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:32:38 devstack sudo[106208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-a595a820-cae2-4d5c-892c-a52d55b24014.f6bf5443-77a9-41d5-9ffe-a71eac2e9481 Nov 04 10:32:38 devstack sudo[106208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:32:38 devstack sudo[106208]: pam_unix(sudo:session): session closed for user root Nov 04 10:32:38 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-3fdd0db0-8cd3-4d97-8858-11804abe80c6 tempest-ProjectMemberTests-163191203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-a595a820-cae2-4d5c-892c-a52d55b24014.f6bf5443-77a9-41d5-9ffe-a71eac2e9481" returned: 0 in 0.365s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:32:38 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-3fdd0db0-8cd3-4d97-8858-11804abe80c6 tempest-ProjectMemberTests-163191203 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a595a820-cae2-4d5c-892c-a52d55b24014(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87068) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 10:32:38 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[76db9904-cff3-4933-9a2d-3af6e8e38c84]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:32:38 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-3fdd0db0-8cd3-4d97-8858-11804abe80c6 tempest-ProjectMemberTests-163191203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-a595a820-cae2-4d5c-892c-a52d55b24014 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:32:38 devstack sudo[106213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-a595a820-cae2-4d5c-892c-a52d55b24014 Nov 04 10:32:38 devstack sudo[106213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:32:38 devstack sudo[106213]: pam_unix(sudo:session): session closed for user root Nov 04 10:32:38 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-3fdd0db0-8cd3-4d97-8858-11804abe80c6 tempest-ProjectMemberTests-163191203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-a595a820-cae2-4d5c-892c-a52d55b24014" returned: 0 in 0.375s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:32:38 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-3fdd0db0-8cd3-4d97-8858-11804abe80c6 tempest-ProjectMemberTests-163191203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-a595a820-cae2-4d5c-892c-a52d55b24014.f6bf5443-77a9-41d5-9ffe-a71eac2e9481 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:32:38 devstack sudo[106218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-a595a820-cae2-4d5c-892c-a52d55b24014.f6bf5443-77a9-41d5-9ffe-a71eac2e9481 Nov 04 10:32:38 devstack sudo[106218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:32:38 devstack sudo[106218]: pam_unix(sudo:session): session closed for user root Nov 04 10:32:38 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-3fdd0db0-8cd3-4d97-8858-11804abe80c6 tempest-ProjectMemberTests-163191203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-a595a820-cae2-4d5c-892c-a52d55b24014.f6bf5443-77a9-41d5-9ffe-a71eac2e9481" returned: 0 in 0.323s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:32:38 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-3fdd0db0-8cd3-4d97-8858-11804abe80c6 tempest-ProjectMemberTests-163191203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-a595a820-cae2-4d5c-892c-a52d55b24014.f6bf5443-77a9-41d5-9ffe-a71eac2e9481 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:32:39 devstack sudo[106223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-a595a820-cae2-4d5c-892c-a52d55b24014.f6bf5443-77a9-41d5-9ffe-a71eac2e9481 Nov 04 10:32:39 devstack sudo[106223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:32:39 devstack sudo[106223]: pam_unix(sudo:session): session closed for user root Nov 04 10:32:39 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-3fdd0db0-8cd3-4d97-8858-11804abe80c6 tempest-ProjectMemberTests-163191203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-a595a820-cae2-4d5c-892c-a52d55b24014.f6bf5443-77a9-41d5-9ffe-a71eac2e9481" returned: 0 in 0.296s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:32:39 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-3fdd0db0-8cd3-4d97-8858-11804abe80c6 tempest-ProjectMemberTests-163191203 None] Lock "cinder-quobyte-f6bf5443-77a9-41d5-9ffe-a71eac2e9481" released by "_delete_snapshot" :: held 1.458s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:32:39 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-3fdd0db0-8cd3-4d97-8858-11804abe80c6 tempest-ProjectMemberTests-163191203 None] Lock "cinder-quobyte-a595a820-cae2-4d5c-892c-a52d55b24014" released by "delete_snapshot" :: held 1.477s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:32:39 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-3fdd0db0-8cd3-4d97-8858-11804abe80c6 tempest-ProjectMemberTests-163191203 None] Created reservations ['439d60da-cf85-4f4d-82a0-27cd2819c401', 'e5063e8c-f1a6-4d52-b318-b5b47b7548bc', 'f66fcdcd-8001-45f7-b6dd-b025247addd5', 'd9058d20-5ef2-483f-8768-70735e6b5b75'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:32:39 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-3fdd0db0-8cd3-4d97-8858-11804abe80c6 tempest-ProjectMemberTests-163191203 None] Delete snapshot completed successfully. Nov 04 10:32:39 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-3fdd0db0-8cd3-4d97-8858-11804abe80c6 tempest-ProjectMemberTests-163191203 None] Lock "cinder-f6bf5443-77a9-41d5-9ffe-a71eac2e9481-delete_snapshot" released by "delete_snapshot" :: held 1.606s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:32:39 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-6b9c0cbc-cf8d-441f-8615-51811d492af9 tempest-ProjectMemberTests-163191203 None] Acquiring lock "cinder-a595a820-cae2-4d5c-892c-a52d55b24014-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:32:40 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-6b9c0cbc-cf8d-441f-8615-51811d492af9 tempest-ProjectMemberTests-163191203 None] Lock "cinder-a595a820-cae2-4d5c-892c-a52d55b24014-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:32:40 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-6b9c0cbc-cf8d-441f-8615-51811d492af9 tempest-ProjectMemberTests-163191203 None] Acquiring lock "cinder-quobyte-a595a820-cae2-4d5c-892c-a52d55b24014" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:32:40 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-6b9c0cbc-cf8d-441f-8615-51811d492af9 tempest-ProjectMemberTests-163191203 None] Lock "cinder-quobyte-a595a820-cae2-4d5c-892c-a52d55b24014" acquired by "delete_volume" :: waited 0.018s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:32:40 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d538e42-b013-40ae-ad7c-67516ab0ceee]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:32:40 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6b9c0cbc-cf8d-441f-8615-51811d492af9 tempest-ProjectMemberTests-163191203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-a595a820-cae2-4d5c-892c-a52d55b24014 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:32:40 devstack sudo[106226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-a595a820-cae2-4d5c-892c-a52d55b24014 Nov 04 10:32:40 devstack sudo[106226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:32:40 devstack sudo[106226]: pam_unix(sudo:session): session closed for user root Nov 04 10:32:40 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6b9c0cbc-cf8d-441f-8615-51811d492af9 tempest-ProjectMemberTests-163191203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-a595a820-cae2-4d5c-892c-a52d55b24014" returned: 0 in 0.367s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:32:40 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6b9c0cbc-cf8d-441f-8615-51811d492af9 tempest-ProjectMemberTests-163191203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-a595a820-cae2-4d5c-892c-a52d55b24014 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:32:40 devstack sudo[106231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-a595a820-cae2-4d5c-892c-a52d55b24014 Nov 04 10:32:40 devstack sudo[106231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:32:40 devstack sudo[106231]: pam_unix(sudo:session): session closed for user root Nov 04 10:32:40 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6b9c0cbc-cf8d-441f-8615-51811d492af9 tempest-ProjectMemberTests-163191203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-a595a820-cae2-4d5c-892c-a52d55b24014" returned: 0 in 0.249s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:32:40 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-6b9c0cbc-cf8d-441f-8615-51811d492af9 tempest-ProjectMemberTests-163191203 None] Lock "cinder-quobyte-a595a820-cae2-4d5c-892c-a52d55b24014" released by "delete_volume" :: held 0.678s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:32:40 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-6b9c0cbc-cf8d-441f-8615-51811d492af9 tempest-ProjectMemberTests-163191203 None] Created reservations ['286dd608-1fd9-41ec-9a9a-e21c647a7347', '353bcabe-24f0-4c4e-a4db-9f389c7da8d8', '3c1a1b30-0f21-4656-ba74-f01508678e25', '617f96ca-e01c-4859-9703-7ffb127cc985'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:32:40 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-6b9c0cbc-cf8d-441f-8615-51811d492af9 tempest-ProjectMemberTests-163191203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:32:40 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-6b9c0cbc-cf8d-441f-8615-51811d492af9 tempest-ProjectMemberTests-163191203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:32:40 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-6b9c0cbc-cf8d-441f-8615-51811d492af9 tempest-ProjectMemberTests-163191203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:32:40 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-6b9c0cbc-cf8d-441f-8615-51811d492af9 tempest-ProjectMemberTests-163191203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:32:40 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-6b9c0cbc-cf8d-441f-8615-51811d492af9 tempest-ProjectMemberTests-163191203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:32:40 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6b9c0cbc-cf8d-441f-8615-51811d492af9 tempest-ProjectMemberTests-163191203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:32:40 devstack sudo[106234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:32:40 devstack sudo[106234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:32:41 devstack sudo[106234]: pam_unix(sudo:session): session closed for user root Nov 04 10:32:41 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-6b9c0cbc-cf8d-441f-8615-51811d492af9 tempest-ProjectMemberTests-163191203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.257s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:32:41 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-6b9c0cbc-cf8d-441f-8615-51811d492af9 tempest-ProjectMemberTests-163191203 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:32:41 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-6b9c0cbc-cf8d-441f-8615-51811d492af9 tempest-ProjectMemberTests-163191203 None] Deleted volume successfully. Nov 04 10:32:41 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-6b9c0cbc-cf8d-441f-8615-51811d492af9 tempest-ProjectMemberTests-163191203 None] Lock "cinder-a595a820-cae2-4d5c-892c-a52d55b24014-delete_volume" released by "delete_volume" :: held 1.130s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:32:41 devstack cinder-volume[87068]: DEBUG cinder.volume.flows.manager.create_volume [None req-56b928bd-114e-45cc-bc18-e69b0450b8c4 tempest-ProjectMemberTests-163191203 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87068) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:32:41 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-56b928bd-114e-45cc-bc18-e69b0450b8c4 tempest-ProjectMemberTests-163191203 None] Flow 'volume_create_manager' (fe5b00c9-4929-49b5-97b7-f0d54ca1e172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:32:41 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-56b928bd-114e-45cc-bc18-e69b0450b8c4 tempest-ProjectMemberTests-163191203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (908123fd-91f9-48d4-ae77-0fa4269b1f9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:32:41 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-56b928bd-114e-45cc-bc18-e69b0450b8c4 tempest-ProjectMemberTests-163191203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (908123fd-91f9-48d4-ae77-0fa4269b1f9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:32:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-57913167',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e39278d-7f08-42c0-a408-3f2d224e1aad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6102192fe22c4f298ee9815860bd7a9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:32:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:32:42Z,use_quota=True,user_id='df3853accc6242909d45cceeb3a0db9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:32:41 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-56b928bd-114e-45cc-bc18-e69b0450b8c4 tempest-ProjectMemberTests-163191203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39569f45-738d-4eec-92d9-c54521192aed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:32:41 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-56b928bd-114e-45cc-bc18-e69b0450b8c4 tempest-ProjectMemberTests-163191203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39569f45-738d-4eec-92d9-c54521192aed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:32:41 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-56b928bd-114e-45cc-bc18-e69b0450b8c4 tempest-ProjectMemberTests-163191203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcbe5067-13a8-48a0-8203-f774420f8cc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:32:41 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-56b928bd-114e-45cc-bc18-e69b0450b8c4 tempest-ProjectMemberTests-163191203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcbe5067-13a8-48a0-8203-f774420f8cc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e39278d-7f08-42c0-a408-3f2d224e1aad', 'volume_name': 'volume-6e39278d-7f08-42c0-a408-3f2d224e1aad', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:32:41 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-56b928bd-114e-45cc-bc18-e69b0450b8c4 tempest-ProjectMemberTests-163191203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06bc5602-13d3-4e09-9504-c89a387e3c17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:32:41 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-56b928bd-114e-45cc-bc18-e69b0450b8c4 tempest-ProjectMemberTests-163191203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06bc5602-13d3-4e09-9504-c89a387e3c17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:32:41 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-56b928bd-114e-45cc-bc18-e69b0450b8c4 tempest-ProjectMemberTests-163191203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (682dd264-462f-42a2-b9cb-cbb9a953da1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:32:41 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-56b928bd-114e-45cc-bc18-e69b0450b8c4 tempest-ProjectMemberTests-163191203 None] Volume 6e39278d-7f08-42c0-a408-3f2d224e1aad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e39278d-7f08-42c0-a408-3f2d224e1aad', 'volume_size': 1} Nov 04 10:32:41 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-56b928bd-114e-45cc-bc18-e69b0450b8c4 tempest-ProjectMemberTests-163191203 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:32:41 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-56b928bd-114e-45cc-bc18-e69b0450b8c4 tempest-ProjectMemberTests-163191203 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:32:41 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-56b928bd-114e-45cc-bc18-e69b0450b8c4 tempest-ProjectMemberTests-163191203 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:32:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-57913167',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e39278d-7f08-42c0-a408-3f2d224e1aad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6102192fe22c4f298ee9815860bd7a9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:32:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:32:42Z,use_quota=True,user_id='df3853accc6242909d45cceeb3a0db9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63afa94a-cfcd-4c6d-8b5f-039f64a48043),volume_type_id=63afa94a-cfcd-4c6d-8b5f-039f64a48043)}" {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 10:32:41 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-56b928bd-114e-45cc-bc18-e69b0450b8c4 tempest-ProjectMemberTests-163191203 None] Creating volume 6e39278d-7f08-42c0-a408-3f2d224e1aad {{(pid=87068) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:32:41 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-56b928bd-114e-45cc-bc18-e69b0450b8c4 tempest-ProjectMemberTests-163191203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:32:41 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-56b928bd-114e-45cc-bc18-e69b0450b8c4 tempest-ProjectMemberTests-163191203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:32:41 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-56b928bd-114e-45cc-bc18-e69b0450b8c4 tempest-ProjectMemberTests-163191203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:32:41 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-56b928bd-114e-45cc-bc18-e69b0450b8c4 tempest-ProjectMemberTests-163191203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:32:41 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-56b928bd-114e-45cc-bc18-e69b0450b8c4 tempest-ProjectMemberTests-163191203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:32:41 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-56b928bd-114e-45cc-bc18-e69b0450b8c4 tempest-ProjectMemberTests-163191203 None] Selected osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 as target Quobyte volume. {{(pid=87068) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:32:41 devstack cinder-volume[87068]: INFO cinder.volume.drivers.remotefs [None req-56b928bd-114e-45cc-bc18-e69b0450b8c4 tempest-ProjectMemberTests-163191203 None] casted to osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034 Nov 04 10:32:41 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-56b928bd-114e-45cc-bc18-e69b0450b8c4 tempest-ProjectMemberTests-163191203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6e39278d-7f08-42c0-a408-3f2d224e1aad 1073741824 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:32:41 devstack sudo[106237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6e39278d-7f08-42c0-a408-3f2d224e1aad 1073741824 Nov 04 10:32:41 devstack sudo[106237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:32:42 devstack sudo[106237]: pam_unix(sudo:session): session closed for user root Nov 04 10:32:42 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-56b928bd-114e-45cc-bc18-e69b0450b8c4 tempest-ProjectMemberTests-163191203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6e39278d-7f08-42c0-a408-3f2d224e1aad 1073741824" returned: 0 in 0.424s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:32:42 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-56b928bd-114e-45cc-bc18-e69b0450b8c4 tempest-ProjectMemberTests-163191203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6e39278d-7f08-42c0-a408-3f2d224e1aad {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:32:42 devstack sudo[106242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6e39278d-7f08-42c0-a408-3f2d224e1aad Nov 04 10:32:42 devstack sudo[106242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:32:42 devstack sudo[106242]: pam_unix(sudo:session): session closed for user root Nov 04 10:32:42 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-56b928bd-114e-45cc-bc18-e69b0450b8c4 tempest-ProjectMemberTests-163191203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6e39278d-7f08-42c0-a408-3f2d224e1aad" returned: 0 in 0.252s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:32:42 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-56b928bd-114e-45cc-bc18-e69b0450b8c4 tempest-ProjectMemberTests-163191203 None] <== create_volume: return (723ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'} {{(pid=87068) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 10:32:42 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-56b928bd-114e-45cc-bc18-e69b0450b8c4 tempest-ProjectMemberTests-163191203 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.726s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:32:42 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-56b928bd-114e-45cc-bc18-e69b0450b8c4 tempest-ProjectMemberTests-163191203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (682dd264-462f-42a2-b9cb-cbb9a953da1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e39278d-7f08-42c0-a408-3f2d224e1aad', 'volume_size': 1}' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:32:42 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-56b928bd-114e-45cc-bc18-e69b0450b8c4 tempest-ProjectMemberTests-163191203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (773061ba-7f1b-4ff2-aebc-fcac99dc366a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:32:42 devstack cinder-volume[87068]: INFO cinder.volume.flows.manager.create_volume [None req-56b928bd-114e-45cc-bc18-e69b0450b8c4 tempest-ProjectMemberTests-163191203 None] Volume volume-6e39278d-7f08-42c0-a408-3f2d224e1aad (6e39278d-7f08-42c0-a408-3f2d224e1aad): created successfully Nov 04 10:32:42 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-56b928bd-114e-45cc-bc18-e69b0450b8c4 tempest-ProjectMemberTests-163191203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (773061ba-7f1b-4ff2-aebc-fcac99dc366a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87068) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:32:42 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-56b928bd-114e-45cc-bc18-e69b0450b8c4 tempest-ProjectMemberTests-163191203 None] Flow 'volume_create_manager' (fe5b00c9-4929-49b5-97b7-f0d54ca1e172) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87068) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:32:42 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-56b928bd-114e-45cc-bc18-e69b0450b8c4 tempest-ProjectMemberTests-163191203 None] Created volume successfully. Nov 04 10:32:42 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-5badd462-2c23-4faa-a35a-10c2a6c44b93 tempest-ProjectMemberTests-163191203 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:32:42 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-5badd462-2c23-4faa-a35a-10c2a6c44b93 tempest-ProjectMemberTests-163191203 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:32:42 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-5badd462-2c23-4faa-a35a-10c2a6c44b93 tempest-ProjectMemberTests-163191203 None] Creating offline snapshot fa20f7f3-e0d8-4098-8c10-fe8f78065e46 of volume 6e39278d-7f08-42c0-a408-3f2d224e1aad {{(pid=87068) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 10:32:42 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4ad97ab-dfd6-4ffe-ae37-ca99d3999dc1]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:32:42 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-5badd462-2c23-4faa-a35a-10c2a6c44b93 tempest-ProjectMemberTests-163191203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6e39278d-7f08-42c0-a408-3f2d224e1aad {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:32:42 devstack sudo[106245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6e39278d-7f08-42c0-a408-3f2d224e1aad Nov 04 10:32:42 devstack sudo[106245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:32:43 devstack sudo[106245]: pam_unix(sudo:session): session closed for user root Nov 04 10:32:43 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-5badd462-2c23-4faa-a35a-10c2a6c44b93 tempest-ProjectMemberTests-163191203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6e39278d-7f08-42c0-a408-3f2d224e1aad" returned: 0 in 0.380s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:32:43 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-5badd462-2c23-4faa-a35a-10c2a6c44b93 tempest-ProjectMemberTests-163191203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6e39278d-7f08-42c0-a408-3f2d224e1aad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6e39278d-7f08-42c0-a408-3f2d224e1aad.fa20f7f3-e0d8-4098-8c10-fe8f78065e46 1G {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:32:43 devstack sudo[106251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6e39278d-7f08-42c0-a408-3f2d224e1aad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6e39278d-7f08-42c0-a408-3f2d224e1aad.fa20f7f3-e0d8-4098-8c10-fe8f78065e46 1G Nov 04 10:32:43 devstack sudo[106251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:32:43 devstack sudo[106251]: pam_unix(sudo:session): session closed for user root Nov 04 10:32:43 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-5badd462-2c23-4faa-a35a-10c2a6c44b93 tempest-ProjectMemberTests-163191203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6e39278d-7f08-42c0-a408-3f2d224e1aad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6e39278d-7f08-42c0-a408-3f2d224e1aad.fa20f7f3-e0d8-4098-8c10-fe8f78065e46 1G" returned: 0 in 0.397s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:32:43 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-5badd462-2c23-4faa-a35a-10c2a6c44b93 tempest-ProjectMemberTests-163191203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e39278d-7f08-42c0-a408-3f2d224e1aad -F qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6e39278d-7f08-42c0-a408-3f2d224e1aad.fa20f7f3-e0d8-4098-8c10-fe8f78065e46 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:32:43 devstack sudo[106256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e39278d-7f08-42c0-a408-3f2d224e1aad -F qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6e39278d-7f08-42c0-a408-3f2d224e1aad.fa20f7f3-e0d8-4098-8c10-fe8f78065e46 Nov 04 10:32:43 devstack sudo[106256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:32:43 devstack sudo[106256]: pam_unix(sudo:session): session closed for user root Nov 04 10:32:43 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-5badd462-2c23-4faa-a35a-10c2a6c44b93 tempest-ProjectMemberTests-163191203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e39278d-7f08-42c0-a408-3f2d224e1aad -F qcow2 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6e39278d-7f08-42c0-a408-3f2d224e1aad.fa20f7f3-e0d8-4098-8c10-fe8f78065e46" returned: 0 in 0.314s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:32:43 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-5badd462-2c23-4faa-a35a-10c2a6c44b93 tempest-ProjectMemberTests-163191203 None] /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6e39278d-7f08-42c0-a408-3f2d224e1aad.fa20f7f3-e0d8-4098-8c10-fe8f78065e46 is being set with open permissions: ugo+rw Nov 04 10:32:43 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-5badd462-2c23-4faa-a35a-10c2a6c44b93 tempest-ProjectMemberTests-163191203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6e39278d-7f08-42c0-a408-3f2d224e1aad.fa20f7f3-e0d8-4098-8c10-fe8f78065e46 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:32:43 devstack sudo[106261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6e39278d-7f08-42c0-a408-3f2d224e1aad.fa20f7f3-e0d8-4098-8c10-fe8f78065e46 Nov 04 10:32:43 devstack sudo[106261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:32:44 devstack sudo[106261]: pam_unix(sudo:session): session closed for user root Nov 04 10:32:44 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-5badd462-2c23-4faa-a35a-10c2a6c44b93 tempest-ProjectMemberTests-163191203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6e39278d-7f08-42c0-a408-3f2d224e1aad.fa20f7f3-e0d8-4098-8c10-fe8f78065e46" returned: 0 in 0.240s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:32:44 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-5badd462-2c23-4faa-a35a-10c2a6c44b93 tempest-ProjectMemberTests-163191203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6e39278d-7f08-42c0-a408-3f2d224e1aad.info {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:32:44 devstack sudo[106264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6e39278d-7f08-42c0-a408-3f2d224e1aad.info Nov 04 10:32:44 devstack sudo[106264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:32:44 devstack sudo[106264]: pam_unix(sudo:session): session closed for user root Nov 04 10:32:44 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-5badd462-2c23-4faa-a35a-10c2a6c44b93 tempest-ProjectMemberTests-163191203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6e39278d-7f08-42c0-a408-3f2d224e1aad.info" returned: 0 in 0.257s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:32:44 devstack cinder-volume[87068]: WARNING cinder.volume.drivers.remotefs [None req-5badd462-2c23-4faa-a35a-10c2a6c44b93 tempest-ProjectMemberTests-163191203 None] /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6e39278d-7f08-42c0-a408-3f2d224e1aad.info is being set with open permissions: ugo+rw Nov 04 10:32:44 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-5badd462-2c23-4faa-a35a-10c2a6c44b93 tempest-ProjectMemberTests-163191203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6e39278d-7f08-42c0-a408-3f2d224e1aad.info {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:32:44 devstack sudo[106267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6e39278d-7f08-42c0-a408-3f2d224e1aad.info Nov 04 10:32:44 devstack sudo[106267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:32:44 devstack sudo[106267]: pam_unix(sudo:session): session closed for user root Nov 04 10:32:44 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-5badd462-2c23-4faa-a35a-10c2a6c44b93 tempest-ProjectMemberTests-163191203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6e39278d-7f08-42c0-a408-3f2d224e1aad.info" returned: 0 in 0.244s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:32:44 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-5badd462-2c23-4faa-a35a-10c2a6c44b93 tempest-ProjectMemberTests-163191203 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.917s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:32:44 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-5badd462-2c23-4faa-a35a-10c2a6c44b93 tempest-ProjectMemberTests-163191203 None] Create snapshot completed successfully Nov 04 10:32:45 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-5f2f9b1f-4ad2-4fef-bf75-b4a99fe36082 tempest-ProjectMemberTests-163191203 None] Acquiring lock "cinder-fa20f7f3-e0d8-4098-8c10-fe8f78065e46-delete_snapshot" by "delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:32:45 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-5f2f9b1f-4ad2-4fef-bf75-b4a99fe36082 tempest-ProjectMemberTests-163191203 None] Lock "cinder-fa20f7f3-e0d8-4098-8c10-fe8f78065e46-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:32:45 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-5f2f9b1f-4ad2-4fef-bf75-b4a99fe36082 tempest-ProjectMemberTests-163191203 None] Acquiring lock "cinder-quobyte-6e39278d-7f08-42c0-a408-3f2d224e1aad" by "delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:32:45 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-5f2f9b1f-4ad2-4fef-bf75-b4a99fe36082 tempest-ProjectMemberTests-163191203 None] Lock "cinder-quobyte-6e39278d-7f08-42c0-a408-3f2d224e1aad" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:32:45 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-5f2f9b1f-4ad2-4fef-bf75-b4a99fe36082 tempest-ProjectMemberTests-163191203 None] Acquiring lock "cinder-quobyte-fa20f7f3-e0d8-4098-8c10-fe8f78065e46" by "_delete_snapshot" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:32:45 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-5f2f9b1f-4ad2-4fef-bf75-b4a99fe36082 tempest-ProjectMemberTests-163191203 None] Lock "cinder-quobyte-fa20f7f3-e0d8-4098-8c10-fe8f78065e46" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:32:45 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-5f2f9b1f-4ad2-4fef-bf75-b4a99fe36082 tempest-ProjectMemberTests-163191203 None] Deleting offline snapshot fa20f7f3-e0d8-4098-8c10-fe8f78065e46 of volume 6e39278d-7f08-42c0-a408-3f2d224e1aad {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 10:32:45 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-5f2f9b1f-4ad2-4fef-bf75-b4a99fe36082 tempest-ProjectMemberTests-163191203 None] snapshot_file for this snap is: volume-6e39278d-7f08-42c0-a408-3f2d224e1aad.fa20f7f3-e0d8-4098-8c10-fe8f78065e46 {{(pid=87068) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 10:32:45 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[2895e5c4-a5cc-4037-a5d7-cb96a37f8875]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:32:45 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-5f2f9b1f-4ad2-4fef-bf75-b4a99fe36082 tempest-ProjectMemberTests-163191203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6e39278d-7f08-42c0-a408-3f2d224e1aad.fa20f7f3-e0d8-4098-8c10-fe8f78065e46 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:32:45 devstack sudo[106270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6e39278d-7f08-42c0-a408-3f2d224e1aad.fa20f7f3-e0d8-4098-8c10-fe8f78065e46 Nov 04 10:32:45 devstack sudo[106270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:32:45 devstack sudo[106270]: pam_unix(sudo:session): session closed for user root Nov 04 10:32:45 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-5f2f9b1f-4ad2-4fef-bf75-b4a99fe36082 tempest-ProjectMemberTests-163191203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6e39278d-7f08-42c0-a408-3f2d224e1aad.fa20f7f3-e0d8-4098-8c10-fe8f78065e46" returned: 0 in 0.392s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:32:45 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.remotefs [None req-5f2f9b1f-4ad2-4fef-bf75-b4a99fe36082 tempest-ProjectMemberTests-163191203 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6e39278d-7f08-42c0-a408-3f2d224e1aad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87068) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 10:32:45 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbdba670-57c4-4af5-80bf-dbc5966e94ee]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:32:45 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-5f2f9b1f-4ad2-4fef-bf75-b4a99fe36082 tempest-ProjectMemberTests-163191203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6e39278d-7f08-42c0-a408-3f2d224e1aad {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:32:45 devstack sudo[106275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6e39278d-7f08-42c0-a408-3f2d224e1aad Nov 04 10:32:45 devstack sudo[106275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:32:45 devstack sudo[106275]: pam_unix(sudo:session): session closed for user root Nov 04 10:32:45 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-5f2f9b1f-4ad2-4fef-bf75-b4a99fe36082 tempest-ProjectMemberTests-163191203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6e39278d-7f08-42c0-a408-3f2d224e1aad" returned: 0 in 0.357s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:32:45 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-5f2f9b1f-4ad2-4fef-bf75-b4a99fe36082 tempest-ProjectMemberTests-163191203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6e39278d-7f08-42c0-a408-3f2d224e1aad.fa20f7f3-e0d8-4098-8c10-fe8f78065e46 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:32:45 devstack sudo[106280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6e39278d-7f08-42c0-a408-3f2d224e1aad.fa20f7f3-e0d8-4098-8c10-fe8f78065e46 Nov 04 10:32:46 devstack sudo[106280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:32:46 devstack sudo[106280]: pam_unix(sudo:session): session closed for user root Nov 04 10:32:46 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-5f2f9b1f-4ad2-4fef-bf75-b4a99fe36082 tempest-ProjectMemberTests-163191203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6e39278d-7f08-42c0-a408-3f2d224e1aad.fa20f7f3-e0d8-4098-8c10-fe8f78065e46" returned: 0 in 0.338s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:32:46 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-5f2f9b1f-4ad2-4fef-bf75-b4a99fe36082 tempest-ProjectMemberTests-163191203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6e39278d-7f08-42c0-a408-3f2d224e1aad.fa20f7f3-e0d8-4098-8c10-fe8f78065e46 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:32:46 devstack sudo[106285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6e39278d-7f08-42c0-a408-3f2d224e1aad.fa20f7f3-e0d8-4098-8c10-fe8f78065e46 Nov 04 10:32:46 devstack sudo[106285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:32:46 devstack sudo[106285]: pam_unix(sudo:session): session closed for user root Nov 04 10:32:46 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-5f2f9b1f-4ad2-4fef-bf75-b4a99fe36082 tempest-ProjectMemberTests-163191203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6e39278d-7f08-42c0-a408-3f2d224e1aad.fa20f7f3-e0d8-4098-8c10-fe8f78065e46" returned: 0 in 0.290s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:32:46 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-5f2f9b1f-4ad2-4fef-bf75-b4a99fe36082 tempest-ProjectMemberTests-163191203 None] Lock "cinder-quobyte-fa20f7f3-e0d8-4098-8c10-fe8f78065e46" released by "_delete_snapshot" :: held 1.488s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:32:46 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-5f2f9b1f-4ad2-4fef-bf75-b4a99fe36082 tempest-ProjectMemberTests-163191203 None] Lock "cinder-quobyte-6e39278d-7f08-42c0-a408-3f2d224e1aad" released by "delete_snapshot" :: held 1.513s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:32:46 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-5f2f9b1f-4ad2-4fef-bf75-b4a99fe36082 tempest-ProjectMemberTests-163191203 None] Created reservations ['543aefb9-9d47-4d8f-a924-55a0466c84a1', '80249af7-4bbc-40cb-9f0c-bb1bd8d70584', '3134d4c6-0fbd-4822-b46b-17eb95c4e8a4', '16074dbf-7ef1-4f51-ba78-5d389976cd6a'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:32:46 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-5f2f9b1f-4ad2-4fef-bf75-b4a99fe36082 tempest-ProjectMemberTests-163191203 None] Delete snapshot completed successfully. Nov 04 10:32:46 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-5f2f9b1f-4ad2-4fef-bf75-b4a99fe36082 tempest-ProjectMemberTests-163191203 None] Lock "cinder-fa20f7f3-e0d8-4098-8c10-fe8f78065e46-delete_snapshot" released by "delete_snapshot" :: held 1.648s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:32:47 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-68d98f93-cc62-4259-af64-0041714832a2 tempest-ProjectMemberTests-163191203 None] Acquiring lock "cinder-6e39278d-7f08-42c0-a408-3f2d224e1aad-delete_volume" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:32:47 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-68d98f93-cc62-4259-af64-0041714832a2 tempest-ProjectMemberTests-163191203 None] Lock "cinder-6e39278d-7f08-42c0-a408-3f2d224e1aad-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:32:47 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-68d98f93-cc62-4259-af64-0041714832a2 tempest-ProjectMemberTests-163191203 None] Acquiring lock "cinder-quobyte-6e39278d-7f08-42c0-a408-3f2d224e1aad" by "delete_volume" {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:32:47 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-68d98f93-cc62-4259-af64-0041714832a2 tempest-ProjectMemberTests-163191203 None] Lock "cinder-quobyte-6e39278d-7f08-42c0-a408-3f2d224e1aad" acquired by "delete_volume" :: waited 0.020s {{(pid=87068) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:32:47 devstack cinder-volume[87068]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b7c89a1-7255-4b99-87a8-823231cea447]: (4, 'qcow2') {{(pid=88271) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:32:47 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-68d98f93-cc62-4259-af64-0041714832a2 tempest-ProjectMemberTests-163191203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6e39278d-7f08-42c0-a408-3f2d224e1aad {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:32:47 devstack sudo[106288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6e39278d-7f08-42c0-a408-3f2d224e1aad Nov 04 10:32:47 devstack sudo[106288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:32:47 devstack sudo[106288]: pam_unix(sudo:session): session closed for user root Nov 04 10:32:47 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-68d98f93-cc62-4259-af64-0041714832a2 tempest-ProjectMemberTests-163191203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6e39278d-7f08-42c0-a408-3f2d224e1aad" returned: 0 in 0.339s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:32:47 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-68d98f93-cc62-4259-af64-0041714832a2 tempest-ProjectMemberTests-163191203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6e39278d-7f08-42c0-a408-3f2d224e1aad {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:32:47 devstack sudo[106299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6e39278d-7f08-42c0-a408-3f2d224e1aad Nov 04 10:32:47 devstack sudo[106299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:32:47 devstack sudo[106299]: pam_unix(sudo:session): session closed for user root Nov 04 10:32:47 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-68d98f93-cc62-4259-af64-0041714832a2 tempest-ProjectMemberTests-163191203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921/volume-6e39278d-7f08-42c0-a408-3f2d224e1aad" returned: 0 in 0.230s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:32:47 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-68d98f93-cc62-4259-af64-0041714832a2 tempest-ProjectMemberTests-163191203 None] Lock "cinder-quobyte-6e39278d-7f08-42c0-a408-3f2d224e1aad" released by "delete_volume" :: held 0.644s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:32:48 devstack cinder-volume[87068]: DEBUG cinder.quota [None req-68d98f93-cc62-4259-af64-0041714832a2 tempest-ProjectMemberTests-163191203 None] Created reservations ['a9bdc294-29a6-42a8-ba8e-48f3dc3ad9ea', '59becb29-f8b8-45c1-b9e7-ca385a7ee87d', '3b0343fe-11f9-40fc-82c7-59999ef80e44', 'c94bfb00-f45f-4940-bc7e-8b0124eedb0d'] {{(pid=87068) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:32:48 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-68d98f93-cc62-4259-af64-0041714832a2 tempest-ProjectMemberTests-163191203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:32:48 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-68d98f93-cc62-4259-af64-0041714832a2 tempest-ProjectMemberTests-163191203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:32:48 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-68d98f93-cc62-4259-af64-0041714832a2 tempest-ProjectMemberTests-163191203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:32:48 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-68d98f93-cc62-4259-af64-0041714832a2 tempest-ProjectMemberTests-163191203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:32:48 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-68d98f93-cc62-4259-af64-0041714832a2 tempest-ProjectMemberTests-163191203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:32:48 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-68d98f93-cc62-4259-af64-0041714832a2 tempest-ProjectMemberTests-163191203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:32:48 devstack sudo[106302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:32:48 devstack sudo[106302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:32:48 devstack sudo[106302]: pam_unix(sudo:session): session closed for user root Nov 04 10:32:48 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-68d98f93-cc62-4259-af64-0041714832a2 tempest-ProjectMemberTests-163191203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.240s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:32:48 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-68d98f93-cc62-4259-af64-0041714832a2 tempest-ProjectMemberTests-163191203 None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:32:48 devstack cinder-volume[87068]: INFO cinder.volume.manager [None req-68d98f93-cc62-4259-af64-0041714832a2 tempest-ProjectMemberTests-163191203 None] Deleted volume successfully. Nov 04 10:32:48 devstack cinder-volume[87068]: DEBUG cinder.coordination [None req-68d98f93-cc62-4259-af64-0041714832a2 tempest-ProjectMemberTests-163191203 None] Lock "cinder-6e39278d-7f08-42c0-a408-3f2d224e1aad-delete_volume" released by "delete_volume" :: held 1.083s {{(pid=87068) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:32:53 devstack cinder-volume[87068]: DEBUG oslo_service.periodic_task [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87068) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 10:32:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:32:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:32:53 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034': None} {{(pid=87068) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:32:53 devstack cinder-volume[87068]: DEBUG cinder.volume.drivers.quobyte [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-845395c6-710a-48ae-afca-6cb0c5cd6034'] {{(pid=87068) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:32:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.lockutils [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87068) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:32:53 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:32:53 devstack sudo[106344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921 Nov 04 10:32:53 devstack sudo[106344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:32:54 devstack sudo[106344]: pam_unix(sudo:session): session closed for user root Nov 04 10:32:54 devstack cinder-volume[87068]: DEBUG oslo_concurrency.processutils [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc1b634c0a82a1ef771631ca8479f921" returned: 0 in 0.262s {{(pid=87068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:32:54 devstack cinder-volume[87068]: DEBUG cinder.manager [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Notifying Schedulers of capabilities ... {{(pid=87068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:32:54 devstack cinder-volume[87068]: DEBUG oslo_service.periodic_task [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] Running periodic task VolumeManager._thread_info {{(pid=87068) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 10:32:54 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] thread count: 28 {{(pid=87068) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 04 10:32:54 devstack cinder-volume[87068]: DEBUG cinder.volume.manager [None req-3d1738b0-bfe5-41a8-a494-dd0c984c18a4 None None] thread info: [<_MainThread(MainThread, started 126275656192128)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87068) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 04 10:32:58 devstack cinder-volume[87068]: DEBUG dbcounter [-] [87068] Writing DB stats cinder:SELECT=64,cinder:INSERT=25,cinder:UPDATE=90,cinder:DELETE=6 {{(pid=87068) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 10:32:58 devstack cinder-volume[87068]: DEBUG dbcounter [-] [87068] Writing DB stats cinder:INSERT=23,cinder:UPDATE=81,cinder:SELECT=65,cinder:DELETE=7 {{(pid=87068) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}